Control method and device and vehicle

Abstract

The invention provides a control method and device and a vehicle, and the method comprises the steps: a display device is controlled to display a first interface, and the first interface comprises a plurality of parts outside a vehicle model cabin; in response to input of the vehicle model, based on information of a user in a cabin, the display device is controlled to be switched from displaying the first interface to displaying a second interface, the second interface comprises a plurality of components in the cabin of the vehicle model and first prompt information, and the first prompt information is sent to the display device; the first prompt information is used for prompting to select at least one component from the plurality of components. According to the method and the device, the interaction intuition can be improved, and the user can quickly find the required function, so that the efficient interaction between the user and the vehicle is realized, and the user experience is improved.

Description

Technical Field

[0001] The present application relates to the field of smart vehicles, and more specifically, to a control method, device and vehicle. Background Art

[0002] Traditional vehicle control systems usually rely on physical buttons and multi-level menus, resulting in low operational efficiency. Drivers need to operate multiple times or enter the menu layer by layer to complete function adjustments, which will distract driving attention to a certain extent and create safety hazards.

[0003] In recent years, even though some vehicles have adopted voice control, there are still problems such as unstable voice recognition. Therefore, the search for more efficient and stable vehicle control methods continues. Summary of the Invention

[0004] The present application provides a control method, device, and vehicle that can improve the intuitiveness of interaction, enabling users to quickly find the desired functions, thereby achieving efficient interaction between users and vehicles and enhancing the user experience.

[0005] In a first aspect, a control method is provided, which includes: controlling a display device to display a first interface, the first interface including multiple components outside a vehicle model cabin; in response to input of a vehicle model, based on information of a user in the cabin, controlling the display device to switch from displaying the first interface to displaying a second interface, the second interface including multiple components in the vehicle model cabin and first prompt information, the first prompt information being used to prompt selection of at least one component from multiple components.

[0006] Based on the above technical solution, personalized recommendations for cabin components are made according to user information, which helps users find the required interior components intuitively and quickly.

[0007] In combination with the first aspect, in certain implementations of the first aspect, before controlling the display device to switch from displaying the first interface to displaying the second interface based on the information of the user in the cabin, the method also includes: obtaining the type of audio when the user information instructs the user to play audio; wherein, controlling the display device to switch from displaying the first interface to displaying the second interface based on the information of the user in the cabin includes: controlling the display device to switch from displaying the first interface to displaying the second interface based on the type of audio, the second interface including multiple sound-emitting devices and first prompt information in the vehicle model cabin, the first prompt information being used to prompt the user to select at least one sound-emitting device from the multiple sound-emitting devices.

[0008] Based on the above technical solution, it is helpful to intelligently recommend suitable sound devices according to the audio type, which can optimize the user's audio experience.

[0009] In combination with the first aspect, in certain implementations of the first aspect, before controlling the display device to switch from displaying the first interface to displaying the second interface based on the information of the user in the cabin, the method also includes: when the user information instructs the user to play audio, obtaining the area where one or more users in the cabin are located; based on the information of the user in the cabin, controlling the display device to switch from displaying the first interface to displaying the second interface, including: based on the area where one or more users are located, controlling the display device to switch from displaying the first interface to displaying the second interface, the second interface including multiple sound devices and first prompt information in the vehicle model cabin, the first prompt information being used to prompt the user to select at least one sound device from the multiple sound devices.

[0010] Based on the above technical solution, it is helpful to intelligently recommend the sound device closest to the user or most suitable according to the user's position information in the cabin, thereby optimizing the user's audio experience.

[0011] In combination with the first aspect, in certain implementations of the first aspect, before controlling the display device to switch from displaying the first interface to displaying the second interface based on information of the user in the cabin, the method also includes: when the user information indicates that the user is experiencing motion sickness, obtaining information of the first area where the user is located; based on the information of the user in the cabin, controlling the display device to switch from displaying the first interface to displaying the second interface, including: based on the information of the first area, controlling the display device to switch from displaying the first interface to displaying the second interface, the second interface including multiple anti-motion sickness components in the first area of ​​the vehicle model cabin and first prompt information, the first prompt information being used to prompt the user to select at least one anti-motion sickness component from the multiple anti-motion sickness components.

[0012] Based on the above technical solution, when motion sickness symptoms are detected, intelligent recommendations are made on components that can alleviate motion sickness, which helps improve driving safety and prevent potential safety risks.

[0013] In combination with the first aspect, in certain implementations of the first aspect, before controlling the display device to switch from displaying the first interface to displaying the second interface based on information of the user in the cabin, the method also includes: obtaining the input and / or status of the user in the second area in the cabin; based on information of the user in the cabin, controlling the display device to switch from displaying the first interface to displaying the second interface, including: based on the input and / or status of the user in the second area, controlling the display device to display the second interface, the second interface including multiple components in the second area in the vehicle model cabin and the first prompt information.

[0014] Based on the above technical solution, users can quickly locate the local area they need to control and intuitively select the corresponding components, which improves the efficiency of operation.

[0015] In combination with the first aspect, in certain implementations of the first aspect, the method also includes: obtaining the user's preference parameters for the first component among multiple components; based on the information of the user in the cockpit, controlling the display device to switch from displaying the first interface to displaying the second interface, including: when the current usage parameters of the first component are different from the preference parameters, based on the preference parameters, controlling the display device to display the second interface, the second interface also includes second prompt information, and the second prompt information is used to prompt to set the usage parameters of the first component to the preference parameters.

[0016] Based on the above technical solution, the usage parameters of the current component are intelligently recommended according to the user's preference parameters for the component, realizing personalized parameter adjustment to meet the user's personalized needs.

[0017] In combination with the first aspect, in certain implementations of the first aspect, controlling the display device to switch from displaying the first interface to displaying the second interface includes: controlling the transparency of the vehicle model to gradually decrease to display multiple components within the vehicle model cabin.

[0018] Based on the above technical solution, users can intuitively see the various components inside the car model and perform convenient operations.

[0019] In combination with the first aspect, in certain implementations of the first aspect, controlling the display device to switch from displaying the first interface to displaying the second interface includes: controlling the vehicle model to execute the disassembly of the components in the cabin to display the separation of the components in the cabin along the preset control trajectory, and maintaining the relative positions of the components during the separation process.

[0020] Based on this technical solution, the 3D vehicle model is broken down into multiple, independently visible components, resolving the issue of fragmented access points to different functions, making it difficult for users to quickly locate them. Users can more easily and quickly find the functions they need and perform the corresponding operations, thereby improving intuitive interaction and operational efficiency.

[0021] In combination with the first aspect, in some implementations of the first aspect, the method further includes: detecting an input for selecting at least one component from a plurality of components; and controlling the at least one component to perform a corresponding function.

[0022] Based on the above technical solution, corresponding functions can be quickly realized by quickly selecting components.

[0023] In a second aspect, a control method is provided, which includes: controlling a display device to display a first interface, the first interface including multiple components outside a vehicle model cabin; in response to a first input to the vehicle model, based on information of a user in the cabin, controlling the display device to switch from displaying the first interface to displaying a second interface, the second interface including multiple areas in the vehicle model cabin and first prompt information, the first prompt information being used to prompt selection of at least one area from multiple areas.

[0024] In combination with the second aspect, in certain implementations of the second aspect, the method includes: in response to a second input to a first area among multiple areas, based on information of a user in the cabin, controlling the display device to switch from displaying a second interface to displaying a third interface, the third interface including multiple components in the first area and second prompt information, the second prompt information being used to prompt selection of at least one component from the multiple components.

[0025] In combination with the second aspect, in certain implementations of the second aspect, the method includes: in response to a third input to a first component among multiple components, based on information of a user in the cabin, controlling the display device to switch from displaying a third interface to displaying a fourth interface, the fourth interface including multiple functional control components of the first component and third prompt information, the third prompt information being used to prompt selection of at least one functional control component from the multiple functional control components.

[0026] In combination with the second aspect, in certain implementations of the second aspect, the multiple areas are obtained according to at least one of the following factors: division based on spatial location; division based on user identity; division based on scene function; user customization.

[0027] Based on the hierarchical operation provided by the above technical solution, the recommendations are refined from "coarse" to "fine" through graded recommendations, which can achieve efficient, safe and personalized control of complex vehicle functions in a more intuitive interaction.

[0028] In a third aspect, a control device is provided, which includes: a control unit, used to: control a display device to display a first interface, the first interface including multiple components outside the vehicle model cabin; the control unit is also used to: in response to input to the vehicle model, based on information of the user in the cabin, control the display device to switch from displaying the first interface to displaying a second interface, the second interface including multiple components in the vehicle model cabin and first prompt information, the first prompt information being used to prompt the selection of at least one component from multiple components.

[0029] In combination with the third aspect, in certain implementations of the third aspect, the device further includes an acquisition unit for: obtaining the type of audio when the user information instructs the user to play audio; the control unit is also used to: based on the type of audio, control the display device to switch from displaying the first interface to displaying the second interface, the second interface including multiple sound-emitting devices in the vehicle model cabin and a first prompt message, the first prompt message being used to prompt the user to select at least one sound-emitting device from the multiple sound-emitting devices.

[0030] In combination with the third aspect, in certain implementations of the third aspect, the acquisition unit is further used to: when the user information instructs the user to play audio, obtain the area where one or more users are located in the cabin; the control unit is further used to: based on the area where one or more users are located, control the display device to switch from displaying the first interface to displaying the second interface, the second interface includes multiple sound-emitting devices and first prompt information in the vehicle model cabin, and the first prompt information is used to prompt the user to select at least one sound-emitting device from multiple sound-emitting devices.

[0031] In combination with the third aspect, in certain implementations of the third aspect, the acquisition unit is further used to: when the user information indicates that the user is experiencing motion sickness, obtain information of the first area where the user is located; the control unit is further used to: based on the information of the first area, control the display device to switch from displaying the first interface to displaying the second interface, where the second interface includes multiple anti-motion sickness components in the first area within the vehicle model cabin and first prompt information, and the first prompt information is used to prompt the user to select at least one anti-motion sickness component from the multiple anti-motion sickness components.

[0032] In combination with the third aspect, in certain implementations of the third aspect, the acquisition unit is further used to: obtain the input and / or status of the user in the second area in the cabin; the control unit is further used to: control the display device to display the second interface based on the input and / or status of the user in the second area, and the second interface includes multiple components in the second area in the vehicle model cabin and the first prompt information.

[0033] In combination with the third aspect, in certain implementations of the third aspect, the acquisition unit is further used to: obtain the user's preference parameters for the first component among multiple components; the control unit is further used to: when the current usage parameters of the first component are different from the preference parameters, based on the preference parameters, control the display device to display a second interface, the second interface also includes second prompt information, and the second prompt information is used to prompt to set the usage parameters of the first component to the preference parameters.

[0034] In combination with the third aspect, in certain implementations of the third aspect, the control unit is further configured to: control the transparency of the vehicle model to gradually decrease so as to display multiple components within the cabin of the vehicle model.

[0035] In combination with the third aspect, in certain implementations of the third aspect, the control unit is further used to: control the vehicle model to execute the disassembly of the components in the cabin to show that the components in the cabin are separated along the preset control trajectory, and maintain the relative positions of the components during the separation process.

[0036] In combination with the third aspect, in certain implementations of the third aspect, the device further includes a detection unit for detecting an input of selecting at least one component from a plurality of components; and a control unit for controlling at least one component to perform a corresponding function.

[0037] In a fourth aspect, a control device is provided, which includes: a control unit, used to: control a display device to display a first interface, the first interface including multiple components outside the vehicle model cabin; the control unit is also used to: in response to a first input to the vehicle model, based on information of the user in the cabin, control the display device to switch from displaying the first interface to displaying a second interface, the second interface including multiple areas in the vehicle model cabin and first prompt information, the first prompt information being used to prompt the selection of at least one area from multiple areas.

[0038] In combination with the fourth aspect, in certain implementations of the fourth aspect, the control unit is further used to: in response to a second input to the first area of ​​the multiple areas, based on information of the user in the cabin, control the display device to switch from displaying the second interface to displaying the third interface, the third interface including multiple components in the first area and second prompt information, the second prompt information being used to prompt the selection of at least one component from the multiple components.

[0039] In combination with the fourth aspect, in certain implementations of the fourth aspect, the control unit is further used to: in response to a third input to a first component among multiple components, based on information of a user in the cabin, control the display device to switch from displaying a third interface to displaying a fourth interface, the fourth interface including multiple functional control components of the first component and third prompt information, the third prompt information being used to prompt selection of at least one functional control component from the multiple functional control components.

[0040] In a fifth aspect, a control device is provided, comprising: a memory for storing a computer program; and a processor for executing the computer program stored in the memory, so that the device performs any possible method in the first aspect or the second aspect.

[0041] In a sixth aspect, a vehicle is provided, comprising any possible device of the third aspect, the fourth aspect or the fifth aspect.

[0042] In a seventh aspect, a computer-readable storage medium is provided, on which instructions are stored. When the instructions are executed by a processor, the processor implements any possible method in the first aspect or the second aspect.

[0043] In an eighth aspect, a computer program product is provided, which includes a computer program code. When the computer program code is run on a computer, the computer is enabled to implement any possible method in the first aspect or the second aspect.

[0044] In a ninth aspect, a chip is provided, the chip including a circuit for executing any possible method in the first aspect or the second aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] Figure 1 It is a functional schematic block diagram of the vehicle 100 provided in an embodiment of the present application.

[0046] Figure 2 It is a schematic block diagram of the intelligent driving system provided in an embodiment of the present application.

[0047] Figure 3 It is a schematic flow chart of a control method 300 provided in an embodiment of the present application.

[0048] Figure 4 It is a schematic flow chart of a control method 400 provided in an embodiment of the present application.

[0049] Figure 5 This is a schematic diagram of an interface for recommending cockpit components and guiding selection provided in an embodiment of the present application.

[0050] Figure 6 This is another interface diagram for recommending cockpit components and guiding selection provided in an embodiment of the present application.

[0051] Figure 7 This is an example of the GUI provided in the embodiment of the present application.

[0052] Figure 8 This is another example of the GUI provided in the embodiment of the present application.

[0053] Figure 9 This is another example of the GUI provided in the embodiment of the present application.

[0054] Figure 10 This is another example of the GUI provided in the embodiment of the present application.

[0055] Figure 11 This is a GUI example of a recommended component provided in an embodiment of the present application.

[0056] Figure 12 It is a schematic flow chart of a control method 1200 provided in an embodiment of the present application.

[0057] Figure 13 This is a scenario diagram of a group of recommended discomfort relief components provided in an embodiment of the present application.

[0058] Figure 14 This is a control diagram for recommending regional components based on the regions where different users are located, provided in an embodiment of the present application.

[0059] Figure 15 This is another control schematic diagram provided by an embodiment of the present application for recommending regional components based on the regions where different users are located.

[0060] Figure 16It is a schematic flow chart of a control method 1600 provided in an embodiment of the present application.

[0061] Figure 17 This is a schematic diagram showing multiple areas provided in an embodiment of the present application.

[0062] Figure 18 It is a schematic block diagram of the control device 1800 provided in an embodiment of the present application. DETAILED DESCRIPTION

[0063] The technical solution in this application will be described below with reference to the accompanying drawings.

[0064] In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is merely a way to describe the association relationship of associated objects, indicating that three relationships can exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. "At least one" refers to one or more items. For example, "at least one of A and B" is similar to "A and / or B", describing the association relationship of associated objects, indicating that three relationships can exist. For example, at least one of A and B can mean: A exists alone, A and B exist at the same time, and B exists alone.

[0065] In the embodiments of the present application, prefixes such as "first" and "second" are used only to distinguish different description objects and have no limiting effect on the position, order, priority, quantity or content of the described objects. The use of prefixes such as ordinal numbers to distinguish description objects in the embodiments of the present application does not constitute a restriction on the described objects. For the statement of the described objects, please refer to the description in the context of the claims or embodiments, and the use of such prefixes should not constitute an unnecessary restriction. In addition, in the description of this embodiment, unless otherwise specified, the meaning of "plurality" is two or more.

[0066] Figure 1 This is a functional schematic block diagram of the vehicle 100 provided in the embodiment of the present application. Figure 1 As shown, vehicle 100 may include a perception system 110 , a computing platform 120 , and a display device 130 .

[0067] Among them, the display device 130 in the cockpit is mainly divided into two categories, the first category is the vehicle-mounted display screen; the second category is the projection display screen, such as a head-up display (HUD) device. The vehicle-mounted display screen is a physical display screen and an important part of the vehicle infotainment system. There can be multiple display screens in the cockpit, such as a digital instrument display screen, a central control screen, a display screen in front of the passenger on the co-pilot seat (also called the front passenger), a display screen in front of the left rear passenger, and a display screen in front of the right rear passenger. Even the car window can be used as a display screen for display. Head-up display, also known as a head-up display system. It is mainly used to display driving information such as speed and navigation on a display device in front of the driver (such as a windshield). This reduces the driver's line of sight diversion time, avoids pupil changes caused by the driver's line of sight diversion, and improves driving safety and comfort.

[0068] The above display device 130 is described by taking a vehicle-mounted display screen and a projection display screen as examples, and the embodiments of the present application are not limited thereto. For example, the display device 130 can also be a light display screen or a projection screen.

[0069] Some or all functions of the vehicle 100 may be controlled by a computing platform 120. The computing platform 120 may include one or more processors, such as processors 121 to 12n (n is a positive integer). A processor is a circuit capable of processing signals. In one implementation, the processor may be a circuit capable of reading and executing instructions, such as a central processing unit (CPU), a microprocessor, a graphics processing unit (GPU) (which can be understood as a microprocessor), or a digital signal processor (DSP). In another implementation, the processor may implement certain functions through the logical relationships of a hardware circuit. The logical relationships of the hardware circuit may be fixed or reconfigurable. For example, the processor may be a hardware circuit implemented as an application-specific integrated circuit (ASIC) or a programmable logic device (PLD), such as a field programmable gate array (FPGA). In a reconfigurable hardware circuit, the process of the processor loading a configuration file to implement the hardware circuit configuration can be understood as the process of the processor loading instructions to implement the functions of some or all of the above units. In addition, the processor may also be a hardware circuit designed for artificial intelligence, which can be understood as an ASIC, such as a neural network processing unit (NPU), a tensor processing unit (TPU), a deep learning processing unit (DPU), etc. In addition, the computing platform 120 may also include a memory for storing instructions, and some or all of the processors 121 to 12n may call the instructions in the memory to implement corresponding functions.

[0070] Optionally, the structure of the above vehicle 100 is merely illustrative, and in actual applications, various components in the above vehicle 100 may be added or deleted according to actual needs.

[0071] Vehicle 100 may include an intelligent driving system, which may include an advanced driving assistant system (ADAS) and an autonomous driving system (ADS). The intelligent driving system utilizes a variety of sensors on the vehicle (including but not limited to: lidar, millimeter-wave radar, camera, ultrasonic sensor, global positioning system, inertial measurement unit) to obtain information from the surroundings of the vehicle, and analyzes and processes the obtained information to achieve functions such as obstacle perception, target recognition, vehicle positioning, path planning, driver monitoring / reminders, etc., thereby improving the safety, automation and comfort of vehicle driving.

[0072] For example, Figure 2 A schematic block diagram of an intelligent driving system provided by an embodiment of the present application is shown. The intelligent driving system may include three functional modules: a perception module 210, a planning module 220, and a control module 230, wherein the perception module 210 perceives the surrounding environment of the vehicle body through sensors and outputs corresponding perception data to the control module 220. The planning module 220 obtains information such as road topology and target objects based on the information obtained by the perception module 210. The planning module 220 may determine a planned trajectory within a period of time based on the road topology and target object information. The planning module 220 may send the planned trajectory to the control module 230. After receiving the planned trajectory from the planning module 220, the control module 230 may output a control signal to control the actuator to take corresponding actions, such as steering, acceleration, deceleration, etc.

[0073] The above perception module 210 may be the above perception system 110 , and the planning module 220 and the control module 230 may be located in the above computing platform 120 .

[0074] The above perception module 210 may also be located in the computing platform 120 .

[0075] Figure 3 A schematic diagram of a vehicle cockpit scene provided for an embodiment of the present application. One or more vehicle-mounted display screens (or vehicle-mounted screens) are arranged inside the smart cockpit, including but not limited to a central control screen 301, a co-pilot entertainment screen 302, a screen 303 behind the driver's headrest, a screen 304 behind the co-pilot's headrest, a display screen arranged on the top of the cockpit, and an instrument screen. Furthermore, the central control screen 301, the co-pilot entertainment screen 302, the screen 303 behind the driver's headrest, and the screen 304 behind the co-pilot's headrest can display a graphical user interface (GUI), which can include one or more application icons, and / or one or more cards. For example, Figure 1The display device 130 shown may be one or more of a central control screen 301, a passenger entertainment screen 302, a screen behind the driver's headrest 303, and a screen behind the passenger's headrest 304. In some possible implementations, the central control screen 301 may also be a long screen extending to the passenger area.

[0076] It should be understood that the following embodiments are based on Figure 3 The five-seater vehicle shown is used as an example for illustration, but the embodiments of the present application are not limited thereto. For example, for a seven-seater sport / suburban utility vehicle (SUV), the cabin may include a central control screen, a co-driver entertainment screen, a screen behind the driver's headrest, a screen behind the co-driver's headrest, entertainment screens in the three-row left area, and entertainment screens in the three-row right area. For another example, for a passenger car, the cabin may include front-row entertainment screens and rear-row entertainment screens; or, the cabin may include a display screen in the driving area and an entertainment screen in the passenger area. In addition, the following embodiments are described using a left-hand drive vehicle (i.e., the driver is on the left side of the vehicle) as an example. In actual implementation, the vehicle may also be a right-hand drive vehicle (i.e., the driver is on the right side of the vehicle).

[0077] With the development of smart cars, users have put forward higher requirements for the efficiency of vehicle control. Currently, vehicle control can be achieved through physical buttons, the function list on the central control screen, voice commands, etc. However, the above implementation methods usually have certain limitations:

[0078] (1) Physical buttons

[0079] First, operations using physical buttons are often limited by distance. For example, the driver cannot directly touch the reading lights of users in the second row of the cabin. Second, the driver often needs to memorize the positions and functions of different physical buttons, and it is easy to make mistakes when the memory is wrong. In addition, physical buttons cannot achieve dynamic permission management, and all passengers have the same operating permissions, which may pose a safety hazard to a certain extent.

[0080] (2) Function list of the central control screen

[0081] The current mainstream control solution is for the user to click on a function list on the main control screen to execute the relevant vehicle function. While this solution can somewhat address the distance problem of physical buttons, it still has significant shortcomings. First, the function list typically uses a multi-level menu design, resulting in deep function entry and complex operation paths. Second, the function list format is relatively fixed, so all users see the same list structure, which cannot be intuitively adjusted to meet different user needs.

[0082] (3) Voice commands

[0083] Although voice commands can solve the distance problem of physical buttons to a certain extent, they still have the following shortcomings: First, the recognition accuracy of voice commands in noisy environments (such as music, wind noise, and passenger conversations) is low, which can easily lead to false triggers; second, some intelligent driving systems have poor compatibility with dialects, accents, or non-standard pronunciations, which affects the recognition rate; third, complex voice commands may not be understood by the vehicle, causing users to repeat operations and distracting their driving attention.

[0084] Based on the limitations of the above control methods, there is an urgent need for a control method to help users realize vehicle functions more efficiently.

[0085] The following describes a control method, device, and vehicle provided by embodiments of the present application. The control method provided by embodiments of the present application can provide personalized component recommendations based on user information, helping users quickly find the required components.

[0086] Figure 4 A schematic flow chart of a control method 400 provided in an embodiment of the present application is shown. The method 400 includes:

[0087] S401: Control the display device to display a first interface, where the first interface includes multiple components outside the vehicle model cabin.

[0088] S402: In response to input of the vehicle model, based on information of the user in the cabin, the display device is controlled to switch from displaying the first interface to displaying the second interface, the second interface includes multiple components in the vehicle model cabin and first prompt information, and the first prompt information is used to prompt the selection of at least one component from the multiple components.

[0089] Optionally, controlling the display device to switch from displaying the first interface to displaying the second interface includes: controlling the transparency of the vehicle model to gradually decrease to display multiple components in the vehicle model cabin.

[0090] Optionally, controlling the display device to switch from displaying the first interface to displaying the second interface includes: controlling the vehicle model to execute the disassembly of the components in the cabin to display the separation of the components in the cabin along the preset control trajectory, and maintaining the relative positions of the components during the separation process.

[0091] Next, combine Figure 5 and Figure 17 The control scenarios and GUI involved in the embodiments of this application are introduced in detail. Figures 5 to 17 The control actions or steps involved in this application can be Figure 1 The illustrated computing platform 120 may execute the above-mentioned system.

[0092] Figure 5The following is a schematic diagram of an interface for recommending cockpit components and guiding selection provided by an embodiment of the present application, which is used to illustrate a "perspective display solution" provided by an embodiment of the present application. Figure 5 As shown, user A is located in the main driving area of ​​the vehicle cabin and operates on the central control screen 301. The GUI presented by the central control screen 301 can be as follows: Figure 5 (a) and Figure 5 As shown in (b), where Figure 5 (a) can represent the first interface mentioned above, Figure 5 (b) may represent the second interface described above.

[0093] exist Figure 5 In (a), the GUI interface includes a top status bar, a content display area, and a bottom function bar.

[0094] Exemplarily, the top status bar may include: a login control (login status) for logging into the vehicle system; a Bluetooth function icon for indicating the vehicle's on and / or connection status; a Wi-Fi function icon for indicating the Wi-Fi on status; and a cellular network signal icon for indicating the cellular network signal strength.

[0095] Exemplarily, the bottom function bar may include multiple function icons, from left to right: home icon, menu control, setting control, navigation control, music control, seat control, 360-degree panoramic control, air circulation control, window blowing control, trunk control, car lock control, and volume control.

[0096] For example, the content display area can display a vehicle model corresponding to the current vehicle. The displayed vehicle model can be the exterior of the entire vehicle, showing multiple components outside the vehicle cabin, such as doors and tires. The vehicle model allows users to interact with it through touch. For example, users can rotate the vehicle model by sliding their finger within the content display area, thereby viewing the exterior components of the vehicle model from different perspectives.

[0097] In some implementations, in response to a user long-press input at any position of the vehicle model, the appearance transparency of the three-dimensional model in the first interface can be controlled to gradually decrease, smoothly transitioning from an opaque state to a semi-transparent state, and then to a transparent state (the state with the lowest transparency), thereby allowing the interior structure of the cabin and multiple cabin components that were originally obscured by the vehicle exterior to be presented. The central control screen 301 can display the following: Figure 5 The content display area shown in (b) helps users to view the various components in the vehicle cabin intuitively and conveniently while maintaining awareness of the overall vehicle structure.

[0098] As can be seen from the above, the second interface includes multiple components in the cabin, such as seats, steering wheels, speakers, etc., and also includes a first prompt message, which is used to prompt the user to select at least one of the components. Specifically, Figure 5 As shown in (b), the recommended component is the left rear seat 501 of the vehicle. The component can be displayed by visual prominence, for example, it can be marked by bolding the outline, highlighting, circling, etc., and prompted with an arrow image to guide the user to pay attention and make a selection.

[0099] In some implementations, in response to a user long-press anywhere on the vehicle model, the transparency of the vehicle model can gradually transition along a set transparency curve over a preset time period, gradually revealing various components within the cabin. After reaching the lowest transparency, the transparency of the vehicle model gradually recovers in the opposite manner, increasing until it returns to its original state, completing a "reflection process."

[0100] In the above implementation scheme, the user can see multiple components in the cabin, such as air conditioning, speakers, seats, etc., which facilitates the user to intuitively select recommended components.

[0101] In addition to the above-mentioned "perspective display solution", the embodiment of the present application also provides a "disassembly display solution".

[0102] Figure 6 FIG2 shows another interface diagram for recommending cockpit components and guiding selection provided by an embodiment of the present application, which is used to illustrate a “disassembly display solution”. Figure 6 As shown, Figure 6 (a) shows the left front view of the vehicle model. In response to the long press input of user A at any position of the vehicle model, the display device can be controlled to display the following: Figure 6 The second interface shown in (b).

[0103] like Figure 6 As shown in (b), the content display area switches from the first interface to the second interface. The second interface shows a decomposition diagram of the vehicle model, which includes multiple vehicle components inside and outside the vehicle cabin. For example, the second interface may include a left front wheel 601, a left rear wheel 601', a left front door 602, a left rear door 602', a left A-pillar speaker 603, a right A-pillar speaker 603', a trunk 604, a left front window, a left rear window 605', a windshield 606, a left rearview mirror 607, and a right rearview mirror 607'. Figure 6 In (b), the left rear wheel 601' is highlighted and an arrow image is used as a prompt to guide the user to pay attention and make a selection.

[0104] It should be noted that the embodiment of the present application does not limit the presentation method of the first prompt information. The prompt information can be displayed in any way such as text, graphics, animation, voice, mask guidance, etc. to achieve effective prompts to users.

[0105] For example, a text label and an icon indicator may be used for prompting, for example, a text label of "Recommended Click" may be used with an arrow pointing to the target component.

[0106] For example, gesture animation may be used to simulate user operation, such as dynamic clicking or sliding of a finger icon.

[0107] For example, an aperture may be used to highlight a target component.

[0108] also, Figure 6 The disassembled parts shown in (b) are for illustration only, and this application does not limit the parts of the vehicle model that are displayed after disassembly.

[0109] Optionally, the method 400 further includes: detecting an input for selecting at least one component of the vehicle model from a plurality of components of the vehicle model; and controlling the at least one component of the vehicle model to perform a corresponding function.

[0110] In some embodiments, in response to a user's selection input of a component in the vehicle model, the display device can display a functional operation interface of the corresponding component based on the input, thereby enabling convenient control of the target component.

[0111] Figure 7 An example of a GUI provided by an embodiment of the present application is shown. Figure 9 As shown in (a), under the "disassembly display scheme", in response to the input of user A clicking on the left rear tire 601', the display device can be controlled to display the following Figure 9 The interface shown in (b) displays a prompt box, which includes a warning symbol and the prompt content "Identify left rear tire pressure loss" to remind the user that there is an abnormality in the current tire.

[0112] Figure 8 Another example of the GUI provided by the embodiment of the present application is shown. Figure 10 As shown in (a), in response to the input of user A clicking the left rearview mirror 607, the display device may display the following Figure 10 The left rearview mirror operating panel shown includes heating controls, folding space, and adjustment controls.

[0113] Figure 9 Another example of the GUI provided by the embodiment of the present application is shown. Figure 7As shown in (a), under the "perspective display scheme", in response to the input of user A clicking on the rear left seat 501, the display device can be controlled to display the following Figure 7 The interface shown in (b) displays the rear left 1-seat operation panel, which includes massage controls (off state), heating controls (off state), and angle adjustment controls, wherein the angle adjustment controls can be adjusted by sliding buttons.

[0114] Figure 10 Another example of the GUI provided by the embodiment of the present application is shown. Figure 8 As shown in (a), under the "perspective display scheme", in response to the input of user A clicking the left A-pillar speaker 603, the current sound output can be switched to the left A-pillar speaker 603, and the display device can be controlled to display as shown below. Figure 8 The interface shown in (b) displays a prompt box, which includes the prompt content "The speaker on the left side of the A-pillar has been switched for you."

[0115] Optionally, before controlling the display device to switch from displaying the first interface to displaying the second interface based on the information of the user in the cabin, method 300 also includes: obtaining the type of audio when the user information instructs the user to play audio; wherein, controlling the display device to switch from displaying the first interface to displaying the second interface based on the information of the user in the cabin includes: controlling the display device to switch from displaying the first interface to displaying the second interface based on the type of audio, the second interface including multiple sound-emitting devices and first prompt information in the vehicle model cabin, the first prompt information being used to prompt the user to select at least one sound-emitting device from the multiple sound-emitting devices.

[0116] For example, the vehicle can determine whether the user is playing audio based on the user's in-cabin information. For example, the vehicle can identify the audio playback status through a connection with the user's terminal, or identify the user's intention through voice assistant commands.

[0117] The components in the cabin of the vehicle model may include a sound-generating device, such as a speaker.

[0118] Exemplarily, the vehicle 100 may include the following different sound-emitting devices: a roof sound-emitting device, a door sound-emitting device, a center console sound-emitting device, a headrest sound-emitting device, a rear surround sound-emitting device, an underbody sound-emitting device, and the like.

[0119] In some implementations, an appropriate sound device may be recommended based on the type of currently playing audio to enhance the user's immersive audio experience.

[0120] For example, if the user's information indicates that the current audio is a crosstalk program, the left and right A-pillar sound devices may be prioritized for coordinated playback. By outputting sound from the left and right sides of the vehicle, the stereo field can be simulated to simulate the traditional positioning of crosstalk performers (the supporting actor on the left, the funny actor on the right), giving the user a stronger sense of space and presence during the listening process.

[0121] like Figure 11 As shown, the content display area shows multiple parts of the disassembled vehicle, among which the left A-pillar sound device and the right A-pillar sound device of the vehicle are marked with key colors and are equipped with arrows and text prompts. For example, the specific prompt content may be: It is detected that you are listening to crosstalk, and it is recommended that you choose left and right surround sound.

[0122] For example, if the user's information indicates that the current audio is a talk show hosted by a single person, the user can select the center console audio system and the rear surround sound system for coordinated playback. The center console audio system outputs the speaker's voice content, ensuring a focused and clear sound; the rear surround sound system can play background interactive sound effects such as audience laughter and applause. This surround sound creates a realistic atmosphere of interaction between the stage and the audience, allowing users to enjoy an immersive listening experience even while in the car.

[0123] In addition, the audio's rhythm, instruments, range, and other information can be analyzed based on its characteristics to determine whether the audio belongs to the following music types: classical music, pop music, rock music, electronic music, jazz, etc.

[0124] For example, when the user's information indicates that the current audio is classical music, the front sound devices and the surround sound devices in the car can be recommended to the user. Selecting these sound devices can highlight the spatial sense and delicate layers of the music.

[0125] For example, when the user's information indicates that the current audio is rock music, rear bass sound-generating devices can be recommended to the user, as these sound-generating devices can create better rhythmic impact.

[0126] In some embodiments, the user can customize the activation rules of the sound-emitting device and name the new rules.

[0127] The above solution can achieve differentiated recommendations based on different audio content, has strong adaptability and scalability, and is conducive to building a more intelligent and personalized in-vehicle audio interaction environment.

[0128] Optionally, before controlling the display device to switch from displaying the first interface to displaying the second interface based on the information of the user in the cabin, method 300 also includes: when the user information indicates that the user plays audio, obtaining the area where one or more users in the cabin are located; based on the information of the user in the cabin, controlling the display device to switch from displaying the first interface to displaying the second interface, including: based on the area where one or more users are located, controlling the display device to switch from displaying the first interface to displaying the second interface, the second interface including multiple sound-emitting devices and first prompt information in the vehicle model cabin, the first prompt information being used to prompt the user to select at least one sound-emitting device from the multiple sound-emitting devices.

[0129] The area where one or more users are located in the cabin can be obtained, for example, through cabin camera recognition results, infrared sensors, or pressure sensors. For example, it can be determined whether multiple users in the cabin are located in the driver's seat, the passenger seat, the left side of the second row, the middle of the second row, the right side of the second row, etc.

[0130] In an embodiment of the present application, a sound-emitting device that matches the area may be recommended to the user.

[0131] For example, when the user is in the front row, the vehicle may recommend that the user use the sound-emitting device located in the front row, such as the A-pillar sound-emitting device, the main driving door sound-emitting device, and the right door sound-emitting device.

[0132] For example, when the user is in the back row, the vehicle may recommend the user to use a sound-emitting device in the back row, such as a sound-emitting device in the second row of car pillows.

[0133] If multiple sound-emitting devices are recommended, the multiple recommended sound-emitting devices can be directly presented in the form of icons. For example, the vehicle model displays the A-pillar sound-emitting device, the main driving door sound-emitting device and the right door sound-emitting device through the "dismantling display scheme", and the central control screen 301 can display relevant prompt content: you can select the sound-emitting device recommended by the vehicle.

[0134] In some embodiments, when the user clicks on each sound-emitting device, the corresponding sound-emitting device in the vehicle can emit a corresponding audition sound effect and prompt the user "Are you sure to use this sound-emitting device?" If the user chooses "Yes", the vehicle's sound-emitting device can be switched.

[0135] An embodiment of the present application also provides a control method for improving the audio experience in a multi-user scenario. When different audio experience requirements of different users are detected, the relevant users are reminded, thereby avoiding disturbing the users' rest or affecting the users' audio experience.

[0136] For example, when it is detected that the rear-seat user is in a resting state or watching a video, the front-seat user can be reminded to adjust the volume setting of the sound-emitting device to avoid affecting the rear-seat user's rest or viewing experience.

[0137] Figure 12 A schematic flow chart of a control method 1200 provided in an embodiment of the present application is shown. Figure 12 As shown, the method 1200 includes:

[0138] S1201: Acquire information about users in the cabin, including each user's location status, activity status, and audio / video usage status.

[0139] S1202: It is detected that at least one user in the back row is resting or watching a video.

[0140] S1203: Determine whether the front row user is playing audio, and whether the current audio output uses the rear row sound device.

[0141] If all the above conditions are met, then execute S1204. Otherwise, end the method 1200.

[0142] S1204: Control the display device to display the second interface, which includes the rear sound device components and a prompt message: "The rear passengers are resting / watching a movie, do you want to mute the rear sound device?"

[0143] In other embodiments, the content of the prompt information may also be "It is recommended to lower the volume of the front row sound device to avoid disturbing the users in the back row."

[0144] The above prompt information can be displayed on the central control screen 301 in the form of a pop-up window or a floating window, and the user can click controls such as "Confirm" or "Remind later" to respond.

[0145] S1205: The user chooses to turn off the rear sound device, and the rear sound device is muted.

[0146] In some embodiments, the vehicle can adjust the volume based on the user's decision, or provide a slider for the user to manually adjust the volume.

[0147] In some embodiments, the user's preferences for this operation can be recorded, and the user's preference information can be automatically prompted when similar scenarios occur in the future.

[0148] Through the above method, in a scenario where multiple users are in the cabin together, the passenger status can be perceived in real time and audio adjustment prompts can be quickly made, which helps users quickly find components that do not disturb other users, thereby effectively improving cabin comfort and user experience.

[0149] Optionally, before controlling the display device to switch from displaying the first interface to displaying the second interface based on information of the user in the cabin, method 300 also includes: when the user information indicates that the user is experiencing motion sickness, obtaining information of the first area where the user is located; based on the information of the user in the cabin, controlling the display device to switch from displaying the first interface to displaying the second interface, including: based on the information of the first area, controlling the display device to switch from displaying the first interface to displaying the second interface, the second interface including multiple anti-motion sickness components in the first area of ​​the vehicle model cabin and first prompt information, the first prompt information being used to prompt the user to select at least one anti-motion sickness component from the multiple anti-motion sickness components.

[0150] An embodiment of the present application also provides a control method for helping users alleviate discomfort while riding in a vehicle. When discomfort symptoms are detected in passengers in the cabin, the method recommends that users promptly select cabin components that can alleviate the discomfort, thereby improving driving comfort.

[0151] For example, sensors can be used to detect whether the user is experiencing motion sickness by capturing facial expressions, voice feedback, or smart detection devices worn by the user. Based on the user's motion sickness symptoms, information about the first area the user is located in can be further obtained. For example, if the user is detected to be in the right second row seat area of ​​the vehicle, information about components around the right second row seat area that can alleviate the user's motion sickness symptoms can be obtained, and these components can be recommended to the user via central control screen 301.

[0152] Figure 13 A schematic diagram of a scenario of a group of recommended discomfort relief components provided by an embodiment of the present application is shown. Figure 13 In the scenario shown, the vehicle can determine that the user is experiencing motion sickness based on the user's voice feedback. Figure 13 As shown in (a), in response to the user in the back row of the cabin saying "I feel a little carsick", the control device can control the central control screen 301 to display the following Figure 13 The GUI shown in (b) in FIG.

[0153] like Figure 13 As shown in (b) in the figure, the content display area includes a left rear view of the vehicle model, which is convenient for the driver to operate the area on the main driver's side. When the user on the right side of the second row in the cabin is detected to be motion sickness, the user can be prompted with the message "Detected passenger motion sickness, please rotate the car to the passenger side". The user can follow Figure 13 The gesture shown in (b) in the figure suggests rotating the vehicle model in the direction of rotation. The rotated vehicle model can be Figure 13 As shown in (c) in .

[0154] like Figure 13As shown in (c), since the user on the right side of the second row is experiencing motion sickness, the vehicle model on the right side of the second row can be highlighted (the diagonal area in the figure) to recommend the user to click on the corresponding area. In response to the user's click on the vehicle model, the central control screen can display the following Figure 13 The GUI shown in (d) in FIG.

[0155] Figure 13 (d) is a schematic diagram of vehicle components displayed according to the aforementioned "disassembled display scheme." The second row right window is highlighted and indicated by an arrow, and a prompt "Recommend clicking on the window for fresh air" is displayed on central control screen 301. When the user clicks on the second row right window, the corresponding window opens, allowing fresh air into the vehicle.

[0156] In some embodiments, the anti-motion sickness component associated with the second row of right seats may further include: a fragrance component for releasing a fresh fragrance to alleviate the user's motion sickness symptoms.

[0157] Through the above solution, timely and efficient intervention can be carried out when the user experiences motion sickness symptoms.

[0158] It should be noted that the discomfort symptoms targeted by the embodiments of the present application are not limited to motion sickness symptoms. For example, they may also include: the user experiencing back pain, the user experiencing dry mouth and nose, the user experiencing hot flashes, the user experiencing eye fatigue, the user experiencing anxiety, etc.

[0159] For example, if the vehicle detects that the user frequently changes their sitting position or presses their waist with their hands, the vehicle can determine that the user is experiencing back pain based on the user's movements. Based on the user's location information, the vehicle can recommend a corresponding seat component to the user through central control screen 301, along with a text message stating "Back pain detected, recommending massage chair activation." The user can intuitively find the corresponding seat through the components displayed on central control screen 301 and activate the corresponding massage function by clicking on the seat.

[0160] For example, if the user is detected swallowing or coughing frequently, or uttering the voice feedback "dry air", the central control screen 301 can recommend the user an air conditioner in the corresponding location and provide a text message "The air inside the car is relatively dry, it is recommended to turn on air humidification". The user can intuitively turn on the air conditioner component that requires humidification through the display on the central control screen 301.

[0161] For example, if the user's face is flushed, they frequently wipe sweat, or they give the voice feedback "a bit hot," the central control screen 301 can recommend the air conditioner in the corresponding location to the user, along with a text message saying "The user is hot, so it's recommended to turn on the air conditioner to cool down." The user can intuitively turn on the air conditioner component to cool down the cabin area through the display on the central control screen 301.

[0162] For example, if a child is sitting in the back seat and has been watching cartoons on the front passenger headrest rear screen 304 for a long time, the central control screen 301 can recommend the front passenger headrest rear screen 304 to the parent in the front seat and display a message saying, "We've detected that your child has been watching cartoons for an hour. Do you want to turn off the screen to let them rest?" The parent in the front seat can then quickly and intuitively turn off the screen.

[0163] In some embodiments, when the user does not adopt the vehicle-recommended parts, the user can return to the previous GUI interface by clicking the background area.

[0164] Optionally, before controlling the display device to switch from displaying the first interface to displaying the second interface based on information of the user in the cabin, method 300 also includes: obtaining the input and / or status of the user in the second area in the cabin; based on information of the user in the cabin, controlling the display device to switch from displaying the first interface to displaying the second interface, including: based on the input and / or status of the user in the second area, controlling the display device to display the second interface, the second interface including multiple components in the second area in the vehicle model cabin and the first prompt information.

[0165] Figure 14 FIG. 1 shows a control diagram of recommending regional components based on the regions where different users are located, provided by an embodiment of the present application. Figure 14 As shown, there are two users, user A and user B, in the cockpit, wherein user A sits in the main driving seat and user B sits in the right seat of the second row.

[0166] User A can perform the following operations on the central control screen 301: Figure 14 The operation shown in (a) in FIG. 1 , that is, long pressing the main driving area of ​​the vehicle model, can control the central control screen 301 to display the following Figure 14 The interface shown in (b) in the figure shows the driver's seat, steering wheel, pedals, sound system, and other components displayed in the "disassembled display mode". Because user A's waist discomfort is detected, the interface recommends the user to select the driver's seat through an arrow icon and displays the prompt "Recommend clicking on the driver's seat".

[0167] User B can perform the following operations on the front passenger headrest rear screen 304: Figure 14The operation shown in (c) in FIG. 1 is to long press the right area of ​​the second row of the vehicle model to control the screen 304 behind the passenger headrest to display the following Figure 14 The interface shown in (d) in the figure shows the second row of seats, reading lights, and rear-seat sound system, all displayed in "disassembled display mode." Since user B is reading, the interface uses an arrow to recommend the user to select the reading light and displays the prompt "Recommend clicking on the reading light."

[0168] Figure 15 FIG. 1 shows another control schematic diagram of recommending regional components based on the regions where different users are located, provided by an embodiment of the present application. Figure 15 As shown in (a), user A in the main driving seat can click on any position of the vehicle model on the central control screen 301. In response to the input of user A, the central control screen can be controlled to display the following Figure 15 User A has the authority to operate all the components in the vehicle cabin shown in (b).

[0169] like Figure 15 As shown in (c), user B on the right side of the second row can click on a designated area on the screen 304 behind the passenger headrest. There is no response after user B clicks on other areas. Figure 15 In (c), a prompt message to user B is also displayed: "You can click on the area on the right side of row 2." In response to user B clicking on the designated area, the screen 304 behind the passenger headrest can be controlled to display the following: Figure 15 (d) shows all the components in the vehicle cabin, where user B can only click on the components related to his area and has no permission to operate on the rest of the components. Figure 15 As shown in (d), components that the user does not have permission to use are in a grayed-out state, indicating that user B cannot click on them. Components that user B can operate include: the rear sound device, the second row right seat, and the screen 304 behind the passenger headrest.

[0170] Optionally, method 300 also includes: obtaining the user's preference parameters for the first component among multiple components; based on the information of the user in the cockpit, controlling the display device to switch from displaying the first interface to displaying the second interface, including: when the current usage parameters of the first component are different from the preference parameters, based on the preference parameters, controlling the display device to display the second interface, the second interface also includes second prompt information, and the second prompt information is used to prompt to set the usage parameters of the first component to the preference parameters.

[0171] In an embodiment of the present application, the vehicle can record different users' usage habits or preferences for different components in the cabin. When the current usage status of a component is different from the user's usage habits or preferences, it is recommended that the user reset the corresponding component according to his or her own usage habits or preferences.

[0172] For example, the vehicle detects that the passenger seat's current backrest angle is 105° and the cushion height is at its lowest, while the user's typical seat preferences are 115° and a moderate cushion height. Therefore, the vehicle model's "transparent display solution" can be used to highlight the passenger seat components on the second interface, with a text prompt suggesting "Adjust your seat to your usual preferences" to encourage the user to adjust the seat's backrest angle and height.

[0173] An embodiment of the present application also provides a control method, which can make graded recommendations based on the aforementioned “perspective display solution” and “disassembly display solution”.

[0174] Figure 16 A schematic flow chart of a control method 1600 provided in an embodiment of the present application is shown. The method 1600 includes:

[0175] S1601: Control the display device to display a first interface, where the first interface includes multiple components outside the vehicle model cabin.

[0176] S1602: In response to a first input to the vehicle model, based on information of the user in the cabin, the display device is controlled to switch from displaying a first interface to displaying a second interface, the second interface including multiple areas in the vehicle model cabin and first prompt information, the first prompt information being used to prompt selection of at least one area from multiple areas.

[0177] Optionally, the multiple areas are obtained according to at least one of the following factors: division based on spatial location; division based on user identity; division based on scene function; user customization.

[0178] For example, the areas divided based on spatial location may include: the driver's seat, the passenger seat, the second row left area, the second row right area, the trunk area, the top sunroof area, etc. Different areas are independent of each other. The vehicle can display these areas using the "perspective display mode" or "disassembled display mode" described above.

[0179] Figure 17 FIG. 1 shows a schematic diagram of displaying multiple areas provided by an embodiment of the present application. Figure 17 As shown, user A can follow Figure 17 The gesture shown in (a) clicks on the vehicle model. Figure 17 (a) in the figure shows a top view of the vehicle model.

[0180] In response to the click input of user A, the central control screen 301 can be controlled to display the following Figure 17 (b) shows multiple areas. Figure 17 In (b), the main driving area 1701, the passenger driving area 1702, the second row right area 1703, the second row middle area 1704, and the second row left area 1705 are displayed. The above five areas are displayed through the "disassembled display mode".

[0181] Optionally, method 1600 also includes: in response to a second input to the first area among the multiple areas, based on information of the user in the cabin, controlling the display device to switch from displaying the second interface to displaying a third interface, the third interface including multiple components in the first area and second prompt information, the second prompt information being used to prompt selection of at least one component from the multiple components.

[0182] Optionally, method 1600 also includes: in response to a third input to a first component among multiple components, based on information of a user in the cabin, controlling the display device to switch from displaying a third interface to displaying a fourth interface, the fourth interface including multiple functional control components of the first component and third prompt information, the third prompt information being used to prompt selection of at least one functional control component from the multiple functional control components.

[0183] In some embodiments, when a user clicks on the passenger area 1702, the central control screen 301 may display multiple components in the passenger area, such as the passenger fragrance, passenger windows, passenger seat, passenger audio, and passenger air conditioning. A user may click on the passenger seat, and the central control screen may display multiple functional controls for the passenger seat, such as seat massage controls, seat height adjustment controls, and seat back angle adjustment controls.

[0184] For example, the area can be divided according to the identity of the user. For example, the vehicle recognizes the identity and location of the current passenger, such as the driver, the driver's mother, the driver's child, etc. The vehicle can divide different areas for different users based on safety mechanisms or user habits.

[0185] For example, the areas may be divided according to scene functions, and the correspondence between different scenes and components may be as shown in Table 1.

[0186] Table 1

[0187] Scene Mode Related parts Travel Mode Seats, lights, speakers Focus Mode Small table, reading light Dating Mode & Style Mode Aroma, massage, and sound devices Welcome mode Ambient lighting, seats

[0188] For example, users can create their own zones to customize the cabin components within them and save related configurations, such as "Father and Child Travel Zone" or "Rear Seat Movie Viewing Zone." Each zone can store corresponding parameters for the components, or record a single user's preferences for different components. When the user selects the corresponding zone again, the vehicle may display a prompt saying, "Welcome to this mode. Your last preferences have been automatically set for you."

[0189] Figure 18 A schematic block diagram of a control device 1800 provided in an embodiment of the present application is shown. Device 1800 includes a control unit 1810 configured to control a display device to display a first interface, the first interface including multiple components outside a vehicle model cabin; and control unit 1810 configured to control the display device to switch from displaying the first interface to displaying a second interface, the second interface including multiple components within the vehicle model cabin and first prompt information, the first prompt information prompting a user to select at least one component from the multiple components, in response to input into the vehicle model and based on information from a user within the cabin.

[0190] Optionally, the device also includes an acquisition unit 1820, which is used to: obtain the type of audio when the user information instructs the user to play audio; the control unit 1810 is also used to: based on the type of audio, control the display device to switch from displaying the first interface to displaying the second interface, the second interface includes multiple sound-emitting devices in the vehicle model cabin and a first prompt message, the first prompt message is used to prompt the user to select at least one sound-emitting device from multiple sound-emitting devices.

[0191] Optionally, the acquisition unit 1820 is further used to: obtain the area where one or more users are located in the cabin when the user information instructs the user to play audio; the control unit 1810 is further used to: based on the area where one or more users are located, control the display device to switch from displaying the first interface to displaying the second interface, the second interface including multiple sound-emitting devices and first prompt information in the vehicle model cabin, the first prompt information being used to prompt the user to select at least one sound-emitting device from multiple sound-emitting devices.

[0192] Optionally, the acquisition unit 1820 is further used to: when the user information indicates that the user is experiencing motion sickness, obtain information about the first area in which the user is located; the control unit 1810 is further used to: based on the information about the first area, control the display device to switch from displaying the first interface to displaying the second interface, the second interface including multiple anti-motion sickness components in the first area within the vehicle model cabin and first prompt information, the first prompt information being used to prompt the user to select at least one anti-motion sickness component from the multiple anti-motion sickness components.

[0193] Optionally, the acquisition unit 1820 is further used to: obtain the input and / or status of the user in the second area in the cabin; the control unit 1810 is further used to: control the display device to display a second interface based on the input and / or status of the user in the second area, and the second interface includes multiple components in the second area in the vehicle model cabin and the first prompt information.

[0194] Optionally, the acquisition unit 1820 is further used to: obtain the user's preference parameters for the first component among multiple components; the control unit 1810 is further used to: when the current usage parameters of the first component are different from the preference parameters, based on the preference parameters, control the display device to display a second interface, the second interface also includes a second prompt information, and the second prompt information is used to prompt to set the usage parameters of the first component to the preference parameters.

[0195] Optionally, the control unit 1810 is further configured to: control the transparency of the vehicle model to gradually decrease so as to display multiple components within the cabin of the vehicle model.

[0196] Optionally, the control unit 1810 is further configured to control the vehicle model to disassemble the components in the cabin, so as to display the components in the cabin being separated along a preset control trajectory, and to maintain the relative positions of the components during the separation process.

[0197] Optionally, the device further includes a detection unit 1830, configured to detect an input for selecting at least one component from a plurality of components; and the control unit 1810 is further configured to control the at least one component to perform a corresponding function.

[0198] The present application also provides a control device 1900. The device 1900 includes a control unit 1910 configured to control a display device to display a first interface, the first interface including multiple components outside the vehicle model cabin; and control unit 1910 configured to control the display device to switch from displaying the first interface to displaying a second interface, the second interface including multiple areas within the vehicle model cabin and first prompt information, in response to a first input to the vehicle model and based on information from a user within the cabin. The first prompt information is configured to prompt the user to select at least one area from the multiple areas.

[0199] In combination with the fourth aspect, in certain implementations of the fourth aspect, the control unit 1910 is further used to: in response to a second input to the first area of ​​the multiple areas, based on information of the user in the cabin, control the display device to switch from displaying the second interface to displaying the third interface, the third interface including multiple components in the first area and second prompt information, the second prompt information being used to prompt the selection of at least one component from the multiple components.

[0200] In combination with the fourth aspect, in certain implementations of the fourth aspect, the control unit 1910 is further used to: in response to a third input to a first component among multiple components, based on information from a user in the cabin, control the display device to switch from displaying a third interface to displaying a fourth interface, the fourth interface including multiple functional control components of the first component and third prompt information, the third prompt information being used to prompt selection of at least one functional control component from the multiple functional control components.

[0201] It should be understood that the division of the various units in the above device is merely a division of logical functions. In actual implementation, they may be fully or partially integrated into a single physical entity, or they may be physically separated. Furthermore, the units in the device may be implemented in the form of a processor calling software; for example, the device includes a processor connected to a memory storing instructions, and the processor calls the instructions stored in the memory to implement any of the above methods or the functions of the various units in the device, where the processor is, for example, a general-purpose processor such as a CPU or a microprocessor, and the memory is a memory within the device or a memory external to the device. Alternatively, the units in the device may be implemented in the form of hardware circuits, and the functions of some or all of the units may be implemented through the design of the hardware circuits. The hardware circuits may be understood as one or more processors. For example, in one implementation, the hardware circuit is an ASIC, and the functions of some or all of the above units may be implemented through the design of the logical relationships between the components within the circuits. In another implementation, the hardware circuit may be implemented using a PLD, such as an FPGA, which may include a large number of logic gate circuits, and the connections between the logic gate circuits may be configured using a configuration file to implement the functions of some or all of the above units. All units of the above apparatus may be implemented entirely in the form of software called by a processor, or entirely in the form of hardware circuits, or partially in the form of software called by a processor and the rest in the form of hardware circuits.

[0202] In an embodiment of the present application, a processor is a circuit with the ability to process signals. In one implementation, the processor may be a circuit with the ability to read and execute instructions, such as a CPU, a microprocessor, a GPU, or a DSP. In another implementation, the processor may implement certain functions through the logical relationship of a hardware circuit, and the logical relationship of the hardware circuit may be fixed or reconfigurable, such as a hardware circuit implemented by an ASIC or PLD, such as an FPGA. In a reconfigurable hardware circuit, the process of the processor loading a configuration document to implement the configuration of the hardware circuit can be understood as the process of the processor loading instructions to implement the functions of some or all of the above units. In addition, it can also be a hardware circuit designed for artificial intelligence, which can be understood as an ASIC, such as an NPU, TPU, DPU, etc.

[0203] It can be seen that each unit in the above device can be one or more processors (or processing circuits) configured to implement the above method, such as: CPU, GPU, NPU, TPU, DPU, microprocessor, DSP, ASIC, FPGA, or a combination of at least two of these processor forms.

[0204] In addition, the various units in the above apparatus may be fully or partially integrated together, or may be implemented independently. In one implementation, these units are integrated together and implemented in the form of a system-on-chip (SoC). The SoC may include at least one processor for implementing any of the above methods or implementing the functions of the various units of the apparatus. The at least one processor may be of different types, for example, including a CPU and an FPGA, a CPU and an artificial intelligence processor, a CPU and a GPU, etc.

[0205] An embodiment of the present application further provides a control device 2000, comprising: a memory for storing a computer program; and a processor for executing the computer program stored in the memory, so that the device executes the method in the above embodiment.

[0206] An embodiment of the present application also provides a vehicle, comprising any possible device among the above-mentioned control device 1800, control device 1900 or control device 2000.

[0207] An embodiment of the present application further provides a computer-readable storage medium having instructions stored thereon. When the instructions are executed by a processor, the processor implements the method in the above embodiment.

[0208] An embodiment of the present application further provides a computer program product, which includes computer program code. When the computer program code is run on a computer, the computer implements the method in the above embodiment.

[0209] An embodiment of the present application further provides a chip, which includes a circuit, and the circuit is used to implement the method in the above embodiment.

[0210] During implementation, each step of the above method can be completed by an integrated logic circuit of the hardware in the processor or by instructions in the form of software. The method disclosed in conjunction with the embodiments of the present application can be directly embodied as being executed by a hardware processor, or can be executed by a combination of hardware and software modules in the processor. The software module can be located in a storage medium mature in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, or a power-on erasable programmable memory, a register, etc. The storage medium is located in the memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware. To avoid repetition, it will not be described in detail here.

[0211] It should be understood that in the embodiment of the present application, the memory may include a read-only memory and a random access memory, and provide instructions and data to the processor.

[0212] It should also be understood that in the various embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0213] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0214] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0215] In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0216] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0217] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0218] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0219] The above description is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in the present application should be covered and fall within the scope of protection of the present application. Therefore, the scope of protection of the present application should be based on the scope of protection of the claims.

Claims

1. A control method, characterized in that: The method comprises: Controlling the display device to display a first interface, wherein the first interface includes a plurality of components outside the vehicle model cabin; In response to input to the vehicle model, based on information from a user in the cabin, the display device is controlled to switch from displaying the first interface to displaying a second interface, wherein the second interface includes multiple components in the cabin of the vehicle model and first prompt information, and the first prompt information is used to prompt the selection of at least one component from the multiple components.

2. The method according to claim 1, characterized in that Before controlling the display device to switch from displaying the first interface to displaying the second interface based on the information of the user in the cabin, the method further includes: When the user information indicates that the user plays audio, obtaining the type of the audio; The controlling the display device to switch from displaying the first interface to displaying the second interface based on the information of the user in the cabin includes: Based on the type of the audio, the display device is controlled to switch from displaying the first interface to displaying the second interface, wherein the second interface includes multiple sound-emitting devices and a first prompt message in the vehicle model cabin, and the first prompt message is used to prompt the user to select at least one sound-emitting device from the multiple sound-emitting devices.

3. The method according to claim 1 or 2, characterized in that Before controlling the display device to switch from displaying the first interface to displaying the second interface based on the information of the user in the cabin, the method further includes: When the user information indicates that the user plays audio, obtaining an area where one or more users are located in the cabin; The controlling the display device to switch from displaying the first interface to displaying the second interface based on the information of the user in the cabin includes: Based on the area where the one or more users are located, the display device is controlled to switch from displaying the first interface to displaying the second interface, wherein the second interface includes multiple sound-emitting devices and a first prompt message in the vehicle model cabin, and the first prompt message is used to prompt the user to select at least one sound-emitting device from the multiple sound-emitting devices.

4. The method according to any one of claims 1 to 3, characterized in that Before controlling the display device to switch from displaying the first interface to displaying the second interface based on the information of the user in the cabin, the method further includes: When the user information indicates that the user suffers from motion sickness, obtaining information of a first area where the user is located; The controlling the display device to switch from displaying the first interface to displaying the second interface based on the information of the user in the cabin includes: Based on the information of the first area, the display device is controlled to switch from displaying the first interface to displaying the second interface, where the second interface includes multiple anti-motion sickness components in the first area within the vehicle model cabin and first prompt information, and the first prompt information is used to prompt the user to select at least one anti-motion sickness component from the multiple anti-motion sickness components.

5. The method according to any one of claims 1 to 4, characterized in that Before controlling the display device to switch from displaying the first interface to displaying the second interface based on the information of the user in the cabin, the method further includes: Obtaining input and / or status of a user in a second area within the cabin; The controlling the display device to switch from displaying the first interface to displaying the second interface based on the information of the user in the cabin includes: Based on the user input and / or status of the second area, the display device is controlled to display a second interface, where the second interface includes the multiple components in the second area in the vehicle model cabin and the first prompt information.

6. The method according to any one of claims 1 to 5, characterized in that The method further comprises: obtaining a preference parameter of the user for a first component among the plurality of components; The controlling the display device to switch from displaying the first interface to displaying the second interface based on the information of the user in the cabin includes: When the current usage parameters of the first component are different from the preference parameters, based on the preference parameters, the display device is controlled to display a second interface, and the second interface also includes second prompt information, and the second prompt information is used to prompt to set the usage parameters of the first component to the preference parameters.

7. The method according to any one of claims 1 to 6, characterized in that The controlling the display device to switch from displaying the first interface to displaying the second interface includes: The transparency of the vehicle model is controlled to gradually decrease to display multiple components in the cockpit of the vehicle model.

8. The method according to any one of claims 1 to 6, characterized in that The controlling the display device to switch from displaying the first interface to displaying the second interface includes: The vehicle model is controlled to execute the disassembly of the components in the cockpit, so as to show that the components in the cockpit are separated along a preset control track, and the relative positions of the components are maintained during the separation process.

9. The method according to any one of claims 1 to 8, characterized in that The method further comprises: detecting an input selecting the at least one component from the plurality of components; The at least one component is controlled to perform a corresponding function.

10. A control method, characterized in that: The method comprises: Controlling the display device to display a first interface, wherein the first interface includes a plurality of components outside the vehicle model cabin; In response to a first input to the vehicle model, based on information of a user in the cabin, the display device is controlled to switch from displaying the first interface to displaying a second interface, wherein the second interface includes multiple areas in the cabin of the vehicle model and first prompt information, and the first prompt information is used to prompt the selection of at least one area from the multiple areas.

11. The method according to claim 10, characterized in that The method further comprises: In response to a second input to a first area among the multiple areas, based on information from a user in the cabin, the display device is controlled to switch from displaying the second interface to displaying a third interface, where the third interface includes multiple components in the first area and second prompt information, where the second prompt information is used to prompt the user to select at least one component from the multiple components.

12. The method according to claim 11, characterized in that The method further comprises: In response to a third input to a first component among the multiple components, based on information from a user in the cabin, the display device is controlled to switch from displaying the third interface to displaying a fourth interface, wherein the fourth interface includes multiple function control components of the first component and third prompt information, and the third prompt information is used to prompt the user to select at least one function control component from the multiple function control components.

13. The method according to any one of claims 10 to 12, characterized in that The multiple regions are obtained according to at least one of the following factors: Based on spatial location division; Segmentation based on user identity; Based on scene function division; User defined.

14. A control device, characterized in that: The device comprises: A control unit, configured to: control the display device to display a first interface, wherein the first interface includes a plurality of components outside the vehicle model cabin; The control unit is further used to: in response to input to the vehicle model, based on information of the user in the cabin, control the display device to switch from displaying the first interface to displaying the second interface, wherein the second interface includes multiple components in the cabin of the vehicle model and first prompt information, and the first prompt information is used to prompt the user to select at least one component from the multiple components.

15. The device according to claim 14, characterized in that The device further includes an acquisition unit, configured to: acquire the type of the audio when the user information indicates that the user plays the audio; The control unit is further used to: based on the type of the audio, control the display device to switch from displaying the first interface to displaying the second interface, the second interface including multiple sound-emitting devices and first prompt information in the vehicle model cabin, the first prompt information being used to prompt the user to select at least one sound-emitting device from the multiple sound-emitting devices.

16. The device according to claim 14 or 15, characterized in that The device further includes an acquisition unit, The acquisition unit is further configured to: acquire an area where one or more users are located in the cabin when the user information indicates that the user plays audio; The control unit is further used to: based on the area where the one or more users are located, control the display device to switch from displaying the first interface to displaying the second interface, the second interface including multiple sound-emitting devices and first prompt information in the vehicle model cabin, the first prompt information being used to prompt the user to select at least one sound-emitting device from the multiple sound-emitting devices.

17. The device according to any one of claims 14 to 16, characterized in that The device further includes an acquisition unit, The acquiring unit is further configured to: acquire information of a first area where the user is located when the user information indicates that the user suffers from motion sickness; The control unit is further configured to control the display device to switch from displaying the first interface to displaying the second interface based on information from the first area, where the second interface includes a plurality of anti-motion sickness components in the first area within the cabin of the vehicle model and first prompt information, where the first prompt information is configured to prompt the user to select at least one anti-motion sickness component from the plurality of anti-motion sickness components.

18. The device according to any one of claims 14 to 17, characterized in that The device further includes an acquisition unit, The acquisition unit is further configured to: acquire input and / or status of a user in a second area within the cabin; The control unit is further configured to control the display device to display a second interface based on the user input and / or status of the second area, where the second interface includes the multiple components in the second area within the vehicle model cabin and the first prompt information.

19. The device according to any one of claims 14 to 18, characterized in that The device further includes an acquisition unit, The obtaining unit is further configured to: obtain the user's preference parameter for the first component among the multiple components; The control unit is further configured to: when the current usage parameters of the first component are different from the preference parameters, control the display device to display a second interface based on the preference parameters, wherein the second interface also includes second prompt information, and the second prompt information is used to prompt the user to set the usage parameters of the first component to the preference parameters.

20. The device according to any one of claims 14 to 19, characterized in that The control unit is further configured to control the transparency of the vehicle model to gradually decrease so as to display multiple components within the cockpit of the vehicle model.

21. The device according to any one of claims 14 to 20, characterized in that The control unit is further configured to control the vehicle model to disassemble the components in the cabin, so as to display the components in the cabin being separated along a preset control track, and to maintain the relative positions of the components during the separation process.

22. The device according to any one of claims 14 to 21, characterized in that The apparatus further includes a detection unit configured to: detect an input for selecting the at least one component from the plurality of components; The control unit is further used to control the at least one component to perform a corresponding function.

23. A control device, characterized in that: The device comprises: A control unit, configured to: control the display device to display a first interface, wherein the first interface includes a plurality of components outside the vehicle model cabin; The control unit is also used to: in response to a first input to the vehicle model, based on information of a user in the cabin, control the display device to switch from displaying the first interface to displaying a second interface, wherein the second interface includes multiple areas in the cabin of the vehicle model and first prompt information, and the first prompt information is used to prompt the selection of at least one area from the multiple areas.

24. The device according to claim 23, characterized in that The control unit is further configured to: in response to a second input to a first area among the multiple areas, based on information of a user in the cabin, control the display device to switch from displaying the second interface to displaying a third interface, where the third interface includes multiple components in the first area and second prompt information, where the second prompt information is used to prompt selection of at least one component from the multiple components.

25. The device according to claim 24, characterized in that The control unit is further configured to: in response to a third input to a first component among the multiple components, based on information of a user in the cabin, control the display device to switch from displaying the third interface to displaying a fourth interface, wherein the fourth interface includes multiple functional control components of the first component and third prompt information, and the third prompt information is used to prompt selection of at least one functional control component from the multiple functional control components.

26. A control device, characterized in that: The device comprises: memory for storing computer programs; A processor, configured to execute the computer program stored in the memory, so that the apparatus performs the method according to any one of claims 1 to 9, or performs the method according to any one of claims 10 to 13.

27. A vehicle, characterized in that: Comprising the apparatus of any one of claims 14 to 22, the apparatus of claims 23 to 25, or the apparatus of claim 26.

28. A computer-readable storage medium, characterized in that Instructions are stored thereon, and when the instructions are executed by a processor, the processor implements the method according to any one of claims 1 to 9, or implements the method according to any one of claims 10 to 13.

29. A computer program product, characterized in that The computer program product comprises a computer program code, and when the computer program code is run on a computer, the computer is caused to implement the method according to any one of claims 1 to 9 or the method according to any one of claims 10 to 13.

30. A chip, characterized in that: The chip includes a circuit, and the circuit is used to execute the method according to any one of claims 1 to 9, or to implement the method according to any one of claims 10 to 13.

Images