Interaction method of vehicle-mounted system, vehicle and storage medium

Abstract

The application discloses an interaction method of a vehicle-mounted system, a vehicle and a storage medium. The interaction method comprises the following steps: after the vehicle is powered on, a three-dimensional model of the vehicle and a three-dimensional scene of a driving state of the vehicle constructed according to the three-dimensional model of the vehicle are displayed on a user interface of the vehicle-mounted system; the state information of the vehicle and the driving environment information of the vehicle are displayed in the three-dimensional scene; and the three-dimensional scene is updated in real time in response to changes in the state of the vehicle and the environment information of the vehicle during driving. The vehicle-mounted system displays the three-dimensional model of the vehicle and the three-dimensional scene of the driving state of the vehicle constructed according to the three-dimensional model of the vehicle. After the state of the vehicle and the environment information of the vehicle change during driving, the three-dimensional scene is updated in real time. The user can more intuitively and clearly understand the vehicle information, one three-dimensional scene runs through different application scenarios, the user feels the continuity of the scene when jumping between interfaces, the transition is more natural, and the experience is smoother.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of interaction, and more particularly, to an interaction method of a vehicle-mounted system, a vehicle, and a storage medium and a nonvolatile computer readable storage medium. BACKGROUND

[0002] With the development of new energy vehicles, the vehicle cabin is becoming more and more intelligent, and users can view information of the vehicle in different states through a vehicle-mounted system. In related technologies, the user interfaces of the vehicle in different scenes are independent of each other, the scenes are fragmented, lack continuity, and the user experience is poor. SUMMARY

[0003] The present application provides an interaction method of a vehicle-mounted system, a vehicle, and a storage medium and a nonvolatile computer readable storage medium.

[0004] The interaction method of the vehicle-mounted system of the present application embodiment comprises:

[0005] After the vehicle is powered on, a three-dimensional model of the vehicle and a three-dimensional scene of a driving state of the vehicle constructed according to the three-dimensional model of the vehicle are displayed on a user interface of the vehicle-mounted system;

[0006] The state information of the vehicle and the driving environment information of the vehicle are displayed in the three-dimensional scene;

[0007] The three-dimensional scene is updated in real time in response to changes in the state of the vehicle and the environment information of the vehicle during driving.

[0008] In this way, after the vehicle is powered on, a three-dimensional model of the vehicle and a three-dimensional scene of a driving state of the vehicle constructed according to the three-dimensional model of the vehicle are displayed on a user interface of the vehicle-mounted system, and the state information of the vehicle and the driving environment information of the vehicle are displayed in the three-dimensional scene. After the state of the vehicle and the environment information of the vehicle change during driving, the three-dimensional scene is updated in real time. This allows users to more intuitively and clearly understand vehicle information, drive more safely, and enables a three-dimensional scene to run through different application scenarios, so that users feel the continuity of the scene when jumping between interfaces, the transition is more natural, and the experience is smoother.

[0009] The driving environment information includes surrounding vehicle information, driving line information, parking space information, ground lock information, charging pile information, and / or pedestrian information.

[0010] In this way, users can intuitively understand the driving environment information including surrounding vehicle information, driving line information, parking space information, ground lock information, charging pile information, and / or pedestrian information through a three-dimensional scene centered on the three-dimensional model of the vehicle.

[0011] The state information includes state information of vehicle parts, charging state information, and / or range state information.

[0012] In this way, the user can intuitively understand the state information including the state information of the vehicle parts, the charging state information and / or the range state information through the three-dimensional scene centered on the three-dimensional model of the vehicle.

[0013] In response to changes in the vehicle state and changes in the environmental information during driving of the vehicle, the three-dimensional scene is updated in real time, including:

[0014] In response to the vehicle gear being switched from P to D, the display scale of the three-dimensional model of the vehicle in the user interface is reduced, and the three-dimensional scene is displayed at a predetermined viewing angle.

[0015] In this way, when the vehicle gear is switched from P to D, the display scale of the three-dimensional model of the vehicle in the user interface is reduced, and the three-dimensional scene is displayed at a predetermined viewing angle, which facilitates the user to intuitively understand the environment during forward driving of the vehicle.

[0016] In response to changes in the vehicle state and changes in the environmental information during driving of the vehicle, the three-dimensional scene is updated in real time, including:

[0017] In response to the vehicle gear being switched from P to R, the display scale of the three-dimensional model of the vehicle in the user interface is reduced.

[0018] The three-dimensional scene is displayed at a predetermined viewing angle in a first predetermined area in the user interface, and a reversing image is displayed in a second predetermined area in the user interface.

[0019] In this way, after the vehicle gear is switched from P to R, the display scale of the three-dimensional model of the vehicle in the user interface is reduced, the three-dimensional scene is displayed at a predetermined viewing angle in a first predetermined area in the user interface, and a reversing image is displayed in a second predetermined area in the user interface. This enables the user to intuitively understand the environment around the vehicle and the state of the vehicle itself during reversing of the vehicle, and facilitates the user to reverse the vehicle.

[0020] In response to changes in the vehicle state and changes in the environmental information during driving of the vehicle, the three-dimensional scene is updated in real time, including:

[0021] In response to the driving state of the vehicle on the first road, the display scale of the three-dimensional model of the vehicle in the user interface is reduced, and a three-dimensional map is displayed at a first predetermined viewing angle in the three-dimensional scene.

[0022] In this way, according to the driving state of the vehicle on the first road, the display scale of the three-dimensional model of the vehicle in the user interface is reduced, and a three-dimensional map is displayed at a first predetermined viewing angle in the three-dimensional scene, which enables the user to intuitively understand more driving environment information

[0023] in response to changes in vehicle state and changes in environmental information during driving of the vehicle, updating the three-dimensional scene in real time, including:

[0024] in response to a driving state of the vehicle entering a second road from a first road, enlarging a display scale of the three-dimensional model of the vehicle in the user interface;

[0025] switching the three-dimensional map to a high-precision map, displaying the high-precision map in the three-dimensional scene at a second predetermined viewing angle, the high-precision map including lane navigation information, guide line information, lane line information, and / or surrounding lane information.

[0026] In this way, after the vehicle enters a second road from a first road, the display scale of the three-dimensional model of the vehicle in the user interface can be enlarged, the three-dimensional map can be switched to a high-precision map, the high-precision map can be displayed in the three-dimensional scene at a second predetermined viewing angle, and the high-precision map can include lane navigation information, guide line information, lane line information, and / or surrounding lane information, so that the user can more clearly and in detail understand the situation of the road information.

[0027] in response to changes in vehicle state and changes in environmental information during driving of the vehicle, updating the three-dimensional scene in real time, including:

[0028] in response to a driving state of the vehicle entering a second scene from a first scene, enlarging a display scale of the three-dimensional model of the vehicle in the user interface;

[0029] switching a map of the first scene to parking environment information, and displaying the parking environment information in the three-dimensional scene, the parking environment information including parking space information.

[0030] In this way, after the vehicle enters a second scene from a first scene, the display scale of the three-dimensional model of the vehicle in the user interface can be enlarged, a map of the first scene can be switched to parking environment information, and the parking environment information can be displayed in the three-dimensional scene, and the parking environment information can include parking space information. The user can intuitively understand the situation of the parking lot, and the user can conveniently drive the vehicle into a parking space.

[0031] the displaying of the parking environment information in the three-dimensional scene includes:

[0032] in response to a driving state of the vehicle in the second scene, displaying predetermined parking space information in the second scene in the three-dimensional scene.

[0033] In this way, when the vehicle is driving in the second scene, the predetermined parking space information in the second scene can be displayed in the three-dimensional scene.

[0034] in response to changes in vehicle state and changes in environmental information during driving of the vehicle, updating the three-dimensional scene in real time, including:

[0035] in response to a state that the vehicle completes parking and engages P gear, amplifying a display scale of the three-dimensional model of the vehicle in the user interface, and displaying the three-dimensional model of the vehicle at the amplified display scale at a predetermined angle in the three-dimensional scene;

[0036] in the three-dimensional scene, displaying an interactive control of an interactive vehicle component in the vehicle.

[0037] In this way, after the vehicle completes parking and engages P gear, the display scale of the three-dimensional model of the vehicle in the user interface can be amplified, the three-dimensional model of the vehicle at the amplified display scale can be displayed at a predetermined angle in the three-dimensional scene, and in the three-dimensional scene, the interactive control of the interactive vehicle component in the vehicle can be displayed.

[0038] The three-dimensional scene is updated in real time in response to changes in the vehicle state and changes in the environmental information during driving of the vehicle, including:

[0039] in response to a state that the vehicle is charging, displaying charging scene information in the three-dimensional scene, the charging scene information including a charging pile three-dimensional model, a battery module three-dimensional model, and / or a charging progress dynamic effect.

[0040] In this way, after the vehicle is charging, the charging scene information including the charging pile three-dimensional model, the battery module three-dimensional model, and / or the charging progress dynamic effect can be displayed in the three-dimensional scene, so that the user can intuitively and fully understand the current charging status of the vehicle.

[0041] The application also provides a vehicle, which includes a processor and a memory, the memory storing a computer program, and the computer program is executed by the processor to implement the above-mentioned interactive method.

[0042] The application also provides a non-volatile computer readable storage medium including a computer program, and the computer program is executed by the processor to make the processor execute the above-mentioned interactive method.

[0043] The interactive method of the vehicle-mounted system, the vehicle, the storage medium, and the non-volatile computer readable storage medium of the application can display the three-dimensional model of the vehicle and the three-dimensional scene of the driving state of the vehicle constructed according to the three-dimensional model of the vehicle in the user interface of the vehicle-mounted system after the vehicle is powered on, display the state information of the vehicle and the driving environmental information of the vehicle in the three-dimensional scene, and update the three-dimensional scene in real time after the vehicle state and the environmental information change during driving of the vehicle. The user can more intuitively and clearly understand the vehicle information, drive more safely, and one three-dimensional scene runs through different application scenarios, so that the user feels the continuity of the scene when jumping between interfaces, the transition is more natural, and the experience is smoother.

[0044] Additional aspects and advantages of the embodiments of the present application will be set forth in part in the description that follows, and in part will be obvious from the description, or can be learned by practice of the embodiments of the present application. BRIEF DESCRIPTION OF DRAWINGS

[0045] The foregoing and / or additional aspects and advantages of the present application are achieved by providing an interactive method, comprising the steps of:

[0046] Figure 1 is a flowchart of an interactive method according to certain embodiments of the present application;

[0047] Figure 2 is a scenario diagram of an interactive method according to certain embodiments of the present application;

[0048] Figure 3 is a flowchart of an interactive method according to certain embodiments of the present application;

[0049] Figure 4 is a scenario diagram of an interactive method according to certain embodiments of the present application;

[0050] Figure 5 is a flowchart of an interactive method according to certain embodiments of the present application;

[0051] Figure 6 is a scenario diagram of an interactive method according to certain embodiments of the present application;

[0052] Figure 7 is a flowchart of an interactive method according to certain embodiments of the present application;

[0053] Figure 8 is a scenario diagram of an interactive method according to certain embodiments of the present application;

[0054] Figure 9 is a flowchart of an interactive method according to certain embodiments of the present application;

[0055] Figure 10 is a scenario diagram of an interactive method according to certain embodiments of the present application;

[0056] Figure 11 is a flowchart of an interactive method according to certain embodiments of the present application;

[0057] Figure 12 is a flowchart of an interactive method according to certain embodiments of the present application;

[0058] Figure 13 is a scenario diagram of an interactive method according to certain embodiments of the present application;

[0059] Figure 14is a flowchart of an interaction method of some embodiments of the present application;

[0060] Figure 15 is a flowchart of an interaction method of some embodiments of the present application;

[0061] Figure 16 is a scenario diagram of an interaction method of some embodiments of the present application;

[0062] Figure 17 is a connection state diagram of a non-volatile computer readable storage medium and a processor of some embodiments of the present application. DETAILED DESCRIPTION

[0063] Embodiments of the present application are described in detail below with reference to the attached drawing figures, wherein the same or like reference numerals are used throughout the figures to refer to the same or like elements or elements with the same or similar functionality. The embodiments described below are exemplary and are not intended to limit the scope of the present application, as defined by the claims.

[0064] Referring to Figure 1 , the present application provides an interaction method of a vehicle-mounted system, the interaction method comprising:

[0065] 01: after the vehicle is powered on, a three-dimensional model of the vehicle and a three-dimensional scene of a driving state of the vehicle constructed according to the three-dimensional model of the vehicle are displayed on a user interface of the vehicle-mounted system;

[0066] 02: the state information of the vehicle and the driving environment information of the vehicle are displayed in the three-dimensional scene;

[0067] 03: in response to changes in the state of the vehicle and the environment information during driving of the vehicle, the three-dimensional scene is updated in real time.

[0068] The embodiments of the present application provide a vehicle, the vehicle comprising a memory and a processor. The memory stores a computer program, and the processor is configured to, after the vehicle is powered on, display a three-dimensional model of the vehicle and a three-dimensional scene of a driving state of the vehicle constructed according to the three-dimensional model of the vehicle on a user interface of a vehicle-mounted system, display the state information of the vehicle and the driving environment information of the vehicle in the three-dimensional scene, and update the three-dimensional scene in real time in response to changes in the state of the vehicle and the environment information during driving of the vehicle.

[0069] Specifically, the vehicle is equipped with a display screen, and users can interact with the display screen, such as the central control screen and the passenger screen, and vehicle components. These components include sensors capable of identifying and perceiving the vehicle's surroundings, such as cameras, radar, and body sensors. They also include components that control the vehicle's status, such as the vehicle's gear position, doors and windows, trunk, lights, and air conditioning. The display screen is also used to display the user interface of the vehicle's systems. Users can interact with the user interface to control the vehicle's components to perform various functions. The vehicle can also leverage the sensing capabilities of its components and, in combination with AR and VR devices, create a 3D interactive experience based on the vehicle's metaverse on the display screen.

[0070] The in-vehicle system is installed with various applications that users need when using the vehicle, such as navigation applications, parking applications, and vehicle control settings applications. Users can also install applications related to 3D models into the in-vehicle system, such as out-of-box experience (OOBE), charging applications, sleep applications, and movie mode applications.

[0071] See also Figure 2 The display screen displays a user interface that includes a 3D model display area. The 3D model display area is used to display a 3D scene centered around the vehicle's 3D model. The 3D scene includes 3D models of surrounding vehicles, ground locks, charging stations, pedestrians, and other driving environment information. The 3D vehicle model also displays vehicle status information, such as gear position, door and window access, and trunk opening status, as well as charging and battery life. The 3D scene also features various functional controls, such as a parking control. User interaction with the parking control allows the vehicle to park in a parking space. When the actual vehicle's driving environment or status changes, the 3D scene and the vehicle's 3D model are updated accordingly. Scaling and rotating the vehicle's 3D model or 3D scene can be adjusted accordingly. Furthermore, when the vehicle's application scenario changes, the 3D model or 3D scene can automatically scale, rotate, or highlight portions of the vehicle's 3D model or 3D scene.

[0072] It can be understood that compared with the applications on the two-dimensional plane user interface, the applications are independent of each other, and the two-dimensional user interface is cut into frames based on the applications, without being connected. When the user needs to use different applications in the vehicle-mounted system, for example, according to the change of the vehicle gear, or according to the user's needs, it is necessary to constantly switch back and forth between different applications, the scene is fragmented, and there is a lack of continuity. At the same time, when different applications need to be used in order, the user is inconvenient to remember, and the operation efficiency is low. All applications in the present application are collected in a complete scene, and the display content and mode are automatically switched according to the change of the driving environment and the vehicle state, thereby enhancing the explicitness of the vehicle intelligence.

[0073] The vehicle processor controls the user interface of the display screen to display a three-dimensional scene centered on the three-dimensional model of the vehicle to the user after receiving the state information reported by each component of the vehicle and the driving environment information reported by the sensor of the vehicle.

[0074] It can be understood that by using the recognition and perception ability of the components of the vehicle, in combination with geographic location information, a three-dimensional model of the vehicle and a three-dimensional scene centered on the three-dimensional model of the vehicle are constructed in a three-dimensional virtual space, so that the user interface display content corresponds to the actual vehicle and the actual physical environment one-to-one, the user interface real-time restores and synchronously updates the real state of the vehicle and the surrounding environment, and the user can watch the blind area conveniently, so that the user can more intuitively and clearly understand the vehicle information while driving more safely. At the same time, the same three-dimensional scene is used to run through the scenes of map navigation, parking, vehicle setting, etc., and according to the user operation or the scene change, the vehicle body is automatically scaled and rotated, and the highlighted content is displayed, so that the user feels the continuity of the scene when jumping between interfaces, the transition is more natural, and the experience is smoother.

[0075] In this way, after the vehicle is powered on, the three-dimensional model of the vehicle and the three-dimensional scene of the vehicle driving state constructed according to the three-dimensional model of the vehicle are displayed on the user interface of the vehicle-mounted system, and the state information of the vehicle and the driving environment information of the vehicle are displayed in the three-dimensional scene. After the vehicle state and the environment information change during driving, the three-dimensional scene is updated in real time. The user can more intuitively and clearly understand the vehicle information, drive more safely, and the same three-dimensional scene runs through different application scenes, so that the user feels the continuity of the scene when jumping between interfaces, the transition is more natural, and the experience is smoother.

[0076] The driving environment information includes: surrounding vehicle information, driving line information, parking space information, ground lock information, charging pile information, and / or pedestrian information.

[0077] Specifically, the surrounding vehicle information can include whether there are other vehicles around the actual vehicle corresponding to the three-dimensional model vehicle, sizes of the other vehicles, and the like. The lane information can include positions of the lanes and changes of the lanes to be encountered by the vehicle in the future, and the like. The parking space information can include whether there are available parking spaces at the target location, sizes of the parking spaces, and specific physical positions of the parking spaces, and the like. The ground lock information can include whether there are ground locks at the target parking space, whether the user can open the ground locks, and the like. The charging pile information can include specific positions of the charging piles, available amounts of electricity of the charging piles, and charging pile fees, and the like. The pedestrian information can include whether there are pedestrians around the actual vehicle corresponding to the three-dimensional model vehicle, numbers of the pedestrians, and formations of the pedestrians, and the like.

[0078] In this way, the user can intuitively understand the driving environment information including the surrounding vehicle information, the lane information, the parking space information, the ground lock information, the charging pile information, and / or the pedestrian information through the three-dimensional scene centered on the three-dimensional model of the vehicle.

[0079] The state information includes state information of vehicle parts, charging state information, and / or range state information.

[0080] Specifically, the state information of the parts can include angles of the parts being turned on, turned off, or turned, and the like. The charging state information can include a degree of charging and whether the vehicle is being charged, and the like. The range state information can include a specific range of the vehicle, and the like.

[0081] In this way, the user can intuitively understand the state information including the state information of the vehicle parts, the charging state information, and / or the range state information through the three-dimensional scene centered on the three-dimensional model of the vehicle.

[0082] Please refer to Figure 3 , step 03 includes:

[0083] 030: In response to the gear of the vehicle being switched from P to D, the display scale of the three-dimensional model of the vehicle in the user interface is reduced, and the three-dimensional scene is displayed at a predetermined viewing angle.

[0084] The processor is configured to, in response to the gear of the vehicle being switched from P to D, reduce the display scale of the three-dimensional model of the vehicle in the user interface, and display the three-dimensional scene at a predetermined viewing angle.

[0085] Specifically, the state information of the vehicle includes a change in the gear of the vehicle, and therefore, the display state of the three-dimensional model of the vehicle and the three-dimensional scene in the user interface can be changed according to the change in the gear of the vehicle.

[0086] Please refer to Figure 2 , when the gear of the vehicle is in P, i.e., the parking gear, the three-dimensional scene is displayed to the user at an angle for conveniently observing the state of the vehicle. For example, as shown in the upper right view of the vehicle in Figure 2 .

[0087] Referring to Figure 4 , the three-dimensional scene is displayed to the user at a predetermined angle when the vehicle gear is in D. The predetermined angle refers to an angle at which the user can conveniently observe the driving environment and the forward direction in the three-dimensional scene, for example, the angle of view shown in Figure 4 .

[0088] There are various ways to switch the vehicle gear from P to D, for example, the user interacts with the control for parking in the user interface, or directly engages the actual gear of the vehicle from P to D, etc.

[0089] Understandably, when the vehicle is in P, it means that the user is in a parking state, and the user pays more attention to the state of the vehicle than to the environment around the vehicle, therefore, the display scale of the three-dimensional model of the vehicle in the user interface is larger than that in other gear states, and the three-dimensional scene is displayed to the user at an angle that facilitates observation of the state of the vehicle, which can enable the user to more clearly and intuitively understand the vehicle information. When the vehicle is in D, it means that the user is in a driving state, and for reasons of driving safety, the user pays more attention to the driving environment, therefore, when the vehicle is engaged in D, the display scale of the three-dimensional model of the vehicle is reduced compared to when parking, and the three-dimensional scene is displayed at an angle that facilitates observation of the driving environment and the forward direction, so that more recognized driving environment information such as driving lines, parking spaces, and surrounding vehicles can be displayed, facilitating the user to intuitively understand the environment during the process of driving the vehicle to the destination, for example, a parking lot.

[0090] Referring to Figure 2 and Figure 4 , in one example, the user intends to drive the vehicle out of a parking lot. After the user unlocks and powers on the vehicle, the vehicle gear is in P, and the display scale of the three-dimensional model of the vehicle and the display angle of the three-dimensional scene are as shown in Figure 2 , when the user engages the gear to D and starts driving, the display scale of the three-dimensional model of the vehicle is automatically reduced and the display angle of the three-dimensional scene is automatically changed, and the state after the automatic reduction and change is as shown in Figure 4 .

[0091] In this way, when the vehicle gear is switched from P to D, the display scale of the three-dimensional model of the vehicle in the user interface is reduced, and the three-dimensional scene is displayed at a predetermined viewing angle, facilitating the user to intuitively understand the environment during the process of driving the vehicle.

[0092] Referring to Figure 5 , step 03 includes:

[0093] 031: In response to the vehicle gear being switched from P to R, reducing the display scale of the three-dimensional model of the vehicle in the user interface.

[0094] 032: display the three-dimensional scene in a first predetermined area of the user interface at a predetermined viewing angle, and display the reversing image in a second predetermined area of the user interface.

[0095] The processor is configured to, in response to the gear of the vehicle being switched from P to R, reduce the display scale of the three-dimensional model of the vehicle in the user interface, and display the three-dimensional scene in a first predetermined area of the user interface at a predetermined viewing angle, and display the reversing image in a second predetermined area of the user interface.

[0096] Specifically, when the gear of the vehicle is switched from P to R, it can be judged that the user is reversing, and the user interface displays two areas, a first predetermined area for displaying the three-dimensional scene at an angle convenient for observing the driving environment and the forward direction, and a second predetermined area for displaying the reversing image. The three-dimensional scene in the first predetermined area can be obtained by the display radar scanning of the vehicle. The reversing image in the second predetermined area can be obtained by the camera on the vehicle.

[0097] It can be understood that after obtaining the change of the gear from P to R, the display scale of the three-dimensional model of the vehicle in the user interface is automatically reduced, and the three-dimensional scene is displayed at an angle convenient for observing the driving environment and the forward direction while displaying the reversing image. The user intuitively understands the surrounding environment of the vehicle, the state of the vehicle itself and the blind area during the reversing process of the vehicle, and the user is facilitated to reverse.

[0098] Please refer to Figure 2 and Figure 6 In one example, after the user switches the gear of the vehicle from P to R, the user interface automatically changes from the interface as shown in Figure 2 to the interface as shown in Figure 7 That is, after the user switches the gear of the vehicle from P to R, the interface automatically changes into two areas, the first predetermined area displays the three-dimensional scene at an angle convenient for observing the driving environment and the forward direction, and the display scale of the three-dimensional model of the vehicle in the three-dimensional scene is reduced, and the second predetermined area displays the current reversing image.

[0099] In this way, after the gear of the vehicle is switched from P to R, the display scale of the three-dimensional model of the vehicle in the user interface is reduced, the three-dimensional scene is displayed in a first predetermined area of the user interface at a predetermined viewing angle, and the reversing image is displayed in a second predetermined area of the user interface. The user intuitively understands the surrounding environment of the vehicle and the state of the vehicle itself during the reversing process of the vehicle, and the user is facilitated to reverse.

[0100] Please refer to Figure 7 , step 03 includes:

[0101] 033: In response to the driving state of the vehicle on the first road, the display scale of the three-dimensional model of the vehicle in the user interface is reduced, and the three-dimensional map is displayed in the three-dimensional scene at a first predetermined viewing angle.

[0102] The processor is configured to, in response to the driving state of the vehicle on the first road, reduce the display scale of the three-dimensional model of the vehicle in the user interface, and display the three-dimensional map in the three-dimensional scene at a first predetermined viewing angle.

[0103] Specifically, when the vehicle drives from the parking lot to the road outside the parking lot, the three-dimensional model of the vehicle in the user interface and the three-dimensional scene also change accordingly. The first road refers to the road outside the parking lot.

[0104] Referring to Figure 8 , after the user drives to the road outside the parking lot, compared with in the parking lot, the display scale of the three-dimensional model of the vehicle continues to be reduced, and the three-dimensional scene is displayed at an angle that is convenient for observing the driving environment and the forward direction. The three-dimensional scene includes roads and buildings around the roads.

[0105] It can be understood that the environment inside the parking lot and the environment outside the parking lot are quite different, and there are more factors affecting driving safety outside the parking lot, such as traffic lights, larger route changes, etc. Therefore, the user needs to pay more attention to the driving environment of the vehicle. Therefore, further reducing the display scale of the three-dimensional model and displaying the three-dimensional scene at an angle that is convenient for observing the driving environment and the forward direction can enable the user to intuitively understand more driving environment information.

[0106] In this way, according to the driving state of the vehicle on the first road, the display scale of the three-dimensional model of the vehicle in the user interface is reduced, and the three-dimensional map is displayed in the three-dimensional scene at a first predetermined viewing angle. This can enable the user to intuitively understand more driving environment information.

[0107] Referring to Figure 9 , step 03 includes:

[0108] 034: In response to the driving state of the vehicle from the first road to the second road, the display scale of the three-dimensional model of the vehicle in the user interface is increased;

[0109] 035: Switching the three-dimensional map to a high-precision map, displaying the high-precision map in the three-dimensional scene at a second predetermined viewing angle, the high-precision map including lane navigation information, guide line information, lane line information, and / or surrounding lane information.

[0110] The processor is configured to, in response to the driving state of the vehicle entering a second road from a first road, enlarge the display scale of the three-dimensional model of the vehicle in the user interface, and switch the three-dimensional map to a high-precision map, display the high-precision map in the three-dimensional scene at a second predetermined viewing angle, and the high-precision map includes lane navigation information, guide line information, lane line information and / or surrounding lane information.

[0111] Specifically, the high-precision map refers to a map displayed using an SR (Surrounding Reality, SR) display mode, which is a display mode that restores the road environment in combination with high-precision map data and vehicle perception capabilities. That is, compared with the three-dimensional map used on the first road, the high-precision map can enable the user to more clearly and more detailedly understand the conditions of the roads, such as the navigation information, guide line information, lane line information and / or surrounding lane information of the roads. The navigation information can include the remaining distance, time to the destination, and the subsequent driving direction of the vehicle, the name of the driving intersection, etc. The guide line information includes the specific shape of the guide line, etc. The lane line information includes the specific shape of the lane line, etc. The surrounding lane information includes whether there are vehicles and guide lines on the surrounding roads of the road on which the vehicle is driving, etc.

[0112] The second road refers to a road that can be displayed on the high-precision map. The second predetermined viewing angle refers to a viewing angle that is lowered from the first predetermined viewing angle to an extent that the user can fully understand the detailed information of the second road.

[0113] It can be understood that if the user uses the automatic driving mode on the second road, the user can fully understand the working conditions of the vehicle automatic driving through the automatically enlarged three-dimensional model of the vehicle and the high-precision map displayed in the three-dimensional scene at the second predetermined viewing angle.

[0114] Please refer to Figure 10 In one example, after the vehicle enters the second road from the first road, compared with the first road, the display scale of the three-dimensional model of the vehicle in the user interface is enlarged, the three-dimensional model map is switched to the high-precision map in the three-dimensional scene, the viewing angle is lowered to an extent that the user can fully understand the detailed information of the second road, and the high-precision map is displayed.

[0115] In this way, after the vehicle enters the second road from the first road, the display scale of the three-dimensional model of the vehicle in the user interface can be enlarged, the three-dimensional map is switched to the high-precision map, the high-precision map is displayed in the three-dimensional scene at the second predetermined viewing angle, and the high-precision map includes lane navigation information, guide line information, lane line information and / or surrounding lane information, etc., so that the user can more clearly and detailedly understand the road information.

[0116] Please refer to Figure 11 Step 03 includes:

[0117] 036: in response to a driving state that the vehicle drives from the first scene into a second scene, magnifying a display scale of the three-dimensional model of the vehicle in the user interface;

[0118] 037: switching a map of the first scene to parking environment information, and displaying the parking environment information in the three-dimensional scene, the parking environment information including parking space information.

[0119] The processor is configured to, in response to a driving state that the vehicle drives from the first scene into a second scene, magnify a display scale of the three-dimensional model of the vehicle in the user interface, and to switch a map of the first scene to parking environment information, and display the parking environment information in the three-dimensional scene, the parking environment information including parking space information.

[0120] Specifically, when the user drives to the destination and drives from a road outside the parking lot into the parking lot, the user interface is transformed again into the interface for driving in the parking lot.

[0121] The first scene refers to a scene in which the vehicle has not entered the parking lot, i.e., driving on a road outside the parking lot. The second scene refers to a scene in which the vehicle has entered the parking lot.

[0122] The parking environment information can include a road of the parking lot, a sign of the parking lot, a parking space, and a position of an obstacle existing in the parking lot, etc.

[0123] The parking space information can include a specific position of a parking space that can be used and a size of the parking space, etc.

[0124] It can be understood that, after entering the parking lot, automatically displaying the parking environment information can enable the user to intuitively understand the situation of the parking lot, and facilitate the user to drive the vehicle into the parking space.

[0125] Please refer to Figure 4 In one example, when the user drives the vehicle from a road outside the parking lot into the parking lot, the display scale of the three-dimensional model of the vehicle in the user interface is automatically magnified compared to the road outside the parking lot. The map of the road outside the parking lot is switched to a three-dimensional scene displaying parking environment information.

[0126] In this way, after the vehicle drives from the first scene into the second scene, the display scale of the three-dimensional model of the vehicle in the user interface is magnified, the map of the first scene is switched to parking environment information, and the parking environment information is displayed in the three-dimensional scene, the parking environment information including parking space information. This can enable the user to intuitively understand the situation of the parking lot, and facilitate the user to drive the vehicle into the parking space.

[0127] Please refer to Figure 12 Step 037 includes:

[0128] 0370: In response to the driving state of the vehicle in the second scene, the predetermined parking space information in the second scene is displayed in the three-dimensional scene.

[0129] The processor is configured to display the predetermined parking space information in the second scene in the three-dimensional scene in response to the driving state of the vehicle in the second scene.

[0130] Specifically, the predetermined parking space refers to a parking space exclusive to the user.

[0131] Referring to Figure 13 When the vehicle is driving in the parking lot, the automatic driving system on the vehicle can automatically identify whether there is a parking space exclusive to the user in the parking lot. When the automatic driving system identifies that there is a parking space exclusive to the user, the information of the parking space exclusive to the user in the second scene is displayed in the three-dimensional scene. The user can use the automatic driving mode to make the vehicle automatically park in the parking space exclusive to the user.

[0132] Thus, when the vehicle is driving in the second scene, the predetermined parking space information in the second scene can be displayed in the three-dimensional scene.

[0133] Referring to Figure 14 , step 03 comprises:

[0134] 038: In response to the state that the vehicle completes parking and is in P gear, the display ratio of the three-dimensional model of the vehicle in the user interface is enlarged, and the three-dimensional model of the vehicle after the enlarged display ratio is displayed in the three-dimensional scene at a predetermined angle;

[0135] 039: In the three-dimensional scene, the interactive control of the vehicle parts that can be interacted in the vehicle is displayed.

[0136] The processor is configured to enlarge the display ratio of the three-dimensional model of the vehicle in the user interface in response to the state that the vehicle completes parking and is in P gear, display the three-dimensional model of the vehicle after the enlarged display ratio in the three-dimensional scene at a predetermined angle, and display the interactive control of the vehicle parts that can be interacted in the vehicle in the three-dimensional scene.

[0137] Specifically, the predetermined angle refers to an angle that facilitates observation of the state of the vehicle.

[0138] Referring to Figure 2 , specifically, when the vehicle completes parking and the user puts the gear into P gear, compared with driving in the parking lot, the display ratio of the three-dimensional model of the vehicle in the user interface is automatically enlarged, and the three-dimensional model of the vehicle is displayed in the three-dimensional scene at an angle that facilitates observation of the state of the vehicle. At the same time, the interactive control of the vehicle parts such as the trunk and the charging cover that are opened and closed is displayed in the three-dimensional model of the vehicle.

[0139] Thus, after the vehicle completes parking and is put into P gear, the display scale of the three-dimensional model of the vehicle in the user interface can be enlarged, the three-dimensional model of the vehicle after the enlargement is displayed at a predetermined angle in the three-dimensional scene, and in the three-dimensional scene, the interactive control of the vehicle part that can be interacted in the vehicle is displayed.

[0140] Referring to Figure 15 , step 03 comprises:

[0141] 30: in response to the state of the vehicle charging, charging scene information is displayed in the three-dimensional scene, the charging scene information comprising a charging pile three-dimensional model, a battery module three-dimensional model and / or a charging progress dynamic effect.

[0142] The processor is configured to display charging scene information in the three-dimensional scene in response to the state of the vehicle charging, the charging scene information comprising a charging pile three-dimensional model, a battery module three-dimensional model and / or a charging progress dynamic effect.

[0143] Specifically, referring to Figure 16 , when it is acquired that the vehicle is charging and the gear is put into P gear, the three-dimensional scene displays a charging pile three-dimensional model, the body of the three-dimensional model of the vehicle is transparentized, and a three-dimensional model of a battery module in the three-dimensional model of the vehicle is highlighted displayed. At the same time, the progress of charging can also be displayed in a dynamic effect, for example, the three-dimensional model of the battery module is divided into multiple layers, each layer represents a certain charging capacity. When the charging capacity reaches a certain proportion, the number of layers corresponding to the three-dimensional model of the battery module is displayed in a color different from that of the three-dimensional model of the battery module.

[0144] It can be understood that the user can fully understand the current charging condition of the vehicle through the user interface without opening the charging application.

[0145] Thus, after the vehicle is charging, charging scene information can be displayed in the three-dimensional scene, the charging scene information comprising a charging pile three-dimensional model, a battery module three-dimensional model and / or a charging progress dynamic effect. The user can intuitively and fully understand the current charging condition of the vehicle.

[0146] Referring to Figure 17 , the application embodiment further provides a nonvolatile computer readable storage medium 700 containing a computer program 701. When the computer program 701 is executed by one or more processors 800, the one or more processors 800 execute the control method of any of the above-mentioned embodiments.

[0147] In the description of the specification, the description of the terms "certain embodiments", "in an example", "exemplarily" and the like means that the specific features, structures, materials or characteristics described in connection with the embodiments or examples are included in at least one embodiment or example of the present application. In the specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Also, the specific features, structures, materials or characteristics described can be combined in any one or more embodiments or examples in a suitable manner. In addition, the person skilled in the art can combine and combine the different embodiments or examples described in the specification and the features of the different embodiments or examples without contradiction.

[0148] Any process or method descriptions or descriptions of the flow diagrams in the flow charts described herein and elsewhere can be understood as representing code modules, segments, or portions of code which include one or more executable instructions for performing specific logic functions or steps in the process, and that the various systems described herein can include one or more circuits, circuitry, or other hardware for implementing the described functions or steps. The various systems described herein can form part of a machine in the form of a computer, embedded computer, arithmetical logic unit, or other device for example.

[0149] Although the embodiments of the present application have been shown and described above, it is understood that the above-described embodiments are exemplary and are not to be construed as limiting the present application, and the person skilled in the art can make changes, modifications, replacements and variations to the above-described embodiments within the scope of the present application.

Claims

1. An interaction method of an in-vehicle system, characterized by, The application relates to a method for displaying a three-dimensional scene of a vehicle in a user interface of a vehicle-mounted system. The method comprises the following steps: displaying a three-dimensional model of the vehicle and a three-dimensional scene of a driving state of the vehicle in the user interface of the vehicle-mounted system after the vehicle is powered on, the three-dimensional scene being constructed according to the three-dimensional model of the vehicle and being applied to different application scenarios; displaying state information of the vehicle and driving environment information of the vehicle in the three-dimensional scene; 2. The interaction method of claim 1, wherein, in response to changes in the state of the vehicle and the driving environment information of the vehicle during driving, updating the three-dimensional scene in real time and automatically switching the display content and display mode of the application of the vehicle-mounted system in the three-dimensional scene.

3. The interaction method of claim 1, wherein, The driving environment information comprises surrounding vehicle information, driving line information, parking space information, ground lock information, charging pile information and / or pedestrian information.

4. The interaction method of claim 1, wherein, The state information comprises state information of vehicle parts, charging state information and / or range state information. In response to changes in the state of the vehicle and the driving environment information of the vehicle during driving, the three-dimensional scene is updated in real time, which comprises the following steps:

5. The interaction method of claim 1, wherein, in response to the gear of the vehicle being switched from P to D, the display scale of the three-dimensional model of the vehicle in the user interface is reduced, and the three-dimensional scene is displayed at a predetermined viewing angle. In response to changes in the state of the vehicle and the driving environment information of the vehicle during driving, the three-dimensional scene is updated in real time, which comprises the following steps: in response to the gear of the vehicle being switched from P to R, the display scale of the three-dimensional model of the vehicle in the user interface is reduced; 6. The interactive method according to claim 1, characterized in that: the three-dimensional scene is displayed at a predetermined viewing angle in a first predetermined area in the user interface, and a reversing image is displayed in a second predetermined area in the user interface. In response to changes in the state of the vehicle and the driving environment information of the vehicle during driving, the three-dimensional scene is updated in real time, which comprises the following steps:

7. The interaction method of claim 6, wherein, in response to the driving state of the vehicle on a first road, the display scale of the three-dimensional model of the vehicle in the user interface is reduced, and a three-dimensional map is displayed at a first predetermined viewing angle in the three-dimensional scene. In response to changes in the state of the vehicle and the driving environment information of the vehicle during driving, the three-dimensional scene is updated in real time, which comprises the following steps: in response to the driving state of the vehicle entering a second road from a first road, the display scale of the three-dimensional model of the vehicle in the user interface is increased; 8. The interaction method of claim 1, wherein, the three-dimensional map is switched to a high-precision map, and the high-precision map is displayed at a second predetermined viewing angle in the three-dimensional scene, wherein the high-precision map comprises lane navigation information, guide line information, lane line information and / or surrounding lane information. In response to changes in the state of the vehicle and the driving environment information of the vehicle during driving, the three-dimensional scene is updated in real time, which comprises the following steps: in response to the driving state of the vehicle entering a second scene from a first scene, the display scale of the three-dimensional model of the vehicle in the user interface is increased; 9. The interaction method of claim 8, wherein, a map of the first scene is switched to parking environment information, and the parking environment information is displayed in the three-dimensional scene, wherein the parking environment information comprises parking space information. The parking environment information displayed in the three-dimensional scene comprises the following steps: in response to the driving state of the vehicle in the second scene, predetermined parking space information in the second scene is displayed in the three-dimensional scene.

10. The interaction method of claim 1, wherein, The three-dimensional scene is updated in real time in response to changes in vehicle state and environmental information during driving of the vehicle, including: In response to the vehicle completing parking and shifting into P, the display scale of the three-dimensional model of the vehicle in the user interface is enlarged, and the three-dimensional model of the vehicle after the display scale is enlarged is displayed at a predetermined angle in the three-dimensional scene; In the three-dimensional scene, an interactive control of an interactive vehicle component in the vehicle is displayed.

11. The interaction method of claim 1, wherein, The three-dimensional scene is updated in real time in response to changes in vehicle state and environmental information during driving of the vehicle, including: In response to the vehicle charging, charging scene information is displayed in the three-dimensional scene, and the charging scene information includes a charging pile three-dimensional model, a battery module three-dimensional model, and / or a charging progress dynamic effect.

12. A vehicle characterized by comprising: The vehicle includes a processor and a memory, and the memory stores a computer program, and the computer program is executed by the processor to implement the interaction method of any one of claims 1-11.

13. A non-volatile computer readable storage medium including a computer program, which, when executed by a processor, causes the processor to perform the interaction method of any one of claims 1-11.

Images