Display method and device, vehicle, medium and electronic equipment

Abstract

The invention belongs to the technical field of vehicles, and relates to a display method and device, a vehicle, a medium and electronic equipment. The method comprises the following steps: in response to a trigger operation for journey review, media data corresponding to at least part of key events in a journey are displayed on an interface through a vehicle model, and the key events at least comprise one of traffic conflicts, traffic accidents, normal driving behaviors, dangerous driving behaviors, vehicle faults or abnormities, sudden road conditions and extreme weather; the media data at least comprises one of image data and sound data. The problems of non-intuition and no interest are solved, the interaction and presentation mode is more friendly, the safety problem and the habit problem in the driving process are reflected in a more direct mode, the user is attracted to continuously learn and improve the safety problem and the habit problem in the driving process by reviewing the journey, and the driving experience is improved. The interaction viscosity between the driver and the vehicle is enhanced, and the intelligent degree and the automation degree of the intelligent cabin are improved.

Description

TECHNICAL FIELD

[0001] The present disclosure belongs to the technical field of vehicles, and particularly relates to a display method, a display device, a vehicle, a computer readable storage medium, and an electronic device. BACKGROUND

[0002] The existing vehicle trip summary stays at the data statistics level, cannot review the driving process, and lacks intuitive interaction and interest, so that the driver often does not check in detail, missing the opportunity to learn and improve driving from the trip. SUMMARY

[0003] To overcome the problems in the related art, the present disclosure provides a display method, a display device, a vehicle, a computer readable storage medium, and an electronic device.

[0004] According to a first aspect of an embodiment of the present disclosure, a display method is provided, comprising: In response to a trigger operation of trip review, displaying, on an interface, media data corresponding to at least part of a key event in the trip through a vehicle model, the key event at least including one of traffic conflict, traffic accident, normal driving behavior, dangerous driving behavior, vehicle failure or anomaly, sudden road condition, and extreme weather, and the media data at least including one of image data and sound data.

[0005] Optionally, the trigger operation of trip review includes one of arrival of the vehicle at a destination, gesture interaction with the interface, and voice interaction with the vehicle.

[0006] Optionally, the displaying, on the interface, of the media data corresponding to at least part of the key event in the trip through the vehicle model includes: Displaying, on the interface, a vehicle model animation corresponding to at least part of the key event in the trip through the vehicle model.

[0007] Optionally, the method further comprises: Displaying, on the interface, description text of at least part of the key event in the trip, the description text at least including one of a name of at least one key event, a number of occurrences of the at least one key event in the trip, a key parameter corresponding to the at least one key event, a suggestion feedback on the at least one key event, a driving habit score of a driving level of the trip, and a driving safety score of driving safety of the trip.

[0008] Optionally, the method further comprises: Playing the description text through voice.

[0009] Optionally, the method further comprises: providing, on the interface, a suggestion control corresponding to the suggestion feedback; in response to a triggering operation on the suggestion control, executing the suggestion feedback.

[0010] Optionally, the method further comprises: providing, on the interface, a storage control corresponding to the description text; in response to a triggering operation on the storage control, storing the description text for sharing and / or viewing.

[0011] Optionally, the suggestion feedback comprises driving safety suggestions and driving improvement suggestions, the method further comprises: collecting driving data of the vehicle, and determining, according to the driving data, first event data and second event data corresponding to the key event, the first event data and the second event data being partially identical; determining, according to the first event data and a corresponding weight, the driving safety score and the driving safety suggestions, the driving safety suggestions being determined by the key event; and / or determining, according to the second event data and a corresponding weight, the driving habit score and the driving improvement suggestions, the driving improvement suggestions being determined by the key event.

[0012] Optionally, the suggestion feedback comprises vehicle maintenance suggestions, the method further comprises: determining, according to the driving safety score, the driving habit score and the driving data, a target wear coefficient, and determining, according to the target wear coefficient and the driving data, equivalent wear data; obtaining historical wear data, and determining, according to the historical wear data and the equivalent wear data, the vehicle maintenance suggestions.

[0013] Optionally, the method further comprises: displaying, on the interface, a video playback for at least part of the key events in the trip, the video being captured by a camera in communication with the vehicle, the camera in communication with the vehicle being a camera of the vehicle itself and / or a camera of a third-party device in communication connection.

[0014] Optionally, the displaying, on the interface, the media data corresponding to at least part of the key events in the trip by the vehicle model comprises: providing, on the interface, a timeline corresponding to at least part of the key events in the trip, the timeline representing the occurrence time of the at least part of the key events; In response to a trigger operation acting on the timeline, display, through a vehicle model, on the interface, media data corresponding to at least part of the key events in the trip.

[0015] Optionally, the method further comprises: Displaying a trajectory of the trip, the trajectory representing a path traveled by the vehicle.

[0016] According to a second aspect of embodiments of the present disclosure, a display device is provided, comprising: An event display module configured to, in response to a trigger operation of trip review, display, through a vehicle model, on the interface, media data corresponding to at least part of the key events in the trip, the key events including at least one of traffic conflict, traffic accident, normal driving behavior, dangerous driving behavior, vehicle failure or anomaly, sudden road condition, and extreme weather, and the media data including at least one of image data and sound data.

[0017] Optionally, the trigger operation of the trip review includes one of arrival of the vehicle at a destination, gesture interaction with the interface, and voice interaction with the vehicle.

[0018] Optionally, the event display module is configured to: Display, through a vehicle model, on the interface, vehicle model animation corresponding to at least part of the key events in the trip.

[0019] Optionally, the display device is further configured to: Display, on the interface, description text of at least part of the key events in the trip, the description text including at least one of the following: name of at least one key event, number of occurrences of the at least one key event in the trip, key parameter corresponding to the at least one key event, suggested feedback on the at least one key event, driving habit score of driving level of the trip, and driving safety score of driving safety of the trip.

[0020] Optionally, the display device is further configured to: Display, on the interface, video playback for at least part of the key events in the trip, the video being captured by a camera in communication with the vehicle, the camera in communication with the vehicle being a camera of the vehicle itself and / or a camera of a third-party device in communication connection.

[0021] According to a third aspect of embodiments of the present disclosure, a vehicle is provided, comprising: A processor; A memory for storing processor-executable instructions; The processor is configured to execute executable instructions stored in the memory to implement the steps of the display method of any one of the first aspect of the present disclosure.

[0022] According to a fourth aspect of the embodiments of the present disclosure, a computer readable storage medium is provided, and the computer readable storage medium stores computer program instructions which are executed by a processor to implement the steps of the display method of any one of the first aspect of the present disclosure.

[0023] According to a fifth aspect of the embodiments of the present disclosure, an electronic device is provided, and the electronic device comprises: a processor; a memory for storing executable instructions of the processor; The processor is configured to execute the executable instructions to implement the steps of the display method of any one of the first aspect of the present disclosure.

[0024] The technical solutions provided by the embodiments of the present disclosure can include the following beneficial effects: In the method and device provided by the exemplary embodiments of the present disclosure, a way of reviewing key events of a trip by media data of a vehicle model is provided, which solves the problem of non-intuitive and uninteresting caused by simple data statistics, and the interaction and presentation are more friendly, and the safety problems and habit problems in the driving process are reflected in a more direct way, which also helps users to continuously learn and improve the safety problems and habit problems in the driving process by reviewing the trip, thereby enhancing the stickiness of the driver and the vehicle interaction.

[0025] It should be understood that the foregoing general description and the following detailed description are only exemplary and explanatory, and cannot limit the present disclosure. BRIEF DESCRIPTION OF DRAWINGS

[0026] The accompanying drawings, which are incorporated into the specification and constitute a part of the specification, illustrate embodiments consistent with the present disclosure and, together with the specification, serve to explain the principles of the present disclosure.

[0027] Figure 1 The flowchart schematically shows a display method in an exemplary embodiment of the present disclosure; Figure 2 The flowchart schematically shows a method of displaying key event media data in an exemplary embodiment of the present disclosure; Figure 3 The flowchart schematically shows a method of determining a suggestion feedback in an exemplary embodiment of the present disclosure; Figure 4 The flowchart schematically shows a method of determining a vehicle maintenance suggestion in an exemplary embodiment of the present disclosure; Figure 5A flowchart schematically showing a method of implementing suggestion feedback in an exemplary embodiment of the present disclosure is shown; Figure 6 A flowchart schematically showing a method of storing a description text in an exemplary embodiment of the present disclosure is shown; Figure 7 A structural diagram of a display system in an application scenario in an exemplary embodiment of the present disclosure is shown schematically; Figure 8 A structural diagram of a display device in an exemplary embodiment of the present disclosure is shown schematically; Figure 9 A structural diagram of another display device in an exemplary embodiment of the present disclosure is shown schematically; Figure 10 A structural diagram of still another display device in an exemplary embodiment of the present disclosure is shown schematically. DETAILED DESCRIPTION

[0028] The exemplary embodiments will be described in detail herein with reference to the attached drawings. When the description below refers to accompanying drawings, unless otherwise specified, the same numbers in different drawings refer to the same or similar elements. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present disclosure. Instead, they are merely examples of apparatuses and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0029] It should be noted that all actions of acquiring signals, information or data in the present disclosure are carried out in compliance with the corresponding data protection regulations and policies of the country where the device is located, and with the authorization given by the owner of the corresponding device.

[0030] The existing vehicle trip summary for the driver mostly stays at the level of simple data statistics, such as total mileage, average fuel / electricity consumption, driving time, etc. Although these information is useful, it cannot fully reflect the safety and habit problems in the driving process, and it will not actively give improvement suggestions.

[0031] In addition, the traditional report is usually presented in the form of numbers and texts, which lacks intuitive interactivity and interest, and the driver often does not check in detail, missing the opportunity to learn from data to improve driving.

[0032] Therefore, the prior art lacks a system that comprehensively evaluates the safety, efficiency and driving habits of the trip at the end of the trip and presents it in a friendly 3D visualization manner, which cannot meet the needs of users to deeply understand their own driving behavior and obtain improvement guidance.

[0033] In view of the problems in the related art, the present disclosure provides a display method, Figure 1is a flowchart of a display method according to an example embodiment, as Figure 1 as shown, the method can at least include the following steps: In step S110, in response to a triggering operation of a trip review, media data corresponding to at least part of key events in the trip is displayed on the interface through the vehicle model, the key events at least including one of a traffic conflict, a traffic accident, normal driving behavior, dangerous driving behavior, vehicle failure or anomaly, sudden road conditions, and extreme weather, and the media data at least including one of image data and sound data.

[0034] In the example embodiments of the present disclosure, a way of reviewing key events in a trip through media data of a vehicle model is provided, which solves the problem of non-intuitive and uninteresting caused by simple data statistics, and the interaction and presentation are more friendly, and the safety problems and habit problems in the driving process are reflected in a more direct way, which also attracts users to continuously learn and improve the safety problems and habit problems in the driving process through reviewing the trip, thereby enhancing the stickiness of the driver and the vehicle interaction.

[0035] The steps of the display method are described in detail below.

[0036] In step S110, in response to a triggering operation of a trip review, media data corresponding to at least part of key events in the trip is displayed on the interface through the vehicle model, the key events at least including one of a traffic conflict, a traffic accident, normal driving behavior, dangerous driving behavior, vehicle failure or anomaly, sudden road conditions, and extreme weather, and the media data at least including one of image data and sound data.

[0037] In the example embodiments of the present disclosure, after the user inputs the starting point and the ending point, the vehicle can be started to travel according to the input information.

[0038] In the optional embodiments, the triggering operation of the trip review includes one of the vehicle reaching the destination, gesture interaction with the interface, and voice interaction with the vehicle.

[0039] After the user reaches the ending point to complete the trip, the media data corresponding to at least part of the key events in the trip can be displayed through the vehicle model in any of the following ways: the vehicle reaching the destination, gesture interaction on the interface, or voice interaction with the vehicle. The gesture interaction and the voice interaction can be any corresponding form, and the example embodiments do not make special limitations on this.

[0040] In the optional embodiments, the vehicle model animation corresponding to at least part of the key events in the trip is displayed on the interface through the vehicle model.

[0041] The vehicle model can be a 3D digital twin model of the vehicle, or can be other visualized models, and the example embodiment is not specially limited in this regard.

[0042] For example, when the key event is an acceleration event, the vehicle model can rapidly impact forward and be accompanied by engine sound effects and other acceleration sound effects; when the key event is a deceleration event, the vehicle model brake light flashes and nods, that is, the vehicle body tilts forward; when the key event is a distracted driving event, the driver's seat of the vehicle model is highlighted with a human-shaped logo, and a red exclamation mark and the words "distracted driving" appear beside it; when the key event is an overspeed event, a red wind track appears around the vehicle model to represent virtual wind, and a red exclamation mark and the words "overspeed driving" appear; when the key event is a sharp turning event, the vehicle model tilts left or right according to the turning direction, and the rear of the vehicle model appears a sliding mark, and the screen displays the words "sharp turning".

[0043] The distracted driving event refers to a situation in which, when the vehicle is in a driving state, for example, the vehicle speed is greater than or equal to 5 km / h, the driver's perception-decision-operation chain is temporarily "stolen" by other activities, causing the line of sight, hands, or attention to be away from the main driving task for more than T seconds (the system defaults to T=2s, which can be configured).

[0044] Once any trigger condition shown in Table 1 is met, it is determined to be a distracted driving event, and the start time, end time, duration, speed range, and confidence are recorded:

[0045] Table 1 In optional embodiments, Figure 2 A flowchart of a method for displaying media data of a key event is shown, as shown in Figure 2 The method can at least include the following steps: in step S210, a timeline corresponding to at least part of the key events in the trip is provided on the interface, and the timeline represents the occurrence time of at least part of the key events.

[0046] The timeline can be displayed at the bottom of the screen, or can be displayed at other positions, and the example embodiment is not specially limited in this regard.

[0047] In step S220, in response to a trigger operation acting on the timeline, media data corresponding to at least part of the key events in the trip is displayed on the interface through the vehicle model.

[0048] The trigger operation acting on the timeline can be a drag operation, a click operation, or other operations that can act on the timeline to view the vehicle state at any time, and the example embodiment is not specially limited in this regard.

[0049] In an optional embodiment, a description text of at least one key event in the trip is displayed on the interface, and the description text at least includes one of the following: a name of the at least one key event, a number of occurrences of the at least one key event in the trip, a key parameter corresponding to the at least one key event, a recommended feedback on the at least one key event, a driving habit score of a driving level of the trip, and a driving safety score of a driving safety of the trip.

[0050] At this time, the display mode of the vehicle model can be a slow rotation display, and the key parameters of the current trip are listed beside, such as "mileage: 52.3 km, power consumption: 50%, average power consumption: 0.96% / km, maximum speed: 120 km / h", and the like.

[0051] The "key parameter" refers to a core statistical quantity that can summarize the overall performance of a trip in the "mileage-speed-energy consumption" three dimensions with a single numerical value or ratio, and can reflect the global state of the entire trip without relying on a specific time point. This set of data is displayed when the 3D digital twin model appears, helping the driver to quickly recognize the efficiency and performance of the trip in a few seconds. Specifically, the key data is shown in Table 2:

[0052] Table 2 After the vehicle starts and begins to drive, the driving data during the driving process can be collected, and the collected driving data can be analyzed after the trip ends.

[0053] In an optional embodiment, the recommended feedback includes driving safety recommendations and driving improvement recommendations, Figure 3 A flowchart of a method for determining the recommended feedback is shown, as shown in Figure 3 The method can at least include the following steps: in step S310, collecting driving data of the vehicle, and determining first event data and second event data corresponding to the key event according to the driving data, the first event data and the second event data being partially the same.

[0054] For example, a speed sensor and a GPS (Global Positioning System) module continuously record the vehicle speed and position; a battery management system (BMS) provides power consumption, for example, the initial power is 80%, the final power is 30%, and the power consumption is 50%; a vehicle ADAS (Advanced Driver Assistance System) or DMS (Dealer Management System) module records a distraction event caused by the driver making a phone call; the steering and braking sensors monitor 2 sudden accelerations, i.e., the pedal depth suddenly increases and the speed sharply rises in a short time, and 1 sudden braking, i.e., the brake pedal is sharply pressed to trigger the ABS (Anti-lock Braking System); the total driving time is 1 hour, and the driving distance is 52.3 kilometers.

[0055] In step S320, a driving safety score and a driving safety suggestion are determined according to the first event data and the corresponding weights, and the driving safety suggestion is determined by the key events.

[0056] After the trip ends, the collected driving data can be analyzed to obtain a driving safety score and a driving safety suggestion.

[0057] According to the driving data, the key events at this time are determined, which include one or more of an acceleration event, a deceleration event, a distracted driving event, and an overspeed event.

[0058] In Table 3, the counting method and the triggering threshold of the key events at this time are shown:

[0059] Table 3 After the key events are determined, the driving safety score can be calculated according to formula (1): (1) wherein, =100, i.e., the full score of the driving safety score, , , , is the weight corresponding to each key event, which is the deduction coefficient of the key event, and can be determined by historical accident data or insurance claim data regression, or can be set according to the actual situation, and the exemplary embodiments do not make special limitations.

[0060] For example, =3 (i.e., 3 points are deducted for each sudden acceleration), = 5 (i.e. 5 points for each sudden braking), = 7 (i.e. 7 points for each distraction), = 0.1 points / second (i.e. 0.1 points for each second of overspeed).

[0061] Other dangerous events that affect driving safety, such as side-slip, lane deviation, ABS intervention, etc., can be inserted in the defined safety-critical events.

[0062] After determining the key events for driving safety score and deduction, the key events for deduction can be explained when giving the driving safety score, as the basis for determining the driving safety recommendations, such as avoiding making and receiving calls during driving, etc.

[0063] In an optional embodiment, the driving improvement recommendations include a driving habit score and driving improvement recommendations corresponding to the driving habit score, In step S330, the driving habit score and driving improvement recommendations are determined according to the second event data and the corresponding weights, and the driving improvement recommendations are determined by the key events.

[0064] Table 4 shows the way to determine the key events at this time:

[0065] Table 4 After determining the key events at this time, the deduction points can be calculated according to the deduction function to determine the driving habit score.

[0066] The deduction function is shown in formulas (2)-(5): (2) (3) (4) (5) The calculation method of the driving habit score is shown in formula (6): (6) For example, to achieve the priority punishment of sudden deceleration events, the following parameters can be set: , , ; (i.e. 0.3 points for each 1% of excessive electricity consumption), (i.e. 0.2 points for each km / h of speed fluctuation), (i.e. 0.05 points for each 1 min of long idling waiting time).

[0067] After the driving habit score is calculated, a driving improvement suggestion can be made according to the deduction items of the driving habit score, such as paying attention to smooth driving, etc.

[0068] In an optional embodiment, the suggestion feedback includes a vehicle maintenance suggestion, Figure 4 A flowchart of a method for determining a vehicle maintenance suggestion is shown, as shown in the figure, the method can at least include the following steps: in step S410, determining a target wear coefficient according to the driving safety score, the driving habit score and the driving data, and determining equivalent wear data according to the target wear coefficient and the driving data. Figure 4

[0069] In the process of determining the equivalent wear data, the symbols of the driving data can be defined in advance as shown in Table 5:

[0070] Table 5 Specifically, the calculation method of the target wear coefficient is shown in formula (7): (7) Wherein, the lower the driving safety score and the driving habit score are, the greater the target wear coefficient is, indicating that the equivalent wear is faster.

[0071] For example, when , , it indicates that it needs to be lightly converted; when , , it indicates that it needs to be heavily converted.

[0072] When there is a race track or extreme driving condition, race track or extreme driving weighting can be performed after the target wear coefficient is calculated. Specifically, the weighting method is shown in formula (8): (8) At this time, the target wear coefficient is . In this case, the confirmation method of the race track or extreme driving condition can be to meet: (1) the lateral acceleration , and the longitudinal acceleration , and the duration ; (2) the continuous lap time fluctuation ( ); (3) the engine or motor speed is long time red line (red line), which can also be judged according to actual conditions, and this example embodiment does not specially limit it.

[0073] After the target wear coefficient is determined, the equivalent wear data can be calculated according to formula (9) and formula (10).​

[0074] (9) (10) In step S420, historical wear data is obtained, and a vehicle maintenance suggestion is determined according to the historical wear data and the equivalent wear data.

[0075] The historical wear data includes a distance traveled before the current trip and a time traveled before the current trip.

[0076] Further, the wear data after the current trip is calculated according to formula (11) and formula (12): (11) (12) The "real mileage" of each trip is mapped into the equivalent wear mileage of the vehicle, and is continuously accumulated, so as to trigger a vehicle maintenance suggestion when the accumulated value is greater than or equal to a reference threshold. The reference threshold is 10,000 km or 12 months, and other judgment criteria can also be set according to actual conditions, and the exemplary embodiments do not make special limitations on this.

[0077] After that, description text can be displayed, and the calculated driving safety score, driving safety suggestion, driving habit score, driving improvement suggestion and vehicle maintenance suggestion are presented.

[0078] For example, the safe driving evaluation is: "This driving safety score: 80 / 100. Suggestions: avoid driving while talking on the phone, maintain a safe distance, and brake smoothly." The energy consumption evaluation is: "The average energy consumption of this trip is slightly higher than your average level, which is within the normal range. Suggestions: use kinetic energy recovery reasonably, and pay attention to smooth driving when driving at high speed to improve endurance." The maintenance suggestion is: "Your car has traveled about 10,000 kilometers, and this driving is slightly intense, so it is recommended to perform regular maintenance (check tire pressure, brake system, etc.) as soon as possible.

[0079] In an optional embodiment, the description text is played by voice.

[0080] Considering that the driver may not be able to view the description text, a voice playback mode can be provided for selection. The description text can be announced by a voice assistant, so that the driver can listen to the summary and suggestions after parking.

[0081] In an optional embodiment, the trajectory of the trip is displayed, and the trajectory represents the path traveled by the vehicle.

[0082] The trajectory of the vehicle on the map can be displayed on one side of the interface, and the average speed and power consumption of each stage can be marked on the trajectory, so that the user can understand the vehicle speed and energy consumption of each road segment.

[0083] In an optional embodiment, Figure 5 A flowchart of a method for implementing suggestion feedback is shown, as Figure 5 The method can at least include the following steps: in step S510, providing a suggestion control corresponding to the suggestion feedback on the interface.

[0084] In step S520, in response to the trigger operation acting on the suggestion control, the suggestion feedback is executed.

[0085] The suggestion control can be in the form of a clickable or other trigger mode integrated at the corresponding suggestion. When the driver acts a trigger operation on the suggestion control, the corresponding application program, such as a quick button for making an appointment for maintenance, can be displayed, so that the user can make an appointment through the suggestion feedback. In addition, the application program representing the location of the charging pile and the location of the repair shop can also be displayed, so that the user can jump to the query through the suggestion feedback.

[0086] In an optional embodiment, Figure 6 A flowchart of a method for storing description text is shown, as Figure 6 The method can at least include the following steps: in step S610, providing a storage control corresponding to the description text on the interface.

[0087] In step S620, in response to the trigger operation acting on the storage control, the description text is stored for sharing and / or viewing.

[0088] The driver can generate a picture or short video of the description text or summary through a trigger operation to store the description text. Further, the driver can also share the stored description text for showing his driving performance or interesting findings.

[0089] In an optional embodiment, a video playback of at least part of the key events in the trip is displayed on the interface, and the video is captured by a camera in communication with the vehicle. The camera in communication with the vehicle is a camera provided by the vehicle, and / or a camera of a third-party device in communication connection.

[0090] When the vehicle collects driving data during driving, a video of at least part of the key events of this trip can be collected. The camera that collects the video is set or installed in what form, which is not specially limited in this exemplary embodiment. After the vehicle collects the video during driving, the video can also be played back on the interface for the driver or the person handling the accident to view and review.

[0091] The display method in the embodiments of the present disclosure is described in detail below in combination with an application scenario.

[0092] Figure 7 The structural schematic diagram of the display system in the application scenario is shown as Figure 7 As shown in the figure, an electric vehicle is equipped with the system, the driver drives from the city to the suburban scenic spot, the whole journey is about 50 kilometers, and the system generates a report after parking and turning off the engine.

[0093] Specifically, the vehicle sensor module is responsible for data acquisition and trip recording.

[0094] After the vehicle starts and begins to drive, the trip data acquisition module works automatically. The data of each subsystem on the vehicle is collected through the vehicle bus or gateway to the system. For example, the speed sensor and GPS module continuously record the vehicle speed and position; the battery management system BMS provides the power consumption (80% of the initial power, 30% of the final power, 50% of the power consumption, corresponding to the power consumption); the vehicle ADAS or DMS module records a distraction event caused by the driver making a phone call; the steering and braking sensors monitor 2 times of sudden acceleration (sudden increase in pedal depth and sharp rise in speed in a short time) and 1 time of sudden braking (ABS triggered by rapid pressing of the brake pedal); the total driving distance is 52.3 kilometers and the total driving time is 1 hour.

[0095] The vehicle computing unit module is responsible for data analysis.

[0096] After the trip, the data analysis and evaluation module calculates the collected data. For example, the calculated key results include: the highest speed is 120 km / h (occurring on the highway), the average speed is about 52 km / h; the power consumption of this trip is 50%, which is equivalent to an average power consumption of about 0.96% / km (assuming the total capacity of the battery corresponds to the endurance); 2 times of sudden acceleration, 1 time of sudden braking; DMS captures 1 time of distraction event (call, lasts for 15 seconds); no speeding (road speed limit 120, highway exactly reaches); according to the situation of sudden acceleration and braking and distraction, the system algorithm gives a safety score: for example, full score 100, this time 80 points (deduction because of distraction and sudden); the driving habit score is given as 85 points (slightly intense driving but within acceptable range) according to the degree of smooth driving, power consumption, etc. At the same time, the system queries the vehicle maintenance database: the vehicle has accumulated nearly 10,000 kilometers of driving mileage and the last maintenance was 6 months ago, combined with this slightly intense driving, it is recommended to perform routine inspection and maintenance. In terms of power consumption, the average power consumption is compared with the official nominal and historical average, and it is found that the power consumption this time is about 10% higher than the average, considering that there are some highway and traffic jam road conditions, it is within the normal range, and there is no abnormal power consumption evidence, so the power consumption evaluation is normal. All these analysis results are passed to the 3D visualization display module and the feedback suggestion module in structured data.

[0097] The 3D visualization is displayed on the vehicle screen.

[0098] After the driver turns off the engine and parks, the central control large screen automatically switches to the driving summary interface. The central screen displays the 3D digital twin model of the vehicle. First, the 3D model slowly rotates and displays the key parameters of this trip on the side: for example, "driving distance: 52.3 km, power consumption: 50%, average power consumption: 0.96% / km, maximum speed: 120 km / h".

[0099] Then, the system replays the key driving events in the form of animation: when the number of sudden accelerations is mentioned, the 3D car model suddenly rushes forward twice with engine sound effects, and "sudden acceleration: 2 times" pops up on the screen; when sudden braking is mentioned, the car model's brake light flashes and nods (the front of the car body tilts) once, while "sudden braking: 1 time" is displayed. For the distraction driving event, the driver's seat position of the 3D model is highlighted with a human-shaped symbol, and a warning symbol and the text "distraction driving: 1 time (15 seconds of making and receiving calls)" appear on the side. These animations are synchronized, and the timeline at the bottom of the screen indicates the approximate trip time period when the events occurred, and the user can drag the timeline to view the vehicle status at any time on the 3D model, such as the speed and battery level at a certain time. In addition, one side of the screen displays the vehicle's brief trajectory on the map and bar charts of average speed, power consumption, etc., so that users can understand which section of the road the vehicle is faster and which section of the road has higher energy consumption, etc.

[0100] The feedback suggestion output is also displayed on the vehicle screen.

[0101] After the 3D model demonstration is completed, the interface finally presents a comprehensive feedback module. For example, a safe driving evaluation: "This driving safety score: 80 / 100. Suggestions: avoid driving while talking on the phone, maintain a safe following distance, and brake smoothly." Energy consumption evaluation: "This average energy consumption is slightly higher than your average level, which is within the normal range. Suggestions: use kinetic energy recovery reasonably, and pay attention to smooth driving when driving at high speed to improve endurance." Maintenance suggestions: "Your car has traveled about 10,000 kilometers, and this driving is slightly intense, so it is recommended to perform regular maintenance (check tire pressure, brake system, etc.) as soon as possible." These suggestions are automatically generated by the feedback suggestion module based on the analysis results, and are presented in simple language. Users can click on the corresponding suggestions to get more information, such as a quick button to make an appointment for maintenance. The entire reporting process can also be announced by a voice assistant, allowing the driver to listen to the summary while organizing their belongings.

[0102] In addition, the system can also provide sharing and storage functions, such as allowing the driver to generate a picture or short video of the summary of this driving report (without sensitive data) with one click, and share it on social platforms to show their driving performance or interesting findings.

[0103] In addition, the report is stored in the car or cloud account, making it easy for users to review historical reports and compare progress in the future. For advanced users, the system can provide customization options to select the focus of the report (such as paying more attention to energy consumption or speed). For professional training, the system can even export OBD (On-Board Diagnostics) data to analyze driving behavior in more detail.

[0104] The driving summary report of this scheme not only contains rich quantitative indicators, but also realizes vivid presentation through 3D animation. The driver can obtain feedback with guiding significance at the moment of ending the journey, which will help improve driving habits, improve energy efficiency, and prevent safety risks. The implementation of this scheme is not limited to the above examples, and can be adjusted according to different vehicle models and user needs without deviating from its core idea, which belongs to the scope of this scheme.

[0105] In the exemplary embodiments of the present disclosure, the complete process from data collection and analysis to 3D display and suggestion output is implemented, so that the driver can obtain a graphical and story-telling report at the end of the trip. This not only improves the readability and interest of the report, but also provides safety and maintenance suggestions to help the driver continuously improve driving habits and maintain the vehicle in good condition. Compared with the prior art, the present application enriches the content of the trip summary, upgrades the traditional single numerical statistics to multi-dimensional driving evaluation, and makes the report more intuitive through 3D digital twin, enhances the stickiness of user-vehicle interaction, and prompts the driver to really pay attention to and use these feedbacks to improve behavior.

[0106] In addition, in the exemplary embodiments of the present disclosure, a display device is also provided, Figure 8 The structure diagram of the display device is shown as Figure 8 As shown, the display device 800 can include an event display module 810. Wherein: The event display module 810 is configured to display, in response to a trigger operation of trip review, media data corresponding to at least part of key events in the trip on the interface through a vehicle model, the key events at least including one of traffic conflict, traffic accident, normal driving behavior, dangerous driving behavior, vehicle failure or anomaly, sudden road condition, and extreme weather, and the media data at least including one of image data and sound data.

[0107] In some embodiments of the present disclosure, the trigger operation of trip review includes one of arrival of the vehicle at the destination, gesture interaction with the interface, and voice interaction with the vehicle.

[0108] In some embodiments of the present disclosure, the event display module 810 is configured to: Display, on the interface, a vehicle model animation corresponding to at least part of key events in the trip through the vehicle model.

[0109] In some embodiments of the present disclosure, the display device 800 is further configured to: Display, on the interface, description text of at least part of key events in the trip, the description text at least including one of the following: name of at least one key event, number of occurrences of the at least one key event in the trip, key parameter corresponding to the at least one key event, suggestion feedback on the at least one key event, driving habit score of driving level of the trip, and driving safety score of driving safety of the trip.

[0110] In some embodiments of the present disclosure, the display device 800 is further configured to: Voice play the description text.

[0111] In some embodiments of the present disclosure, the display device 800 is further configured to: provide, in the interface, a suggestion control corresponding to the suggestion feedback; in response to a triggering operation acting on the suggestion control, execute the suggestion feedback.

[0112] In some embodiments of the present disclosure, the display device 800 is further configured to: provide, in the interface, a storage control corresponding to the description text; in response to a triggering operation acting on the storage control, store the description text for sharing and / or viewing.

[0113] In some embodiments of the present disclosure, the suggestion feedback includes driving safety suggestions and driving improvement suggestions, the display device 800 is further configured to: collect driving data of the vehicle, and determine first event data and second event data corresponding to the key event according to the driving data, the first event data and the second event data being partially the same; determine the driving safety score and the driving safety suggestion according to the first event data and a corresponding weight, the driving safety suggestion being determined by the key event; and / or determine the driving habit score and the driving improvement suggestion according to the second event data and a corresponding weight, the driving improvement suggestion being determined by the key event.

[0114] In some embodiments of the present disclosure, the suggestion feedback includes vehicle maintenance suggestions, the display device 800 is further configured to: determine a target wear coefficient according to the driving safety score, the driving habit score and the driving data, and determine equivalent wear data according to the target wear coefficient and the driving data; obtain historical wear data, and determine the vehicle maintenance suggestion according to the historical wear data and the equivalent wear data.

[0115] In some embodiments of the present disclosure, the display device 800 is further configured to: display, in the interface, a video playback for at least part of the key events in the trip, the video being captured by a camera in communication with the vehicle, the camera in communication with the vehicle being a camera of the vehicle itself and / or a camera of a third-party device in communication connection.

[0116] In some embodiments of the present disclosure, the event display module 810 is configured to: provide a timeline corresponding to at least part of the key events in the trip on the interface, the timeline representing time instants of the at least part of the key events; in response to a triggering operation on the timeline, display media data corresponding to at least part of the key events in the trip on the interface via a vehicle model.

[0117] In some embodiments of the present disclosure, the display apparatus 800 is further configured to: display a trajectory of the trip, the trajectory representing a path traveled by the vehicle.

[0118] As to the apparatus in the above embodiments, the specific manners in which the respective modules perform operations have been described in detail in the embodiments of the method, and thus will not be described in detail here.

[0119] The present disclosure also provides a vehicle comprising: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to execute the executable instructions stored in the memory to implement any of the display methods provided by the present disclosure.

[0120] The present disclosure also provides a computer-readable storage medium having stored thereon computer program instructions, which, when executed by a processor, implement the steps of the display method provided by the present disclosure.

[0121] Figure 9 is another block diagram of a display apparatus 900 according to an exemplary embodiment. For example, the apparatus 900 can be a mobile phone, computer, digital broadcast terminal, message communicator, game console, tablet device, medical device, fitness device, personal digital assistant, etc.

[0122] Referring to Figure 9 , the apparatus 900 can include one or more of the following components: a processing component 902, a memory 904, a power supply component 906, a multimedia component 908, an audio component 910, an input / output (I / O) interface 912, a sensor component 914, and a communication component 916.

[0123] The processing component 902 usually controls overall operations of the apparatus 900, such as operations associated with display, phone call, data communication, camera operation and recording operation. The processing component 902 can include one or more processors 920 to execute instructions to complete all or part of steps of the methods described above. Further, the processing component 902 can include one or more modules to facilitate interaction between the processing component 902 and other components. For example, the processing component 902 can include a multimedia module to facilitate the interaction between the multimedia component 908 and the processing component 902.

[0124] Memory 904 is configured to store various types of data to support operations of the device 900. Examples of such data include instructions for any application or methods operating on the device 900, contact data, phonebook data, messages, pictures, videos, and so on. The memory 904 can be implemented by any type of volatile or nonvolatile storage devices or a combination thereof such as static random access memory (SRAM), electrically erasable programmable read only memory (EEPROM), erasable programmable read only memory (EPROM), programmable read only memory (PROM), read only memory (ROM), magnetic memory, flash memory, magnetic disks, or optical disks.

[0125] The power supply component 906 supplies electrical power for the various components of the device 900. The power supply component 906 can include a power supply management system, one or more power supplies, and other components associated with generating, managing and distributing electrical power for the device 900.

[0126] The multimedia component 908 includes a screen providing an output interface between the device 900 and the user. In some embodiments, the screen includes a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, swiping and gestures on the touch panel. The touch sensors can not only sense a boundary of a touch or swiping action, but also detect duration and pressure associated with the touch or swiping action. In some embodiments, the multimedia component 908 includes a front camera and / or a rear camera. The front camera and / or the rear camera can receive external multimedia data when the device 900 is in an operation mode, such as a shooting mode or a video mode. Each of the front and rear camera can be a fixed optical lens system or have a focal length and optical zoom capability.

[0127] The audio component 910 is configured to output and / or input audio signals. For example, the audio component 910 includes a microphone (MIC) to receive an external audio signal when the device 900 is in an operation mode, such as a calling mode, a recording mode and a voice recognition mode. The received audio signal can be further stored in the memory 904 or transmitted via the communication component 916. In some embodiments, the audio component 910 also includes a speaker for outputting an audio signal.

[0128] The input / output interface 912 provides an interface between the processing component 902 and peripheral interface modules, which can be a keyboard, a click wheel, buttons, and so on. The buttons can include, but are not limited to, a home button, a volume button, a start button, and a lock button.

[0129] The sensor component 914 includes one or more sensors for providing status assessments for various aspects of the device 900. For example, the sensor component 914 can detect an open / closed position of the device 900, relative positioning of components of the device 900, such as a display and keypad of the device 900, a change in position of the device 900 or a component of the device 900, presence or absence of user contact with the device 900, orientation or acceleration / deceleration of the device 900, and temperature changes of the device 900. The sensor component 914 can include proximity sensor(s) configured to detect presence of nearby objects without any physical contact. The sensor component 914 can also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor component 914 can also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0130] The communication component 916 is configured to facilitate wired or wireless communication between the device 900 and another device. The device 900 can access a wireless network based on a communication standard, such as WiFi, 2G, or 3G, or a combination thereof. In an exemplary embodiment, the communication component 916 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 916 also includes a Near Field Communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technology.

[0131] In an exemplary embodiment, the device 900 can be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, micro-controllers, microprocessors, or other electronic components, for performing the above-described methods.

[0132] In an exemplary embodiment, a non-transitory computer-readable storage medium, such as the memory 904 including instructions, is also provided, which can be executed by the processor 920 of the device 900 to perform the above-described methods. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disc, and an optical data storage device, etc.

[0133] The apparatus described above can be a part of a standalone electronic device, for example, in an embodiment, the apparatus can be an integrated circuit (IC) or a chip, where the integrated circuit can be one IC or a collection of multiple ICs; the chip can include but is not limited to the following categories: GPU (Graphics Processing Unit), CPU (Central Processing Unit), FPGA (Field Programmable Gate Array), DSP (Digital Signal Processor), ASIC (Application Specific Integrated Circuit), SOC (System on Chip, SoC, System on a Chip or System Level Chip), etc. The integrated circuit or chip described above can be used to execute executable instructions (or code) to implement the display method described above. Wherein the executable instructions can be stored in the integrated circuit or chip, or obtained from other devices or equipment, for example, the integrated circuit or chip includes a processor, a memory, and an interface for communicating with other devices. The executable instructions can be stored in the memory, and when the executable instructions are executed by the processor, the display method described above is implemented; or the integrated circuit or chip can receive executable instructions through the interface and transmit them to the processor for execution to implement the above method.

[0134] In another exemplary embodiment, a computer program product is also provided, which includes a computer program capable of being executed by a programmable device, and the computer program has a code portion for executing the display method described above when executed by the programmable device.

[0135] Figure 10 is another block diagram of an apparatus 1000 for displaying according to an exemplary embodiment. For example, the apparatus 1000 can be provided as a server. Referring to Figure 10 , the apparatus 1000 includes a processing component 1022, which further includes one or more processors, and a memory resource represented by a memory 1032, for storing instructions executable by the processing component 1022, such as an application program. The application program stored in the memory 1032 can include one or more than one module each corresponding to a set of instructions. In addition, the processing component 1022 is configured to execute instructions to perform the display method described above.

[0136] The apparatus 1000 can also include a power supply component 1026 configured to perform power management for the apparatus 1000, a wired or wireless network interface 1050 configured to connect the apparatus 1000 to a network, and an input / output interface 1058. The apparatus 1000 can operate based on an operating system stored in the memory 1032.

[0137] In another exemplary embodiment, the present disclosure also provides a computer program product containing a computer program capable of being executed by a programmable apparatus, the computer program having code portions for performing, when executed by the programmable apparatus, a method of displaying provided by the present disclosure.

[0138] Other embodiments of the present disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the present disclosure. The present disclosure is intended to cover any variations, uses, or adaptations of the present disclosure following, in general, the principles of the present disclosure and including such

[0139] It is to be understood that the present disclosure is not limited to the precise construction described above and shown in the attached drawings, and that various modifications and changes can be made by those skilled in the art without departing from the scope of the present disclosure. The scope of the present disclosure is limited only by the claims that follow.

Claims

1. A display method characterized by comprising: The method comprises: in response to a triggering operation of a trip review, displaying, on an interface, media data corresponding to at least part of a key event in a trip by a vehicle model, the key event comprising at least one of a traffic conflict, a traffic accident, normal driving behavior, dangerous driving behavior, vehicle failure or anomaly, sudden road conditions, and extreme weather, the media data comprising at least one of image data and sound data.

2. The display method according to claim 1, wherein The triggering operation of the trip review comprises one of arrival of the vehicle at a destination, gesture interaction with the interface, and voice interaction with the vehicle.

3. The display method according to claim 1, wherein The displaying, on the interface, of the media data corresponding to the at least part of the key event in the trip by the vehicle model comprises: displaying, on the interface, a vehicle model animation corresponding to the at least part of the key event in the trip by the vehicle model.

4. The display method according to claim 1, wherein The method further comprises: displaying, on the interface, a description of the at least part of the key event in the trip, the description comprising at least one of a name of the at least one key event, a number of occurrences of the at least one key event in the trip, a key parameter corresponding to the at least one key event, a suggested feedback on the at least one key event, a driving habit score on a driving level of the trip, and a driving safety score on a driving safety of the trip.

5. The display method according to claim 4, wherein The method further comprises: voice playing of the description.

6. The display method according to claim 4, wherein The method further comprises: providing, on the interface, a suggestion control corresponding to the suggested feedback; in response to a triggering operation on the suggestion control, executing the suggested feedback.

7. The display method according to claim 4, wherein The method further comprises: providing, on the interface, a storage control corresponding to the description; in response to a triggering operation on the storage control, storing the description for sharing and / or viewing.

8. The display method according to claim 4, wherein The suggested feedback comprises a driving safety suggestion and a driving improvement suggestion, The method further comprises: collecting driving data of the vehicle, and determining, from the driving data, first event data and second event data corresponding to the key event, the first event data and the second event data being partially the same; determining, from the first event data and a corresponding weight, the driving safety score and the driving safety suggestion, the driving safety suggestion being determined from the key event; and / or determining, from the second event data and a corresponding weight, the driving habit score and the driving improvement suggestion, the driving improvement suggestion being determined from the key event.

9. The display method according to claim 8, wherein The suggested feedback comprises a vehicle maintenance suggestion, The method further comprises: determining, from the driving safety score, the driving habit score, and the driving data, a target wear coefficient, and determining, from the target wear coefficient and the driving data, equivalent wear data; obtaining historical wear data, and determining, from the historical wear data and the equivalent wear data, the vehicle maintenance suggestion.

10. The display method according to claim 1, wherein The method further comprises: displaying, on an interface, a video playback for the at least part of the key event in the trip, the video being captured by a camera in communication with the vehicle, the camera in communication with the vehicle being a camera of the vehicle itself and / or a camera of a third-party device in communication connection.

11. The display method according to claim 1, wherein The displaying the media data corresponding to the at least part of the key events in the trip on the interface through the vehicle model comprises: providing a timeline corresponding to the at least part of the key events in the trip on the interface, the timeline representing time instants of the at least part of the key events; in response to a triggering operation acting on the timeline, displaying the media data corresponding to the at least part of the key events in the trip on the interface through the vehicle model.

12. The display method according to claim 1, wherein The method further comprises: displaying a trajectory of the trip, the trajectory representing a path traveled by the vehicle.

13. A display device comprising: comprises: an event display module configured to, in response to a triggering operation of a trip review, display media data corresponding to at least part of key events in the trip on the interface through a vehicle model, the key events at least including one of a traffic conflict, a traffic accident, normal driving behavior, dangerous driving behavior, vehicle failure or anomaly, sudden road conditions, and extreme weather, and the media data at least including one of image data and sound data.

14. The display device of claim 13, wherein, The triggering operation of the trip review comprises one of the vehicle reaching a destination, gesture interaction with the interface, and voice interaction with the vehicle.

15. The display device of claim 13, wherein, The display device is further configured to: display, on the interface, an animation of the vehicle model corresponding to the at least part of the key events in the trip through the vehicle model.

16. The display device of claim 13, wherein, The display device is further configured to: display, on the interface, a description of the at least part of the key events in the trip, the description at least including one of a name of at least one key event, a number of occurrences of the at least one key event in the trip, a key parameter corresponding to the at least one key event, a suggested feedback on the at least one key event, a driving habit score of a driving level of the trip, and a driving safety score of a driving safety of the trip.

17. The display device of claim 13, wherein, The display device is further configured to: display, on the interface, a video playback for the at least part of the key events in the trip, the video being captured by a camera in communication with the vehicle, the camera in communication with the vehicle being a camera of the vehicle itself and / or a camera of a third-party device communicatively connected.

18. A vehicle characterized by comprising: comprises: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to execute the executable instructions stored in the memory to implement steps of the method of any one of claims 1-12.

19. A computer-readable storage medium having stored thereon computer program instructions, wherein, The program instructions, when executed by the processor, implement steps of the method of any one of claims 1-12.

20. An electronic device, comprising: comprises: a memory having stored thereon a computer program; a processor for executing the computer program in the memory to implement steps of the method of any one of claims 1-12.

Images