Driving feedback method and device and vehicle-mounted equipment

Abstract

The invention discloses a driving feedback method and device and vehicle-mounted equipment. The method comprises the following steps: acquiring information of a pedal of the vehicle, wherein the information of the pedal comprises information of an accelerator pedal and information of a brake pedal; outputting vehicle state feedback information matched with at least one of the information of the accelerator pedal and the information of the brake pedal, wherein the vehicle state feedback information is used for indicating at least one of the state of the accelerator pedal and the state of the brake pedal. The output vehicle state feedback information can be visual and / or auditory, and by providing visual and auditory feedback during driving of a driver, stepping on an acceleration / brake pedal by the driver is distinguished, slow / fast acceleration of the vehicle is distinguished, and input / output of energy of the vehicle is distinguished. And establishing a relationship between operation and auditory and visual feedback for the driver. According to the method, visual and / or auditory feedback information can be recorded, and the visual and / or auditory feedback information output by the vehicle can be stored.

Description

Technical Field

[0001] The present application relates to the field of automobile technology, and in particular to a driving feedback method and device, and a vehicle-mounted device. Background Art

[0002] With the development of electric vehicle technology, electric vehicles are becoming more and more popular. After drivers switch from driving fuel vehicles to electric vehicles, they are prone to driving inconvenience or even accidents due to differences in the vehicle's pedal design.

[0003] Because electric vehicles have a kinetic energy recovery system, when the accelerator pedal is released but still open, the electric vehicle will be in a deceleration state. This is different from a fuel vehicle that will only be in a deceleration state when the brake pedal is open.

[0004] The above-mentioned differences between electric vehicles and fuel vehicles result in poor driving feedback for drivers when driving electric vehicles, and they are prone to mistaking the accelerator pedal for the brake pedal, which in turn causes the accelerator pedal to be accidentally stepped on when braking is needed. Summary of the invention

[0005] The present application provides a driving feedback method and device, and a vehicle-mounted device. The method can provide feedback on the driver's operation of the pedal, establish a relationship between the operation and the auditory and visual feedback for the driver, and then quickly familiarize the driver with the vehicle control logic, strengthen the pre-awareness and memory, reduce the chance of accidentally stepping on the accelerator, and improve driving safety.

[0006] In a first aspect, the present application provides a driving feedback method. The method includes: obtaining information of a vehicle pedal, the pedal information including information of an accelerator pedal and information of a brake pedal; outputting vehicle state feedback information matching at least one of the accelerator pedal information and the brake pedal information, the vehicle state feedback information being used to indicate at least one of the state of the accelerator pedal and the state of the brake pedal.

[0007] In this implementation, by acquiring information about the vehicle's pedals during driving, and then outputting vehicle status feedback information that can indicate at least one of the status of the accelerator pedal and the status of the brake pedal, it is possible to provide feedback on the driver's operation of the pedals, thereby establishing a relationship between the operation and the auditory and visual feedback for the driver, thereby quickly becoming familiar with the vehicle's control logic, strengthening pre-awareness and memory, reducing the chance of accidentally stepping on the accelerator, and improving driving safety.

[0008] In an implementation of the present application, the accelerator pedal information includes the accelerator pedal depression depth, and the brake pedal information includes the brake pedal depression depth.

[0009] In the implementation of the present application, outputting vehicle state feedback information that matches at least one of the accelerator pedal information and the brake pedal information includes the following situations:

[0010] The first one is that when the accelerator pedal depression depth is greater than 0 and the vehicle's driving speed and the accelerator pedal depression depth do not exceed corresponding thresholds, a first indication information is output, and the first indication information is used to indicate that the accelerator pedal is in a power output state.

[0011] The first situation is that the driver steps on the accelerator pedal at a slow speed, or the vehicle is traveling at a slow speed.

[0012] The second type is to output second indication information when at least one of the vehicle's running speed and the accelerator pedal depression depth exceeds a corresponding threshold value, and the second indication information is used to indicate that the accelerator pedal is in a high-power driving state.

[0013] The second situation is that the vehicle has a large output power, which is manifested by a high speed or a large accelerator pedal depth. The vehicle's speed is obtained from the vehicle speed sensor in the vehicle. The second situation allows the driver to become familiar with the cockpit feedback screen provided when the vehicle has a high power output. If it is normal driving, it is a driving feedback. If it is an accidental accelerator pedal operation, it serves as a reminder.

[0014] In the second case, there are many ways to set the above threshold, for example:

[0015] In the first method, the threshold value adopts a fixed value. For example, the threshold value corresponding to the vehicle's driving speed is set to 110 km / h, and the threshold value corresponding to the accelerator pedal depression depth is set to 75% of the maximum accelerator pedal depth or the pedal depth corresponding to 75% of the vehicle's maximum power.

[0016] In the second method, the threshold value will adaptively change according to the driver's driving record so that the number of times the driver triggers the second indication information each day will not be too many or too few, thereby achieving the effect of establishing the driver's correct operating awareness through feedback.

[0017] Exemplarily, the method may include: determining thresholds corresponding to the vehicle's driving speed and accelerator pedal depression depth based on the vehicle's historical accelerator pedal depression depth data and the vehicle's historical driving speed data, so that the number of times the second indication information is output in each cycle is within a preset number range.

[0018] Among them, the historical accelerator pedal depression depth data and the historical driving speed data of the vehicle are data that are periodically collected and saved during the driving process of the vehicle. The data may be time-sensitive, such as one week or one month.

[0019] When determining the threshold based on the above historical data, a threshold can be determined so that the average number of times the second indication information is triggered in the data corresponding to the historical records within a period is within a preset number range. The period can be every day, and the preset number range is, for example, greater than 0 and less than 3, and the range is set to 1-2 times per day. For example, the threshold is determined by adaptively determining the second indication information so that the second indication information is triggered once a day.

[0020] The above-mentioned adaptive threshold determination scheme can provide each driver with an adaptive threshold, so that the driver can basically trigger the second indication information a certain number of times every day while driving, matching his driving habits, and will neither trigger it frequently nor basically not trigger it, thus becoming familiar with the vehicle feedback system.

[0021] The third type is to output third indication information when the accelerator pedal is depressed to a reduced depth, where the third indication information is used to indicate that the accelerator pedal is in a kinetic energy recovery deceleration state.

[0022] The third situation is usually when the driver releases the accelerator pedal, the accelerator pedal depression depth decreases, the brake pedal depression depth is 0, and the vehicle recovers kinetic energy and decelerates.

[0023] A fourth type is when the brake pedal is stepped on with a depth greater than 0, outputting fourth indication information, the fourth indication information being used to indicate that the brake pedal is in a braking state.

[0024] The fourth situation is when the driver steps on the brake pedal. As long as the brake pedal is stepped on, it is considered to be in this state. Usually, the fourth situation occurs after the third situation, that is, after the accelerator pedal is completely released, the vehicle will automatically recover kinetic energy according to the set recovery power. At this time, when the brake pedal is stepped on, the kinetic energy recovery feedback screen is synchronized with the brake pedal feedback.

[0025] In this implementation, the vehicle feeds back the above-mentioned indication information, and establishes the driver's correct operating awareness through feedback, thereby reducing the probability of accidentally stepping on the accelerator.

[0026] In some possible implementations of the present application, the vehicle status feedback information is only used to indicate one of the status of the accelerator pedal and the status of the brake pedal.

[0027] For example, by feeding back acceleration images or sounds when pressing the accelerator pedal, feeding back kinetic energy recovery images or sounds when releasing the accelerator pedal, and feeding back braking images or sounds when pressing the brake pedal, the driver can distinguish different working conditions through different images or sounds, thus avoiding the problem in related technologies that the driver has difficulty distinguishing between the two working conditions of releasing the accelerator to slow down and lightly pressing the brake to slow down.

[0028] In some other possible implementations of the present application, the vehicle status feedback information is used to indicate the status of the accelerator pedal and the status of the brake pedal.

[0029] In this implementation, the vehicle status feedback information indicates the status of both pedals simultaneously, allowing the driver to more intuitively determine the pedal depression status, better establish the relationship between operation and auditory and visual feedback, and avoid accidental depression of the accelerator pedal.

[0030] In the implementation of the present application, the vehicle status feedback information includes visual feedback information, which includes text, icons, animations, and the like.

[0031] When icons are used as visual feedback information, less resources are occupied, and the icon form can facilitate the driver to establish a relationship between operation and visual feedback.

[0032] When icons are used as visual feedback information, the vehicle status feedback information may include one or more icons.

[0033] For example, the vehicle status feedback information includes an acceleration feedback icon, a kinetic energy recovery feedback icon, and a braking feedback icon.

[0034] Among them, the acceleration feedback icon is used to indicate whether the state of the accelerator pedal is in the power output state or the high-power drive state;

[0035] The kinetic energy recovery feedback icon is used to indicate whether the accelerator pedal is in the kinetic energy recovery deceleration state;

[0036] The brake feedback icon is used to indicate whether the accelerator pedal is in the braking state by pressing the brake pedal.

[0037] In this implementation, different icons are used to reflect whether the pedal is in different states, which can provide the driver with intuitive status feedback.

[0038] In one example, the acceleration feedback icon, the kinetic energy recovery feedback icon, and the braking feedback icon are an acceleration feedback bar, a kinetic energy recovery feedback bar, and a braking feedback bar, respectively.

[0039] In the power output state, the length of the acceleration feedback bar is greater than 0, and the length of the acceleration feedback bar corresponds to the depth of the accelerator pedal. The lengths of the kinetic energy recovery feedback bar and the brake feedback bar are both 0.

[0040] In the high-power driving state, the length of the acceleration feedback bar is greater than 0, the length of the acceleration feedback bar corresponds to the depth of the accelerator pedal, and the acceleration feedback bar has an indicator indicating emergency acceleration. The lengths of the kinetic energy recovery feedback bar and the brake feedback bar are both 0.

[0041] In the kinetic energy recovery deceleration state, the length of the kinetic energy recovery feedback bar is greater than 0, and the length of the kinetic energy recovery feedback bar corresponds to the strength of the kinetic energy recovery. The lengths of the acceleration feedback bar and the braking feedback bar are both 0.

[0042] When the brake pedal is pressed, the length of the brake feedback bar is greater than 0, and the length of the brake feedback bar corresponds to the depth of the brake pedal. The length of the kinetic energy recovery feedback bar is greater than or equal to 0, and the length of the kinetic energy recovery feedback bar corresponds to the strength of the kinetic energy recovery. The length of the acceleration feedback bar is 0.

[0043] In the above example, these icons can not only indicate the pedal status, but also indicate the pedal depression depth and other contents, making it easier for the driver to use this information as a reference while driving.

[0044] In other examples, the acceleration feedback icon, the kinetic energy recovery feedback icon, and the braking feedback icon may also adopt other shapes, such as curves, rings, etc.

[0045] In other examples, the acceleration feedback icon, kinetic energy recovery feedback icon and brake feedback icon may also be implemented in other ways, such as using different pattern deformations of the same icon to distinguish different states, or using different colors of the same icon to distinguish different states.

[0046] In the implementation of the present application, the vehicle status feedback information includes auditory feedback information, which includes voice, fuel vehicle simulation sound, etc.

[0047] Among them, voice refers to the voice broadcast of the pedal status. The fuel vehicle simulation sound refers to the sound effect that is the same or similar to the sound inside the vehicle when the pedal of a fuel vehicle is in different states.

[0048] The vehicle status feedback information includes vehicle status feedback sounds corresponding to different states of the accelerator pedal and different states of the brake pedal, respectively. The vehicle status feedback sounds here can be the aforementioned voice or fuel vehicle simulation sound.

[0049] In this implementation, different vehicle status feedback sounds are used to reflect different status of the pedals, thereby providing the driver with intuitive status feedback.

[0050] In one example, the vehicle status feedback information includes one of visual and auditory feedback information.

[0051] In another example, the vehicle status feedback information includes both visual and auditory feedback information. By outputting visual and auditory feedback information to the driver at the same time, the driver can obtain more comprehensive feedback, providing conditions for the driver to better establish the relationship between operation and auditory and visual feedback.

[0052] When the vehicle status feedback information includes visual feedback information, the visual feedback information may be output via at least one of the central control screen and the instrument screen.

[0053] When the vehicle includes a head up display (HUD), the visual feedback information may also be output via the HUD.

[0054] For example, the acceleration feedback icon, the kinetic energy recovery feedback icon, and the braking feedback icon are output through at least one of the vehicle's central control screen and the instrument screen.

[0055] Optionally, the method further includes: when at least one of the vehicle's driving speed and the accelerator pedal depression depth exceeds a corresponding threshold, acquiring screen data of at least one of the central control screen and the instrument screen, and saving the acquired screen data.

[0056] In this implementation, the images of the central control screen and the instrument screen are saved as evidence to clarify the accidental stepping on the accelerator pedal. On the one hand, compared with the black box data in the related art, the saved image data can be played directly without restoration, and the images that can be displayed are more intuitive; on the other hand, the images are simple and easy to understand; on the other hand, since the driver has established the relationship between operation and visual feedback through the vehicle status feedback information, he is familiar with the visual feedback information displayed on the central control screen and the instrument screen, so the image can improve the credibility.

[0057] For example, acceleration feedback icons, kinetic energy recovery feedback icons, and braking feedback icons are output through the vehicle's HUD.

[0058] Optionally, the method also includes: when at least one of the vehicle's driving speed and the accelerator pedal depression depth exceeds a corresponding threshold, obtaining display data of the HUD and saving the obtained display data, the display data including picture information and display setting information, the display setting information including at least one of projection height, projection angle, projection distance and projection brightness.

[0059] In this implementation, since the HUD is a virtual image and there is no physical display screen to carry it, what is saved is the display data of the HUD. The display data of the HUD can be restored through projection, thereby achieving the same function as the central control screen and instrument screen.

[0060] For example, when restoring the HUD screen, the stored HUD display data is directly imported into the vehicle-mounted HUD of the same model to restore the HUD screen. Among them, the screen information in the display data is responsible for screen generation, and the display setting information is responsible for the angle, height, projection distance and brightness control when the screen is projected.

[0061] Optionally, the method may further include: when the vehicle's driving speed exceeds the speed limit, controlling at least one of the vehicle's central control screen, instrument screen and HUD to change at least one of the backlight color and brightness.

[0062] For example, change the backlight color from white to a more warning color such as yellow or red, or increase the backlight brightness for prompting.

[0063] In this implementation, when the vehicle's speed exceeds the speed limit, the warning effect is enhanced by changing the backlight color and / or brightness. The speed limit is greater than a threshold corresponding to the vehicle's speed, such as 120 km / h.

[0064] When the vehicle status feedback information includes auditory feedback information, the auditory feedback information may be output through a speaker in the vehicle.

[0065] For example, the vehicle status feedback sound is output through a speaker in the vehicle.

[0066] Optionally, the method further includes: when at least one of the vehicle's driving speed and the accelerator pedal depression depth exceeds a corresponding threshold, recording the sound inside the vehicle and saving the recorded data.

[0067] In this implementation, the sound inside the vehicle is recorded, and the recording contains auditory feedback information of the high-power driving state, which can be used as evidence to clarify the accidental stepping on the accelerator pedal. On the one hand, compared with the black box data in the related technology, the saved recording data can be played directly without restoration, and the sound that can be displayed is more intuitive; on the other hand, the sound is simple and easy to understand; on the other hand, because the driver establishes the relationship between operation and auditory feedback through the vehicle status feedback information, he is familiar with the auditory feedback information in the recording, so the sound can improve the credibility.

[0068] Optionally, the method further includes: when at least one of the vehicle's driving speed and the accelerator pedal depression depth exceeds a corresponding threshold, turning on the in-vehicle monitoring camera to record and save the driver's control screen. Recording the driver's control screen provides a basis for subsequent restoration of the driving scene.

[0069] In the implementation of the present application, the start of recording operations such as images, information, and sounds is based on the vehicle speed and the accelerator pedal depression depth. Furthermore, the end of the recording operation and the processing of the recorded data can be as follows:

[0070] If the vehicle stops within 5 minutes of the start of recording, the recording ends when the vehicle stops. If a serious accident occurs within 5 minutes of the start of recording and the power is cut off, the recording ends just before the power is cut off. If the vehicle does not stop, the recording lasts for 5 minutes and then the recorded data is deleted. After the recorded data is deleted, the system starts to detect the conditions that trigger the recording next time.

[0071] Each time the vehicle restarts and the speed reaches 5 km / h or more, the recorded data is cleared and the next triggering condition for recording is detected. Alternatively, the vehicle periodically clears the recorded data.

[0072] In the case of an autonomous driving scenario, when the autonomous driving system issues an alarm and requires the driver to take over, it will also record operations such as screen recording / screenshot, saving data, turning on the vehicle camera, and recording. For example, it will record data for a period of time before and after the autonomous driving system requires the driver to take over.

[0073] In a second aspect, the present application provides a driving feedback device, the device comprising:

[0074] An acquisition unit, used to acquire information of a pedal of the vehicle, where the pedal information includes information of an accelerator pedal and information of a brake pedal;

[0075] The output unit is used to output vehicle status feedback information matching at least one of the information of the accelerator pedal and the information of the brake pedal, wherein the vehicle status feedback information is used to indicate at least one of the status of the accelerator pedal and the status of the brake pedal.

[0076] Optionally, the accelerator pedal information includes the accelerator pedal depression depth, and the brake pedal information includes the brake pedal depression depth.

[0077] Optionally, an output unit is used to:

[0078] When the accelerator pedal depression depth is greater than 0 and the vehicle's driving speed and the accelerator pedal depression depth do not exceed the corresponding threshold, output first indication information, the first indication information is used to indicate that the accelerator pedal is in a power output state; or,

[0079] When at least one of the vehicle's running speed and the accelerator pedal depression depth exceeds a corresponding threshold, outputting second indication information, the second indication information is used to indicate that the accelerator pedal is in a high-power driving state; or,

[0080] When the accelerator pedal is depressed to a reduced depth, a third indication information is output, where the third indication information is used to indicate that the accelerator pedal is in a kinetic energy recovery deceleration state; or,

[0081] When the brake pedal depression depth is greater than 0, fourth indication information is output, and the fourth indication information is used to indicate that the brake pedal is in a braking state of the brake pedal being depressed.

[0082] Optionally, the device further comprises:

[0083] The determination unit is used to determine the threshold values ​​corresponding to the vehicle's driving speed and the accelerator pedal depression depth based on the vehicle's historical accelerator pedal depression depth data and the vehicle's historical driving speed data, so that the number of times the second indication information is output in each cycle is within a preset number range.

[0084] Optionally, the vehicle status feedback information includes an acceleration feedback icon, a kinetic energy recovery feedback icon, and a braking feedback icon;

[0085] The acceleration feedback icon is used to indicate whether the accelerator pedal is in power output state or high-power drive state;

[0086] The kinetic energy recovery feedback icon is used to indicate whether the accelerator pedal is in the kinetic energy recovery deceleration state;

[0087] The brake feedback icon is used to indicate whether the accelerator pedal is in the braking state by pressing the brake pedal.

[0088] Optionally, the output unit includes at least one of a central control screen and an instrument screen of the vehicle.

[0089] Optionally, the device further comprises a first storage unit,

[0090] an acquisition unit, configured to acquire picture data of at least one of a central control screen and an instrument screen when at least one of a vehicle's running speed and an accelerator pedal depression depth exceeds a corresponding threshold;

[0091] The first storage unit is used to store the acquired picture data.

[0092] Optionally, the output unit comprises a head-up display HUD of the vehicle.

[0093] Optionally, the device further comprises a first storage unit,

[0094] an acquisition unit, configured to acquire display data of the HUD when at least one of the vehicle's driving speed and the accelerator pedal depression depth exceeds a corresponding threshold, the display data including picture information and display setting information, the display setting information including at least one of a projection height, a projection angle, a projection distance, and a projection brightness;

[0095] The first storage unit is used to store the acquired display data.

[0096] Optionally, the device further comprises:

[0097] A control unit is used to control at least one of the central control screen, instrument screen and HUD of the vehicle to change at least one of the backlight color and brightness when the vehicle's running speed exceeds the speed limit.

[0098] Optionally, the vehicle state feedback information includes vehicle state feedback sounds corresponding to different states of the accelerator pedal and different states of the brake pedal, respectively.

[0099] Optionally, the device further comprises a recording unit and a second storage unit;

[0100] a recording unit, configured to record the sound inside the vehicle when at least one of the vehicle's driving speed and the accelerator pedal depression depth exceeds a corresponding threshold;

[0101] The second storage unit is used to store the recording data.

[0102] In one example, the first storage unit and the second storage unit may be the same storage unit. In another example, the first storage unit and the second storage unit may be different storage units.

[0103] Optionally, the device further comprises:

[0104] The monitoring unit is used to activate the in-vehicle monitoring camera, record and save the driver's control screen when at least one of the vehicle's driving speed and the accelerator pedal depression depth exceeds the corresponding threshold.

[0105] In a third aspect, a vehicle-mounted device is provided. The vehicle-mounted device includes a processor, and the processor is coupled to a memory. The memory is used to store software programs and modules. The processor implements the method in the first aspect or any possible implementation of the first aspect by running or executing the software program and / or module stored in the memory.

[0106] Optionally, the number of the processors is one or more, and the number of the memories is one or more.

[0107] Optionally, the memory may be integrated with the processor, or the memory may be provided separately from the processor.

[0108] In the specific implementation process, the memory can be a non-transitory memory, such as a read-only memory (ROM), which can be integrated with the processor on the same chip or can be set on different chips. This application does not limit the type of memory and the setting method of the memory and the processor.

[0109] In a fourth aspect, a computer program product is provided, wherein the computer program product comprises computer program code, and when the computer program code is executed by a computer, the computer executes the method in the first aspect or any possible implementation of the first aspect.

[0110] In a fifth aspect, the present application provides a computer-readable storage medium, wherein the computer-readable storage medium is used to store program codes executed by a processor, wherein the program codes include a method for implementing any possible implementation of the first aspect above.

[0111] In a sixth aspect, a chip is provided, comprising a processor, the processor being used to call and execute instructions stored in a memory from the memory, so that a vehicle-mounted device equipped with the chip executes a method in any possible implementation manner of the above-mentioned first aspect.

[0112] In a seventh aspect, another chip is provided. The another chip includes an input interface, an output interface, a processor, and a memory. The input interface, the output interface, the processor, and the memory are connected via an internal connection path. The processor is used to execute the code in the memory, and when the code is executed, the processor is used to execute the method in any possible implementation of the first aspect above.

[0113] In an eighth aspect, a vehicle is provided, wherein the vehicle comprises the device in the second aspect or any possible implementation manner of the second aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0114] Figure 1 is a flow chart of a driving feedback method provided in an embodiment of the present application;

[0115] Figure 2 is a flow chart of a driving feedback method provided in an embodiment of the present application;

[0116] Figure 3 This is a schematic diagram of a pedal stepping depth signal transmission provided by an embodiment of the present application;

[0117] Figure 4 It is a schematic diagram of a brake feedback icon provided in an embodiment of the present application;

[0118] Figure 5 This is a schematic diagram of obtaining screen data provided by an embodiment of the present application;

[0119] Figure 6 is a flow chart of a driving feedback method provided in an embodiment of the present application;

[0120] Figure 7 is a block diagram of a driving feedback device provided in an embodiment of the present application;

[0121] Figure 8 It is a structural schematic diagram of a vehicle-mounted device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0122] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below with reference to the accompanying drawings.

[0123] Figure 1 is a flow chart of a driving feedback method provided by an embodiment of the present application. The method may be executed by a vehicle controller, such as a vehicle computer controller, or a vehicle display controller, HUD controller and / or audio controller. Figure 1 , the method may include the following steps:

[0124] S101: Acquire information of pedals of a vehicle.

[0125] The pedal information includes the information of the accelerator pedal (ie, the gas pedal) and the information of the brake pedal.

[0126] S102: Output vehicle state feedback information that matches at least one of the accelerator pedal information and the brake pedal information.

[0127] The vehicle status feedback information is used to indicate at least one of a status of an accelerator pedal and a status of a brake pedal.

[0128] In this implementation, by acquiring information about the vehicle's pedals during driving, and then outputting vehicle status feedback information that can indicate at least one of the status of the accelerator pedal and the status of the brake pedal, it is possible to provide feedback on the driver's operation of the pedals, thereby establishing a relationship between the operation and the auditory and visual feedback for the driver, thereby quickly becoming familiar with the vehicle's control logic, strengthening pre-awareness and memory, reducing the chance of accidentally stepping on the accelerator, and improving driving safety.

[0129] In the implementation of the present application, outputting vehicle state feedback information that matches at least one of the accelerator pedal information and the brake pedal information includes the following situations:

[0130] The first one is that when the accelerator pedal depression depth is greater than 0 and the vehicle's driving speed and the accelerator pedal depression depth do not exceed corresponding thresholds, a first indication information is output, and the first indication information is used to indicate that the accelerator pedal is in a power output state.

[0131] The first situation is that the driver steps on the accelerator pedal at a slow speed, or the vehicle is traveling at a slow speed.

[0132] In the embodiment of the present application, the depth of the pedal in a natural state is the smallest, and the minimum depth is 0. As the driver steps on the pedal, the depth of the pedal gradually increases. When the pedal is stepped on to the bottom, the depth of the pedal is the largest.

[0133] The second type is to output second indication information when at least one of the vehicle's running speed and the accelerator pedal depression depth exceeds a corresponding threshold value, and the second indication information is used to indicate that the accelerator pedal is in a high-power driving state.

[0134] The high-power driving state refers to a situation where the acceleration of the vehicle increases to a large value in a short period of time, which may cause danger if the accelerator pedal is stepped on by mistake. The high-power driving state is defined by a speed threshold corresponding to the vehicle's driving speed and a depth threshold corresponding to the accelerator pedal stepping depth.

[0135] The second situation is that the output power of the vehicle is large, which is manifested as a high vehicle speed or a large accelerator pedal depth of the vehicle. The vehicle's running speed is obtained by a vehicle speed sensor in the vehicle.

[0136] The second situation requires both the speed and depth of the accelerator pedal. If there is only speed but no depth, it is not a high-power driving state. The main purpose of this state is to make the driver familiar with the vehicle's feedback during emergency acceleration. If the accelerator pedal is not stepped on by mistake, the image and / or sound output in this state is normal operation feedback. If the accelerator pedal is indeed stepped on by mistake, it will serve as a prompt.

[0137] In the second case, there are many ways to set the above threshold, for example:

[0138] In the first method, the threshold value adopts a fixed value. For example, the threshold value corresponding to the vehicle's driving speed is set to 110 km / h, and the threshold value corresponding to the accelerator pedal depression depth is set to 75% of the maximum accelerator pedal depth or the pedal depth corresponding to 75% of the vehicle's maximum power.

[0139] In the second method, the threshold value will adaptively change according to the driver's driving record so that the number of times the driver triggers the second indication information each day will not be too many or too few, thereby achieving the effect of establishing the driver's correct operating awareness through feedback.

[0140] Exemplarily, the method may include: determining thresholds corresponding to the vehicle's driving speed and accelerator pedal depression depth based on the vehicle's historical accelerator pedal depression depth data and the vehicle's historical driving speed data, so that the number of times the second indication information is output in each cycle is within a preset number range.

[0141] Among them, the historical accelerator pedal depression depth data and the historical driving speed data of the vehicle are data that are periodically collected and saved during the driving process of the vehicle. The data may be time-sensitive, such as one week or one month.

[0142] When determining the threshold based on the above historical data, a threshold can be determined so that the average number of times the second indication information is triggered in the data corresponding to the historical records within a period is within a preset number range. The period can be every day, and the preset number range is, for example, greater than 0 and less than 3, and the range is set to 1-2 times per day, for example, limited to 1 time.

[0143] The above-mentioned adaptive threshold determination scheme can provide each driver with an adaptive threshold, so that the driver can basically trigger the second indication information a certain number of times every day while driving, matching his driving habits, and will neither trigger it frequently nor basically not trigger it, thus becoming familiar with the vehicle feedback system.

[0144] The third type is to output third indication information when the accelerator pedal is depressed to a reduced depth, where the third indication information is used to indicate that the accelerator pedal is in a kinetic energy recovery deceleration state.

[0145] The third situation is usually when the driver releases the accelerator pedal, the accelerator pedal depression depth decreases, the brake pedal depression depth is 0, and the vehicle recovers kinetic energy and decelerates. When the accelerator pedal is completely released, the intensity of kinetic energy recovery is the highest.

[0146] A fourth type is when the brake pedal is stepped on with a depth greater than 0, outputting fourth indication information, the fourth indication information being used to indicate that the brake pedal is in a braking state.

[0147] The fourth situation is when the driver steps on the brake pedal. As long as the brake pedal is stepped on, it is considered to be in this state. Usually, the fourth situation occurs after the third situation, that is, after the accelerator pedal is completely released, the vehicle will automatically recover kinetic energy according to the set recovery power. At this time, when the brake pedal is stepped on, the kinetic energy recovery feedback screen is synchronized with the brake pedal feedback.

[0148] In some possible implementations of the present application, the vehicle status feedback information is only used to indicate one of the status of the accelerator pedal and the status of the brake pedal.

[0149] For example, by feeding back acceleration images or sounds when pressing the accelerator pedal, feeding back kinetic energy recovery images or sounds when releasing the accelerator pedal, and feeding back braking images or sounds when pressing the brake pedal, the driver can distinguish different working conditions through different images or sounds, thus avoiding the problem in related technologies that the driver has difficulty distinguishing between the two working conditions of releasing the accelerator to slow down and lightly pressing the brake to slow down.

[0150] Of course, the above four situations are only examples, and in other implementations, more or fewer situations may be included. For example, when more situations are included, the situation corresponding to the out-of-control state on slippery roads is also included.

[0151] In some other possible implementations of the present application, the vehicle status feedback information is used to indicate the status of the accelerator pedal and the status of the brake pedal.

[0152] In this implementation, the vehicle status feedback information indicates the status of both pedals simultaneously, allowing the driver to more intuitively determine the pedal depression status, better establish the relationship between operation and auditory and visual feedback, and avoid accidental depression of the accelerator pedal.

[0153] In the implementation of the present application, the vehicle status feedback information includes visual feedback information, which includes text, icons, animations, and the like.

[0154] When icons are used as visual feedback information, less resources are occupied, and the icon form can facilitate the driver to establish a relationship between operation and visual feedback.

[0155] When icons are used as visual feedback information, the vehicle status feedback information may include one or more icons.

[0156] For example, the vehicle status feedback information includes an acceleration feedback icon, a kinetic energy recovery feedback icon, and a braking feedback icon.

[0157] In the implementation of the present application, the vehicle status feedback information includes auditory feedback information, which includes voice, fuel vehicle simulation sound, etc.

[0158] Among them, voice refers to the voice broadcast of the pedal status. The simulated sound of a fuel vehicle refers to the sound effect that is the same or similar to the sound inside the vehicle when the pedal of a fuel vehicle is in different states. For example, the roar of the engine generated by the acceleration of a fuel vehicle in the power output state, and the sound inside the vehicle when the brake pedal is stepped on, etc., focus on distinguishing the acceleration and deceleration process.

[0159] In one example, the vehicle status feedback information includes one of visual and auditory feedback information.

[0160] In another example, the vehicle status feedback information includes both visual and auditory feedback information. By outputting visual and auditory feedback information to the driver at the same time, the driver can obtain more comprehensive feedback, distinguish between the accelerator pedal and the brake pedal, distinguish between energy input (acceleration) and output (kinetic energy recovery), and distinguish between slow and fast acceleration, thus providing conditions for the driver to better establish the relationship between operation and auditory and visual feedback.

[0161] Combine the following Figure 2 and Figure 6Two implementation modes of outputting visual feedback information and outputting auditory feedback information are described respectively.

[0162] Figure 2 is a flow chart of a driving feedback method provided by an embodiment of the present application. The method may be executed by a vehicle controller, for example, by a vehicle computer controller, or by a vehicle display controller and / or HUD controller. Figure 2 , the method may include the following steps:

[0163] S201: Obtain information of the pedals of the vehicle.

[0164] The pedal information includes the accelerator pedal information and the brake pedal information.

[0165] In an implementation of the present application, the accelerator pedal information includes the accelerator pedal depression depth, and the brake pedal information includes the brake pedal depression depth.

[0166] The accelerator pedal stepping depth and the brake pedal stepping depth are obtained from the accelerator pedal pedal travel sensor and the brake pedal pedal travel sensor, respectively. The vehicle's driving speed is calculated based on the two acquired accelerator pedal stepping depths and the time interval.

[0167] Exemplarily, the controller obtains signals collected by two pedal travel sensors via a CAN bus to obtain an accelerator pedal stepping depth and a brake pedal stepping depth. The CAN bus may be a chassis CAN bus of the vehicle.

[0168] Figure 3 Schematic diagram of a pedal stepping depth signal transmission provided by an embodiment of the present application. Figure 3 As shown, the pedal travel sensor of the accelerator pedal and the pedal travel sensor of the brake pedal respectively send pedal depression depth signals to the vehicle gateway through the CAN bus, and the vehicle gateway then sends the pedal depression depth signal to the controller.

[0169] This method of transmitting the pedal depth signal is highly safe, and because the CAN bus performance can meet millisecond-level applications and has low latency, it can achieve real-time feedback on the pedal status during driving, consistent with the visual and auditory feedback speed brought by fuel vehicles.

[0170] S202: Outputting an acceleration feedback icon, a kinetic energy recovery feedback icon, and a brake feedback icon that match the information of the accelerator pedal and the information of the brake pedal.

[0171] Among them, the acceleration feedback icon is used to indicate whether the state of the accelerator pedal is in the power output state or the high-power drive state;

[0172] The kinetic energy recovery feedback icon is used to indicate whether the accelerator pedal is in the kinetic energy recovery deceleration state;

[0173] The brake feedback icon is used to indicate whether the accelerator pedal is in the braking state by pressing the brake pedal.

[0174] In this implementation, different icons are used to reflect whether the pedal is in different states, which can provide the driver with intuitive status feedback.

[0175] Figure 4 is a schematic diagram of a brake feedback icon provided in an embodiment of the present application. Figure 4 The acceleration feedback icon, kinetic energy recovery feedback icon and braking feedback icon are acceleration feedback bar A, kinetic energy recovery feedback bar B and braking feedback bar C respectively.

[0176] Among them, when the length of the acceleration feedback bar A (the black part) is 0, it indicates that it is not in a power output state or a high-power drive state; when the length of the acceleration feedback bar A is greater than 0 and there is no mark indicating emergency acceleration (arrow mark), it indicates that it is in a power output state; when the length of the acceleration feedback bar A is greater than 0 and there is a mark indicating emergency acceleration, it indicates that it is in a high-power drive state.

[0177] Among them, when the length of the kinetic energy recovery feedback bar B (the black part) is 0, it indicates that it is not in the kinetic energy recovery deceleration state; when the length of the kinetic energy recovery feedback bar B is greater than 0, it indicates that it is in the kinetic energy recovery deceleration state.

[0178] Among them, when the length of the brake feedback bar C (the black part) is 0, it indicates that the brake pedal is not in a braking state; when the length of the brake feedback bar C is greater than 0, it indicates that the brake pedal is in a braking state.

[0179] In the power output state, the length of the acceleration feedback bar is greater than 0, and the length of the acceleration feedback bar corresponds to the depth of the accelerator pedal. The lengths of the kinetic energy recovery feedback bar and the brake feedback bar are both 0.

[0180] In the high-power driving state, the length of the acceleration feedback bar is greater than 0, the length of the acceleration feedback bar corresponds to the depth of the accelerator pedal, and the acceleration feedback bar has an indicator indicating emergency acceleration. The lengths of the kinetic energy recovery feedback bar and the brake feedback bar are both 0.

[0181] In addition to providing feedback on the high-power driving state, the mark indicating emergency acceleration in the figure can also be used to provide feedback on the high-speed state. For example, when the vehicle speed exceeds 120 km / h, the acceleration feedback bar also has this mark.

[0182] In the kinetic energy recovery deceleration state, the length of the kinetic energy recovery feedback bar is greater than 0, and the length of the kinetic energy recovery feedback bar corresponds to the strength of the kinetic energy recovery. The lengths of the acceleration feedback bar and the braking feedback bar are both 0.

[0183] Since the strength of kinetic energy recovery needs to be determined in the kinetic energy recovery deceleration state, the method may further include: obtaining the strength of kinetic energy recovery. Exemplarily, the controller may obtain the strength of kinetic energy recovery from the motor controller. The path for obtaining the strength of kinetic energy recovery may be the same as the path for obtaining the pedal stepping depth signal, that is, the strength of kinetic energy recovery first passes through the CAN bus and then is sent to the controller by the vehicle gateway. This transmission method ensures signal security and low latency.

[0184] When the brake pedal is pressed, the length of the brake feedback bar is greater than 0, and the length of the brake feedback bar corresponds to the depth of the brake pedal. The length of the kinetic energy recovery feedback bar is greater than or equal to 0, and the length of the kinetic energy recovery feedback bar corresponds to the strength of the kinetic energy recovery. The length of the acceleration feedback bar is 0.

[0185] In the above example, these icons can not only indicate the pedal status, but also indicate the pedal depression depth and other contents, making it easier for the driver to use this information as a reference while driving.

[0186] exist Figure 4 In the implementation shown, the kinetic energy recovery feedback bar B and the brake feedback bar C are arranged side by side, and the acceleration feedback bar A is arranged separately, so that the acceleration feedback bar A can be highlighted, allowing the driver to better receive feedback on the power output status and high-power driving status during driving.

[0187] In other implementations, the acceleration feedback bar A, the kinetic energy recovery feedback bar B, and the brake feedback bar C may also be arranged in other ways, such as being arranged side by side, or being swapped. Figure 4 The position of the acceleration feedback bar A and the brake feedback bar C, etc.

[0188] In other examples, the acceleration feedback icon, the kinetic energy recovery feedback icon, and the braking feedback icon may also adopt other shapes, such as curves, rings, etc.

[0189] In other examples, the acceleration feedback icon, kinetic energy recovery feedback icon and brake feedback icon may also be implemented in other ways, such as using different pattern deformations of the same icon to distinguish different states, or using different colors of the same icon to distinguish different states.

[0190] When the vehicle status feedback information includes visual feedback information, the visual feedback information may be output via at least one of the central control screen and the instrument screen.

[0191] For example, the acceleration feedback icon, the kinetic energy recovery feedback icon, and the braking feedback icon are output through at least one of the vehicle's central control screen and the instrument screen.

[0192] When the vehicle includes a head up display (HUD), the visual feedback information can also be output through the HUD. The HUD image can be most directly transmitted to the driver, and the visual feedback effect is good.

[0193] For example, acceleration feedback icons, kinetic energy recovery feedback icons, and braking feedback icons are output through the vehicle's HUD.

[0194] When visual feedback information is output, it is output together with the original content of the central control screen, instrument screen or HUD.

[0195] Optionally, the function of the HUD outputting visual feedback information may be set as a switch, that is, the method may further include: receiving a switch selection signal, and turning on or off the function of the HUD outputting visual feedback information according to the switch selection signal.

[0196] Optionally, when the function of the HUD to output visual feedback information is turned off, in a high-power driving state, visual feedback information is still output through the vehicle's HUD, or prompts are output through the HUD in other ways.

[0197] S203: When at least one of the vehicle's running speed and the accelerator pedal depression depth exceeds a corresponding threshold, obtain screen data and / or display data, and save the obtained screen data and / or display data.

[0198] In a possible example, when at least one of the vehicle's driving speed and the accelerator pedal depression depth exceeds a corresponding threshold, image data of at least one of the central control screen and the instrument screen is acquired, and the acquired image data is saved.

[0199] That is, when at least one of the vehicle's driving speed and the accelerator pedal depression depth exceeds the corresponding threshold, the central control screen and / or the instrument screen is recorded or captured to obtain image data of at least one of the central control screen and the instrument screen.

[0200] Figure 5 Schematic diagram of obtaining screen data provided by an embodiment of the present application. Figure 5 , when the vehicle's speed exceeds the speed threshold, and / or the accelerator pedal's stepping depth exceeds the threshold in a high-power driving state, the screen recording or screenshot operation of the central control screen and / or the instrument screen is triggered, and a common image file or video file, such as MP4, is generated. The screen recording or screenshot data is compressed and stored in the vehicle event data recorder (EDR) (abbreviated as black box) or in the memory to facilitate subsequent driving scene restoration. The end point of the screen data recording can be when the vehicle has an obvious collision or deceleration, so that the speed and depth requirements of the accelerator pedal are no longer met.

[0201] In this implementation, the screen data obtained by recording or capturing the screen includes not only the visual feedback information displayed on the central control screen and / or the instrument screen, but also the vehicle parameter information, control information, etc. displayed on the central control screen and / or the instrument screen itself.

[0202] In this implementation, the images of the central control screen and the instrument screen are saved as evidence to clarify the accidental stepping on the accelerator pedal. On the one hand, compared with the black box data in the related art, the saved image data can be played directly without restoration, and the images that can be displayed are more intuitive; on the other hand, the images are simple and easy to understand; on the other hand, since the driver has established the relationship between operation and visual feedback through the vehicle status feedback information, he is familiar with the visual feedback information displayed on the central control screen and the instrument screen, so the image can improve the credibility.

[0203] Optionally, the method may further include: when the vehicle's driving speed exceeds the speed limit, controlling at least one of the vehicle's central control screen, instrument screen and HUD to change at least one of the backlight color and brightness.

[0204] In this implementation, when the vehicle's speed exceeds the speed limit, the warning effect is enhanced by changing the backlight color and / or brightness. The speed limit is greater than a threshold corresponding to the vehicle's speed, such as 120 km / h.

[0205] Optionally, the method may further include: when at least one of the vehicle's driving speed and the accelerator pedal depression depth exceeds a corresponding threshold, turning on the in-vehicle monitoring camera, recording and saving the driver's operation screen, compressing the operation screen and storing it in the EDR or memory, and providing a basis for subsequent restoration of the driving scene.

[0206] In another possible example, when at least one of the vehicle's driving speed and the accelerator pedal's depression depth exceeds a corresponding threshold, the HUD display data is acquired and the acquired display data is saved, the display data including picture information and display setting information, and the display setting information includes at least one of projection height, projection angle, projection distance and projection brightness.

[0207] That is, when at least one of the vehicle's driving speed and the accelerator pedal depression depth exceeds the corresponding threshold, the HUD display data is saved to facilitate the subsequent restoration of the HUD screen.

[0208] In this implementation, the HUD screen information includes not only the visual feedback information displayed on the HUD, but also the vehicle parameter information, control information, etc. displayed by the HUD itself.

[0209] The display data of the HUD may also be compressed and then stored in the EDR or the memory.

[0210] The display data of the HUD includes picture information for restoring the picture content. The display data of the HUD includes display setting information for restoring the height, brightness, distance, angle, etc. of the projected picture, thereby achieving complete restoration of the HUD picture. The display data of the HUD can be read from the HUD driver.

[0211] When restoring the HUD screen, the stored HUD display data is directly imported into the vehicle-mounted HUD of the same model to restore the HUD screen. Among them, the screen information in the display data is responsible for screen generation, and the display setting information is responsible for the angle, height, projection distance and brightness control when the screen is projected.

[0212] Optionally, the method further includes: when at least one of the vehicle's driving speed and the accelerator pedal depression depth exceeds a corresponding threshold, recording the vehicle's external light intensity through a brightness sensor. When subsequently restoring the HUD screen, simulating the vehicle's external light based on the recorded light intensity. The above technical means are used to achieve the subsequent true restoration of the HUD screen that appears in the driver's eyes.

[0213] In this implementation, since the HUD is a virtual image and there is no physical display screen to carry it, what is saved is the display data of the HUD (that is, driving data). The display data of the HUD can be restored through projection, thereby achieving the same function as the screen of the central control screen and the instrument screen.

[0214] By storing the feedback visual information as key data, it can directly restore the truth of the scene.

[0215] In the implementation of the present application, the start of the recording operation is based on the vehicle speed and the accelerator pedal depression depth. Furthermore, the end of the recording operation and the processing of the recorded data can be as follows:

[0216] If the vehicle stops within 5 minutes of the start of recording, the recording ends when the vehicle stops. If a serious accident occurs within 5 minutes of the start of recording and the power is cut off, the recording ends just before the power is cut off. If the vehicle does not stop, the recording lasts for 5 minutes and then the recorded data is deleted. After the recorded data is deleted, the system starts to detect the conditions that trigger the recording next time.

[0217] Each time the vehicle restarts and the speed reaches 5 km / h or more, the recorded data is cleared and the next triggering condition for recording is detected. Alternatively, the vehicle periodically clears the recorded data.

[0218] For example, the method may also include: deleting stored vehicle status feedback information and related information, such as deleting screen data, display data, driver control screen, vehicle external light intensity, etc.

[0219] For example, the deletion method can be scheduled deletion, such as storing data for 3 days and deleting it after the expiration. For another example, the deletion method can be the data of the current driving record, which is deleted when the vehicle reaches a certain speed next time, which can indicate that the vehicle is still normal.

[0220] The solution provided in this application can be applied to manual driving, in which case the pedal information is the real pedal information detected by the sensor. The solution provided in this application can also be applied to autonomous driving, in which case the pedal information is the virtual pedal information obtained from the autonomous driving system. The screen recording / screenshot solution of the display screen provided in this application can also restore the cause of the accident and the scene for autonomous driving vehicles. The human-computer interaction of autonomous driving can present useful information on the screen, and effective information can be retained through screen recording / screenshot, which can show that the vehicle's smart cockpit does feedback relevant information. When the vehicle is in autonomous driving mode, rich prompt information can be displayed on the central control screen, instrument screen or HUD, as well as the decision reasons for the vehicle to perform related automatic operations. In scenarios such as requiring the driver to take over, timely saving the display information several minutes before and after the triggering condition can play a role in restoring the scene.

[0221] In the case of an autonomous driving scenario, when the autonomous driving system issues an alarm and requires the driver to take over, it will also record operations such as screen recording / screenshot, saving data, turning on the vehicle camera, and recording. For example, it will record data for a period of time before and after the autonomous driving system requires the driver to take over.

[0222] Figure 6 is a flow chart of a driving feedback method provided by an embodiment of the present application. The method may be executed by a vehicle controller, such as a vehicle computer controller, or an audio controller of the vehicle. Figure 6 , the method may include the following steps:

[0223] S301: Obtain information of the pedals of the vehicle.

[0224] This step may refer to step S201 and will not be described in detail here.

[0225] S302: Outputting a vehicle status feedback sound that matches the information of the accelerator pedal and the brake pedal.

[0226] In this embodiment, the vehicle state feedback information includes vehicle state feedback sounds corresponding to different states of the accelerator pedal and different states of the brake pedal, respectively. The vehicle state feedback sounds here may be the aforementioned voice or fuel vehicle simulation sound.

[0227] In this implementation, different vehicle status feedback sounds are used to reflect different status of the pedals, thereby providing the driver with intuitive status feedback.

[0228] When the vehicle status feedback information includes auditory feedback information, the auditory feedback information may be output through a speaker in the vehicle.

[0229] For example, the vehicle status feedback sound is output through a speaker in the vehicle. The speaker in the vehicle can be a cockpit audio system with good playback effect.

[0230] Optionally, the function of the speaker outputting the auditory feedback information may be set as a switch, that is, the method may further include: receiving a switch selection signal, and turning on or off the function of the speaker outputting the auditory feedback information according to the switch selection signal.

[0231] S303: When at least one of the vehicle's driving speed and the accelerator pedal depression depth exceeds a corresponding threshold, the sound inside the vehicle is recorded and the recording data is saved.

[0232] Optionally, the method further includes: when at least one of the vehicle's driving speed and the accelerator pedal depression depth exceeds a corresponding threshold, recording the sound inside the vehicle and saving the recorded data.

[0233] For example, the cabin ambient sound is recorded through a microphone inside the car as recording data.

[0234] When at least one of the vehicle's driving speed and the accelerator pedal's depression depth exceeds the corresponding threshold, recording is triggered to generate a common audio file, such as MP3. The recording data is compressed and stored in the EDR or memory to facilitate subsequent driving scene restoration.

[0235] Optionally, the method may further include: deleting stored vehicle status feedback information and related information thereof, such as deleting recorded data and the like.

[0236] For example, the deletion method can be scheduled deletion, such as storing data for 3 days and deleting it after the expiration. For another example, the deletion method can be the data of the current driving record, which is deleted when the vehicle reaches a certain speed next time, which can indicate that the vehicle is still normal.

[0237] In this implementation, the sound inside the vehicle is recorded, and the recording contains auditory feedback information of the high-power driving state, which can be used as evidence to clarify the accidental stepping on the accelerator pedal. On the one hand, compared with the black box data in the related technology, the saved recording data can be played directly without restoration, and the sound that can be displayed is more intuitive; on the other hand, the sound is simple and easy to understand; on the other hand, because the driver establishes the relationship between operation and auditory feedback through the vehicle status feedback information, he is familiar with the auditory feedback information in the recording, so the sound can improve the credibility.

[0238] Figure 74 is a block diagram of a driving feedback device provided in an embodiment of the present application. The driving feedback device can be implemented as all or part of a vehicle controller through software, hardware, or a combination of both. The driving feedback device can include: an acquisition unit 401 and an output unit 402.

[0239] The acquisition unit 401 is used to acquire the information of the pedals of the vehicle, and the pedal information includes the information of the accelerator pedal and the information of the brake pedal;

[0240] The output unit 402 is used to output vehicle state feedback information that matches at least one of the information of the accelerator pedal and the information of the brake pedal, and the vehicle state feedback information is used to indicate at least one of the state of the accelerator pedal and the state of the brake pedal.

[0241] Optionally, the accelerator pedal information includes the accelerator pedal depression depth, and the brake pedal information includes the brake pedal depression depth.

[0242] Optionally, the output unit 402 is used to:

[0243] When the accelerator pedal depression depth is greater than 0 and the vehicle's driving speed and the accelerator pedal depression depth do not exceed the corresponding threshold, output first indication information, the first indication information is used to indicate that the accelerator pedal is in a power output state; or,

[0244] When at least one of the vehicle's running speed and the accelerator pedal depression depth exceeds a corresponding threshold, outputting second indication information, the second indication information is used to indicate that the accelerator pedal is in a high-power driving state; or,

[0245] When the accelerator pedal is depressed to a reduced depth, a third indication information is output, where the third indication information is used to indicate that the accelerator pedal is in a kinetic energy recovery deceleration state; or,

[0246] When the brake pedal depression depth is greater than 0, fourth indication information is output, and the fourth indication information is used to indicate that the brake pedal is in a braking state of the brake pedal being depressed.

[0247] Optionally, the device further comprises:

[0248] The determination unit 403 is used to determine the threshold values ​​corresponding to the vehicle's driving speed and the accelerator pedal depression depth based on the vehicle's historical accelerator pedal depression depth data and the vehicle's historical driving speed data, so that the number of times the second indication information is output in each cycle is within a preset number range.

[0249] Optionally, the vehicle status feedback information includes an acceleration feedback icon, a kinetic energy recovery feedback icon, and a braking feedback icon;

[0250] The acceleration feedback icon is used to indicate whether the accelerator pedal is in power output state or high-power drive state;

[0251] The kinetic energy recovery feedback icon is used to indicate whether the accelerator pedal is in the kinetic energy recovery deceleration state;

[0252] The brake feedback icon is used to indicate whether the accelerator pedal is in the braking state by pressing the brake pedal.

[0253] Optionally, the output unit 402 includes at least one of a central control screen and an instrument screen of the vehicle.

[0254] Optionally, the device further includes a first storage unit 404,

[0255] The acquisition unit 401 is used to acquire the picture data of at least one of the central control screen and the instrument screen when at least one of the vehicle's running speed and the accelerator pedal depression depth exceeds the corresponding threshold;

[0256] The first storage unit 404 is used to store the acquired picture data.

[0257] Optionally, the output unit 402 includes a head-up display HUD of the vehicle.

[0258] Optionally, the acquisition unit 401 is used to acquire display data of the HUD when at least one of the vehicle's driving speed and the accelerator pedal depression depth exceeds a corresponding threshold, the display data including picture information and display setting information, and the display setting information includes at least one of a projection height, a projection angle, a projection distance, and a projection brightness;

[0259] The first storage unit 404 is used to store the acquired display data.

[0260] Optionally, the device further comprises:

[0261] The control unit 405 is used to control at least one of the central control screen, instrument screen and HUD of the vehicle to change at least one of the backlight color and brightness when the vehicle's driving speed exceeds the speed limit.

[0262] Optionally, the vehicle state feedback information includes vehicle state feedback sounds corresponding to different states of the accelerator pedal and different states of the brake pedal, respectively.

[0263] Optionally, the device further includes a recording unit 406 and a second storage unit 407;

[0264] A recording unit 406, configured to record the sound inside the vehicle when at least one of the vehicle's driving speed and the accelerator pedal depression depth exceeds a corresponding threshold;

[0265] The second storage unit 407 is used to store the recorded data.

[0266] In one example, the first storage unit 404 and the second storage unit 407 may be the same storage unit. In another example, the first storage unit 406 and the second storage unit 407 may be different storage units.

[0267] Optionally, the device further comprises:

[0268] The monitoring unit 408 is used to activate the in-vehicle monitoring camera to record and save the driver's control screen when at least one of the vehicle's driving speed and the accelerator pedal depression depth exceeds the corresponding threshold.

[0269] When the driving feedback device provided in the above embodiment is working, only the division of the above functional units is used as an example. In actual application, the above functions can be assigned to different functional units as needed, that is, the internal structure of the device is divided into different functional units to complete all or part of the functions described above. In addition, the driving feedback device provided in the above embodiment and the driving feedback method embodiment belong to the same concept, and the specific implementation process is detailed in the method embodiment, which will not be repeated here.

[0270] The descriptions of the processes corresponding to the above-mentioned figures have different emphases. For parts that are not described in detail in a certain process, please refer to the relevant descriptions of other processes.

[0271] The present application also provides a vehicle. The vehicle may include: Figure 7 Driving feedback device shown.

[0272] Optionally, the vehicle also includes other components or systems connected to the device, such as a central control screen, an instrument screen, a HUD, a cockpit audio system, etc.

[0273] Figure 8 A schematic structural diagram of a vehicle-mounted device 150 provided in an embodiment of the present application is shown. Figure 8 The vehicle-mounted device 150 shown is used to perform the above Figures 1 to 6 The vehicle-mounted device 150 may include a vehicle controller for the operations involved in the driving feedback method shown in any one of the drawings. The vehicle-mounted device 150 may be implemented by a general bus architecture.

[0274] like Figure 8 As shown, the vehicle-mounted device 150 includes at least one processor 151 , a memory 153 and at least one communication interface 154 .

[0275] The processor 151 is, for example, a general-purpose central processing unit (CPU), a digital signal processor (DSP), a network processor (NP), a data processing unit (DPU), a microprocessor, or one or more integrated circuits for implementing the solution of the present application. For example, the processor 151 includes an application-specific integrated circuit (ASIC), a programmable logic device (PLD) or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. The PLD is, for example, a complex programmable logic device (CPLD), a field-programmable gate array (FPGA), a generic array logic (GAL), or any combination thereof. It can implement or execute various logic blocks, modules, and circuits described in conjunction with the disclosure of the embodiments of the present application. The processor may also be a combination that implements a computing function, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and the like.

[0276] Optionally, the vehicle-mounted device 150 further includes a bus. The bus is used to transmit information between the components of the vehicle-mounted device 150. The bus may be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 8 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0277] The memory 153 is, for example, a read-only memory (ROM) or other types of static storage devices that can store static information and instructions, or a random access memory (RAM) or other types of dynamic storage devices that can store information and instructions, or an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compressed optical disc, laser disc, optical disc, digital versatile disc, Blu-ray disc, etc.), a magnetic disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto. The memory 153 is, for example, independent and connected to the processor 151 through a bus. The memory 153 can also be integrated with the processor 151.

[0278] The communication interface 154 uses any transceiver-like device to communicate with other devices or communication networks, and the communication network can be Ethernet, a radio access network (RAN) or a wireless local area network (WLAN), etc. The communication interface 154 may include a wired communication interface and may also include a wireless communication interface. Specifically, the communication interface 154 may be an Ethernet interface, a Fast Ethernet (FE) interface, a Gigabit Ethernet (GE) interface, an Asynchronous Transfer Mode (ATM) interface, a wireless local area network (WLAN) interface, a cellular network communication interface or a combination thereof. The Ethernet interface may be an optical interface, an electrical interface or a combination thereof. In an embodiment of the present application, the communication interface 154 may be used for the vehicle-mounted device 150 to communicate with other devices.

[0279] In a specific implementation, as an embodiment, the processor 151 may include one or more CPUs, such as Figure 8 0 and CPU1 shown in FIG. Each of these processors may be a single-CPU processor or a multi-CPU processor. A processor herein may refer to one or more devices, circuits, and / or processing cores for processing data (e.g., computer program instructions).

[0280] In a specific implementation, as an embodiment, the vehicle-mounted device 150 may include multiple processors, such as Figure 8 1 and 155. Each of these processors may be a single-CPU or a multi-CPU. A processor herein may refer to one or more devices, circuits, and / or processing cores for processing data (such as computer program instructions).

[0281] In a specific implementation, as an embodiment, the vehicle-mounted device 150 may also include an output device and an input device. The output device communicates with the processor 151 and can display information in a variety of ways. For example, the output device may be a liquid crystal display (LCD), a light emitting diode (LED) display device, a cathode ray tube (CRT) display device, or a projector. The input device communicates with the processor 151 and can receive user input in a variety of ways. For example, the input device may be a mouse, a keyboard, a touch screen device, or a sensor device.

[0282] In some embodiments, the memory 153 is used to store the program code 1510 for executing the solution of the present application, and the processor 151 can execute the program code 1510 stored in the memory 153. That is, the vehicle-mounted device 150 can implement the data processing method provided by the method embodiment by executing the program code 1510 in the memory 153 through the processor 151. The program code 1510 may include one or more software modules. Optionally, the processor 151 itself may also store the program code or instructions for executing the solution of the present application.

[0283] In a specific embodiment, the vehicle-mounted device 150 of the embodiment of the present application may correspond to the controller in each of the above-mentioned method embodiments, and the processor 151 in the vehicle-mounted device 150 reads the instructions in the memory 153 so that Figure 8 The illustrated in-vehicle device 150 is capable of performing all or part of the operations performed by the controller.

[0284] Specifically, the processor 151 is used to obtain the pedal information of the vehicle, and the pedal information includes the accelerator pedal information and the brake pedal information; output the vehicle status feedback information matching at least one of the accelerator pedal information and the brake pedal information, and the vehicle status feedback information is used to indicate at least one of the status of the accelerator pedal and the status of the brake pedal.

[0285] For the sake of brevity, other optional implementations are not described here in detail.

[0286] in, Figures 1 to 6 Each step of the driving feedback method shown in any of the figures is completed by the hardware integrated logic circuit or software instructions in the processor of the vehicle-mounted device 150. The steps of the method disclosed in the embodiment of the present application can be directly embodied as being executed by a hardware processor, or can be executed by a combination of hardware and software modules in the processor. The software module can be located in a mature storage medium in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware. To avoid repetition, it will not be described in detail here.

[0287] The embodiment of the present application also provides a chip, including: an input interface, an output interface, a processor and a memory. The input interface, the output interface, the processor and the memory are connected through an internal connection path. The processor is used to execute the code in the memory. When the code is executed, the processor is used to execute any of the above-mentioned driving feedback methods.

[0288] It should be understood that the processor may be a CPU, or other general-purpose processors, DSPs, ASICs, FPGAs or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc. It is worth noting that the processor may be a processor supporting the ARM architecture.

[0289] Further, in an optional embodiment, the processor is one or more and the memory is one or more. Optionally, the memory can be integrated with the processor, or the memory and the processor are separately arranged. The memory can include a read-only memory and a random access memory, and provide instructions and data to the processor. The memory can also include a non-volatile random access memory. For example, the memory can also store a reference block and a target block.

[0290] The memory may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memory. Among them, the non-volatile memory may be a ROM, a PROM, an EPROM, an EEPROM, or a flash memory. The volatile memory may be a RAM, which is used as an external cache. By way of example but not limitation, many forms of RAM are available. For example, SRAM, DRAM, SDRAM, DDR SDRAM, ESDRAM, SLDRAM, and DR RAM.

[0291] In an embodiment of the present application, a computer-readable storage medium is also provided, which stores computer instructions. When the computer instructions stored in the computer-readable storage medium are executed by a vehicle-mounted device, the vehicle-mounted device executes the driving feedback method provided above.

[0292] In an embodiment of the present application, a computer program product including instructions is also provided, which, when executed on a vehicle-mounted device, enables the vehicle-mounted device to execute the driving feedback method provided above.

[0293] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in this application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, computer, server or data center to another website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) mode. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integration. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk Solid State Disk), etc.

[0294] A person skilled in the art will understand that all or part of the steps to implement the above embodiments may be accomplished by hardware or by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a disk or an optical disk, etc.

[0295] The above are only optional embodiments of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions that can be easily thought of by a person skilled in the art within the technical scope disclosed in the present application should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

[0296] Unless otherwise defined, the technical or scientific terms used herein shall have the usual meanings understood by persons of ordinary skill in the field to which this application belongs. The words "first", "second", "third" and similar terms used in the patent application specification and claims of this application do not indicate any order, quantity or importance, but are only used to distinguish different components. Similarly, similar words such as "one" or "one" do not indicate a quantitative limitation, but rather indicate the presence of at least one. Similar words such as "include" or "comprise" mean that the elements or objects appearing before "include" or "comprises" cover the elements or objects listed after "include" or "comprises" and their equivalents, and do not exclude other elements or objects.

[0297] The above is only an embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application should be included in the protection scope of the present application.

Claims

1. A driving feedback method, characterized in that: The method comprises: Acquiring information about a vehicle's pedals, where the pedal information includes information about an accelerator pedal and information about a brake pedal; Outputting vehicle state feedback information matching at least one of the information of the accelerator pedal and the information of the brake pedal, wherein the vehicle state feedback information is used to indicate at least one of the state of the accelerator pedal and the state of the brake pedal.

2. The method according to claim 1, characterized in that The accelerator pedal information includes an accelerator pedal stepping depth, and the brake pedal information includes a brake pedal stepping depth.

3. The method according to claim 2, characterized in that The output of the vehicle state feedback information matching at least one of the accelerator pedal information and the brake pedal information includes: When the accelerator pedal depression depth is greater than 0 and the vehicle's travel speed and the accelerator pedal depression depth do not exceed corresponding thresholds, outputting first indication information, wherein the first indication information is used to indicate that the accelerator pedal is in a power output state; or When at least one of the vehicle's running speed and the accelerator pedal's depression depth exceeds a corresponding threshold, outputting second indication information, wherein the second indication information is used to indicate that the accelerator pedal is in a high-power driving state; or When the accelerator pedal depression depth decreases, outputting third indication information, wherein the third indication information is used to indicate that the accelerator pedal is in a kinetic energy recovery deceleration state; or, When the brake pedal depression depth is greater than 0, fourth indication information is output, and the fourth indication information is used to indicate that the brake pedal is in a brake pedal depression state.

4. The method according to claim 3, characterized in that The method further comprises: Based on the historical accelerator pedal depression depth data of the vehicle and the historical driving speed data of the vehicle, threshold values ​​corresponding to the driving speed of the vehicle and the accelerator pedal depression depth are determined so that the number of times the second indication information is output in each cycle is within a preset number range.

5. The method according to any one of claims 2 to 4, characterized in that: The vehicle status feedback information includes an acceleration feedback icon, a kinetic energy recovery feedback icon and a braking feedback icon; The acceleration feedback icon is used to indicate whether the state of the accelerator pedal is in a power output state or a high-power driving state; The kinetic energy recovery feedback icon is used to indicate whether the state of the accelerator pedal is in a kinetic energy recovery deceleration state; The brake feedback icon is used to indicate whether the state of the accelerator pedal is in a braking state of stepping on the brake pedal.

6. The method according to claim 5, characterized in that The acceleration feedback icon, the kinetic energy recovery feedback icon and the braking feedback icon are output through at least one of the central control screen and the instrument screen of the vehicle.

7. The method according to claim 6, characterized in that The method further comprises: When at least one of the vehicle's driving speed and the accelerator pedal depression depth exceeds a corresponding threshold, image data of at least one of the central control screen and the instrument screen is acquired, and the acquired image data is saved.

8. The method according to claim 5, characterized in that The acceleration feedback icon, the kinetic energy recovery feedback icon and the braking feedback icon are output via a head-up display (HUD) of the vehicle.

9. The method according to claim 8, characterized in that The method further comprises: When at least one of the vehicle's driving speed and the accelerator pedal's depression depth exceeds a corresponding threshold, display data of the HUD is acquired and the acquired display data is saved, wherein the display data includes picture information and display setting information, and the display setting information includes at least one of projection height, projection angle, projection distance and projection brightness.

10. The method according to any one of claims 6 to 9, characterized in that: The method further comprises: When the driving speed of the vehicle exceeds the speed limit, at least one of the central control screen, the instrument screen and the HUD of the vehicle is controlled to change at least one of the backlight color and the brightness.

11. The method according to any one of claims 2 to 10, characterized in that: The vehicle state feedback information includes vehicle state feedback sounds corresponding to different states of the accelerator pedal and different states of the brake pedal, respectively.

12. The method according to claim 11, characterized in that The method further comprises: When at least one of the driving speed of the vehicle and the accelerator pedal depression depth exceeds a corresponding threshold, the sound inside the vehicle is recorded and the recording data is saved.

13. The method according to any one of claims 2 to 12, characterized in that: The method further comprises: When at least one of the driving speed of the vehicle and the accelerator pedal depression depth exceeds a corresponding threshold, the in-vehicle monitoring camera is turned on to record and save the driver's control screen.

14. A driving feedback device, characterized in that: The device comprises: An acquisition unit, used to acquire information of a pedal of the vehicle, wherein the pedal information includes information of an accelerator pedal and information of a brake pedal; An output unit is used to output vehicle status feedback information matching at least one of the information of the accelerator pedal and the information of the brake pedal, wherein the vehicle status feedback information is used to indicate at least one of the status of the accelerator pedal and the status of the brake pedal.

15. The device according to claim 14, characterized in that The accelerator pedal information includes an accelerator pedal stepping depth, and the brake pedal information includes a brake pedal stepping depth.

16. The device according to claim 15, characterized in that The output unit is used for: When the accelerator pedal depression depth is greater than 0 and the vehicle's travel speed and the accelerator pedal depression depth do not exceed corresponding thresholds, outputting first indication information, wherein the first indication information is used to indicate that the accelerator pedal is in a power output state; or, When at least one of the vehicle's running speed and the accelerator pedal's depression depth exceeds a corresponding threshold, outputting second indication information, wherein the second indication information is used to indicate that the accelerator pedal is in a high-power driving state; or When the accelerator pedal depression depth decreases, outputting third indication information, wherein the third indication information is used to indicate that the accelerator pedal is in a kinetic energy recovery deceleration state; or, When the brake pedal depression depth is greater than 0, fourth indication information is output, and the fourth indication information is used to indicate that the brake pedal is in a brake pedal depression state.

17. The device according to claim 16, characterized in that The device also includes: A determination unit is used to determine the threshold values ​​corresponding to the vehicle's driving speed and the accelerator pedal depression depth based on the vehicle's historical accelerator pedal depression depth data and the vehicle's historical driving speed data, so that the number of times the second indication information is output in each cycle is within a preset number range.

18. The device according to any one of claims 15 to 17, characterized in that The vehicle status feedback information includes an acceleration feedback icon, a kinetic energy recovery feedback icon and a braking feedback icon; The acceleration feedback icon is used to indicate whether the state of the accelerator pedal is in a power output state or a high-power driving state; The kinetic energy recovery feedback icon is used to indicate whether the state of the accelerator pedal is in a kinetic energy recovery deceleration state; The brake feedback icon is used to indicate whether the state of the accelerator pedal is in a braking state of stepping on the brake pedal.

19. The device according to claim 18, characterized in that The output unit includes at least one of a central control screen and an instrument screen of the vehicle.

20. The device according to claim 19, characterized in that The device also includes a first storage unit, The acquisition unit is used to acquire the picture data of at least one of the central control screen and the instrument screen when at least one of the driving speed of the vehicle and the accelerator pedal depression depth exceeds a corresponding threshold; The first storage unit is used to store the acquired screen data.

21. The device according to claim 18, characterized in that The output unit includes a head-up display (HUD) of the vehicle.

22. The device according to claim 21, characterized in that The device also includes a first storage unit, The acquisition unit is used to acquire display data of the HUD when at least one of the driving speed of the vehicle and the accelerator pedal depression depth exceeds a corresponding threshold value, the display data including picture information and display setting information, and the display setting information includes at least one of projection height, projection angle, projection distance and projection brightness; The first storage unit is used to store the acquired display data.

23. The device according to any one of claims 19 to 22, characterized in that The device also includes: A control unit is used to control at least one of the central control screen, instrument screen and HUD of the vehicle to change at least one of the backlight color and brightness when the driving speed of the vehicle exceeds the speed limit.

24. The device according to any one of claims 15 to 23, characterized in that The vehicle state feedback information includes vehicle state feedback sounds corresponding to different states of the accelerator pedal and different states of the brake pedal, respectively.

25. The device according to claim 24, characterized in that The device also includes a recording unit and a second storage unit; The recording unit is used to record the sound in the vehicle when at least one of the driving speed of the vehicle and the accelerator pedal depression depth exceeds a corresponding threshold; The second storage unit is used to store recorded data.

26. The device according to any one of claims 15 to 25, characterized in that The device also includes: The monitoring unit is used to activate the in-vehicle monitoring camera, record and save the driver's control screen when at least one of the vehicle's driving speed and the accelerator pedal's depression depth exceeds a corresponding threshold value.

27. A vehicle-mounted device, characterized in that: The vehicle-mounted device comprises a processor and a memory, the memory is used to store software programs, and the processor runs or executes the software programs stored in the memory so that the vehicle-mounted device implements the method according to any one of claims 1 to 13.

28. A computer-readable storage medium, characterized in that: The computer-readable storage medium is used to store program codes executed by a processor, wherein the program codes include instructions for implementing the method according to any one of claims 1 to 13.

29. A computer program product, characterized in that The computer program product comprises program codes, and when a computer runs the computer program product, the computer is caused to execute the method according to any one of claims 1 to 13.

30. A vehicle, characterized in that: The vehicle comprises an apparatus as claimed in any one of claims 14 to 26.

Images