Driving feedback method and apparatus, and vehicle-mounted device

Abstract

A driving feedback method and apparatus, and a vehicle-mounted device. The method comprises: acquiring information of pedals of a vehicle, wherein the information of the pedals comprises information of an accelerator pedal and information of a brake pedal; and outputting vehicle state feedback information matching at least one piece of the information of the accelerator pedal and the information of the brake pedal, wherein the vehicle state feedback information is used for indicating at least one of the state of the accelerator pedal and the state of the brake pedal. Outputted vehicle state feedback information may be visual and / or auditory. When a driver is driving, visual and auditory feedback is provided, so as to distinguish between the driver stepping on an accelerator pedal and the driver stepping on a brake pedal, to distinguish between slow acceleration of a vehicle and rapid acceleration of the vehicle, and to distinguish between energy input of the vehicle and energy output of the vehicle, thereby establishing for the driver a relationship between operations and auditory and visual feedback.

Description

Driving feedback method and device, and vehicle-mounted equipment

[0001] This application claims priority to Chinese patent application No. 202310922552.7 filed on July 25, 2023, entitled “Driving Feedback Method and Device, and Vehicle-Mounted Equipment,” the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of automotive technology, and in particular to a driving feedback method and device, and a vehicle-mounted device. Background Art

[0003] With the development of electric vehicle technology, electric vehicles are becoming more and more popular. When drivers switch from driving fuel vehicles to electric vehicles, they are prone to driving inconvenience or even accidents due to differences in the vehicle's pedal design.

[0004] Because electric vehicles have a kinetic energy recovery system, when the accelerator pedal is released but still open, the electric vehicle will be in a deceleration state. This is different from a fuel vehicle that will only be in a deceleration state when the brake pedal is open.

[0005] The above-mentioned differences between electric vehicles and fuel vehicles result in poor driving feedback for drivers when driving electric vehicles, making it easy for drivers to mistake the accelerator pedal for the brake pedal, which in turn causes them to accidentally step on the accelerator pedal when braking is required.

[0006] Summary of the Invention

[0007] The present application provides a driving feedback method and device, as well as an on-vehicle device. The method can provide feedback on the driver's pedal operation, establish a relationship between the operation and the auditory and visual feedback for the driver, and thus quickly familiarize the driver with the vehicle control logic, strengthen pre-awareness and memory, reduce the chance of accidental accelerator pedaling, and improve driving safety.

[0008] In a first aspect, the present application provides a driving feedback method. The method includes: obtaining information about a vehicle's pedals, the pedal information including information about an accelerator pedal and information about a brake pedal; and outputting vehicle state feedback information that matches at least one of the accelerator pedal information and the brake pedal information, the vehicle state feedback information indicating at least one of the accelerator pedal state and the brake pedal state.

[0009] In this implementation, by obtaining information about the vehicle's pedals during driving, and then outputting vehicle status feedback information that can indicate at least one of the status of the accelerator pedal and the status of the brake pedal, the driver's operation of the pedals can be fed back, and a relationship between operation and auditory and visual feedback can be established for the driver, allowing the driver to quickly become familiar with the vehicle's control logic, strengthen pre-awareness and memory, reduce the chance of accidentally stepping on the accelerator, and improve driving safety.

[0010] In an implementation of the present application, the accelerator pedal information includes the accelerator pedal depression depth, and the brake pedal information includes the brake pedal depression depth.

[0011] In the implementation of the present application, outputting vehicle status feedback information that matches at least one of the accelerator pedal information and the brake pedal information includes the following situations:

[0012] The first one is to output first indication information when the accelerator pedal depression depth is greater than 0 and the vehicle's driving speed and the accelerator pedal depression depth do not exceed corresponding thresholds. The first indication information is used to indicate that the accelerator pedal is in a power output state.

[0013] The first situation is that the driver steps on the accelerator pedal at a slow speed, or the vehicle is traveling at a slow speed.

[0014] The second type is to output second indication information when at least one of the vehicle's running speed and the accelerator pedal's depression depth exceeds a corresponding threshold value, where the second indication information is used to indicate that the accelerator pedal is in a high-power driving state.

[0015] The second scenario involves high vehicle power output, as evidenced by high speed or a deep accelerator pedal press. The vehicle's speed is obtained from the vehicle's speed sensor. This second scenario allows the driver to familiarize themselves with the cockpit feedback provided during high power output. While this provides feedback during normal driving, it serves as a warning if the accelerator is accidentally pressed.

[0016] In the second case, there are many ways to set the above threshold, for example:

[0017] In the first method, the threshold value adopts a fixed value. For example, the threshold value corresponding to the vehicle's driving speed is set to 110 kilometers per hour (kilometer / hour, km / h), and the threshold value corresponding to the accelerator pedal depression depth is set to 75% of the maximum accelerator pedal depth or the pedal depth corresponding to 75% of the vehicle's maximum power.

[0018] In the second method, the threshold value will adaptively change according to the driver's driving record so that the number of times the driver triggers the second indication information each day is neither too many nor too few, thereby achieving the effect of establishing the driver's correct operating awareness through feedback.

[0019] Exemplarily, this method may include: determining thresholds corresponding to the vehicle's driving speed and accelerator pedal depression depth based on the vehicle's historical accelerator pedal depression depth data and the vehicle's historical driving speed data, so that the number of times the second indication information is output in each cycle is within a preset number range.

[0020] The historical accelerator pedal depression depth data and the historical driving speed data of the vehicle are data that are periodically collected and stored during the driving process of the vehicle. The data may be time-sensitive, such as one week or one month.

[0021] When determining a threshold based on the historical data, a threshold can be determined such that the average number of times the second indication information is triggered in the data corresponding to the historical records within a period is within a preset number range. The period can be daily, and the preset number range is, for example, greater than 0 and less than 3. This range is set to 1-2 times per day. For example, the threshold is adaptively determined so that the second indication information is triggered once per day.

[0022] The above-mentioned adaptive threshold determination scheme can provide each driver with an adaptive threshold, so that the driver can basically trigger the second indication information a certain number of times every day while driving, matching his driving habits, and neither triggering it frequently nor basically not triggering it, thus becoming familiar with the vehicle feedback system.

[0023] The third type is to output third indication information when the accelerator pedal is depressed to a reduced depth, where the third indication information is used to indicate that the accelerator pedal is in a kinetic energy recovery deceleration state.

[0024] The third situation is usually when the driver releases the accelerator pedal, the accelerator pedal depression depth decreases, the brake pedal depression depth is 0, and the vehicle recovers kinetic energy and decelerates.

[0025] A fourth type is when the brake pedal is depressed to a depth greater than 0, outputting fourth indication information, the fourth indication information being used to indicate that the brake pedal is in a braking state.

[0026] The fourth scenario occurs when the driver presses the brake pedal. This state is considered active as long as the brake pedal is pressed. Typically, the fourth scenario occurs after the third scenario, when the accelerator pedal is fully released. The vehicle automatically regenerates kinetic energy according to the set regenerative power. At this point, if the brake pedal is pressed, the kinetic energy regeneration feedback screen synchronizes with the brake pedal feedback.

[0027] In this implementation, the vehicle feeds back the aforementioned several types of indication information, and through feedback, the driver is established with correct operational awareness, thereby reducing the probability of accidentally stepping on the accelerator.

[0028] In some possible implementations of the present application, the vehicle status feedback information is only used to indicate one of the status of the accelerator pedal and the status of the brake pedal.

[0029] For example, by providing acceleration images or sounds when pressing the accelerator pedal, kinetic energy recovery images or sounds when releasing the accelerator pedal, and braking images or sounds when pressing the brake pedal, the driver can distinguish between different operating conditions through different images or sounds, avoiding the problem in related technologies where the driver cannot distinguish between deceleration by releasing the accelerator and deceleration by lightly pressing the brake pedal.

[0030] In some other possible implementations of the present application, the vehicle status feedback information is used to indicate the status of the accelerator pedal and the status of the brake pedal.

[0031] In this implementation, the vehicle status feedback information simultaneously indicates the status of both pedals, allowing the driver to more intuitively determine the pedal depression status, better establish the relationship between operation and auditory and visual feedback, and avoid accidental depression of the accelerator pedal.

[0032] In the implementation of the present application, the vehicle status feedback information includes visual feedback information, which includes text, icons, animations, etc.

[0033] When using icons as visual feedback information, less resources are occupied, and the icon form can facilitate the driver to establish a relationship between operation and visual feedback.

[0034] When icons are used as visual feedback information, the vehicle status feedback information may include one or more icons.

[0035] For example, the vehicle status feedback information includes an acceleration feedback icon, a kinetic energy recovery feedback icon, and a braking feedback icon.

[0036] Among them, the acceleration feedback icon is used to indicate whether the accelerator pedal is in power output state or high-power drive state;

[0037] The kinetic energy recovery feedback icon is used to indicate whether the accelerator pedal is in the kinetic energy recovery deceleration state;

[0038] The brake feedback icon is used to indicate whether the accelerator pedal is in the braking state by pressing the brake pedal.

[0039] In this implementation, different icons are used to reflect whether the pedal is in different states, which can provide the driver with intuitive status feedback.

[0040] In one example, the acceleration feedback icon, the kinetic energy recovery feedback icon, and the braking feedback icon are an acceleration feedback bar, a kinetic energy recovery feedback bar, and a braking feedback bar, respectively.

[0041] In the power output state, the length of the acceleration feedback bar is greater than 0, and the length of the acceleration feedback bar corresponds to the depth of the accelerator pedal. The lengths of the kinetic energy recovery feedback bar and the brake feedback bar are both 0.

[0042] In high-power driving mode, the length of the acceleration feedback bar is greater than 0. The length of the acceleration feedback bar corresponds to the depth of the accelerator pedal and has an indicator of emergency acceleration. The length of the kinetic energy recovery feedback bar and the brake feedback bar are both 0.

[0043] In the regenerative braking state, the length of the regenerative feedback bar is greater than 0, and the length of the regenerative feedback bar corresponds to the strength of the regenerative braking. The lengths of the acceleration feedback bar and the braking feedback bar are both 0.

[0044] When the brake pedal is pressed, the length of the brake feedback bar is greater than 0 and corresponds to the depth of the brake pedal. The length of the kinetic energy recovery feedback bar is greater than or equal to 0 and corresponds to the strength of the kinetic energy recovery. The length of the acceleration feedback bar is 0.

[0045] In the above example, these icons can not only indicate the pedal status, but also indicate the pedal depression depth and other content, making it easier for the driver to use this information as a reference while driving.

[0046] In other examples, the acceleration feedback icon, the kinetic energy recovery feedback icon, and the braking feedback icon may also adopt other shapes, such as a curve, a ring, etc.

[0047] In other examples, the acceleration feedback icon, kinetic energy recovery feedback icon, and brake feedback icon may also be implemented in other ways, such as using different pattern deformations of the same icon to distinguish different states, or using different colors of the same icon to distinguish different states.

[0048] In the implementation of the present application, the vehicle status feedback information includes auditory feedback information, which includes voice, fuel vehicle simulation sound, etc.

[0049] The "speech" refers to the voice announcement of the pedal status, and the "fuel vehicle simulation sound" refers to a sound effect that is identical or similar to the sound inside a fuel vehicle's pedals in different states.

[0050] The vehicle status feedback information includes vehicle status feedback sounds corresponding to different states of the accelerator pedal and different states of the brake pedal, respectively. The vehicle status feedback sounds here can be the aforementioned voice or fuel vehicle simulation sound.

[0051] In this implementation, different vehicle status feedback sounds reflect different pedal states, which can provide the driver with intuitive status feedback.

[0052] In one example, the vehicle status feedback information includes one of visual and auditory feedback information.

[0053] In another example, the vehicle status feedback information includes both visual and auditory feedback information. By outputting visual and auditory feedback information to the driver simultaneously, the driver can obtain more comprehensive feedback, providing conditions for the driver to better establish the relationship between operation and auditory and visual feedback.

[0054] When the vehicle status feedback information includes visual feedback information, the visual feedback information can be output through at least one of the central control screen and the instrument screen.

[0055] When the vehicle includes a head up display (HUD), the visual feedback information may also be output via the HUD.

[0056] For example, the acceleration feedback icon, the kinetic energy recovery feedback icon, and the braking feedback icon are output through at least one of the vehicle's central control screen and the instrument screen.

[0057] Optionally, the method further includes: when at least one of the vehicle's driving speed and the accelerator pedal depression depth exceeds a corresponding threshold, acquiring screen data of at least one of the central control screen and the instrument screen, and saving the acquired screen data.

[0058] In this implementation, the images from the central control and instrument panel are saved as evidence to clarify the possibility of accidental accelerator pedal depression. Compared to black box data in related technologies, the saved image data can be directly played back without restoration, and the resulting images are more intuitive. Furthermore, the images are simple and easy to understand. Furthermore, because drivers have established a relationship between their actions and visual feedback through vehicle status feedback, they are familiar with the visual feedback displayed on the central control and instrument panel, thus enhancing public trust.

[0059] For example, acceleration feedback icons, kinetic energy recovery feedback icons, and braking feedback icons are output through the vehicle's HUD.

[0060] Optionally, the method also includes: when at least one of the vehicle's driving speed and the accelerator pedal's depression depth exceeds a corresponding threshold, obtaining display data of the HUD, and saving the obtained display data, the display data including picture information and display setting information, and the display setting information including at least one of projection height, projection angle, projection distance and projection brightness.

[0061] In this implementation, since the HUD is a virtual image and not supported by a physical display, the HUD display data is saved. This HUD display data can be restored through projection, thereby achieving the same function as the central control screen and instrument screen.

[0062] For example, when restoring the HUD screen, the stored HUD display data is directly imported into the vehicle HUD of the same model to restore the HUD screen. The screen information in the display data is responsible for screen generation, and the display setting information is responsible for the angle, height, projection distance and brightness control of the screen projection.

[0063] Optionally, the method may further include: when the vehicle's driving speed exceeds the speed limit, controlling at least one of the vehicle's central control screen, instrument screen and HUD to change at least one of the backlight color and brightness.

[0064] For example, change the backlight color from white to a more warning color such as yellow or red, or increase the backlight brightness for prompting.

[0065] In this implementation, when a vehicle's speed exceeds a speed limit, the backlight color and / or brightness is changed to enhance the warning effect. The speed limit is greater than a threshold corresponding to the vehicle's speed, such as 120 km / h.

[0066] When the vehicle state feedback information includes auditory feedback information, the auditory feedback information may be output through a speaker in the vehicle.

[0067] For example, the vehicle status feedback sound is output through a speaker in the vehicle.

[0068] Optionally, the method further includes: when at least one of the vehicle's driving speed and the accelerator pedal depression depth exceeds a corresponding threshold value, recording the sound inside the vehicle and saving the recorded data.

[0069] In this implementation, the sounds within the vehicle are recorded. This recording includes auditory feedback information from high-power driving conditions, which can serve as evidence to clarify accidental accelerator pedal depression. Compared to black box data in related technologies, the recorded data can be directly played back without restoration, and the resulting audio is more intuitive. Furthermore, the audio is simple and visually easy to understand. Furthermore, because drivers establish a relationship between their operations and the auditory feedback through vehicle status feedback, they are sufficiently familiar with the recorded auditory feedback, thus enhancing the credibility of the audio.

[0070] Optionally, the method further includes: activating an in-vehicle surveillance camera to record and save the driver's control footage when at least one of the vehicle's driving speed and the accelerator pedal's depression depth exceeds a corresponding threshold. The recorded driver's control footage provides a basis for subsequent reconstruction of the driving scene.

[0071] In the implementation of this application, the start of recording operations such as images, information, and sounds is based on the vehicle speed and the depth of the accelerator pedal. Furthermore, the end of the recording operation and the processing of the recorded data can be as follows:

[0072] If the vehicle stops within 5 minutes of the start of recording, recording ends until the vehicle stops. If a serious accident causes a power outage within 5 minutes of the start of recording, recording ends immediately before the power outage. If the vehicle does not stop, recording continues for 5 minutes, then the recorded data is deleted. After the recorded data is deleted, the system begins detecting the next trigger condition for recording.

[0073] Each time the vehicle is restarted and the speed reaches 5 km / h or above, the recorded data is cleared and the next triggering condition for recording is detected. Alternatively, the vehicle periodically clears the recorded data.

[0074] In autonomous driving scenarios, when the autonomous driving system issues an alarm and requires the driver to take over, operations such as screen recording / screenshotting, saving data, turning on the vehicle's camera, and recording audio will also be recorded. For example, data from the period before and after the autonomous driving system requires the driver to take over will be recorded.

[0075] In a second aspect, the present application provides a driving feedback device, the device comprising:

[0076] An acquiring unit, configured to acquire information about the vehicle's pedals, the pedal information including information about the accelerator pedal and information about the brake pedal;

[0077] The output unit is used to output vehicle status feedback information that matches at least one of the information of the accelerator pedal and the information of the brake pedal, and the vehicle status feedback information is used to indicate at least one of the status of the accelerator pedal and the status of the brake pedal.

[0078] Optionally, the accelerator pedal information includes the accelerator pedal depression depth, and the brake pedal information includes the brake pedal depression depth.

[0079] Optionally, the output unit is configured to:

[0080] When the accelerator pedal depression depth is greater than 0 and the vehicle's speed and the accelerator pedal depression depth do not exceed corresponding thresholds, outputting first indication information, the first indication information is used to indicate that the accelerator pedal is in a power output state; or

[0081] When at least one of the vehicle's speed and the accelerator pedal's depression depth exceeds a corresponding threshold, outputting second indication information, the second indication information being used to indicate that the accelerator pedal is in a high-power driving state; or

[0082] When the accelerator pedal is depressed to a reduced depth, a third indication message is output, where the third indication message is used to indicate that the accelerator pedal is in a kinetic energy recovery deceleration state; or

[0083] When the brake pedal depression depth is greater than 0, fourth indication information is output, and the fourth indication information is used to indicate that the brake pedal is in a braking state.

[0084] Optionally, the device further comprises:

[0085] The determination unit is used to determine the threshold values ​​corresponding to the vehicle's driving speed and the accelerator pedal depression depth based on the vehicle's historical accelerator pedal depression depth data and the vehicle's historical driving speed data, so that the number of times the second indication information is output in each cycle is within a preset number range.

[0086] Optionally, the vehicle status feedback information includes an acceleration feedback icon, a kinetic energy recovery feedback icon, and a braking feedback icon;

[0087] The acceleration feedback icon is used to indicate whether the accelerator pedal is in power output state or high-power drive state;

[0088] The kinetic energy recovery feedback icon is used to indicate whether the accelerator pedal is in the kinetic energy recovery deceleration state;

[0089] The brake feedback icon is used to indicate whether the accelerator pedal is in the braking state by pressing the brake pedal.

[0090] Optionally, the output unit includes at least one of a central control screen and an instrument screen of the vehicle.

[0091] Optionally, the device further includes a first storage unit,

[0092] an acquisition unit, configured to acquire image data of at least one of the central control screen and the instrument screen when at least one of the vehicle's driving speed and the accelerator pedal depression depth exceeds a corresponding threshold;

[0093] The first storage unit is used to store the acquired picture data.

[0094] Optionally, the output unit comprises a head-up display HUD of the vehicle.

[0095] Optionally, the device further includes a first storage unit,

[0096] an acquisition unit, configured to acquire HUD display data when at least one of a vehicle's driving speed and an accelerator pedal depression depth exceeds a corresponding threshold, the display data including picture information and display setting information, the display setting information including at least one of a projection height, a projection angle, a projection distance, and a projection brightness;

[0097] The first storage unit is used to store the acquired display data.

[0098] Optionally, the device further comprises:

[0099] A control unit is used to control at least one of the vehicle's central control screen, instrument screen and HUD to change at least one of the backlight color and brightness when the vehicle's driving speed exceeds the speed limit.

[0100] Optionally, the vehicle state feedback information includes vehicle state feedback sounds corresponding to different states of the accelerator pedal and different states of the brake pedal, respectively.

[0101] Optionally, the device further comprises a recording unit and a second storage unit;

[0102] a recording unit, configured to record sounds inside the vehicle when at least one of the vehicle's speed and the accelerator pedal's depression depth exceeds a corresponding threshold;

[0103] The second storage unit is used to store the recording data.

[0104] In one example, the first storage unit and the second storage unit may be the same storage unit. In another example, the first storage unit and the second storage unit may be different storage units.

[0105] Optionally, the device further comprises:

[0106] The monitoring unit is used to activate the in-vehicle monitoring camera and record and save the driver's control screen when at least one of the vehicle's driving speed and the accelerator pedal's depression depth exceeds the corresponding threshold.

[0107] In a third aspect, an in-vehicle device is provided. The in-vehicle device includes a processor coupled to a memory. The memory is configured to store software programs and modules. The processor implements the method of the first aspect or any possible implementation of the first aspect by running or executing the software programs and / or modules stored in the memory.

[0108] Optionally, there are one or more processors and one or more memories.

[0109] Optionally, the memory may be integrated with the processor, or the memory may be provided separately from the processor.

[0110] In the specific implementation process, the memory can be a non-transitory memory, such as a read-only memory (ROM), which can be integrated on the same chip as the processor or be set on different chips. This application does not limit the type of memory and the setting method of the memory and the processor.

[0111] In a fourth aspect, a computer program product is provided, wherein the computer program product includes computer program code, and when the computer program code is executed by a computer, the computer executes the method in the first aspect or any possible implementation of the first aspect.

[0112] In a fifth aspect, the present application provides a computer-readable storage medium, which is used to store program codes executed by a processor, wherein the program codes include methods for implementing any possible implementation of the first aspect.

[0113] In a sixth aspect, a chip is provided, comprising a processor, the processor being used to call and execute instructions stored in a memory from the memory, so that a vehicle-mounted device equipped with the chip executes a method in any possible implementation of the first aspect above.

[0114] In a seventh aspect, another chip is provided. The chip includes an input interface, an output interface, a processor, and a memory. The input interface, the output interface, the processor, and the memory are connected via an internal connection path. The processor is configured to execute code in the memory. When the code is executed, the processor is configured to perform the method in any possible implementation of the first aspect.

[0115] In an eighth aspect, a vehicle is provided, wherein the vehicle includes the device according to the second aspect or any possible implementation of the second aspect.

[0116] It should be understood that the beneficial effects achieved by the technical solutions of the second to eighth aspects of this application and the corresponding possible implementation methods can be referred to the technical effects of the first aspect and its corresponding possible implementation methods mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0117] FIG1 is a flow chart of a driving feedback method provided by an embodiment of the present application;

[0118] FIG2 is a flow chart of a driving feedback method provided by an embodiment of the present application;

[0119] FIG3 is a schematic diagram of a pedal stepping depth signal transmission according to an embodiment of the present application;

[0120] FIG4 is a schematic diagram of a brake feedback icon provided in an embodiment of the present application;

[0121] FIG5 is a schematic diagram of a screen data acquisition method provided by an embodiment of the present application;

[0122] FIG6 is a flow chart of a driving feedback method provided by an embodiment of the present application;

[0123] FIG7 is a block diagram of a driving feedback device provided in an embodiment of the present application;

[0124] FIG8 is a schematic structural diagram of a vehicle-mounted device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0125] In order to make the objectives, technical solutions and advantages of this application clearer, the implementation methods of this application will be further described in detail below with reference to the accompanying drawings.

[0126] FIG1 is a flow chart of a driving feedback method provided in an embodiment of the present application. The method may be executed by a vehicle controller, such as a vehicle computer controller, or a vehicle display controller, HUD controller, and / or audio controller. Referring to FIG1 , the method may include the following steps:

[0127] S101: Acquire information of the vehicle's pedals.

[0128] The pedal information includes information about the accelerator pedal (ie, gas pedal) and information about the brake pedal.

[0129] S102: Outputting vehicle state feedback information that matches at least one of the accelerator pedal information and the brake pedal information.

[0130] The vehicle status feedback information is used to indicate at least one of a status of an accelerator pedal and a status of a brake pedal.

[0131] In this implementation, by obtaining information about the vehicle's pedals during driving, and then outputting vehicle status feedback information that can indicate at least one of the status of the accelerator pedal and the status of the brake pedal, the driver's operation of the pedals can be fed back, and a relationship between operation and auditory and visual feedback can be established for the driver, allowing the driver to quickly become familiar with the vehicle's control logic, strengthen pre-awareness and memory, reduce the chance of accidentally stepping on the accelerator, and improve driving safety.

[0132] In the implementation of the present application, outputting vehicle status feedback information that matches at least one of the accelerator pedal information and the brake pedal information includes the following situations:

[0133] The first one is to output first indication information when the accelerator pedal depression depth is greater than 0 and the vehicle's driving speed and the accelerator pedal depression depth do not exceed corresponding thresholds. The first indication information is used to indicate that the accelerator pedal is in a power output state.

[0134] The first situation is that the driver steps on the accelerator pedal at a slow speed, or the vehicle is traveling at a slow speed.

[0135] In the embodiment of the present application, the depth of the pedal in a natural state is the smallest, which is 0. As the driver steps on the pedal, the depth of the pedal gradually increases. When the pedal is stepped on to the bottom, the depth of the pedal is the largest.

[0136] The second type is to output second indication information when at least one of the vehicle's running speed and the accelerator pedal's depression depth exceeds a corresponding threshold value, where the second indication information is used to indicate that the accelerator pedal is in a high-power driving state.

[0137] The high-power driving state refers to a situation where the vehicle's acceleration increases to a high value within a short period of time, which can be dangerous if the accelerator is accidentally pressed. This high-power driving state is defined by a speed threshold corresponding to the vehicle's driving speed and a depth threshold corresponding to the depth of the accelerator pedal.

[0138] The second situation is that the output power of the vehicle is large, which is manifested as a high vehicle speed or a large accelerator pedal depth of the vehicle. The vehicle's running speed is obtained by a vehicle speed sensor in the vehicle.

[0139] The second scenario requires both accelerator pedal speed and depth. Speed ​​alone, without depth, does not constitute a high-power driving state. This state primarily serves to familiarize the driver with the vehicle's feedback during emergency acceleration. If the accelerator pedal is not accidentally depressed, the visuals and / or sounds displayed in this state represent normal operational feedback. If the accelerator pedal is indeed accidentally depressed, it serves as a reminder.

[0140] In the second case, there are many ways to set the above threshold, for example:

[0141] In the first method, the threshold value adopts a fixed value. For example, the threshold value corresponding to the vehicle's driving speed is set to 110 km / h, and the threshold value corresponding to the accelerator pedal's depression depth is set to 75% of the accelerator pedal's maximum depth or the pedal depth corresponding to 75% of the vehicle's maximum power.

[0142] In the second method, the threshold value will adaptively change according to the driver's driving record so that the number of times the driver triggers the second indication information each day is neither too many nor too few, thereby achieving the effect of establishing the driver's correct operating awareness through feedback.

[0143] Exemplarily, this method may include: determining thresholds corresponding to the vehicle's driving speed and accelerator pedal depression depth based on the vehicle's historical accelerator pedal depression depth data and the vehicle's historical driving speed data, so that the number of times the second indication information is output in each cycle is within a preset number range.

[0144] The historical accelerator pedal depression depth data and the historical driving speed data of the vehicle are data that are periodically collected and stored during the driving process of the vehicle. The data may be time-sensitive, such as one week or one month.

[0145] When determining a threshold based on the historical data, a threshold can be determined such that the average number of times the second indication information is triggered in the data corresponding to the historical records within a period is within a preset range of times. The period can be daily, and the preset range of times is, for example, greater than 0 and less than 3, and the range is set to 1-2 times per day, for example, limited to 1 time.

[0146] The above-mentioned adaptive threshold determination scheme can provide each driver with an adaptive threshold, so that the driver can basically trigger the second indication information a certain number of times every day while driving, matching his driving habits, and neither triggering it frequently nor basically not triggering it, thus becoming familiar with the vehicle feedback system.

[0147] The third type is to output third indication information when the accelerator pedal is depressed to a reduced depth, where the third indication information is used to indicate that the accelerator pedal is in a kinetic energy recovery deceleration state.

[0148] The third situation is usually when the driver releases the accelerator pedal, the accelerator pedal depression depth decreases, the brake pedal depression depth reaches 0, and the vehicle performs kinetic energy recovery and deceleration. When the accelerator pedal is fully released, the kinetic energy recovery intensity is the highest.

[0149] A fourth type is when the brake pedal is depressed to a depth greater than 0, outputting fourth indication information, the fourth indication information being used to indicate that the brake pedal is in a braking state.

[0150] The fourth scenario occurs when the driver presses the brake pedal. This state is considered active as long as the brake pedal is pressed. Typically, the fourth scenario occurs after the third scenario, when the accelerator pedal is fully released. The vehicle automatically regenerates kinetic energy according to the set regenerative power. At this point, if the brake pedal is pressed, the kinetic energy regeneration feedback screen synchronizes with the brake pedal feedback.

[0151] In some possible implementations of the present application, the vehicle status feedback information is only used to indicate one of the status of the accelerator pedal and the status of the brake pedal.

[0152] For example, by providing acceleration images or sounds when pressing the accelerator pedal, kinetic energy recovery images or sounds when releasing the accelerator pedal, and braking images or sounds when pressing the brake pedal, the driver can distinguish between different operating conditions through different images or sounds, avoiding the problem in related technologies where the driver cannot distinguish between deceleration by releasing the accelerator and deceleration by lightly pressing the brake pedal.

[0153] Of course, the above four situations are only examples. In other implementations, more or fewer situations may be included. For example, when more situations are included, situations corresponding to loss of control on slippery roads are also included.

[0154] In some other possible implementations of the present application, the vehicle status feedback information is used to indicate the status of the accelerator pedal and the status of the brake pedal.

[0155] In this implementation, the vehicle status feedback information simultaneously indicates the status of both pedals, allowing the driver to more intuitively determine the pedal depression status, better establish the relationship between operation and auditory and visual feedback, and avoid accidental depression of the accelerator pedal.

[0156] In the implementation of the present application, the vehicle status feedback information includes visual feedback information, which includes text, icons, animations, etc.

[0157] When using icons as visual feedback information, less resources are occupied, and the icon form can facilitate the driver to establish a relationship between operation and visual feedback.

[0158] When icons are used as visual feedback information, the vehicle status feedback information may include one or more icons.

[0159] For example, the vehicle status feedback information includes an acceleration feedback icon, a kinetic energy recovery feedback icon, and a braking feedback icon.

[0160] In the implementation of the present application, the vehicle status feedback information includes auditory feedback information, which includes voice, fuel vehicle simulation sound, etc.

[0161] Voice refers to the voice announcement of the pedal status. Simulated sounds for fuel vehicles are identical or similar to the sounds inside a fuel vehicle's vehicle under different pedal states. For example, the engine roar produced by accelerating in a simulated fuel vehicle under power output conditions, and the sounds inside the vehicle when the brake pedal is pressed, are used to distinguish between acceleration and deceleration.

[0162] In one example, the vehicle status feedback information includes one of visual and auditory feedback information.

[0163] In another example, vehicle status feedback includes both visual and auditory feedback. By providing both visual and auditory feedback to the driver, the driver can receive more comprehensive feedback, distinguishing between accelerator and brake pedal application, energy input (acceleration) and output (kinetic energy recovery), and differentiating between gentle and rapid acceleration. This allows the driver to better establish a relationship between their actions and the visual and auditory feedback.

[0164] The following describes two implementations of outputting visual feedback information and outputting auditory feedback information respectively with reference to FIG2 and FIG6 .

[0165] FIG2 is a flow chart of a driving feedback method provided in an embodiment of the present application. The method may be executed by a vehicle controller, such as a vehicle computer controller, or a vehicle display controller and / or HUD controller. Referring to FIG2 , the method may include the following steps:

[0166] S201: Acquire information of the vehicle's pedals.

[0167] The pedal information includes accelerator pedal information and brake pedal information.

[0168] In an implementation of the present application, the accelerator pedal information includes the accelerator pedal depression depth, and the brake pedal information includes the brake pedal depression depth.

[0169] The accelerator pedal depression depth and the brake pedal depression depth are obtained from the accelerator pedal travel sensor and the brake pedal travel sensor, respectively. The vehicle's speed is calculated based on the two obtained accelerator pedal depression depths and the time interval.

[0170] For example, the controller obtains signals collected by the two pedal travel sensors via a controller area network (CAN) bus to obtain the accelerator pedal depression depth and the brake pedal depression depth. The CAN bus may be a chassis CAN bus of the vehicle.

[0171] Figure 3 is a schematic diagram of a pedal depth signal transmission method provided by an embodiment of the present application. As shown in Figure 3, the accelerator pedal's pedal travel sensor and the brake pedal's pedal travel sensor each send a pedal depth signal to the vehicle gateway via the CAN bus, and the vehicle gateway then sends the pedal depth signal to the controller.

[0172] This method of transmitting pedal depression depth signals is highly safe, and because the CAN bus performance can meet millisecond-level applications with low latency, it can achieve real-time feedback on the pedal status during driving, and achieve the same speed as the visual and auditory feedback brought by fuel vehicles.

[0173] S202: Outputting an acceleration feedback icon, a kinetic energy recovery feedback icon, and a braking feedback icon that match the information of the accelerator pedal and the information of the brake pedal.

[0174] Among them, the acceleration feedback icon is used to indicate whether the accelerator pedal is in power output state or high-power drive state;

[0175] The kinetic energy recovery feedback icon is used to indicate whether the accelerator pedal is in the kinetic energy recovery deceleration state;

[0176] The brake feedback icon is used to indicate whether the accelerator pedal is in the braking state by pressing the brake pedal.

[0177] In this implementation, different icons are used to reflect whether the pedal is in different states, which can provide the driver with intuitive status feedback.

[0178] FIG4 is a schematic diagram of a brake feedback icon provided by an embodiment of the present application. Referring to FIG4 , the acceleration feedback icon, the kinetic energy recovery feedback icon, and the brake feedback icon are respectively an acceleration feedback bar A, a kinetic energy recovery feedback bar B, and a brake feedback bar C.

[0179] Among them, when the length of the acceleration feedback bar A (black part) is 0, it indicates that it is not in the power output state or the high-power drive state; when the length of the acceleration feedback bar A is greater than 0 and there is no sign indicating emergency acceleration (arrow sign), it indicates that it is in the power output state; when the length of the acceleration feedback bar A is greater than 0 and there is a sign indicating emergency acceleration, it indicates that it is in the high-power drive state.

[0180] Among them, when the length of the kinetic energy recovery feedback bar B (the black part) is 0, it indicates that the vehicle is not in the kinetic energy recovery deceleration state; when the length of the kinetic energy recovery feedback bar B is greater than 0, it indicates that the vehicle is in the kinetic energy recovery deceleration state.

[0181] Among them, when the length of the brake feedback bar C (black part) is 0, it indicates that the brake pedal is not in the braking state; when the length of the brake feedback bar C is greater than 0, it indicates that the brake pedal is in the braking state.

[0182] In the power output state, the length of the acceleration feedback bar is greater than 0, and the length of the acceleration feedback bar corresponds to the depth of the accelerator pedal. The lengths of the kinetic energy recovery feedback bar and the brake feedback bar are both 0.

[0183] In high-power driving mode, the length of the acceleration feedback bar is greater than 0. The length of the acceleration feedback bar corresponds to the depth of the accelerator pedal and has an indicator of emergency acceleration. The length of the kinetic energy recovery feedback bar and the brake feedback bar are both 0.

[0184] In addition to providing feedback on the high-power driving state, the emergency acceleration indicator in the figure can also be used to provide feedback on the high-speed state. For example, when the vehicle speed exceeds 120 km / h, the acceleration feedback bar will also have this indicator.

[0185] In the regenerative braking state, the length of the regenerative feedback bar is greater than 0, and the length of the regenerative feedback bar corresponds to the strength of the regenerative braking. The lengths of the acceleration feedback bar and the braking feedback bar are both 0.

[0186] Because the strength of kinetic energy recovery needs to be determined during the deceleration state, the method may further include obtaining the strength of kinetic energy recovery. For example, the controller may obtain the strength of kinetic energy recovery from the motor controller. The path for obtaining the strength of kinetic energy recovery may be the same as the path for obtaining the pedal depression depth signal, i.e., the strength of kinetic energy recovery first passes through the CAN bus and is then sent to the controller by the onboard gateway. This transmission method ensures signal security and low latency.

[0187] When the brake pedal is pressed, the length of the brake feedback bar is greater than 0 and corresponds to the depth of the brake pedal. The length of the kinetic energy recovery feedback bar is greater than or equal to 0 and corresponds to the strength of the kinetic energy recovery. The length of the acceleration feedback bar is 0.

[0188] In the above example, these icons can not only indicate the pedal status, but also indicate the pedal depression depth and other content, making it easier for the driver to use this information as a reference while driving.

[0189] In the implementation shown in Figure 4, the kinetic energy recovery feedback bar B and the braking feedback bar C are set side by side, and the acceleration feedback bar A is set separately, so that the acceleration feedback bar A can be highlighted, allowing the driver to better receive feedback on the power output status and high-power drive status during driving.

[0190] In other implementations, the acceleration feedback bar A, the kinetic energy recovery feedback bar B, and the brake feedback bar C may also be arranged in other ways, such as arranging the three side by side, or swapping the positions of the acceleration feedback bar A and the brake feedback bar C in Figure 4.

[0191] In other examples, the acceleration feedback icon, the kinetic energy recovery feedback icon, and the braking feedback icon may also adopt other shapes, such as a curve, a ring, etc.

[0192] In other examples, the acceleration feedback icon, kinetic energy recovery feedback icon, and brake feedback icon may also be implemented in other ways, such as using different pattern deformations of the same icon to distinguish different states, or using different colors of the same icon to distinguish different states.

[0193] When the vehicle status feedback information includes visual feedback information, the visual feedback information can be output through at least one of the central control screen and the instrument screen.

[0194] For example, the acceleration feedback icon, the kinetic energy recovery feedback icon, and the braking feedback icon are output through at least one of the vehicle's central control screen and the instrument screen.

[0195] When the vehicle includes a head-up display (HUD), visual feedback information can also be output through the HUD. The HUD image can be conveyed to the driver in the most intuitive way, and the visual feedback effect is good.

[0196] For example, acceleration feedback icons, kinetic energy recovery feedback icons, and braking feedback icons are output through the vehicle's HUD.

[0197] When visual feedback information is output, it is output together with the original content of the central control screen, instrument screen or HUD.

[0198] Optionally, the function of the HUD outputting visual feedback information may be set to a switch, that is, the method may further include: receiving a switch selection signal, and turning on or off the function of the HUD outputting visual feedback information according to the switch selection signal.

[0199] Optionally, when the HUD function of outputting visual feedback information is turned off, in a high-power driving state, visual feedback information is still output through the vehicle's HUD, or prompts are output through the HUD in other ways.

[0200] S203: When at least one of the vehicle's driving speed and the accelerator pedal depression depth exceeds a corresponding threshold, obtain screen data and / or display data, and save the obtained screen data and / or display data.

[0201] In a possible example, when at least one of the vehicle's driving speed and the accelerator pedal depression depth exceeds a corresponding threshold, image data of at least one of the central control screen and the instrument screen is obtained, and the obtained image data is saved.

[0202] That is, when at least one of the vehicle's driving speed and the accelerator pedal's depression depth exceeds the corresponding threshold, the central control screen and / or the instrument screen is recorded or captured to obtain image data of at least one of the central control screen and the instrument screen.

[0203] FIG5 is a schematic diagram of a screen data acquisition provided by an embodiment of the present application. Referring to FIG5 , when the vehicle's driving speed exceeds a speed threshold, and / or the accelerator pedal's depression depth exceeds a threshold in a high-power driving state, a screen recording or screenshot operation of the central control screen and / or the instrument screen is triggered to generate a common image file or video file, such as a moving picture experts group 4 (MP4). The screen recording or screenshot data is compressed and stored in an on-board event data recorder (EDR) (abbreviated as a black box) or in a memory to facilitate subsequent restoration of the driving scene. The end point of the screen data recording may be when the vehicle has a significant collision or deceleration, so that the speed and depth requirements of the accelerator pedal are no longer met.

[0204] In this implementation, the screen data obtained by recording or capturing the screen includes not only the visual feedback information displayed on the central control screen and / or the instrument screen, but also the vehicle parameter information, control information, etc. displayed on the central control screen and / or the instrument screen itself.

[0205] In this implementation, the images from the central control and instrument panel are saved as evidence to clarify the possibility of accidental accelerator pedal depression. Compared to black box data in related technologies, the saved image data can be directly played back without restoration, and the resulting images are more intuitive. Furthermore, the images are simple and easy to understand. Furthermore, because drivers have established a relationship between their actions and visual feedback through vehicle status feedback, they are familiar with the visual feedback displayed on the central control and instrument panel, thus enhancing public trust.

[0206] Optionally, the method may further include: when the vehicle's driving speed exceeds the speed limit, controlling at least one of the vehicle's central control screen, instrument screen and HUD to change at least one of the backlight color and brightness.

[0207] In this implementation, when a vehicle's speed exceeds a speed limit, the backlight color and / or brightness is changed to enhance the warning effect. The speed limit is greater than a threshold corresponding to the vehicle's speed, such as 120 km / h.

[0208] Optionally, the method may further include: activating an in-vehicle surveillance camera to record and save the driver's control footage when at least one of the vehicle's speed and accelerator pedal depression depth exceeds a corresponding threshold. The operation footage is compressed and stored in an EDR or memory, providing a basis for subsequent reconstruction of the driving scene.

[0209] In another possible example, when at least one of the vehicle's driving speed and the accelerator pedal's depression depth exceeds a corresponding threshold, the HUD display data is obtained and the obtained display data is saved. The display data includes picture information and display setting information. The display setting information includes at least one of projection height, projection angle, projection distance, and projection brightness.

[0210] That is, when at least one of the vehicle's speed and the accelerator pedal's depression depth exceeds a corresponding threshold, the HUD display data is saved to facilitate subsequent restoration of the HUD screen.

[0211] In this implementation, the HUD screen information includes not only the visual feedback information displayed on the HUD, but also the vehicle parameter information, control information, etc. displayed by the HUD itself.

[0212] The display data of the HUD may also be compressed and then stored in the EDR or memory.

[0213] The HUD display data includes image information used to restore the screen content. The HUD display data also includes display setting information used to restore the height, brightness, distance, angle, and other aspects of the projected image, thereby achieving complete restoration of the HUD image. The HUD display data can be read from the HUD driver.

[0214] When restoring the HUD screen, the stored HUD display data is directly imported into the vehicle HUD of the same model to restore the HUD screen. The screen information in the display data is responsible for screen generation, and the display setting information is responsible for the angle, height, projection distance and brightness control of the screen projection.

[0215] Optionally, the method further includes: recording the intensity of light outside the vehicle using a brightness sensor when at least one of the vehicle's speed and the accelerator pedal's depression depth exceeds a corresponding threshold. When subsequently restoring the HUD image, the vehicle's external lighting is simulated based on the recorded light intensity. This technical approach allows for a subsequent faithful restoration of the HUD image as it appears to the driver.

[0216] In this implementation, since the HUD is a virtual image and not supported by a physical display screen, the HUD display data (i.e., driving data) is stored. This HUD display data can be restored through projection, thereby achieving the same function as the central control screen and instrument screen.

[0217] By storing the feedback visual information as key data, it is possible to directly restore the truth of the scene.

[0218] In the implementation of the present application, the start of the recording operation is based on the vehicle speed and the accelerator pedal depression depth. Furthermore, the termination of the recording operation and the processing of the recorded data can be as follows:

[0219] If the vehicle stops within 5 minutes of the start of recording, recording ends until the vehicle stops. If a serious accident causes a power outage within 5 minutes of the start of recording, recording ends immediately before the power outage. If the vehicle does not stop, recording continues for 5 minutes, then the recorded data is deleted. After the recorded data is deleted, the system begins detecting the next trigger condition for recording.

[0220] Each time the vehicle is restarted and the speed reaches 5 km / h or above, the recorded data is cleared and the next triggering condition for recording is detected. Alternatively, the vehicle periodically clears the recorded data.

[0221] For example, the method may further include: deleting stored vehicle status feedback information and related information, such as deleting screen data, display data, driver control screen, vehicle external light intensity, etc.

[0222] For example, the deletion method can be scheduled deletion, such as saving data for 3 days and deleting it after the expiration date. Another example is that the deletion method can be the data of the current driving record, which is deleted the next time the vehicle reaches a certain speed, which can indicate that the vehicle is still normal.

[0223] The solution provided in this application can be applied to manual driving, in which case the pedal information is the real pedal information detected by the sensor. The solution provided in this application can also be applied to autonomous driving, in which case the pedal information is the virtual pedal information obtained from the autonomous driving system. The screen recording / screenshot solution of the display provided in this application can also restore the cause of the accident and the scene for autonomous driving vehicles. The human-computer interaction of autonomous driving can present useful information on the screen, and effective information can be retained through screen recording / screenshot, which can prove that the vehicle's smart cockpit has indeed fed back relevant information. When the vehicle is in autonomous driving mode, rich prompt information can be displayed on the central control screen, instrument screen or HUD, as well as the decision reasons for the vehicle to perform relevant automatic operations. In scenarios such as requiring the driver to take over, timely saving the display information for several minutes before and after the triggering condition can play a role in restoring the scene.

[0224] In autonomous driving scenarios, when the autonomous driving system issues an alarm and requires the driver to take over, operations such as screen recording / screenshotting, saving data, turning on the vehicle's camera, and recording audio will also be recorded. For example, data from the period before and after the autonomous driving system requires the driver to take over will be recorded.

[0225] FIG6 is a flow chart of a driving feedback method provided in an embodiment of the present application. The method may be executed by a vehicle controller, such as a vehicle computer controller or an audio controller of the vehicle. Referring to FIG6 , the method may include the following steps:

[0226] S301: Acquire information of the vehicle's pedals.

[0227] This step can refer to step S201 and will not be described in detail here.

[0228] S302: Outputting a vehicle status feedback sound that matches the information of the accelerator pedal and the brake pedal.

[0229] In this embodiment, the vehicle state feedback information includes vehicle state feedback sounds corresponding to different states of the accelerator pedal and different states of the brake pedal, respectively. The vehicle state feedback sounds here can be the aforementioned voice or fuel vehicle simulation sound.

[0230] In this implementation, different vehicle status feedback sounds reflect different pedal states, which can provide the driver with intuitive status feedback.

[0231] When the vehicle state feedback information includes auditory feedback information, the auditory feedback information may be output through a speaker in the vehicle.

[0232] For example, the vehicle status feedback sound is output through a speaker in the vehicle. The speaker in the vehicle can be a cabin audio system with good playback effect.

[0233] Optionally, the function of the speaker outputting the auditory feedback information may be set to a switch, that is, the method may further include: receiving a switch selection signal, and turning on or off the function of the speaker outputting the auditory feedback information according to the switch selection signal.

[0234] S303: When at least one of the vehicle's driving speed and the accelerator pedal depression depth exceeds a corresponding threshold, the sound inside the vehicle is recorded and the recorded data is saved.

[0235] Optionally, the method further includes: recording the sound inside the vehicle and saving the recorded data when at least one of the vehicle's driving speed and the accelerator pedal depression depth exceeds a corresponding threshold value.

[0236] For example, the cabin ambient sound is recorded using a microphone inside the car as recording data.

[0237] When at least one of the vehicle's speed and the accelerator pedal's depression depth exceeds the corresponding threshold, recording is triggered and a common audio file, such as MP3, is generated. The recorded data is compressed and stored in the EDR or memory to facilitate subsequent restoration of the driving scene.

[0238] Optionally, the method may further include: deleting stored vehicle status feedback information and related information, such as deleting recorded data.

[0239] For example, the deletion method can be scheduled deletion, such as saving data for 3 days and deleting it after the expiration date. Another example is that the deletion method can be the data of the current driving record, which is deleted the next time the vehicle reaches a certain speed, which can indicate that the vehicle is still normal.

[0240] In this implementation, the sounds within the vehicle are recorded. This recording includes auditory feedback information from high-power driving conditions, which can serve as evidence to clarify accidental accelerator pedal depression. Compared to black box data in related technologies, the recorded data can be directly played back without restoration, and the resulting audio is more intuitive. Furthermore, the audio is simple and visually easy to understand. Furthermore, because drivers establish a relationship between their operations and the auditory feedback through vehicle status feedback, they are sufficiently familiar with the recorded auditory feedback, thus enhancing the credibility of the audio.

[0241] FIG7 is a block diagram of a driving feedback device provided in an embodiment of the present application. The driving feedback device can be implemented as all or part of a vehicle controller through software, hardware, or a combination of both. The driving feedback device may include: an acquisition unit 401 and an output unit 402.

[0242] The acquisition unit 401 is used to acquire information about the vehicle's pedals, including information about the accelerator pedal and the brake pedal.

[0243] The output unit 402 is used to output vehicle status feedback information that matches at least one of the information of the accelerator pedal and the information of the brake pedal, and the vehicle status feedback information is used to indicate at least one of the status of the accelerator pedal and the status of the brake pedal.

[0244] Optionally, the accelerator pedal information includes the accelerator pedal depression depth, and the brake pedal information includes the brake pedal depression depth.

[0245] Optionally, the output unit 402 is configured to:

[0246] When the accelerator pedal depression depth is greater than 0 and the vehicle's speed and the accelerator pedal depression depth do not exceed corresponding thresholds, outputting first indication information, the first indication information is used to indicate that the accelerator pedal is in a power output state; or

[0247] When at least one of the vehicle's speed and the accelerator pedal's depression depth exceeds a corresponding threshold, outputting second indication information, the second indication information being used to indicate that the accelerator pedal is in a high-power driving state; or

[0248] When the accelerator pedal is depressed to a reduced depth, a third indication message is output, where the third indication message is used to indicate that the accelerator pedal is in a kinetic energy recovery deceleration state; or

[0249] When the brake pedal depression depth is greater than 0, fourth indication information is output, and the fourth indication information is used to indicate that the brake pedal is in a braking state.

[0250] Optionally, the device further comprises:

[0251] The determination unit 403 is used to determine the threshold values ​​corresponding to the vehicle's driving speed and the accelerator pedal depression depth based on the vehicle's historical accelerator pedal depression depth data and the vehicle's historical driving speed data, so that the number of times the second indication information is output in each cycle is within a preset number range.

[0252] Optionally, the vehicle status feedback information includes an acceleration feedback icon, a kinetic energy recovery feedback icon, and a braking feedback icon;

[0253] The acceleration feedback icon is used to indicate whether the accelerator pedal is in power output state or high-power drive state;

[0254] The kinetic energy recovery feedback icon is used to indicate whether the accelerator pedal is in the kinetic energy recovery deceleration state;

[0255] The brake feedback icon is used to indicate whether the accelerator pedal is in the braking state by pressing the brake pedal.

[0256] Optionally, the output unit 402 includes at least one of a central control screen and an instrument screen of the vehicle.

[0257] Optionally, the device further includes a first storage unit 404,

[0258] An acquisition unit 401 is configured to acquire image data of at least one of a central control screen and an instrument screen when at least one of a vehicle's driving speed and an accelerator pedal depression depth exceeds a corresponding threshold;

[0259] The first storage unit 404 is used to store the acquired image data.

[0260] Optionally, the output unit 402 includes a head-up display (HUD) of the vehicle.

[0261] Optionally, the acquisition unit 401 is configured to acquire HUD display data when at least one of the vehicle's driving speed and the accelerator pedal depression depth exceeds a corresponding threshold, the display data including picture information and display setting information, the display setting information including at least one of projection height, projection angle, projection distance, and projection brightness;

[0262] The first storage unit 404 is used to store the acquired display data.

[0263] Optionally, the device further comprises:

[0264] The control unit 405 is used to control at least one of the central control screen, instrument screen and HUD of the vehicle to change at least one of the backlight color and brightness when the vehicle's driving speed exceeds the speed limit.

[0265] Optionally, the vehicle state feedback information includes vehicle state feedback sounds corresponding to different states of the accelerator pedal and different states of the brake pedal, respectively.

[0266] Optionally, the device further includes a recording unit 406 and a second storage unit 407;

[0267] a recording unit 406 for recording sounds inside the vehicle when at least one of the vehicle's speed and the accelerator pedal depression depth exceeds a corresponding threshold;

[0268] The second storage unit 407 is used to store the recorded data.

[0269] In one example, the first storage unit 404 and the second storage unit 407 may be the same storage unit. In another example, the first storage unit 406 and the second storage unit 407 may be different storage units.

[0270] Optionally, the device further comprises:

[0271] The monitoring unit 408 is configured to activate an in-vehicle monitoring camera to record and save the driver's control image when at least one of the vehicle's driving speed and the accelerator pedal depression depth exceeds a corresponding threshold.

[0272] The driving feedback device provided in the above embodiments is illustrated by the division of the aforementioned functional units. In actual applications, the aforementioned functions can be assigned to different functional units as needed, i.e., the internal structure of the device can be divided into different functional units to perform all or part of the functions described above. Furthermore, the driving feedback device provided in the above embodiments and the driving feedback method embodiment are based on the same concept. The specific implementation process is detailed in the method embodiment and will not be further described here.

[0273] The descriptions of the processes corresponding to the above figures have different focuses. For parts that are not described in detail in a certain process, please refer to the relevant descriptions of other processes.

[0274] The present application also provides a vehicle that may include a driving feedback device as shown in FIG7 .

[0275] Optionally, the vehicle also includes other components or systems connected to the device, such as a central control screen, an instrument screen, a HUD, a cockpit audio system, etc.

[0276] Figure 8 shows a schematic diagram of the structure of an in-vehicle device 150 provided in an embodiment of the present application. The in-vehicle device 150 shown in Figure 8 is used to perform the operations involved in the driving feedback method shown in any of Figures 1 to 6 . The in-vehicle device 150 may include a vehicle controller. The in-vehicle device 150 may be implemented using a general bus architecture.

[0277] As shown in FIG. 8 , the in-vehicle device 150 includes at least one processor 151 , a memory 153 , and at least one communication interface 154 .

[0278] The processor 151 is, for example, a general-purpose central processing unit (CPU), a digital signal processor (DSP), a network processor (NP), a data processing unit (DPU), a microprocessor, or one or more integrated circuits for implementing the solution of the present application. For example, the processor 151 includes an application-specific integrated circuit (ASIC), a programmable logic device (PLD) or other programmable logic devices, a transistor logic device, a hardware component, or any combination thereof. The PLD is, for example, a complex programmable logic device (CPLD), a field-programmable gate array (FPGA), a generic array logic (GAL), or any combination thereof. It can implement or execute the various logic blocks, modules, and circuits described in conjunction with the disclosure of the embodiments of the present application. The processor can also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and the like.

[0279] Optionally, the in-vehicle device 150 further includes a bus. The bus is used to transmit information between the various components of the in-vehicle device 150. The bus may be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, for example. Buses can be classified as address buses, data buses, control buses, and the like. For ease of illustration, FIG8 shows only one thick line, but this does not imply that there is only one bus or only one type of bus.

[0280] The memory 153 is, for example, a read-only memory (ROM) or other type of static storage device that can store static information and instructions, a random access memory (RAM) or other type of dynamic storage device that can store information and instructions, an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disc storage, an optical disc storage (including a compact disc, laser disc, optical disc, digital versatile disc, Blu-ray disc, etc.), a magnetic disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto. The memory 153 is, for example, independent and connected to the processor 151 via a bus. The memory 153 can also be integrated with the processor 151.

[0281] The communication interface 154 uses any transceiver-like device to communicate with other devices or communication networks. The communication network can be Ethernet, a radio access network (RAN), or a wireless local area network (WLAN). The communication interface 154 can include a wired communication interface and a wireless communication interface. Specifically, the communication interface 154 can be an Ethernet interface, a Fast Ethernet (FE) interface, a Gigabit Ethernet (GE) interface, an Asynchronous Transfer Mode (ATM) interface, a wireless local area network (WLAN) interface, a cellular network communication interface, or a combination thereof. The Ethernet interface can be an optical interface, an electrical interface, or a combination thereof. In an embodiment of the present application, the communication interface 154 can be used for the vehicle-mounted device 150 to communicate with other devices.

[0282] In a specific implementation, as an example, the processor 151 may include one or more CPUs, such as CPU0 and CPU1 shown in FIG8 . Each of these processors may be a single-core (single-CPU) processor or a multi-core (multi-CPU) processor. The processor herein may refer to one or more devices, circuits, and / or processing cores for processing data (e.g., computer program instructions).

[0283] In a specific implementation, as an embodiment, the in-vehicle device 150 may include multiple processors, such as processor 151 and processor 155 shown in FIG8 . Each of these processors may be a single-core processor (single-CPU) or a multi-core processor (multi-CPU). The processor herein may refer to one or more devices, circuits, and / or processing cores for processing data (such as computer program instructions).

[0284] In a specific implementation, as an embodiment, the vehicle-mounted device 150 may further include an output device and an input device. The output device communicates with the processor 151 and can display information in a variety of ways. For example, the output device can be a liquid crystal display (LCD), a light emitting diode (LED) display device, a cathode ray tube (CRT) display device, or a projector. The input device communicates with the processor 151 and can receive user input in a variety of ways. For example, the input device can be a mouse, a keyboard, a touch screen device, or a sensor device.

[0285] In some embodiments, the memory 153 is used to store program code 1510 for executing the solution of the present application, and the processor 151 can execute the program code 1510 stored in the memory 153. That is, the vehicle-mounted device 150 can implement the data processing method provided by the method embodiment by executing the program code 1510 in the memory 153 through the processor 151. The program code 1510 may include one or more software modules. Optionally, the processor 151 itself may also store program code or instructions for executing the solution of the present application.

[0286] In a specific embodiment, the vehicle-mounted device 150 of the embodiment of the present application may correspond to the controller in the above-mentioned method embodiments, and the processor 151 in the vehicle-mounted device 150 reads the instructions in the memory 153, so that the vehicle-mounted device 150 shown in Figure 8 can execute all or part of the operations performed by the controller.

[0287] Specifically, the processor 151 is used to obtain information about the vehicle's pedals, which includes information about the accelerator pedal and information about the brake pedal; and output vehicle status feedback information that matches at least one of the accelerator pedal information and the brake pedal information, wherein the vehicle status feedback information is used to indicate at least one of the status of the accelerator pedal and the status of the brake pedal.

[0288] For the sake of brevity, other optional implementations will not be described here in detail.

[0289] Among them, each step of the driving feedback method shown in any of Figures 1 to 6 is completed by the hardware integrated logic circuit or software instructions in the processor of the vehicle-mounted device 150. The steps of the method disclosed in conjunction with the embodiments of the present application can be directly embodied as being executed by a hardware processor, or can be executed by a combination of hardware and software modules in the processor. The software module can be located in a storage medium mature in the art, such as random access memory, flash memory, read-only memory, programmable read-only memory or electrically erasable programmable memory, registers, etc. The storage medium is located in the memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware. To avoid repetition, it will not be described in detail here.

[0290] An embodiment of the present application further provides a chip comprising an input interface, an output interface, a processor, and a memory. The input interface, the output interface, the processor, and the memory are connected via an internal connection path. The processor is configured to execute code stored in the memory. When the code is executed, the processor is configured to perform any of the aforementioned driving feedback methods.

[0291] It should be understood that the processor may be a CPU, or other general-purpose processor, DSP, ASIC, FPGA or other programmable logic device, discrete gate or transistor logic device, discrete hardware component, etc. The general-purpose processor may be a microprocessor or any conventional processor, etc. It is worth noting that the processor may be a processor supporting the Advanced Reduced Instruction Set Machine (ARM) architecture.

[0292] Furthermore, in an optional embodiment, there are one or more processors and one or more memories. Alternatively, the memories may be integrated with the processors, or provided separately from the processors. The memories may include read-only memory and random access memory, and provide instructions and data to the processors. The memories may also include non-volatile random access memory. For example, the memories may also store reference blocks and target blocks.

[0293] The memory may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a ROM, a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an EEPROM, or a flash memory. The volatile memory may be a RAM, which is used as an external cache. By way of example but not limitation, many forms of RAM are available. For example, static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct rambus RAM (DR RAM).

[0294] In an embodiment of the present application, a computer-readable storage medium is also provided, which stores computer instructions. When the computer instructions stored in the computer-readable storage medium are executed by a vehicle-mounted device, the vehicle-mounted device executes the driving feedback method provided above.

[0295] In an embodiment of the present application, a computer program product containing instructions is also provided, which, when executed on a vehicle-mounted device, enables the vehicle-mounted device to execute the driving feedback method provided above.

[0296] In the above embodiments, all or part of the embodiments may be implemented by software, hardware, firmware, or any combination thereof. When implemented using software, all or part of the embodiments may be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described herein are generated. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated therein. The available medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a magnetic tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive).

[0297] Those skilled in the art will understand that all or part of the steps to implement the above embodiments may be accomplished by hardware, or by a program to instruct the relevant hardware, and the program may be stored in a computer-readable storage medium, which may be a read-only memory, a disk, or an optical disk, etc.

[0298] The above are merely optional embodiments of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of the present application. Therefore, the scope of protection of the present application should be based on the scope of protection of the claims.

[0299] Unless otherwise defined, the technical or scientific terms used herein shall have the usual meaning understood by persons of ordinary skill in the field to which this application belongs. The words “first”, “second”, “third” and similar terms used in the patent application specification and claims of this application do not indicate any order, quantity or importance, but are only used to distinguish different components. Similarly, words such as “a” or “an” do not indicate a quantitative limitation, but rather indicate the presence of at least one. Words such as “include” or “comprising” and similar words mean that the elements or objects appearing before “include” or “comprising” cover the elements or objects listed after “include” or “comprising” and their equivalents, and do not exclude other elements or objects.

[0300] The above is only an embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present application should be included in the scope of protection of the present application.

Claims

1. A driving feedback method, characterized in that: The method comprises: Acquiring information about a vehicle's pedals, where the pedal information includes information about an accelerator pedal and information about a brake pedal; Outputting vehicle state feedback information matching at least one of the information of the accelerator pedal and the information of the brake pedal, wherein the vehicle state feedback information is used to indicate at least one of the state of the accelerator pedal and the state of the brake pedal.

2. The method according to claim 1, characterized in that: The accelerator pedal information includes an accelerator pedal stepping depth, and the brake pedal information includes a brake pedal stepping depth.

3. The method according to claim 2, characterized in that The output of the vehicle state feedback information matching at least one of the accelerator pedal information and the brake pedal information includes: When the accelerator pedal depression depth is greater than 0 and the vehicle's travel speed and the accelerator pedal depression depth do not exceed corresponding thresholds, output first indication information, wherein the first indication information is used to indicate that the accelerator pedal is in a power output state; or When at least one of the vehicle's running speed and the accelerator pedal's depression depth exceeds a corresponding threshold, outputting second indication information, wherein the second indication information is used to indicate that the accelerator pedal is in a high-power driving state; or When the accelerator pedal depression depth decreases, outputting third indication information, wherein the third indication information is used to indicate that the accelerator pedal is in a kinetic energy recovery deceleration state; or, When the brake pedal depression depth is greater than 0, fourth indication information is output, where the fourth indication information is used to indicate that the brake pedal is in a brake pedal depression state.

4. The method according to claim 3, characterized in that The method further comprises: Based on the historical accelerator pedal depression depth data of the vehicle and the historical driving speed data of the vehicle, threshold values ​​corresponding to the driving speed of the vehicle and the accelerator pedal depression depth are determined so that the number of times the second indication information is output in each cycle is within a preset number range.

5. The method according to any one of claims 2 to 4, characterized in that: The vehicle status feedback information includes an acceleration feedback icon, a kinetic energy recovery feedback icon and a braking feedback icon; The acceleration feedback icon is used to indicate whether the state of the accelerator pedal is in a power output state or a high-power driving state; The kinetic energy recovery feedback icon is used to indicate whether the state of the accelerator pedal is in a kinetic energy recovery deceleration state; The brake feedback icon is used to indicate whether the accelerator pedal is in a braking state by stepping on the brake pedal.

6. The method according to claim 5, characterized in that The acceleration feedback icon, the kinetic energy recovery feedback icon and the braking feedback icon are output through at least one of the central control screen and the instrument screen of the vehicle.

7. The method according to claim 6, characterized in that The method further comprises: When at least one of the vehicle's driving speed and the accelerator pedal depression depth exceeds a corresponding threshold, image data of at least one of the central control screen and the instrument screen is acquired, and the acquired image data is saved.

8. The method according to claim 5, characterized in that The acceleration feedback icon, the kinetic energy recovery feedback icon and the braking feedback icon are output via a head-up display (HUD) of the vehicle.

9. The method according to claim 8, characterized in that The method further comprises: When at least one of the vehicle's driving speed and the accelerator pedal's depression depth exceeds a corresponding threshold, display data of the HUD is acquired and the acquired display data is saved, wherein the display data includes picture information and display setting information, and the display setting information includes at least one of projection height, projection angle, projection distance and projection brightness.

10. The method according to any one of claims 6 to 9, characterized in that: The method further comprises: When the driving speed of the vehicle exceeds the speed limit, at least one of the central control screen, the instrument screen and the HUD of the vehicle is controlled to change at least one of the backlight color and the brightness.

11. The method according to any one of claims 2 to 10, characterized in that: The vehicle state feedback information includes vehicle state feedback sounds corresponding to different states of the accelerator pedal and different states of the brake pedal, respectively.

12. The method according to claim 11, characterized in that The method further comprises: When at least one of the driving speed of the vehicle and the accelerator pedal depression depth exceeds a corresponding threshold, the sound inside the vehicle is recorded and the recording data is saved.

13. The method according to any one of claims 2 to 12, characterized in that: The method further comprises: When at least one of the driving speed of the vehicle and the accelerator pedal depression depth exceeds a corresponding threshold, the in-vehicle monitoring camera is turned on to record and save the driver's control screen.

14. A driving feedback device, characterized in that: The device comprises: An acquisition unit, used to acquire information of a pedal of the vehicle, wherein the pedal information includes information of an accelerator pedal and information of a brake pedal; An output unit is used to output vehicle status feedback information matching at least one of the information of the accelerator pedal and the information of the brake pedal, wherein the vehicle status feedback information is used to indicate at least one of the status of the accelerator pedal and the status of the brake pedal.

15. The device according to claim 14, characterized in that The accelerator pedal information includes an accelerator pedal stepping depth, and the brake pedal information includes a brake pedal stepping depth.

16. The device according to claim 15, characterized in that The output unit is used for: When the accelerator pedal depression depth is greater than 0 and the vehicle's travel speed and the accelerator pedal depression depth do not exceed corresponding thresholds, outputting first indication information, wherein the first indication information is used to indicate that the accelerator pedal is in a power output state; or, When at least one of the vehicle's running speed and the accelerator pedal's depression depth exceeds a corresponding threshold, outputting second indication information, wherein the second indication information is used to indicate that the accelerator pedal is in a high-power driving state; or When the accelerator pedal depression depth decreases, outputting third indication information, wherein the third indication information is used to indicate that the accelerator pedal is in a kinetic energy recovery deceleration state; or, When the brake pedal depression depth is greater than 0, fourth indication information is output, where the fourth indication information is used to indicate that the brake pedal is in a brake pedal depression state.

17. The device according to claim 16, characterized in that The device also includes: A determination unit is used to determine the threshold values ​​corresponding to the vehicle's driving speed and the accelerator pedal depression depth based on the vehicle's historical accelerator pedal depression depth data and the vehicle's historical driving speed data, so that the number of times the second indication information is output in each cycle is within a preset number range.

18. The device according to any one of claims 15 to 17, characterized in that The vehicle status feedback information includes an acceleration feedback icon, a kinetic energy recovery feedback icon and a braking feedback icon; The acceleration feedback icon is used to indicate whether the state of the accelerator pedal is in a power output state or a high-power driving state; The kinetic energy recovery feedback icon is used to indicate whether the state of the accelerator pedal is in a kinetic energy recovery deceleration state; The brake feedback icon is used to indicate whether the accelerator pedal is in a braking state by stepping on the brake pedal.

19. The device according to claim 18, characterized in that The output unit includes at least one of a central control screen and an instrument screen of the vehicle.

20. The device according to claim 19, characterized in that The device also includes a first storage unit, The acquisition unit is used to acquire the picture data of at least one of the central control screen and the instrument screen when at least one of the driving speed of the vehicle and the accelerator pedal depression depth exceeds a corresponding threshold; The first storage unit is used to store the acquired screen data.

21. The device according to claim 18, characterized in that The output unit includes a head-up display (HUD) of the vehicle.

22. The device according to claim 21, characterized in that The device also includes a first storage unit, The acquisition unit is used to acquire display data of the HUD when at least one of the driving speed of the vehicle and the accelerator pedal depression depth exceeds a corresponding threshold value, the display data including picture information and display setting information, and the display setting information includes at least one of projection height, projection angle, projection distance and projection brightness; The first storage unit is used to store the acquired display data.

23. The device according to any one of claims 19 to 22, characterized in that The device also includes: A control unit is used to control at least one of the central control screen, instrument screen and HUD of the vehicle to change at least one of the backlight color and brightness when the driving speed of the vehicle exceeds the speed limit.

24. The device according to any one of claims 15 to 23, characterized in that The vehicle state feedback information includes vehicle state feedback sounds corresponding to different states of the accelerator pedal and different states of the brake pedal, respectively.

25. The device according to claim 24, characterized in that The device also includes a recording unit and a second storage unit; The recording unit is used to record the sound in the vehicle when at least one of the driving speed of the vehicle and the accelerator pedal depression depth exceeds a corresponding threshold; The second storage unit is used to store recorded data.

26. The device according to any one of claims 15 to 25, characterized in that The device also includes: The monitoring unit is used to activate the in-vehicle monitoring camera, record and save the driver's control screen when at least one of the vehicle's driving speed and the accelerator pedal's depression depth exceeds a corresponding threshold value.

27. A vehicle-mounted device, characterized in that: The vehicle-mounted device comprises a processor and a memory, the memory is used to store software programs, and the processor runs or executes the software programs stored in the memory so that the vehicle-mounted device implements the method according to any one of claims 1 to 13.

28. A computer-readable storage medium, characterized in that: The computer-readable storage medium is used to store program codes executed by a processor, wherein the program codes include instructions for implementing the method according to any one of claims 1 to 13.

29. A computer program product, characterized in that The computer program product comprises program codes, and when a computer runs the computer program product, the computer executes the method according to any one of claims 1 to 13.

30. A vehicle, characterized in that: The vehicle comprises an apparatus as claimed in any one of claims 14 to 26.

Images