Display method, data processing method and related apparatus

Abstract

A display method, a data processing method and related devices are applied to the technical field of data processing. The display method comprises: displaying first data, the first data comprising vehicle control prompt information corresponding to a first road section environment in which a first vehicle is located and / or vehicle control suggestion information corresponding to the first road section environment, the vehicle control prompt information being used to prompt a difference between a driving behavior of a driver of the first vehicle and the vehicle control suggestion information. The method can display the first data in real time to help the driver quickly master the characteristics of the first road section environment and the vehicle performance, and assist the driver in making an optimal or better vehicle control behavior in the first road section environment, so that the vehicle can exert high performance potential advantages in the first road section environment, thereby improving the driving experience of the user.

Description

Technical Field

[0001] This application relates to the field of data processing technology, and in particular to a display method, a data processing method, and related apparatus. Background Technology

[0002] In recent years, with the development of the intelligent vehicle market, electric vehicles have achieved significant improvements in power performance, intelligent configuration, and control systems. As users' pursuit of driving experience continues to upgrade, especially among users who seek speed and driving pleasure, track driving has gradually become an important scenario for unleashing vehicle performance and meeting personalized needs.

[0003] Therefore, there is an urgent need for a feasible solution to help drivers quickly grasp road characteristics and vehicle performance, enabling vehicles to unleash their high-performance potential on the road and improve the user's driving experience. Summary of the Invention

[0004] This application provides a display method, a data processing method, and related devices that can help drivers quickly grasp road characteristics and vehicle performance, enabling vehicles to unleash their high-performance potential on the road and improving the user's driving experience.

[0005] In a first aspect, embodiments of this application provide a display method, which includes: displaying first data, the first data including vehicle control prompt information and / or vehicle control suggestion information corresponding to the first road segment environment where the first vehicle is located, the vehicle control prompt information being used to prompt the difference between the driving behavior of the driver of the first vehicle and the vehicle control suggestion information.

[0006] This application embodiment provides a display method that, during the driving of a first vehicle, can display in real-time vehicle control suggestion information corresponding to the first road segment environment in which the first vehicle is located, and can also display in real-time vehicle control prompt information corresponding to the first road segment environment. The vehicle control suggestion information can be understood as including vehicle control suggestions given for the first road segment environment. After seeing the displayed first data, the driver can control the vehicle according to the given vehicle control suggestions, so that the vehicle can maximize its performance potential while ensuring safety in the first road segment environment, thereby improving the driver's driving experience. The vehicle control prompt information can be understood as indicating the difference between the driver's driving behavior and the vehicle control suggestion information. When there is a difference or a large difference between the driver's actual driving behavior and the given vehicle control suggestions, the difference can be displayed through the first data. After seeing the displayed first data, the driver can promptly correct their driving behavior according to the given vehicle control prompts, reducing or even eliminating the difference between their driving behavior and the given vehicle control suggestions, and moving closer to the given vehicle control suggestions, so that the vehicle can maximize its performance potential while ensuring safety in the first road segment environment, thereby improving the driver's driving experience. Through the embodiments of this application, the aforementioned first data can be displayed in real time to help drivers quickly grasp road characteristics and vehicle performance, assisting drivers in making optimal or better vehicle control behaviors in the first road segment environment, so that the vehicle can give full play to its high performance potential advantages in the first road segment environment, thereby improving the user's driving experience.

[0007] Optionally, the first data may include two-dimensional (2D) data or three-dimensional (3D) data; this embodiment of the application does not impose any limitation on this. It is understood that the aforementioned vehicle control prompts and / or vehicle control suggestions may be displayed in the form of two-dimensional and / or three-dimensional data.

[0008] Optionally, when the first data includes three-dimensional data, the augmented reality head-up display (AR-HUD) can display the three-dimensional data in layers within the spatial area between the observation point and the first road segment environment. Through layered display, the above-mentioned vehicle control prompts and / or vehicle control suggestions can be displayed in a more realistic way to the real-world information of the first road segment environment. This allows the vehicle control prompts and / or vehicle control suggestions to be presented to the user more effectively during vehicle operation, improving information display efficiency and enhancing the user's cognitive efficiency. This enables the driver to quickly grasp road characteristics and vehicle performance, ensuring driving safety and improving the driving experience.

[0009] Alternatively, the observation point can be understood as a point in the driver's pupil or an area of ​​the eye box where the displayed content can be observed.

[0010] Optionally, the environment of the first road segment may include, but is not limited to, road segment type (such as highway segment, race track, urban road, etc.), road surface condition, road facilities, obstacles, weather, etc., and this application embodiment does not limit this.

[0011] Optionally, the aforementioned vehicle control prompts and / or suggestions can be obtained from other components with computing capabilities, such as the vehicle's intelligent driving system, vehicle control system, and perception system; this application embodiment does not impose any limitations on this. Furthermore, the aforementioned vehicle control prompts and / or suggestions are provided to a display device, which generates first data based on this data, thereby enabling the display of the corresponding first data.

[0012] In one possible implementation, the vehicle control suggestion information includes any one or more of the following: vehicle speed suggestion information, vehicle position suggestion information, vehicle gear suggestion information, steering angle suggestion information, and headlight control suggestion information.

[0013] In this embodiment, the vehicle control suggestion information may include, but is not limited to, any one or more of the aforementioned vehicle control-related suggestion information, which can be obtained by different relevant components of the vehicle and provided to the display device for display. Furthermore, by using the augmented reality display of the vehicle control suggestion information to represent the real-world environment of the first road segment, the vehicle control suggestion information can be presented to the user more effectively during vehicle operation. This allows the driver to quickly grasp road characteristics and vehicle performance, assisting the driver in making optimal or better vehicle control actions on the road, enabling the vehicle to unleash its high-performance potential and thus improving the user's driving experience.

[0014] In one possible implementation, the aforementioned vehicle control prompt information is determined by vehicle control suggestion information and the driving behavior of the driver of the first vehicle.

[0015] In this embodiment, the vehicle control suggestion information can be understood as an idealized vehicle control suggestion given by a component with computing capabilities in the vehicle, based on considerations of vehicle driving safety and maximizing vehicle performance potential, for the first road segment environment. However, in actual driving, the driver's actual driving behavior may differ from the given vehicle control suggestion due to their own or external factors. When there is a difference or the difference is large, it may affect vehicle driving safety and the realization of vehicle performance potential, thereby affecting the driving experience. Therefore, the component with computing capabilities in the vehicle can determine vehicle control prompt information based on the driver's driving behavior and the given vehicle control suggestion information. This vehicle control prompt information can be used to indicate the difference between the driver's driving behavior and the vehicle control suggestion information. Furthermore, the vehicle control prompt information is provided to the display device, so that the display device can display the difference through the first data. After seeing the displayed first data, the driver can promptly correct their driving behavior according to the given vehicle control prompt, reduce or even eliminate the difference between their driving behavior and the given vehicle control suggestion, and move closer to the given vehicle control suggestion. This allows the vehicle to maximize its performance potential while ensuring safety in the first road segment environment, improving the user's driving experience. Furthermore, by using augmented reality display to present vehicle control prompts to the real-world environment of the first road segment, the vehicle control prompts can be presented to the user more effectively during vehicle operation. This allows the driver to quickly grasp the road characteristics and vehicle performance, assisting the driver in making optimal or better vehicle control actions on the road, enabling the vehicle to unleash its high-performance potential and thus improving the user's driving experience.

[0016] In one possible implementation, the aforementioned vehicle control suggestion information is determined by the environment of the first road segment.

[0017] In this embodiment, vehicle control suggestion information can be determined based on the environment of the first road segment, so that the given vehicle control suggestions can ensure vehicle driving safety as much as possible and maximize the performance potential of the vehicle, thereby improving the user's driving experience.

[0018] In one possible implementation, the aforementioned vehicle control suggestion information is determined by the driver's historical driving behavior of the first vehicle.

[0019] In this embodiment, vehicle control suggestion information can be determined based on the driver's historical driving behavior. For example, the driver's driving behavior can be recorded when the driver last drove the vehicle through the first road segment environment. When the driver passes through the first road segment environment again, vehicle control suggestion information can be determined based on the recorded previous driving behavior and provided to the display device for corresponding display. Through the embodiments of this application, the given vehicle control suggestions can ensure vehicle driving safety as much as possible and maximize the vehicle's performance potential, while also largely conforming to the user's driving habits and improving the user's driving experience.

[0020] In one possible implementation, the above display method may also perform the following steps, including but not limited to: generating second data, which includes data on the driver's driving behavior in the first road segment environment.

[0021] In this embodiment, the driver's driving behavior in the first road segment environment can also be recorded and corresponding second data can be generated so that the driver's driving behavior can be reviewed after the trip is over, and subsequent operations such as accident liability determination and driving behavior optimization can be carried out.

[0022] In one possible implementation, the aforementioned first road segment environment includes a race track environment, and the vehicle control suggestion information includes any one or more of the following: drift mode driving suggestion information, time trial mode driving suggestion information, pursuit mode driving suggestion information, obstacle course mode driving suggestion information, endurance race mode driving suggestion information, and formation race mode driving suggestion information.

[0023] In this embodiment, when the first road segment environment includes a racetrack environment, the aforementioned vehicle control suggestion information may specifically include, but is not limited to, any one or more of the aforementioned vehicle control suggestion information related to the racetrack mode. Through this application embodiment, the aforementioned vehicle control suggestion information can be displayed in real time to help the driver quickly grasp the racetrack characteristics and vehicle performance, assisting the driver in making optimal or better vehicle control behaviors in a racetrack environment, so that the vehicle can unleash its high-performance potential in a racetrack scenario, thereby improving the user's driving experience.

[0024] In one possible implementation, the above display method may also perform the following steps, including but not limited to: acquiring first data and displaying the first data in the spatial area between the observation point and the first road segment environment during the first vehicle's travel in the first road segment environment.

[0025] In this embodiment, after the trip ends, the first road segment environment can be re-run. During the vehicle's journey in the first road segment environment, the first data is displayed in the spatial area between the observation point and the first road segment environment. Historical driving data can be reviewed. By viewing the augmented reality display of the first data and the real-world information of the first road segment environment, subsequent operations such as accident liability determination and driving behavior optimization can be performed.

[0026] In one possible implementation, the above display method may further perform steps including but not limited to: acquiring second data and displaying the second data in a spatial region between the observation point and the first road segment environment during the first vehicle's travel in the first road segment environment. The second data includes data on the driver's driving behavior in the first road segment environment.

[0027] In this embodiment, after the trip ends, the second data can be displayed in the spatial area between the observation point and the first road segment environment during the vehicle's journey in the first road segment environment by re-running the first road segment environment. This allows for a review of the driver's driving behavior. By viewing the augmented reality display of the second data and the real-world information of the first road segment environment, subsequent operations such as accident liability determination and driving behavior optimization can be performed.

[0028] Secondly, embodiments of this application provide a data processing method applied to a first vehicle, the first vehicle including a display device and a detection device. The data processing method includes: acquiring first data and environmental data, and generating a first video and / or any one or more frames of the first video based on the first data and environmental data. The first data is used by the display device to display vehicle control prompt information and / or vehicle control suggestion information corresponding to the environment of a first road segment where the first vehicle is located. The vehicle control prompt information is used to indicate the difference between the driver's driving behavior and the vehicle control suggestion information. The environmental data includes data of the first road segment environment detected by the detection device.

[0029] This application provides a data processing method that, based on vehicle control prompts and / or vehicle control suggestions corresponding to the first road segment environment displayed on a display device, and data of the first road segment environment detected by a detection device, can fuse these to obtain a video and / or any one or more frames of the video with augmented reality visual experience. The vehicle control suggestions can be understood as including vehicle control suggestions given for the first road segment environment. After seeing the displayed first data, the driver can control the vehicle according to the given vehicle control suggestions, so that the vehicle can maximize its performance potential while ensuring safety in the first road segment environment, thereby improving the driver's driving experience. The vehicle control prompt information can be understood as a way to alert the driver of the first vehicle to the difference between their driving behavior and the vehicle control suggestion. When the driver's actual driving behavior differs significantly from the given vehicle control suggestion, this difference can be displayed through the first data. After seeing the displayed first data, the driver can promptly correct their driving behavior according to the given vehicle control prompt, reducing or even eliminating the difference between their driving behavior and the given vehicle control suggestion, thus aligning with the given vehicle control suggestion. This allows the vehicle to maximize its performance potential while ensuring safety in the first road segment environment, improving the driver's driving experience. Optionally, when the display device is an AR-HUD and the detection device is a camera (such as a dashcam), the data processing method in this application embodiment can fuse videos and / or images with augmented reality visual experience, which can be provided to users including but not limited to the driver, front passenger, rear passengers, and other users. It can also support playback after the trip, greatly expanding the application scenarios of AR-HUD and improving the user experience. The data processing method in this application embodiment can be used to fuse videos and / or images with augmented reality visual experience. During the review of historical driving data after the trip, watching the aforementioned videos and / or images with augmented reality visual experience can facilitate subsequent operations such as accident liability determination and driving behavior optimization.

[0030] Optionally, the first data may include two-dimensional (2D) data or three-dimensional (3D) data; this embodiment of the application does not impose any limitation on this. It is understood that the aforementioned vehicle control prompts and / or vehicle control suggestions may be displayed in the form of two-dimensional and / or three-dimensional data.

[0031] Optionally, the environment of the first road segment may include, but is not limited to, road segment type (such as highway segment, race track, urban road, etc.), road surface condition, road facilities, obstacles, weather, etc., and this application embodiment does not limit this.

[0032] Optionally, the aforementioned vehicle control prompts and / or suggestions can be obtained from other components with computing capabilities, such as the vehicle's intelligent driving system, vehicle control system, and perception system; this application embodiment does not impose any limitations on this. Furthermore, the aforementioned vehicle control prompts and / or suggestions are provided to a display device, which generates first data based on this data, thereby enabling the display of the corresponding first data.

[0033] In one possible implementation, the vehicle control suggestion information includes any one or more of the following: vehicle speed suggestion information, vehicle position suggestion information, vehicle gear suggestion information, steering angle suggestion information, and headlight control suggestion information.

[0034] In this embodiment, the vehicle control suggestion information may include, but is not limited to, any one or more of the aforementioned vehicle control-related suggestion information, which can be obtained from different relevant components of the vehicle and provided to the display device for display. Furthermore, by combining the vehicle control suggestion information with the augmented reality display of the first road segment's environmental scene information, the aforementioned vehicle control suggestion information can be presented to the user more effectively during the review of historical driving data after the trip ends. By viewing the aforementioned videos and / or images with augmented reality visual experience, subsequent operations such as accident liability determination and driving behavior optimization can be performed more conveniently.

[0035] In one possible implementation, the aforementioned vehicle control prompt information is determined by vehicle control suggestion information and the driving behavior of the driver of the first vehicle.

[0036] In this embodiment, the vehicle control suggestion information can be understood as an idealized vehicle control suggestion given by a component with computing capabilities in the vehicle, based on considerations of vehicle driving safety and maximizing vehicle performance potential, for the first road segment environment. However, in actual driving, the driver's actual driving behavior may differ from the given vehicle control suggestion due to their own or external factors. When there is a difference or the difference is large, it may affect vehicle driving safety and the realization of vehicle performance potential, thereby affecting the driving experience. Therefore, the component with computing capabilities in the vehicle can determine vehicle control prompt information based on the driver's driving behavior and the given vehicle control suggestion information. This vehicle control prompt information can be used to indicate the difference between the driver's driving behavior and the vehicle control suggestion information. Furthermore, the vehicle control prompt information is provided to the display device, so that the display device can display the difference through the first data. After seeing the displayed first data, the driver can promptly correct their driving behavior according to the given vehicle control prompt, reduce or even eliminate the difference between their driving behavior and the given vehicle control suggestion, and move closer to the given vehicle control suggestion. This allows the vehicle to maximize its performance potential while ensuring safety in the first road segment environment, improving the user's driving experience. Furthermore, by using the vehicle control prompts to display the real-world environmental information of the first road segment, the vehicle control prompts can be presented to the user more effectively during the review of historical driving data after the trip ends. By watching the videos and / or images with the augmented reality visual experience, subsequent operations such as accident liability determination and driving behavior optimization can be performed more conveniently.

[0037] In one possible implementation, the aforementioned vehicle control suggestion information is determined by the environment of the first road segment.

[0038] In this embodiment, vehicle control suggestion information can be determined based on the environment of the first road segment, so that the given vehicle control suggestions can ensure vehicle driving safety as much as possible and maximize the performance potential of the vehicle, thereby improving the user's driving experience.

[0039] In one possible implementation, the aforementioned vehicle control suggestion information is determined by the driver's historical driving behavior of the first vehicle.

[0040] In this embodiment, vehicle control suggestion information can be determined based on the driver's historical driving behavior. For example, the driver's driving behavior can be recorded when the driver last drove the vehicle through the first road segment environment. When the driver passes through the first road segment environment again, vehicle control suggestion information can be determined based on the recorded previous driving behavior and provided to the display device for corresponding display. Through the embodiments of this application, the given vehicle control suggestions can ensure vehicle driving safety as much as possible and maximize the vehicle's performance potential, while also largely conforming to the user's driving habits and improving the user's driving experience.

[0041] In one possible implementation, the data processing method described above may further perform steps including but not limited to: acquiring second data, which includes data on the driver's driving behavior in the first road segment environment. The generation of a first video and / or any one or more frames from the first video based on the first data and environmental data can be specifically achieved through methods including but not limited to: generating a first video and / or any one or more frames from the first video based on the first data, any one or more of the second data, and environmental data.

[0042] In this embodiment, the driver's driving behavior in the first road segment environment can also be recorded as second data. Based on any one or more of the first data and the second data, as well as the environmental data, a video with augmented reality visual experience and / or any one or more frames of the video can be fused together. This allows for a more convenient review of the driver's driving behavior and subsequent operations such as accident liability determination and driving behavior optimization during the review of historical driving data after the trip.

[0043] In one possible implementation, the aforementioned first road segment environment includes a race track environment, and the vehicle control suggestion information includes any one or more of the following: drift mode driving suggestion information, time trial mode driving suggestion information, pursuit mode driving suggestion information, obstacle course mode driving suggestion information, endurance race mode driving suggestion information, and formation race mode driving suggestion information.

[0044] In this embodiment, when the first road segment environment includes a racetrack environment, the aforementioned vehicle control suggestion information may specifically include, but is not limited to, any one or more of the aforementioned vehicle control suggestion information related to the racetrack mode. Furthermore, by using augmented reality display to transform the vehicle control suggestion information into real-world information of the first road segment environment, the aforementioned vehicle control suggestion information can be presented to the user more effectively during the review of historical driving data after the trip ends. By viewing the aforementioned videos and / or images with augmented reality visual experience, subsequent operations such as accident liability determination and driving behavior optimization can be performed more conveniently.

[0045] In one possible implementation, the above-mentioned generation of a first video and / or any one or more frames of images in the first video based on the first data and environmental data can be achieved in ways including but not limited to: fusing the first data and environmental data corresponding to the same timestamp to obtain the first video and / or any one or more frames of images in the first video.

[0046] In this embodiment, data fusion can be performed based on the time dimension. Since the first data and environmental data come from different devices, if the timestamps of the first data and environmental data are not aligned during fusion, the fused video and / or image may have content errors. This application embodiment, by fusing the first data and environmental data corresponding to the same timestamp, can obtain more accurate videos and / or images with augmented reality visual experience, thereby improving the user's viewing experience.

[0047] In one possible implementation, the first data is data in a first reference coordinate system, the origin of which is an observation point or a first calibration point inside the first vehicle; the environmental data is data in a second reference coordinate system, the origin of which is the position of the detection device or a second calibration point. The generation of the first video and / or any one or more frames from the first video based on the first data and environmental data can be achieved, specifically, through methods including but not limited to: converting the environmental data into data in the first reference coordinate system, fusing the first data and the converted environmental data to obtain the first video and / or any one or more frames from the first video, wherein the first video is a video in the first reference coordinate system.

[0048] In this embodiment, data fusion can be performed based on spatial dimensions. Since the first data and environmental data come from different devices and reside in different reference coordinate systems, the fused video and / or image may have content misalignment issues. This embodiment converts the first data and environmental data into data within the same reference coordinate system before fusion, resulting in more accurate videos and / or images with augmented reality visual experiences, thus improving the user's viewing experience.

[0049] Optionally, the first calibration point and / or the second calibration point can be adjusted according to the utilization rate of the interior space of the first vehicle, and this application embodiment does not limit this.

[0050] In one possible implementation, the data processing method described above may further perform the following steps, including but not limited to: receiving a first instruction, and in response to the first instruction, sending a first video and / or any one or more frames of images from the first video to a target device. The first instruction is used to instruct the target device to display the first video and / or any one or more frames of images from the first video.

[0051] In this embodiment, by receiving and responding to a first instruction, the generated video and / or images can be displayed on the target device, providing the user with an augmented reality visual experience. Optionally, during driving, the generated video and / or images can be displayed on, but not limited to, the central control display, the passenger-side display, and the rear-seat display, through the embodiments of this application, so that passengers, including but not limited to the passenger-side and rear-seat passengers, can view the content with an augmented reality visual experience from the driver's perspective in real time, improving the user's viewing experience. Optionally, during the review of historical driving data after the trip, the embodiments of this application can present the historical driving data to the user more effectively. By viewing the aforementioned videos and / or images with an augmented reality visual experience, subsequent operations such as accident liability determination and driving behavior optimization can be performed more conveniently.

[0052] Optionally, the first instruction may be, but is not limited to, instructions in the form of voice, buttons, gestures, or central control interface operations; this application embodiment does not impose any restrictions on this.

[0053] In one possible implementation, the target device includes at least one of the following: a central control display screen of a first vehicle, a passenger-side display screen of a first vehicle, a rear-seat display screen of a first vehicle, a mobile terminal, and a cloud.

[0054] In one possible implementation, the above data processing method may also perform the following steps, including but not limited to: in response to a first instruction, instructing a display device to display a first identifier in front of the observation point, the first identifier indicating that a first video and / or any frame or multiple frames of images in the first video are being synthesized.

[0055] In this embodiment, the first video can be generated in real time through human-computer interaction. By responding to the first command, the display device can be instructed to display a first identifier in front of the observation point to indicate that the first video is being generated, thus providing users with an immersive experience of human-computer interaction and improving user experience.

[0056] Optionally, the first identifier may include, but is not limited to, "start recording", "recording", "recording in progress", "recording completed", etc., and the embodiments of this application do not limit this.

[0057] In one possible implementation, the above data processing method may also perform the following steps, including but not limited to: receiving a second instruction for configuring the display content and / or display style in the first data.

[0058] In this embodiment, by receiving and responding to the second instruction, the display content and / or display style in the first data can be configured to generate videos and / or images that meet the user's expectations, thereby improving the user's augmented reality visual experience. Optionally, after the trip ends and the vehicle stops, the augmented reality display content and / or display style can be arbitrarily configured through the embodiments of this application to generate videos and / or images with an augmented reality visual experience that meet the user's expectations, thereby improving the user experience.

[0059] Optionally, the second instruction may include, but is not limited to, instructions in the form of voice, buttons, gestures, or central control interface operations; this application embodiment does not impose any restrictions on this.

[0060] In one possible implementation, the display content in the first data includes at least one of the following: driving data, location, time, weather, navigation information, intelligent driving information, and status information of the first vehicle; and / or, the display style in the first data includes at least one of the following: font, size, color, transparency, brightness, and display style of the display content.

[0061] In one possible implementation, the data processing method described above may further perform the following steps, including but not limited to: receiving a third instruction, and in response to the third instruction, exporting a first video and / or any one or more frames of images from the first video. The third instruction is used to instruct the export of the first video and / or any one or more frames of images from the first video.

[0062] In this embodiment, by receiving and responding to a third instruction, it is possible to export generated videos and / or images with augmented reality visual experience, which can be provided to users including but not limited to the driver, front passenger, rear passengers and other users for viewing. It can also be provided to users for review after the trip, which greatly expands the use cases of AR-HUD and improves the user experience.

[0063] Optionally, the third instruction may include, but is not limited to, instructions in the form of voice, buttons, gestures, or central control interface operations; this application embodiment does not impose any restrictions on this.

[0064] In one possible implementation, the data processing method described above may further perform the following steps, including but not limited to: receiving a fourth instruction, and in response to the fourth instruction, sending a first video or an identifier corresponding to the first video to a target address, or sending any one or more frames of the first video and their corresponding identifiers to the target address. The fourth instruction is used to instruct the first video and / or any one or more frames of the first video to be sent to the target address.

[0065] In this embodiment, by receiving and responding to the fourth instruction, it is possible to share the generated videos and / or images with augmented reality visual experience to other platforms, providing them to a wider range of users for viewing. It is also possible to provide users with a review after the trip, which greatly expands the use cases of AR-HUD and improves the user experience.

[0066] Optionally, the identifier corresponding to the first video may specifically be a Uniform Resource Locator (URL), and this embodiment of the application does not limit this.

[0067] Optionally, the fourth instruction may include, but is not limited to, instructions in the form of voice, buttons, gestures, or central control interface operations; this application embodiment does not impose any restrictions on this.

[0068] Thirdly, embodiments of this application provide a display device including a unit for performing the method as described in any of the first aspects.

[0069] In one possible design, the device includes:

[0070] The display unit is used to display first data, which includes vehicle control prompt information and / or vehicle control suggestion information corresponding to the first road segment environment where the first vehicle is located. The vehicle control prompt information is used to indicate the difference between the driving behavior of the driver of the first vehicle and the vehicle control suggestion information.

[0071] In one possible implementation, the device further includes a communication unit.

[0072] The display unit is specifically used to acquire first data through the communication unit and display the first data.

[0073] In one possible implementation, the device further includes a processing unit.

[0074] The processing unit is specifically used to generate the first data.

[0075] The steps performed by the display unit, communication unit, and processing unit described in the third aspect and any possible implementation can be referred to the corresponding implementations in the first aspect.

[0076] For the technical effects of the third aspect and any possible implementation, please refer to the description of the technical effects corresponding to the first aspect and the corresponding implementation.

[0077] Optionally, in the display device described in the third aspect above and any possible embodiment:

[0078] In one implementation, the display device is a display apparatus. When the display device is a display apparatus, the communication unit can be a transceiver or an input / output interface; the processing unit can be at least one processor; and the display unit can be a monitor or a projection module. Optionally, the transceiver can be a transceiver circuit. Optionally, the input / output interface can be an input / output circuit.

[0079] In another implementation, the display device is a chip (system) or circuit used in a display device. When the display device is a chip (system) or circuit used in a display device, the communication unit can be a communication interface (input / output interface), interface circuit, output circuit, input circuit, pin, or related circuit on the chip (system) or circuit; the processing unit can be at least one processor, processing circuit, or logic circuit; and the display unit can be a projection module used to control the display.

[0080] Fourthly, embodiments of this application provide a data processing apparatus, which includes units for performing the method as described in any of the second aspects.

[0081] In one possible design, the device includes:

[0082] The processing unit is used to acquire first data and environmental data. The first data is used by the display device to display vehicle control prompt information and / or vehicle control suggestion information corresponding to the first road segment environment where the first vehicle is located. The vehicle control prompt information is used to prompt the difference between the driver's driving behavior and the vehicle control suggestion information. The environmental data includes data of the first road segment environment detected by the detection device.

[0083] The processing unit is configured to generate a first video and / or any frame or multiple frames of images in the first video based on the first data and environmental data.

[0084] In one possible implementation, the device further includes a communication unit.

[0085] The processing unit is specifically used to acquire first data and environmental data through the communication unit.

[0086] Regarding the processing unit and communication unit described in the fourth aspect and any possible implementation, the steps performed thereon can be referred to the corresponding implementation in the second aspect.

[0087] Regarding the technical effects of the fourth aspect and any possible implementation, refer to the description of the technical effects corresponding to the second aspect and the corresponding implementation.

[0088] Optionally, in the data processing apparatus described in the fourth aspect above and any possible implementation:

[0089] In one implementation, the data processing apparatus is a data processing device. When the data processing apparatus is a data processing device, the communication unit can be a transceiver or an input / output interface; the processing unit can be at least one processor. Optionally, the transceiver can be a transceiver circuit. Optionally, the input / output interface can be an input / output circuit.

[0090] In another implementation, the data processing device is a chip (system) or circuit used in a data processing device. When the data processing device is a chip (system) or circuit used in a data processing device, the communication unit can be a communication interface (input / output interface), interface circuit, output circuit, input circuit, pin, or related circuit on the chip (system) or circuit; the processing unit can be at least one processor, processing circuit, or logic circuit.

[0091] Fifthly, embodiments of this application provide a display device including a processor. The processor is coupled to a memory and can be used to execute instructions in the memory to implement the methods described in the first aspect and any of the possible implementations. Optionally, the display device further includes a memory. Optionally, the display device further includes a communication interface, and the processor is coupled to the communication interface. Optionally, the display device further includes a display, and the display is coupled to the communication interface.

[0092] Sixthly, embodiments of this application provide a data processing apparatus including a processor. The processor is coupled to a memory and can be used to execute instructions in the memory to implement the methods described in the second aspect and any of the possible implementations. Optionally, the data processing apparatus further includes a memory. Optionally, the data processing apparatus further includes a communication interface, and the processor is coupled to the communication interface.

[0093] In a seventh aspect, embodiments of this application provide a chip, including: logic circuitry and a communication interface. The communication interface is used to receive or transmit information; the logic circuitry is used to receive or transmit information through the communication interface, causing the chip to execute the methods of any one of the first to second aspects and any possible implementations described above.

[0094] Eighthly, embodiments of this application provide a computer-readable storage medium for storing a computer program (also referred to as code or instructions); when the computer program is run on a computer, the methods of any of the first to second aspects and any of the possible implementations described above are implemented.

[0095] Ninthly, embodiments of this application provide a computer program product, the computer program product comprising: a computer program (also referred to as code or instructions); and, when the computer program is run, causing a computer to perform the method of any one of the first to second aspects and any possible implementation thereof.

[0096] In a tenth aspect, embodiments of this application provide a system including a display device and a data processing device. The display device is configured to perform the methods described in the first aspect and any of the possible implementations above, and the data processing device is configured to perform the methods described in the second aspect and any of the possible implementations above.

[0097] Optionally, the system may also include, but is not limited to, any one or more of the following: intelligent driving system, vehicle control system, and perception system.

[0098] Eleventhly, embodiments of this application provide a terminal, which includes at least one display device as described in the third aspect, a data processing device as described in the fourth aspect, or a display device as described in the fifth aspect, or a data processing device as described in the sixth aspect, or a chip as described in the seventh aspect, or a system as described in the tenth aspect.

[0099] Optionally, the terminal can be a means of transportation, such as a car, truck, aircraft, drone, slow transport vehicle, spacecraft, or ship, or any other possible means of transportation used in any possible scenario. This application embodiment does not limit this.

[0100] Optionally, the terminal is used to implement the method described in any one of the first to second aspects and any possible implementation.

[0101] Furthermore, in the process of performing the methods described in any of the first to second aspects and any possible embodiments described above, the processes related to sending and / or receiving information in the above methods can be understood as the process of the processor outputting information, and / or the process of the processor receiving input information. When outputting information, the processor can output the information to a transceiver (or communication interface, or transmitting module) so that the transceiver can transmit it. After the information is output by the processor, it may need to undergo other processing before reaching the transceiver. Similarly, when the processor receives input information, the transceiver (or communication interface, or transmitting module) receives the information and inputs it to the processor. Furthermore, after the transceiver receives the information, the information may need to undergo other processing before being input to the processor.

[0102] Based on the above principles, for example, the information sent mentioned in the aforementioned method can be understood as information output by the processor. Similarly, the information received can be understood as information received by the processor from input.

[0103] Optionally, unless otherwise specified, or unless they contradict their actual function or internal logic in the relevant description, the operations of the processor, such as transmitting, sending, and receiving, can be more generally understood as processor output and receiving, input, and other operations.

[0104] Optionally, in the process of performing the methods described in any of the first to second aspects and any possible embodiments above, the processor may be a processor specifically designed to perform these methods, or it may be a processor that performs these methods by executing computer instructions stored in memory, such as a general-purpose processor. The memory may be a non-transitory memory, such as read-only memory (ROM), which may be integrated with the processor on the same chip or disposed on separate chips. This application does not limit the type of memory or the arrangement of the memory and processor.

[0105] In one possible implementation, at least one of the aforementioned memories is located outside the device.

[0106] In yet another possible implementation, at least one of the aforementioned memories is located within the device.

[0107] In another possible implementation, a portion of the memory of the at least one memory is located inside the device, while another portion is located outside the device.

[0108] In this application, the processor and memory may also be integrated into a single device, that is, the processor and memory can be integrated together. Attached Figure Description

[0109] To more clearly illustrate the technical solutions of the embodiments of this application, the drawings used in the embodiments of this application will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0110] Figure 1 A schematic diagram illustrating an application scenario of a display device in the automotive field, provided as an embodiment of this application;

[0111] Figure 2 This is a schematic diagram illustrating another perspective on the application scenario of a display device in the automotive field, as provided in an embodiment of this application.

[0112] Figure 3 An imaging schematic diagram illustrating how a display device, as provided in this application, projects an image onto a driver's eye in the automotive field;

[0113] Figure 4 This application provides a schematic diagram of the architecture of a display system.

[0114] Figure 5 A schematic flowchart illustrating a display method provided in an embodiment of this application;

[0115] Figures 6A to 6D A schematic diagram illustrating augmented reality display provided in an embodiment of this application;

[0116] Figure 7 This application provides a schematic diagram of the architecture of a data processing system.

[0117] Figure 8 A flowchart illustrating a data processing method provided in an embodiment of this application;

[0118] Figure 9 This is a schematic diagram of the structure of a display device provided in an embodiment of this application;

[0119] Figure 10 This is a schematic diagram of the structure of a data processing device provided in an embodiment of this application;

[0120] Figure 11 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application;

[0121] Figure 12 This is a schematic diagram of the structure of a chip provided in an embodiment of this application. Detailed Implementation

[0122] To make the objectives, technical solutions, and advantages of this application clearer, the embodiments of this application will be described below with reference to the accompanying drawings.

[0123] The terms "first" and "second," etc., used in the specification, claims, and drawings of this application are used to distinguish different objects, not to describe a specific order. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or apparatus that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products, or apparatuses.

[0124] The term "embodiment" as used herein means that a specific feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of this application. The appearance of this phrase in various places in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment mutually exclusive with other embodiments. Those skilled in the art will explicitly and implicitly understand that, unless otherwise specified or logically conflicting, the terminology and / or descriptions between the various embodiments of this application are consistent and can be mutually referenced, and technical features in different embodiments can be combined to form new embodiments based on their inherent logical relationships.

[0125] It should be understood that in this application, "at least one (item)" means one or more, "more than one" means two or more, "at least two (items)" means two or three or more, and "and / or" is used to describe the relationship between related objects, indicating that there can be three relationships. For example, "A and / or B" can mean: only A exists, only B exists, and A and B exist simultaneously, where A and B can be singular or plural. The character " / " generally indicates that the related objects before and after are in an "or" relationship. "At least one (item) of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one (item) of a, b, or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, and c can be single or multiple.

[0126] It should be noted that, in this application, "instruction" can include direct instruction, indirect instruction, explicit instruction, and implicit instruction. When describing a certain instruction information for the purpose of instructing A, it can be understood that the instruction information carries A, directly instructs A, or indirectly instructs A.

[0127] In this application, the information indicated by the instruction information is called the information to be instructed. In specific implementations, there are many ways to indicate the information to be instructed, such as, but not limited to, directly indicating the information to be instructed, such as the information to be instructed itself or its index. It can also indirectly indicate the information to be instructed by indicating other information, where there is a correlation between the other information and the information to be instructed. It can also indicate only a part of the information to be instructed, while the other parts are known or pre-agreed upon. For example, the instruction of specific information can be achieved by using a pre-agreed (e.g., protocol-defined) arrangement of various information, thereby reducing instruction overhead to some extent. The information to be instructed can be sent as a whole or divided into multiple sub-information units, and the sending period and / or timing of these sub-information units can be the same or different. This application does not limit the specific sending method. The sending period and / or timing of these sub-information units can be predefined, for example, according to a protocol, or configured by the transmitting device by sending configuration information to the receiving device.

[0128] It should be noted that in this application, "send" can be understood as "output" and "receive" can be understood as "input". "Send information to A", where "to A" simply indicates the direction of information transmission, and A is the destination, does not limit "send information to A" to a direct transmission over the air interface. "Send information to A" includes sending information directly to A, as well as sending information indirectly to A through a transmitter. Therefore, "send information to A" can also be understood as "outputting information destined for A". Similarly, "receive information from A" indicates that the source of the information is A, including receiving information directly from A, as well as receiving information indirectly from A through a receiver. Therefore, "receive information from A" can also be understood as "inputting information from A".

[0129] This application provides a display method, a data processing method, and related apparatus, relating to the field of data processing technology, such as display methods and data processing methods in a racing track driving scenario. To more clearly describe the solution of this application, some terms used in the embodiments of this application will be explained below.

[0130] Head-up display (HUD): Also known as a head-up display system, it refers to a multi-functional instrument panel centered on the driver and operated blindly. The HUD projects vehicle instrument information (such as speed, RPM, temperature, fuel level, etc.) and navigation information into the driver's field of vision. The driver can see the vehicle's instrument and navigation information directly in front of them without needing to look down at the instrument panel or central control display below the steering wheel. This improves braking reaction time in emergency situations and enhances driving safety and convenience.

[0131] Augmented reality head-up display (AR-HUD): This is a combination of holographic augmented reality (AR) technology and head-up display (HUD) functionality. Through computational processing, it overlays the acquired image information onto the real three-dimensional environment in front of the driving route. It can integrate information such as distance, speed, and navigation into the real-world view obtained by the driver. The combination of computational data and display scene makes digital information richer and more intuitive, improving the driving experience and driving safety.

[0132] The in-vehicle infotainment system (IVS) is the operating system installed in the vehicle. It provides users (drivers and passengers) with the fundamental ability to operate and manage numerous intelligent hardware and in-vehicle software components. It is responsible for underlying scheduling of complex tasks, processing various types of data, and displaying vehicle data, fault signals, and media information to users through diverse user interfaces (UIs). This provides drivers with effective assisted driving, semi-autonomous, and even autonomous driving capabilities, and passengers with a more comfortable and intelligent riding environment. The central control screen, instrument panel, head-up display (HUD), and various smart screens are important information interaction windows within the vehicle, visually integrating and displaying a variety of effective vehicle information to users.

[0133] Intelligent driving systems can include advanced driving assistance systems (ADAS) and / or autonomous driving systems (ADS). Intelligent driving systems utilize various sensors on the vehicle (including but not limited to: lidar, millimeter-wave radar, cameras, ultrasonic sensors, GPS, and inertial measurement units) to acquire information from the vehicle's surroundings, and analyze and process this information to achieve functions such as obstacle perception, target recognition, vehicle localization, path planning, and driver monitoring / alerts, thereby improving the safety, automation, and comfort of driving.

[0134] At different levels of autonomous driving (or intelligent driving levels, ranging from L0 to L5, totaling six levels), intelligent driving systems can achieve different levels of automated driving assistance based on artificial intelligence algorithms and information acquired by multiple sensors. These levels of autonomous driving are based on the classification standards of the Society of Automotive Engineers (SAE). Specifically, L0 is no automation; L1 is driver assistance; L2 is partial automation; L3 is conditional automation; L4 is high automation; and L5 is full automation. At levels L1 to L3, the task of monitoring road conditions and reacting is jointly completed by the driver and the system, requiring the driver to take over dynamic driving tasks. Levels L4 and L5 allow the driver to completely transform into a passenger. Currently, the functions that intelligent driving systems can achieve mainly include, but are not limited to: adaptive cruise control, automatic emergency braking, automatic parking, blind spot monitoring, forward cross-traffic alert / braking, rear cross-traffic alert / braking, forward collision warning, lane departure warning, lane keeping assist, rear collision warning, traffic sign recognition, traffic jam assist, and highway assist. It should be understood that the above-mentioned functions can have specific modes at different levels of autonomous driving (L0-L5). The higher the level of autonomous driving, the more intelligent the corresponding mode.

[0135] In some implementations, a vehicle being in intelligent driving mode can be understood as the state in which the vehicle is driving under the control of an intelligent driving system. For example, when a vehicle is operating with functions such as automatic parking, adaptive cruise assist, navigation cruise assist (NCA), and navigation on autopilot (NOA) enabled, it can be determined that the vehicle is in intelligent driving mode.

[0136] Vehicle control system (VCS) is an electronic system used to monitor and manage various functions and operations of a vehicle. The VCS collects real-time vehicle status information through sensors, such as vehicle speed, engine speed, coolant temperature, oil pressure, steering angle, and brake pedal position, and transmits these analog or digital signals to the corresponding electronic control unit (ECU). The ECU analyzes and processes these signals according to pre-programmed control procedures and algorithms, determines the vehicle's current driving state and the driver's intentions, and then issues precise control commands to the various actuators. The actuators adjust the operating state of corresponding components or systems according to the ECU's commands, thereby achieving precise control over various aspects of the vehicle's power, chassis, and body, enabling the vehicle to drive safely, stably, and efficiently according to the driver's wishes.

[0137] A perception system is a collection of devices and technologies within a vehicle used to perceive its own state, the surrounding environment, and other relevant information. It acts like the vehicle's "senses," enabling it to acquire various information to support safe driving, intelligent decision-making, and a comfortable ride. Perception content can include the perception of the vehicle's own state and environmental perception. Vehicle state perception includes vehicle speed, engine speed, tire pressure, vehicle posture (including attitude and position), and battery charge (for electric vehicles). This information helps the driver understand the vehicle's operating status and provides necessary data for the vehicle's control system to make adaptive adjustments and optimizations. Environmental perception includes detecting the presence, position, and movement of vehicles, pedestrians, and obstacles in front, behind, and to the sides; identifying traffic information such as road signs, markings, and traffic lights; and perceiving environmental factors such as weather conditions and lighting conditions. Perception methods include physical sensor perception and satellite positioning and communication perception. Physical sensor perception utilizes sensors based on various physical principles to acquire information. For example, cameras capture visual images using optical imaging principles, millimeter-wave radar detects the distance, speed, and angle of target objects using the reflection of millimeter waves, lidar creates three-dimensional point cloud maps through the reflection of laser beams, ultrasonic sensors measure distance using the reflection of ultrasonic waves, and infrared sensors detect the infrared radiation of objects. Satellite positioning and communication perception uses satellite positioning technologies such as the Global Positioning System (GPS) and the BeiDou Navigation Satellite System to determine the vehicle's geographical location and driving direction. Simultaneously, through vehicle-to-everything (V2X) technology, vehicles can also acquire traffic information, map data, and other data from external sources, further enriching their perception of the surrounding environment.

[0138] The following description, in conjunction with the accompanying drawings, introduces a display device and its display scenario that may be applied to this application.

[0139] Please see Figures 1 to 3 ,in, Figure 1 This illustration shows an application scenario of a display device 100 provided in this application in the automotive field. Figure 2 This illustration shows another perspective on the application scenario of a display device 100 provided in this application embodiment in the automotive field. Figure 3 This illustration shows an imaging schematic diagram of a display device 100 according to an embodiment of this application, which projects an image onto the driver's eye in the automotive field. Figure 1 and Figure 2 The display device 100 projects an image into the driver's eyes, allowing the driver to see virtual image information.

[0140] Depend on Figures 1 to 3As can be seen, when the driver looks out through the windshield 200, they can see a virtual image with a certain depth of field (i.e., the distance of the clear image within the range before and after the focal point of the image). Information acquisition modules, such as cameras and infrared sensors, acquire information about the road ahead, including distance to the vehicle in front, the speed of the vehicle in front, and other road information. This digital information is projected onto an image closely integrated with the surrounding environment. This digital information includes: vehicle speed, navigation information (road directions), vehicle gear, cruise control, distance to the vehicle in front, speed of the vehicle in front, engine speed, battery level, remaining driving range, and infotainment system information. This allows the driver to access necessary information without shifting their gaze while driving, avoiding the driving risks that might arise from neglecting road conditions while looking down at the instrument panel or central control screen.

[0141] To achieve the aforementioned display, the vehicle needs to be equipped with a head-up display (HUD) system. This HUD system may include a display device 100 and optical elements. The display device 100 can project images, and the optical elements may include the vehicle's windshield 200, a reflective film attached to the windshield 200, or a separate screen within the vehicle's cabin. The optical elements can reflect and / or refract the image projected by the display device 100 before projecting it into the driver's eyes, allowing the driver to obtain a virtual information image in front of the windshield 200. Optionally, the display device 100 has one or more interfaces through which current and / or image signals are obtained from the vehicle's central control system or in-vehicle infotainment system. The current signals are used to power the electrical components in the display device 100, and the image signals are used to provide the displayed image.

[0142] In the automotive industry, over 100 display devices that enhance head-up display functionality are located on the center console of vehicles. (See also...) Figure 1 , Figure 2 , Figure 3 As shown, the display device 100 can be installed in the center console and located in front of the steering wheel (in the direction of the car's travel).

[0143] It should be noted that the vehicles used in the embodiments of this application are all exemplified as automobiles and should not be considered as limitations on the embodiments of this application. The vehicle can be a traditional gasoline-powered vehicle, or a new energy vehicle such as a pure electric vehicle or a hybrid vehicle. The vehicle can be any of different types of automobiles, such as sedans, trucks, passenger buses, and sport utility vehicles (SUVs), or it can be a land transportation device for carrying people or goods, such as a tricycle, motorcycle, or train. Alternatively, the display device of this application can also be applied to other types of transportation vehicles such as airplanes and ships.

[0144] Currently, with the development of the intelligent vehicle market, electric vehicles have achieved significant improvements in power performance, intelligent configuration, and control systems. As users increasingly pursue a higher level of driving experience, especially among those who seek speed and driving pleasure, track driving is gradually becoming an important scenario for unleashing vehicle performance and meeting personalized needs.

[0145] Therefore, there is an urgent need for a feasible solution to help drivers quickly grasp road characteristics and vehicle performance, enabling vehicles to unleash their high-performance potential on the road and improve the user's driving experience.

[0146] In view of this, embodiments of this application provide a display method, a data processing method, and related apparatus, relating to the field of data processing technology, such as display methods and data processing methods in track driving scenarios, which can help drivers quickly grasp road characteristics and vehicle performance, enabling vehicles to unleash their high-performance potential on the road and improve the user's driving experience.

[0147] The display system, display method, data processing system, data processing method, and related devices provided in this application will now be described in detail with reference to the accompanying drawings.

[0148] Please see Figure 4 , Figure 4 This is a schematic diagram of the architecture of a display system provided in an embodiment of this application.

[0149] like Figure 4 As shown, the architecture of this display system includes, but is not limited to, the vehicle's control system, intelligent driving system, perception system, in-vehicle infotainment system, cockpit, and AR-HUD. The descriptions of each module are as follows:

[0150] The perception system is used to perceive the vehicle's own status information (such as, but not limited to, vehicle speed, engine speed, tire pressure, vehicle position, battery / fuel level, etc.) and the environmental information of the road segment in which the vehicle is located (such as, but not limited to, road segment type (highway segment, race track, urban road, etc.), road surface condition, road facilities, obstacles, weather, etc.), and to determine vehicle control prompts and / or vehicle control suggestions based on the perceived information.

[0151] The vehicle control suggestion information can be understood as providing vehicle control recommendations based on the road conditions the vehicle is in. Drivers can follow these recommendations to control the vehicle, ensuring safety while maximizing its performance potential and improving the driving experience. The vehicle control prompt information can be understood as alerting the driver to discrepancies between their actual driving behavior and the suggested recommendations. When there are significant differences between the driver's actual behavior and the suggested recommendations, these discrepancies are provided to the driver. The driver can then correct their behavior accordingly, reducing or eliminating the discrepancy and aligning their actions with the suggested recommendations. This ensures the vehicle maintains safety while maximizing its performance potential and improving the driving experience.

[0152] Optionally, the perception system may also provide the perceived information to the vehicle's intelligent driving system or other modules with computing capabilities, and the vehicle's intelligent driving system or other modules with computing capabilities may determine the above-mentioned vehicle control prompt information and / or vehicle control suggestion information based on the perceived information. This application embodiment does not limit this.

[0153] Optionally, for scenarios where the road environment is a racetrack, the perception system may include, but is not limited to, a real-time kinematic global positioning system (RTK-GPS), an inertial measurement unit (IMU), and a simultaneous localization and mapping (SLAM) module, for real-time and accurate positioning within the racetrack environment. Optionally, the perception system may also include, but is not limited to, wheel speed sensors, gyroscopes, accelerometers, steering wheel angle sensors, and engine operating condition data acquisition modules, for real-time perception and monitoring of vehicle status.

[0154] The intelligent driving system is used to acquire perception information from the aforementioned perception system, analyze and process the acquired perception information, and determine the aforementioned vehicle control prompt information and / or vehicle control suggestion information.

[0155] Optionally, for scenarios where the road environment is a racetrack, the intelligent driving system can combine LiDAR point clouds and high-precision maps to generate a dynamic driving path that includes parameters such as curve curvature, slope, and curb height, and make real-time corrections. For example, when the system detects that the driver is slowing down in advance, it adaptively shortens the braking zone warning range and adjusts the optimal cornering trajectory.

[0156] Optionally, for scenarios where the road environment is a racetrack, the intelligent driving system can also provide multimodal route suggestions based on racetrack data modeling. For example, in safety mode, it can provide a conservative path (with a safety margin along the inside of the curve); in performance mode, it can provide a high-performance extreme path (a driving trajectory that closely follows the inside of the curve).

[0157] Optionally, for scenarios where the road environment is a racetrack, the intelligent driving system can also combine the driver's driving style and driving intention recognition to provide multiple driving style route suggestions. For example, it can judge the driver's control tendency in real time. If continuous sharp turns are detected, it can provide an aggressive driving route suggestion; if slow turns are detected, it can provide a conservative driving route suggestion.

[0158] The vehicle control system is used to acquire perception information from the aforementioned perception system, analyze and process the acquired perception information, determine the current driving status of the vehicle and the driver's operating intention, and then determine the aforementioned vehicle control prompt information and / or vehicle control suggestion information, and issue precise control commands to each actuator to achieve precise control of various aspects of the vehicle's power, chassis, body, etc., so that the vehicle can drive safely, stably and efficiently according to the driver's wishes.

[0159] Optionally, for scenarios where the road environment is a racetrack, the vehicle control system can pre-calculate the optimal cornering speed and route for each road segment based on the vehicle chassis parameters (mass, moment of inertia, grip coefficient, etc.) and power system characteristics.

[0160] Optionally, for scenarios where the road environment is a racetrack, the vehicle control system can also use features such as steering wheel turning angle rate and acceleration / deceleration response time to judge the driver's driving tendency in real time and provide aggressive / conservative driving suggestions.

[0161] The vehicle infotainment system provides users (drivers and passengers) with the basic ability to operate and manage numerous intelligent hardware and in-vehicle software. It also integrates and displays various effective vehicle information to in-vehicle users in a visual way, such as displaying vehicle data, fault signals, and media information to users through diverse user interfaces (UI).

[0162] Optionally, the in-vehicle infotainment system can also provide users with an interface such as a screen, buttons, sliders, knobs, levers, and voice commands to enable interaction between the user and the cabin.

[0163] Optionally, users can activate the AR-HUD display function through interaction with the cockpit. At this time, data from the aforementioned perception system, intelligent driving system, vehicle control system, and vehicle infotainment system (including but not limited to the aforementioned vehicle control prompts and / or vehicle control suggestions) can be provided to the AR-HUD, which then generates and displays the corresponding two-dimensional and / or three-dimensional data.

[0164] AR-HUD uses the generated vehicle control prompts and / or suggestions to generate two-dimensional and / or three-dimensional data. Through data processing including but not limited to data modeling, latency compensation, slope compensation, image frame optimization, 3D perspective changes, and layer overlay, it displays accurate AR images that blend reality and virtuality in the track environment.

[0165] Optionally, for scenarios where the road environment is a racetrack, AR-HUD can automatically adjust the depth of field of the virtual image based on the driver's interpupillary distance to reduce visual fatigue.

[0166] Optionally, for scenarios where the road environment is a race track, the AR-HUD can also adjust the display brightness in real time according to the race track environment to ensure the visibility of the displayed content in sunlight.

[0167] Optionally, for scenarios where the road environment is a racetrack, the AR-HUD can also annotate the aforementioned vehicle control prompts and / or suggestions. For example, the AR-HUD displays the optimal driving path on a real road and marks the key points. Another example is that the AR-HUD, combined with a braking distance model, dynamically displays a red gradient zone before entering a curve, adjusting the starting position in real time according to vehicle speed. Yet another example is that the AR-HUD overlays dynamic arrows and digital scales (such as "65→80km / h") at the edge of the track to indicate the deviation between the current speed and the recommended cornering speed, and so on.

[0168] It should be understood that the above Figure 4 The display architecture shown is merely an illustrative example of a possible embodiment and should not be construed as limiting the scope of this application. Figure 4 The display architecture shown may also include more or fewer modules, and this application embodiment does not limit this.

[0169] As can be seen from the above display architecture, with AR-HUD as the core, by integrating perception, planning, control, and human-computer interaction technologies, a bird's-eye view of the path and key driving information (such as the optimal cornering route, braking point markings, speed threshold prompts, etc.) can be projected into the real road environment in front of the driver's field of vision in a virtual-real fusion manner. Combined with vehicle perception data, vehicle control suggestions and / or vehicle control prompts can be dynamically adjusted, achieving at least the following technical effects:

[0170] (1) Real-time visual guidance: Through high-precision map matching and camera positioning, ensure that virtual signs are accurately superimposed on road physical features;

[0171] (2) Reduce cognitive load: Transform complex operational logic into intuitive visual cues (such as speed limit color warnings, dynamic arrow trajectories, etc.) to help drivers quickly understand track strategies;

[0172] (3) Personalized adaptation: Adjust the guidance intensity according to the vehicle performance parameters and the driver's real-time driving behavior, taking into account the learning efficiency and optimization space of drivers with different driving skills.

[0173] Therefore, through the embodiments of this application, drivers can quickly grasp road characteristics and vehicle performance, enabling vehicles to maximize their high-performance potential while ensuring driving safety on the road, allowing drivers to fully enjoy the driving pleasure brought by vehicle performance.

[0174] Based on the architecture of this display system, the display method provided in this application can be executed to help drivers quickly grasp road characteristics and vehicle performance, enabling vehicles to unleash their high-performance potential on the road and improve the user's driving experience.

[0175] Please see Figure 5 , Figure 5 This is a flowchart illustrating a display method provided in an embodiment of this application. This display method is applied in the field of data processing technology, such as data display in a racing scenario.

[0176] Specifically, the display method includes, but is not limited to, the following steps:

[0177] S501: The display device displays the first data.

[0178] The first data includes vehicle control prompt information and / or vehicle control suggestion information corresponding to the first road segment environment where the first vehicle is located. The vehicle control prompt information is used to indicate the difference between the driver's driving behavior and the vehicle control suggestion information.

[0179] It is understood that the display device in the embodiments of this application may be a device equipped with a processor / chip that can execute computer execution instructions, or it may be a processor / chip that can execute computer execution instructions. Optionally, the display device may be an electronic device, or it may be a processor / chip within an electronic device. Specifically, the display device may be as described above. Figures 1 to 3 The display device in the middle can also be the one described above. Figure 4The AR-HUD in the present application is used to execute the display method in the embodiments of this application, so as to help the driver quickly grasp the road characteristics and vehicle performance, enable the vehicle to exert its high performance potential on the road, and improve the user's driving experience.

[0180] Optionally, the display device may specifically include, but is not limited to, any one or more of the following: augmented reality head-up display (AR-HUD), vehicle headlight module, and vehicle-mounted projector. It is understood that the above-mentioned display device can display images through various means, including but not limited to projection, light projection, and display screens. The displayed image can be a real image or a virtual image, and this application embodiment does not impose any limitations on this.

[0181] Optionally, the display device and display method in the embodiments of this application can be applied to, but are not limited to, vehicle systems. The vehicle equipped with the vehicle system is an intelligent driving vehicle and can be replaced by a terminal device. The terminal device can be, but is not limited to, vehicles such as commercial vehicles, passenger cars, trains, industrial vehicles (such as forklifts, trailers, tractors, etc.), engineering vehicles (such as excavators, bulldozers, cranes, etc.), robots, etc. The embodiments of this application do not specifically limit this.

[0182] It is understood that the display method in this application embodiment can display vehicle control suggestion information corresponding to the first road segment environment where the first vehicle is located in real time during the driving of the first vehicle, and can also display vehicle control prompt information corresponding to the first road segment environment in real time.

[0183] The environment of the first road segment may include, but is not limited to, road segment type (such as highway segment, race track, urban road, etc.), road surface condition, road facilities, obstacles, weather, etc., and this application embodiment does not limit this.

[0184] The vehicle control suggestion information can be understood as including vehicle control suggestions given for the first road segment environment. After seeing the displayed first data, the driver can control the vehicle according to the given vehicle control suggestions to ensure the vehicle's safety while maximizing its performance potential in the first road segment environment, thereby improving the driver's driving experience. Optionally, the vehicle control suggestions may include specific driving parameters or only a brief description of the driving suggestions; this application embodiment does not limit this. For example, road segment 1 in the first road segment environment includes location points A, B, and C. The vehicle control suggestions corresponding to road segment 1 include: the vehicle control suggestion for location point A is that the steering angle should be 40 degrees to the right and the speed should be controlled within 60 km / h; the vehicle control suggestion for location point B is that the steering angle should be 100 degrees to the left, the handbrake should be engaged, and the speed should be controlled within 80 km / h; the vehicle control suggestion for location point C is to straighten the vehicle and control the speed within 100 km / h. For example, in the first road segment environment, road segment 2 includes location points D, E, and F. The vehicle control suggestions corresponding to road segment 2 are as follows: the vehicle control suggestion for location point D is to control the vehicle to turn right; the vehicle control suggestion for location point E is to control the vehicle to make a U-turn and accelerate; and the vehicle control suggestion for location point F is to accelerate.

[0185] The vehicle control prompt information can be understood as a way to alert the driver of the first vehicle to the difference between their driving behavior and the vehicle control suggestion. When there is a significant difference between the driver's actual driving behavior and the given vehicle control suggestion, this difference can be displayed through the first data. After seeing the displayed first data, the driver can promptly correct their driving behavior according to the given vehicle control prompt, reducing or even eliminating the difference between their driving behavior and the given vehicle control suggestion, thus aligning with the given vehicle control suggestion. This allows the vehicle to maximize its performance potential while ensuring safety in the first road segment environment, improving the driver's driving experience. Optionally, the vehicle control prompt may include specific driving parameters or only a brief description of the driving prompt; this application embodiment does not impose any limitations on this. For example, road segment 1 in the first road segment environment includes location point A. The vehicle control suggestion corresponding to location point A is that the steering angle should be a 40-degree right turn. However, the driver's actual driving behavior is only a 20-degree right turn. In this case, the given vehicle control prompt could be to continue turning the steering wheel to the right for another 20 degrees, or it could be to continue turning right.

[0186] Optionally, the aforementioned first data may include vehicle control suggestion information. Accordingly, the display device may directly display the aforementioned vehicle control suggestion information, that is, provide vehicle control suggestions to the driver, suggesting that the vehicle should be in the state indicated by the vehicle control suggestion information in the first road segment environment. After seeing the vehicle control suggestion information, the driver should use his own driving behavior to make the vehicle reach the state indicated by the vehicle control suggestion information as much as possible.

[0187] Optionally, the aforementioned first data may include vehicle control suggestion information and vehicle control prompt information. Accordingly, the display device may directly display the aforementioned vehicle control suggestion information. When there is a difference or a large difference between the driver's actual driving behavior and the given vehicle control suggestion, the aforementioned vehicle control prompt information may be further displayed to remind the driver that there is a difference or a large difference between the current driving behavior and the given vehicle control suggestion. After seeing the vehicle control prompt information, the driver can correct his driving behavior in a timely manner according to the given vehicle control prompt, reduce or even eliminate the difference between his driving behavior and the given vehicle control suggestion, and move closer to the given vehicle control suggestion.

[0188] Optionally, the aforementioned first data may include vehicle control prompt information. Accordingly, the display device may directly display the aforementioned vehicle control prompt information to remind the driver that there is a difference or a large difference between the current driving behavior and the vehicle control suggestion under the ideal state. After seeing the vehicle control prompt information, the driver can correct his driving behavior in a timely manner according to the given vehicle control prompt, reduce or even eliminate the difference between his driving behavior and the vehicle control suggestion under the ideal state, and move closer to the vehicle control suggestion under the ideal state.

[0189] Optionally, the aforementioned vehicle control prompts and / or suggestions may be obtained from other components with computing capabilities, such as the vehicle's intelligent driving system, vehicle control system, perception system, and vehicle infotainment system. For details, please refer to the above. Figure 4 The description of the display architecture shown is not limited in this application embodiment. Furthermore, the aforementioned vehicle control prompts and / or vehicle control suggestions are provided to the display device, which generates first data based on this, thereby enabling the display of the corresponding first data.

[0190] Through the embodiments of this application, the aforementioned first data can be displayed in real time to help drivers quickly grasp road characteristics and vehicle performance, assisting drivers in making optimal or better vehicle control behaviors on the road, so that the vehicle can exert its high performance potential advantages on the road, thereby improving the user's driving experience.

[0191] Optionally, the aforementioned first data may include two-dimensional (2D) data or three-dimensional (3D) data, and this application embodiment does not impose any limitation on this. It is understood that the aforementioned vehicle control prompt information and / or vehicle control suggestion information may be displayed in the form of two-dimensional data and / or three-dimensional data.

[0192] Optionally, when the first data includes three-dimensional data, the display device (AR-HUD) can display the three-dimensional data in layers within the spatial area between the observation point and the first road segment environment. Through layered display, the above-mentioned vehicle control prompts and / or vehicle control suggestions can be displayed in a realistic way to the real-world information of the first road segment environment. This allows the vehicle control prompts and / or vehicle control suggestions to be presented to the user more effectively during vehicle operation, improving information display efficiency and enhancing the user's cognitive efficiency. This enables the driver to quickly grasp road characteristics and vehicle performance, ensuring driving safety and improving the driving experience.

[0193] Alternatively, the observation point can be understood as a point in the driver's pupil or an area of ​​the eye box where the displayed content can be observed.

[0194] In one possible embodiment, the aforementioned vehicle control suggestion information may specifically possess the following characteristics:

[0195] Optionally, the vehicle control suggestion information may include, but is not limited to, any one or more of the following:

[0196] Suggested vehicle speed, vehicle position, gear position, steering angle, and headlight control.

[0197] It is understood that vehicle control suggestion information may include, but is not limited to, any one or more of the aforementioned vehicle control-related suggestions, which can be obtained from different relevant components of the vehicle and provided to the display device for display. Furthermore, through augmented reality display of the vehicle control suggestion information and the real-world environmental information of the first road segment, the aforementioned vehicle control suggestion information can be presented to the user more effectively during vehicle operation. This allows the driver to quickly grasp road characteristics and vehicle performance, assisting the driver in making optimal or superior vehicle control actions on the road, enabling the vehicle to unleash its high-performance potential and thus improving the user's driving experience.

[0198] Optionally, when the aforementioned first road segment environment includes a racetrack environment, the vehicle control suggestion information may specifically include, but is not limited to, any one or more of the following:

[0199] Driving suggestions for Drift Mode, Time Trial Mode, Chase Mode, Obstacle Course Mode, Endurance Course Mode, and Formation Mode.

[0200] It is understood that when the first road segment environment includes a track environment, the aforementioned vehicle control suggestions may include, but are not limited to, any one or more of the vehicle control suggestions related to the track mode. Optionally, in different track modes, the corresponding vehicle control suggestions may include, but are not limited to, vehicle speed suggestions, vehicle position suggestions, vehicle gear suggestions, steering angle suggestions, headlight control suggestions, etc. For details, please refer to the relevant descriptions above, which will not be repeated here.

[0201] Through the embodiments of this application, the above-mentioned vehicle control suggestion information can be displayed in real time to help drivers quickly grasp the characteristics of the track and the performance of the vehicle, assisting drivers to make optimal or better vehicle control behaviors in the track environment, so that the vehicle can give full play to its high performance potential in the track scenario, thereby improving the user's driving experience.

[0202] Alternatively, the above vehicle control recommendations can be determined by the environment of the first road segment.

[0203] For example, specific information about the first road segment environment can be obtained based on navigation information and / or high-precision maps. Then, based on the driving experience requirements proposed by the user (such as drifting, racing, high curvature turns, etc.), the above-mentioned vehicle control suggestions can be obtained through intelligent driving algorithms or 3D topology models of roads. This will help the driver make optimal or better vehicle control behaviors in the first road segment environment, so that the vehicle can give full play to its high performance potential advantages in the first road segment environment and meet the driving experience requirements proposed by the user.

[0204] For example, the vehicle can be driven once or multiple times in the first road segment environment in advance to collect more accurate measured data on the first road segment environment, such as road surface information, pothole information, slope, and curves, which cannot be provided by navigation information and high-precision maps. Based on the driving experience requirements proposed by the user (such as drifting, racing, and high-curvature turns), the above-mentioned vehicle control suggestions are obtained through intelligent driving algorithms or 3D topology models of the road. This helps the driver make optimal or better vehicle control behaviors in the first road segment environment, so that the vehicle can give full play to its high performance potential advantages in the first road segment environment and meet the driving experience requirements proposed by the user.

[0205] By using the embodiments of this application to determine vehicle control suggestion information based on the environment of the first road segment, the given vehicle control suggestions can ensure vehicle driving safety as much as possible and maximize the performance potential of the vehicle, thereby improving the user's driving experience.

[0206] Optionally, the aforementioned vehicle control suggestion information may be determined from the driver's historical driving behavior of the first vehicle.

[0207] For example, driving style or intention can be identified based on the driver's historical driving behavior recorded in the driver's associated account. For instance, if there are many consecutive sharp turns or accelerations in the historical driving behavior, it is identified as an aggressive driving style; if there are many continuous slow turns or accelerations in the historical driving behavior, it is identified as a conservative driving style. Based on the driver's corresponding aggressive / conservative driving style, and based on the user's proposed driving experience needs (such as drifting, racing, high-curvature turns, etc.), the above-mentioned vehicle control suggestions are obtained through intelligent driving algorithms or 3D road topology models. This helps the driver make optimal or better vehicle control behaviors in the first road segment environment, so that the vehicle can exert its high-performance potential advantages in the first road segment environment, meet the user's proposed driving experience needs, and largely follow the user's driving habits.

[0208] For example, the vehicle can be driven once or multiple times in the first road segment environment beforehand to record the driver's historical driving behavior in that environment and identify the driver's driving preferences at various locations within that environment. Based on the driver's driving preferences in the first road segment environment, and based on the user's proposed driving experience needs (such as drifting, racing, and high-curvature turns), the aforementioned vehicle control suggestions are obtained through intelligent driving algorithms or a 3D topology model of the road. This assists the driver in making optimal or near-optimal vehicle control behaviors in the first road segment environment, enabling the vehicle to leverage its high-performance potential and meet the user's proposed driving experience needs, while also largely adhering to the user's driving habits.

[0209] Through the embodiments of this application, the given vehicle control suggestions can ensure vehicle driving safety as much as possible and maximize the performance potential of the vehicle, while also largely following the user's driving habits and improving the user's driving experience.

[0210] Optionally, it can also be combined with Figure 6A For an explanation of the above vehicle control recommendations, please refer to [link / reference]. Figure 6A , Figure 6A This is a schematic diagram of an augmented reality display provided in an embodiment of this application.

[0211] like Figure 6A As shown, the display device projects the aforementioned first data onto the AR-HUD display area, allowing the driver to see digital information with an augmented reality visual experience.

[0212] From the driver's perspective, the AR-HUD can be seen overlaying both AR data (3D data) and non-AR data (2D data) onto the vehicle's real-world 3D environment. The AR data includes, but is not limited to, AR lane change indicators (such as...). Figure 6AThe virtual arrow and virtual lane change guide lines shown in 601 are directly displayed on the actual road surface. Non-AR data includes, but is not limited to, vehicle speed (e.g., 118 km / h), speed limit (e.g., 120 km / h), and navigation information (e.g., turn right 60m ahead). The real-world 3D environment in which the vehicle is located includes, but is not limited to, the road where the vehicle is located, road facilities, vehicles or obstacles on the road, and weather.

[0213] Depend on Figure 6A As can be seen, there are many vehicles ahead in the lane where the vehicle is located and the adjacent left lane, and a right turn is imminent within 60 meters. Based on the current road conditions and / or the driver's historical driving behavior (driving habits), a lane-changing suggestion to the right is given. The display content of the first data corresponding to this suggestion can be as follows: Figure 6A The virtual arrow and virtual lane change guide lines shown in 601 are integrated into the real three-dimensional environment in which the vehicle is located (directly displayed on the actual road surface). This makes the digital information with augmented reality visual experience seen from the driver's perspective richer and more intuitive. This helps the driver to quickly grasp the road characteristics and vehicle performance, enabling the vehicle to exert its high-performance potential advantages while ensuring driving safety on the road, allowing the driver to fully enjoy the driving pleasure brought by the vehicle's performance.

[0214] In one possible embodiment, the aforementioned vehicle control prompt information may specifically have the following characteristics:

[0215] Optionally, the vehicle control prompt information can be determined by vehicle control suggestion information and the driving behavior of the driver of the first vehicle.

[0216] It is understandable that the vehicle control suggestion information can be interpreted as an idealized vehicle control recommendation given by the vehicle's computing components based on considerations of vehicle driving safety and maximizing vehicle performance potential, tailored to the first road segment environment. However, in actual driving, the driver's actual driving behavior may differ from the given vehicle control suggestion due to personal or external factors. When this difference exists or is significant, it may affect vehicle driving safety and the realization of vehicle performance potential, thereby impacting the driving experience. Therefore, the vehicle's computing components can determine vehicle control prompts based on the driver's driving behavior and the given vehicle control suggestion information. These prompts can then be used to alert the driver to the discrepancy between their driving behavior and the suggested information.

[0217] Furthermore, the vehicle control prompt information is provided to the display device, which can then display the difference through the first data. After seeing the displayed first data, the driver can promptly correct their driving behavior according to the given vehicle control prompt, reducing or even eliminating the difference between their driving behavior and the given vehicle control suggestion, and moving closer to the given vehicle control suggestion. This allows the vehicle to maximize its performance potential while ensuring safety in the first road segment environment, thereby improving the user's driving experience.

[0218] Furthermore, by using augmented reality display to present vehicle control prompts to the real-world environment of the first road segment, the vehicle control prompts can be presented to the user more effectively during vehicle operation. This allows the driver to quickly grasp the road characteristics and vehicle performance, assisting the driver in making optimal or better vehicle control actions on the road, enabling the vehicle to unleash its high-performance potential and thus improving the user's driving experience.

[0219] Optionally, it can also be combined with Figure 6B For an explanation of the above vehicle control prompts, please refer to [link / reference]. Figure 6B , Figure 6B This is a schematic diagram of an augmented reality display provided in an embodiment of this application.

[0220] like Figure 6B As shown, the display device projects the aforementioned first data onto the AR-HUD display area, allowing the driver to see digital information with an augmented reality visual experience.

[0221] From the driver's perspective, the AR-HUD can be seen overlaying both AR data (3D data) and non-AR data (2D data) onto the vehicle's real-world 3D environment. The AR data includes, but is not limited to, vehicle control suggestions and prompts (such as…). Figure 6BThe virtual indicator arrows and speed limit rings shown in 602a, 602b, and 602c are directly displayed on the actual road surface. This vehicle control suggestion includes the virtual indicator arrows corresponding to 602a, 602b, and 602c, indicating a suggested right turn ahead. It also includes the number "120" corresponding to 602a, 602b, and 602c, indicating a suggested speed limit of 120 km / h. This vehicle control prompt includes the outer halo of the number "120" corresponding to 602a, 602b, and 602c. This indicates the difference between the driver's current actual vehicle speed and the recommended speed of 120 km / h. The thicker and darker the halo around the number "120," the greater the driver's actual speed exceeds the recommended speed of 120 km / h, suggesting the driver should further reduce speed. Conversely, the thinner and lighter the halo around the number "120," the less the driver's actual speed exceeds the recommended speed of 120 km / h, suggesting the driver should further reduce speed only slightly or not at all. Non-AR data includes, but is not limited to, the vehicle's current speed (e.g., ...). Figure 6B The numbers "138", "128", and "118" in the text represent the vehicle's current speed as 138 km / h, 128 km / h, and 118 km / h, respectively. The real-world 3D environment in which the vehicle is located includes, but is not limited to, the road where the vehicle is located, road facilities, vehicles or obstacles on the road, and the weather.

[0222] Depend on Figure 6B It can be seen that the traffic sign's attribute information indicates that the vehicle should be limited to a speed of 120km / h and is about to turn right. At this time, based on the current road environment and / or the driver's historical driving behavior (driving habits), a vehicle control suggestion is given to decelerate at the first deceleration, so that the vehicle decelerates smoothly and the speed is reduced to less than 120km / h at a certain distance before the curve.

[0223] exist Figure 6B In (1), the actual vehicle speed monitored by the driver is 138 km / h, which exceeds the recommended speed of 120 km / h by a significant margin. The vehicle control prompt message given at this time is shown in the outer halo of the number "120" corresponding to 602a. The outer halo is thicker and darker in color, indicating that the actual vehicle speed exceeds the recommended speed of 120 km / h by a significant margin, and prompting the driver to continue to reduce the speed considerably. Optionally, this prompt is made by adjusting the thickness and color of the outer halo. Other methods can also be used to make this vehicle control prompt, and this should not be construed as limiting the embodiments of this application. For example, the above vehicle control prompt can be made by directly displaying the text "Please continue to reduce the speed considerably!", or by using voice broadcast. This embodiment of the application does not limit this.

[0224] exist Figure 6BIn step (2), the actual vehicle speed monitored by the driver is 128 km / h, which is slightly higher than the recommended speed of 120 km / h. The vehicle control prompt message given at this time is shown in the outer halo of the number "120" corresponding to 602b. The outer halo is of medium thickness and medium color intensity, used to indicate that the actual vehicle speed exceeds the recommended speed of 120 km / h slightly, and to prompt the driver to continue to reduce the speed slightly. Optionally, this prompt is made by adjusting the thickness and color intensity of the outer halo. Other methods can also be used to make this vehicle control prompt, and this should not be construed as limiting the embodiments of this application. For example, the above vehicle control prompt can be made by directly displaying the text "Please continue to reduce the speed slightly!", or by using voice broadcast. This embodiment of the application does not limit this.

[0225] exist Figure 6B In step (3), the actual vehicle speed monitored by the driver is 118 km / h, which is within the recommended speed of 120 km / h and the difference is small. At this time, the vehicle control prompt information given is as shown by the outer halo of the number "120" corresponding to 602c. The outer halo is thin and light in color, which is used to prompt the driver that the actual vehicle speed is within the recommended speed of 120 km / h and the difference is small, and to prompt the driver that there is no need to continue to decelerate and to continue driving at the current speed. Optionally, the prompt is made by the thickness and color of the outer halo. The prompt can also be made by other means, and should not be construed as limiting the embodiments of this application. For example, the above vehicle control prompt can also be made by displaying the text "Please maintain the current speed, no need to continue to decelerate!", or by voice broadcast. The embodiments of this application do not limit this.

[0226] From the above Figure 6B It can be seen that the display content of the first data corresponding to the vehicle control suggestion and vehicle control prompt can be as follows: Figure 6B The virtual indicator arrows and speed limit rings shown in 602a, 602b, and 602c are integrated into the real three-dimensional environment in which the vehicle is located (directly displayed on the actual road surface). This makes the digital information with augmented reality visual experience seen from the driver's perspective richer and more intuitive. This helps the driver quickly grasp the road characteristics and vehicle performance, enabling the vehicle to exert its high-performance potential advantages while ensuring driving safety on the road, allowing the driver to fully enjoy the driving pleasure brought by the vehicle's performance.

[0227] Optionally, it can also be combined with Figure 6C For an explanation of the vehicle control suggestions and prompts displayed in track scenarios, please refer to [link / reference]. Figure 6C , Figure 6C This is a schematic diagram of an augmented reality display provided in an embodiment of this application.

[0228] like Figure 6C As shown in (1), the vehicle is driving on the track. At the bend ahead, the driver activates drift mode, intending to drift to the right using power drift. At this time, based on the current track environment and / or the driver's historical driving behavior (driving habits), a vehicle control suggestion for drifting to the right is given, and corresponding vehicle control prompts are given in combination with the driver's actual vehicle control behavior.

[0229] like Figure 6C As shown in (2), the above vehicle control suggestions and prompts can be projected onto the AR-HUD display area through the vehicle's display device, so that the driver can see digital information with a real-world augmented visual experience.

[0230] From the driver's perspective, the AR-HUD can be seen overlaying both AR data (3D data) and non-AR data (2D data) onto the vehicle's real-world 3D environment. The AR data includes, but is not limited to, vehicle control suggestions (such as…). Figure 6C The virtual indicator arrow shown in 603a is directly displayed on the actual track) and vehicle control prompts (such as... Figure 6C The virtual steering wheel operation shown in 603b is directly displayed on the actual track. Non-AR data includes, but is not limited to, the vehicle's current speed (e.g., ...). Figure 6C The number "98" indicates the vehicle's current speed is 98 km / h. The real-world 3D environment in which the vehicle is located includes, but is not limited to, the track where the vehicle is located, track facilities, vehicles or obstacles on the track, and the weather.

[0231] exist Figure 6B In step (2), a right turn lane is detected ahead of the track, and drift mode is activated. The vehicle control suggestion given at this time is shown by the virtual indicator arrow corresponding to 603a, which suggests that the driver quickly turn the steering wheel 90 degrees to the right at the current speed to achieve rapid vehicle steering and drifting to the right through the turn. Optionally, this suggestion is made by the bending angle of the virtual indicator arrow. Other methods can also be used to make this vehicle control suggestion, and this should not be construed as limiting the embodiments of this application. For example, the above vehicle control suggestion can be made directly by displaying the text "Please quickly turn the steering wheel 90 degrees to the right at the current speed!", or by voice broadcast. This embodiment of the application does not limit this.

[0232] When the driver's actual vehicle control behavior is detected to be only turning the steering wheel 60 degrees to the right, which is significantly different from the suggested 90 degrees, the vehicle control prompt message is as shown in the virtual steering wheel operation corresponding to 603b. This prompts the driver that the actual steering angle of 60 degrees differs significantly from the suggested 90 degrees, and that the driver should continue to turn the steering wheel quickly to the right at the current speed. Optionally, this prompt is made by using the rotation angle of the virtual steering wheel operation. Other methods can also be used to make this vehicle control prompt, and this should not be considered a limitation of the embodiments of this application. For example, the prompt can be made by displaying the text "Please continue to turn the steering wheel quickly to the right by 30 degrees at the current speed!" or by using voice broadcast. This embodiment of the application does not limit this approach.

[0233] Through the embodiments of this application, vehicle control suggestions and prompts can be integrated into the real three-dimensional environment in which the vehicle is located (directly displayed on the actual track) in a track scenario. This makes the digital information with augmented reality visual experience seen from the driver's perspective richer and more intuitive, thereby helping the driver to quickly grasp the track characteristics and vehicle performance. This assists the driver in making optimal or better vehicle control behaviors on the track, so that the vehicle can give full play to its high-performance potential while ensuring driving safety on the track, allowing the driver to fully enjoy the driving pleasure brought by the vehicle's performance.

[0234] In one possible embodiment, the above display method may also perform the following steps, including but not limited to:

[0235] The display device generates the second data.

[0236] The second data includes data on the driver's driving behavior in the first road segment environment.

[0237] Understandably, it can also record the driver's driving behavior in the first road segment environment and generate corresponding second data, so that after the trip, the second data can be used to review the driver's driving behavior and carry out subsequent operations such as accident liability determination and driving behavior optimization.

[0238] In one possible embodiment, after the trip ends, the driving data of the historical trip can be reviewed by rerunning the first road segment environment. In this case, the display method can also perform the following steps, including but not limited to:

[0239] Optionally, the display device acquires the aforementioned first data and displays the first data in the spatial area between the observation point and the first road segment environment during the first vehicle's journey through the first road segment environment.

[0240] Understandably, after the trip ends, the first road segment environment can be re-run. During the vehicle's journey through the first road segment environment, the first data can be displayed in the spatial area between the observation point and the first road segment environment. This allows for a review of historical driving data. By viewing the augmented reality display of the first data and the real-world information of the first road segment environment, subsequent operations such as accident liability determination and driving behavior optimization can be performed.

[0241] Optionally, the display device acquires the second data and displays the second data in the spatial area between the observation point and the first road segment environment during the first vehicle's travel in the first road segment environment.

[0242] The second data includes data on the driver's driving behavior in the first road segment environment.

[0243] Understandably, after the trip ends, the second data can be displayed in the spatial area between the observation point and the first road segment environment while the vehicle is driving in the first road segment environment. This allows for a review of the driver's driving behavior. By viewing the augmented reality display of the second data and the real-world information of the first road segment environment, subsequent operations such as accident liability determination and driving behavior optimization can be performed.

[0244] Optionally, it can also be combined with Figure 6D For an explanation of how the second data is displayed, please refer to [link / reference needed]. Figure 6D , Figure 6D This is a schematic diagram of an augmented reality display provided in an embodiment of this application.

[0245] like Figure 6D As shown, the display device projects the aforementioned second data onto the AR-HUD display area, allowing the driver to see digital information with an augmented reality visual experience.

[0246] From the driver's perspective, the AR-HUD can be seen overlaying both AR data (3D data) and non-AR data (2D data) onto the vehicle's real-world 3D environment. The AR data includes, but is not limited to, braking information (such as...). Figure 6D The brake markings shown in 604 are directly displayed on the actual road surface. Non-AR data includes, but is not limited to, vehicle speed (e.g., 8 km / h). The real-world 3D environment in which the vehicle is located includes, but is not limited to, the road where the vehicle is located, road facilities, vehicles or obstacles on the road, and weather.

[0247] Depend on Figure 6DAs can be seen, there are many vehicles ahead in the lane where the vehicle is located and in the adjacent lanes. At this point, based on the current road conditions and / or the driver's past driving behavior (driving habits), the driver brakes, and this action is recorded by the vehicle control system. The display content of the second data corresponding to this braking action can be as follows: Figure 6D The brake indicator shown in 604 is integrated into the real three-dimensional environment in which the vehicle is located (directly displayed at the actual braking position on the actual road surface). This makes the digital information with augmented reality visual experience seen from the driver's perspective richer and more intuitive. This allows for a review of the driver's driving behavior. By viewing the augmented reality display of the second data to the real-world information of the first road segment, subsequent operations such as accident liability determination and driving behavior optimization can be performed.

[0248] Optionally, in addition to reviewing the driving data of historical trips by re-running the first segment of the road as described above, this application also provides a data processing method that can review the driving data of historical trips by fusing the driving data and environmental data of historical trips into AR videos.

[0249] For details, please refer to [link / reference]. Figure 7 , Figure 7 This is a schematic diagram of the architecture of a data processing system provided in an embodiment of this application.

[0250] like Figure 7 As shown, the data processing system mainly includes, but is not limited to, AR-HUD, camera (driving recorder), and data processing module.

[0251] The AR-HUD transmits the first data to the data processing module, while the camera transmits the environmental data to the data processing module. The first data and environmental data are detailed in the previous section and will not be repeated here.

[0252] Optionally, the environmental data may specifically include video data of the external environment of the vehicle, which can be obtained through a camera.

[0253] Optionally, the first data can be obtained through generation method one: the first data may include data generated after the original data is rendered by the AR engine, such as: data generated after the video stream of the multimedia application in the vehicle system is rendered by the AR engine, data generated after the data detection results of the advanced driving assistance system (ADAS) are rendered by the AR engine, and so on. Optionally, the first data can also be obtained through generation method two, and the first data may further include data generated after the original data is fused with environmental data collected by the camera and rendered by the AR engine, such as: data generated after the navigation data of the navigation application in the vehicle system is fused with environmental data collected by the digital video recorder (DVR) and rendered by the AR engine.

[0254] Optionally, the original data (e.g., video streams from multimedia applications in the vehicle infotainment system, data detection results from ADAS, etc.) and the first data generated after rendering by the AR engine are located in different reference coordinate systems. Optionally, the original data (e.g., navigation data from navigation applications in the vehicle infotainment system) and the first data generated after rendering by the AR engine are fused with environmental data collected by the camera.

[0255] Optionally, the aforementioned first data can also be displayed in real time in the AR-HUD display area via AR-HUD, providing it to the user in the driver's view.

[0256] The data processing module fuses the aforementioned first data and environmental data to generate an AR video. Because this AR video integrates data about the vehicle's environment and rendered 3D data, it offers an augmented reality visual experience, enhancing the user experience.

[0257] The data processing method in this application embodiment can be used to fuse videos and / or images with augmented reality visual experience. During the review of historical driving data after the trip, watching the aforementioned videos and / or images with augmented reality visual experience can facilitate subsequent operations such as accident liability determination and driving behavior optimization.

[0258] Optionally, the generated AR video can be displayed in real time through various display devices, such as the vehicle's central control display, the vehicle's passenger-side display, the vehicle's rear-seat display, and mobile terminals, so that passengers, including but not limited to the passenger in the front seat and rear seat, can watch content with an augmented reality visual experience from the driver's perspective in real time, thereby improving the user's viewing experience.

[0259] Optionally, the generated AR videos can also be exported and shared, supporting the sharing of generated videos and / or images with augmented reality visual experience to other platforms, providing them to a wider range of users. They can also be provided to users for review after the trip, greatly expanding the use cases of AR-HUD and improving the user experience.

[0260] Based on the architecture of this data processing system, the data processing method provided in this application can be executed to facilitate subsequent operations such as accident liability determination and driving behavior optimization during the review of historical driving data after the trip ends.

[0261] Please see Figure 8 , Figure 8 This is a flowchart illustrating a data processing method provided in an embodiment of this application. This data processing method is applied in the field of data processing technology, such as data fusion processing of AR-HUD rendering data and camera video stream data.

[0262] Specifically, the data processing method is applied to a first vehicle, which includes a display device and a detection device. Optionally, the display device may refer to the above-described... Figure 4 or Figure 5 or Figure 7 The AR-HUD mentioned above refers to the detection device. Figure 7 The camera (dashcam) in the car.

[0263] Specifically, the data processing method includes, but is not limited to, the following steps:

[0264] S801: The data processing device acquires first data and environmental data.

[0265] S802: The data processing device generates a first video and / or any frame or multiple frames of images in the first video based on the first data and environmental data.

[0266] It is understood that the data processing device in the embodiments of this application may be a device equipped with a processor / chip that can execute computer execution instructions, or it may be a processor / chip that can execute computer execution instructions. Optionally, the data processing device may be an electronic device, or it may be a processor / chip within an electronic device. Optionally, the data processing device may specifically be as described above. Figure 7 The data processing module is used to execute the data processing method in the embodiments of this application, so as to facilitate subsequent operations such as accident liability determination and driving behavior optimization during the review of historical driving data after the end of the trip.

[0267] Optionally, the data processing device and data processing method in the embodiments of this application can be applied to, but are not limited to, vehicle systems. The vehicle equipped with the vehicle system is an intelligent driving vehicle and can be replaced by a terminal device. The terminal device can be, but is not limited to, vehicles such as commercial vehicles, passenger cars, trains, industrial vehicles (such as forklifts, trailers, tractors, etc.), engineering vehicles (such as excavators, bulldozers, cranes, etc.), robots, etc. The embodiments of this application do not specifically limit this.

[0268] The first data is used to display vehicle control prompts and / or vehicle control suggestions corresponding to the first road segment environment where the first vehicle is located. The vehicle control prompts are used to indicate the difference between the driver's driving behavior and the vehicle control suggestions. The environmental data includes data of the first road segment environment detected by the detection device.

[0269] The environment of the first road segment may include, but is not limited to, road segment type (such as highway segment, race track, urban road, etc.), road surface condition, road facilities, obstacles, weather, etc., and this application embodiment does not limit this.

[0270] This vehicle control suggestion information can be understood as including vehicle control suggestions given for the first road segment environment. After seeing the displayed first data, the driver can control the vehicle according to the given vehicle control suggestions so that the vehicle can maximize the vehicle's performance potential while ensuring safety in the first road segment environment, thereby improving the driver's driving experience.

[0271] This vehicle control prompt can be understood as a way to alert the driver of the first vehicle to the difference between their driving behavior and the vehicle control suggestion. When there is a difference or a significant difference between the driver's actual driving behavior and the given vehicle control suggestion, this difference can be displayed on the first data. After seeing the displayed data, the driver can promptly correct their driving behavior according to the given vehicle control prompt, reducing or even eliminating the difference between their driving behavior and the given vehicle control suggestion, and moving closer to the given vehicle control suggestion. This allows the vehicle to maximize its performance potential while ensuring safety in the first road segment environment, thereby improving the driver's driving experience.

[0272] Optionally, the aforementioned vehicle control prompts and / or suggestions may be obtained from other components with computing capabilities, such as the vehicle's intelligent driving system, vehicle control system, perception system, and vehicle infotainment system. For details, please refer to the above. Figure 4 The description of the display architecture shown is not limited in this application embodiment. Furthermore, the aforementioned vehicle control prompts and / or vehicle control suggestions are provided to the display device, which generates first data based on this, thereby enabling the display of the corresponding first data.

[0273] Optionally, the first data and environmental data in the embodiments of this application can be referred to the relevant descriptions of the first data and environmental data above, and will not be repeated here.

[0274] It is understandable that, based on the vehicle control prompts and / or vehicle control suggestions corresponding to the first road segment environment displayed by the display device, and the data of the first road segment environment detected by the detection device, a video with augmented reality visual experience and / or any frame or multiple frames of images in the video can be fused together.

[0275] The data processing method in this application embodiment can be used to fuse videos and / or images with augmented reality visual experience. During the review of historical driving data after the trip, watching the aforementioned videos and / or images with augmented reality visual experience can facilitate subsequent operations such as accident liability determination and driving behavior optimization.

[0276] Optionally, the aforementioned first data may include two-dimensional (2D) data or three-dimensional (3D) data, and this application embodiment does not impose any limitation on this. It is understood that the aforementioned vehicle control prompt information and / or vehicle control suggestion information may be displayed in the form of two-dimensional data and / or three-dimensional data.

[0277] Optionally, when the first data includes three-dimensional data, the data processing method according to the embodiments of this application can be fused to obtain videos and / or images with augmented reality visual experience, and can be provided to the driver, front passenger, rear passengers and other users for viewing, and can also support users to watch back after the trip, which greatly expands the use cases of AR-HUD and improves the user experience.

[0278] In one possible embodiment, the aforementioned vehicle control suggestion information may specifically possess the following characteristics:

[0279] Optionally, the vehicle control suggestion information may include, but is not limited to, any one or more of the following:

[0280] Suggested vehicle speed, vehicle position, gear position, steering angle, and headlight control.

[0281] It is understood that the vehicle control suggestion information may include, but is not limited to, any one or more of the aforementioned vehicle control-related suggestions, which can be obtained from different relevant components of the vehicle and provided to the display device for display. Furthermore, by combining the vehicle control suggestion information with the augmented reality display of the first road segment's environmental scene information, the aforementioned vehicle control suggestion information can be presented to the user more effectively during the review of historical driving data after the trip ends. By viewing the aforementioned videos and / or images with augmented reality visual experience, subsequent operations such as accident liability determination and driving behavior optimization can be performed more conveniently.

[0282] Optionally, when the aforementioned first road segment environment includes a racetrack environment, the vehicle control suggestion information may specifically include, but is not limited to, any one or more of the following:

[0283] Driving suggestions for Drift Mode, Time Trial Mode, Chase Mode, Obstacle Course Mode, Endurance Course Mode, and Formation Mode.

[0284] It is understood that when the first road segment environment includes a track environment, the aforementioned vehicle control suggestions may include, but are not limited to, any one or more of the vehicle control suggestions related to the track mode. Optionally, in different track modes, the corresponding vehicle control suggestions may include, but are not limited to, vehicle speed suggestions, vehicle position suggestions, vehicle gear suggestions, steering angle suggestions, headlight control suggestions, etc. For details, please refer to the relevant descriptions above, which will not be repeated here.

[0285] Through the embodiments of this application, the vehicle control suggestion information can be displayed in a real-world environment of the first road segment through augmented reality display. During the review of historical driving data after the trip, the vehicle control suggestion information can be presented to the user more effectively. By watching the videos and / or images with augmented reality visual experience, subsequent operations such as accident liability determination and driving behavior optimization can be performed more conveniently.

[0286] Alternatively, the above vehicle control recommendations can be determined by the environment of the first road segment.

[0287] Understandably, determining vehicle control recommendations based on the environment of the first road segment can ensure vehicle driving safety as much as possible and maximize the vehicle's performance potential, thereby improving the user's driving experience.

[0288] Optionally, the aforementioned vehicle control suggestion information may be determined from the driver's historical driving behavior of the first vehicle.

[0289] Understandably, vehicle control suggestions can be determined based on the driver's historical driving behavior. For example, the driver's driving behavior can be recorded when the driver last drove the vehicle through the first road segment environment. When the driver passes through the first road segment environment again, vehicle control suggestions can be determined based on the recorded previous driving behavior and provided to the display device for corresponding display.

[0290] Through the embodiments of this application, the given vehicle control suggestions can ensure vehicle driving safety as much as possible and maximize the performance potential of the vehicle, while also largely following the user's driving habits and improving the user's driving experience.

[0291] Alternatively, you can refer to the above text for more details. Figure 6A The above vehicle control recommendations will be explained in detail here.

[0292] In one possible embodiment, the aforementioned vehicle control prompt information may specifically have the following characteristics:

[0293] Optionally, the vehicle control prompt information can be determined by vehicle control suggestion information and the driving behavior of the driver of the first vehicle.

[0294] It is understandable that the vehicle control suggestion information can be interpreted as an idealized vehicle control recommendation given by the vehicle's computing components based on considerations of vehicle driving safety and maximizing vehicle performance potential, tailored to the first road segment environment. However, in actual driving, the driver's actual driving behavior may differ from the given vehicle control suggestion due to personal or external factors. When this difference exists or is significant, it may affect vehicle driving safety and the realization of vehicle performance potential, thereby impacting the driving experience. Therefore, the vehicle's computing components can determine vehicle control prompts based on the driver's driving behavior and the given vehicle control suggestion information. These prompts can then be used to alert the driver to the discrepancy between their driving behavior and the suggested information.

[0295] Furthermore, the vehicle control prompt information is provided to the display device, which can then display the difference through the first data. After seeing the displayed first data, the driver can promptly correct their driving behavior according to the given vehicle control prompt, reducing or even eliminating the difference between their driving behavior and the given vehicle control suggestion, and moving closer to the given vehicle control suggestion. This allows the vehicle to maximize its performance potential while ensuring safety in the first road segment environment, thereby improving the user's driving experience.

[0296] Furthermore, by using the vehicle control prompts to display the real-world environmental information of the first road segment, the vehicle control prompts can be presented to the user more effectively during the review of historical driving data after the trip ends. By watching the videos and / or images with the augmented reality visual experience, subsequent operations such as accident liability determination and driving behavior optimization can be performed more conveniently.

[0297] Alternatively, you can refer to the above text for more details. Figure 6B and Figure 6C The above vehicle control prompts will be explained in detail here.

[0298] In one possible embodiment, the above data processing method may further perform the following steps, including but not limited to:

[0299] The data processing device acquires the second data.

[0300] The second data includes data on the driver's driving behavior in the first road segment environment.

[0301] At this point, step S802 can be implemented in ways including but not limited to the following:

[0302] The data processing device generates a first video and / or any one or more frames of images in the first video based on any one or more of the first data, the second data, and environmental data.

[0303] Alternatively, you can refer to the above text for more details. Figure 6D The display of the second data mentioned above will be explained in detail here.

[0304] Understandably, the driver's driving behavior in the first road segment environment can also be recorded as second data. Based on the first data, the second data, or any one or more of them, as well as the environmental data, a video with augmented reality visual experience and / or any one or more frames of the video can be fused together. This allows for a more convenient review of the driver's driving behavior during the historical driving data review process after the trip, enabling subsequent operations such as accident liability determination and driving behavior optimization.

[0305] In one possible embodiment, step S802 described above can be implemented in ways including but not limited to the following:

[0306] The data processing device fuses the first data and environmental data corresponding to the same timestamp to obtain the first video and / or any frame or multiple frames of the first video.

[0307] It is understood that embodiments of this application may fuse the first data and environmental data based on the time dimension.

[0308] Since the primary data and environmental data come from different devices, if the timestamps of the primary data and environmental data are not aligned during fusion, the fused video and / or image may have content errors.

[0309] This application embodiment can obtain more accurate videos and / or images with augmented reality visual experience by fusing first data and environmental data corresponding to the same timestamp, thereby improving the user's viewing experience.

[0310] In one possible embodiment, the first data is data in a first reference coordinate system, where the origin of the first reference coordinate system is an observation point or a first calibration point inside the first vehicle. The environmental data is data in a second reference coordinate system, where the origin of the second reference coordinate system is the position of the detection device or a second calibration point. Step S802 can be implemented in ways including, but not limited to, the following:

[0311] The data processing device converts the environmental data into data in a first reference coordinate system, and fuses the first data and the converted environmental data to obtain a first video and / or any frame or multiple frames of images in the first video.

[0312] The first video is a video in the first reference coordinate system.

[0313] Optionally, the first calibration point and / or the second calibration point can be adjusted according to the utilization rate of the interior space of the first vehicle, and this application embodiment does not limit this.

[0314] It is understood that embodiments of this application may fuse the first data and environmental data based on the spatial dimension.

[0315] Since the primary data and environmental data come from different devices and have different reference coordinate systems, the fused video and / or images may have content misalignment issues.

[0316] This application embodiment converts the first data and environmental data into data under the same reference coordinate system before fusing them, which can obtain more accurate videos and / or images with augmented reality visual experience, thereby improving the user's viewing experience.

[0317] In one possible embodiment, the above data processing method further includes, but is not limited to, the following steps:

[0318] The data processing device receives a first instruction, which instructs the target device to display a first video and / or any frame or multiple frames of images in the first video.

[0319] In response to the first instruction, the data processing device sends the first video and / or any frame or multiple frames of the first video to the target device.

[0320] Optionally, the first instruction may be, but is not limited to, instructions in the form of voice, buttons, gestures, or central control interface operations; this application embodiment does not impose any restrictions on this.

[0321] Optionally, the target device may include, but is not limited to, the central control display screen of the first vehicle, the passenger-side display screen of the first vehicle, the rear display screen of the first vehicle, a mobile terminal, the cloud, etc., and the embodiments of this application do not limit this.

[0322] Understandably, by receiving and responding to the first instruction, the generated video and / or images can be displayed on the target device, providing users with an augmented reality visual experience.

[0323] Optionally, during the driving of the first vehicle, the generated video and / or images can be displayed on, but not limited to, the central control display screen, the passenger-side display screen, and the rear-seat display screen through the embodiments of this application, so that passengers, including but not limited to the passenger-side and rear-seat passengers, can watch content with augmented reality visual experience from the driver's perspective in real time, thereby improving the user's viewing experience.

[0324] For example, while the first vehicle is in motion, if a user wants to view the HUD AR display effect from the driver's perspective in real time via the central control screen / passenger screen, they can perform operations including but not limited to the following:

[0325] Step 1: The user enters the HUD interface on the central control screen / passenger screen.

[0326] Step 2: The user selects "Project AR Video".

[0327] Step 3: The central control screen / passenger screen displays AR content from the driver's perspective (including the real-world environment outside the vehicle and AR rendering data displayed by the AR-HUD).

[0328] Optionally, the above data processing method may also include, but is not limited to, the following steps:

[0329] The data processing device responds to the first instruction and instructs the display device to display the first mark in front of the observation point.

[0330] The first identifier indicates that the first video and / or any frame or multiple frames of images in the first video are being synthesized.

[0331] Optionally, the first identifier may include, but is not limited to, "start recording", "recording", "recording in progress", "recording completed", etc., and the embodiments of this application do not limit this.

[0332] It is understandable that the first video can be generated in real time through human-computer interaction, and the first video can be generated by displaying a first identifier in front of the observation point in response to the first command, thus bringing an immersive human-computer interaction experience to the user and improving the user experience.

[0333] For example, during the driving of the first vehicle, if a user wishes to record a video that blends the distinctive scenery seen by the human eye with the AR rendered data displayed by the AR-HUD, the following operations can be performed, including but not limited to:

[0334] Step 1: The driver initiates real-time video recording via voice and requests the addition of HUD information.

[0335] Step 2: The system responds to the customer with a voice message, and the HUD displays a "Recording" icon.

[0336] Step 3: The driver stops recording via voice command.

[0337] Step 4: The system responds to the customer with a voice message, and the HUD displays a "Recording Complete" icon, which disappears after 3 seconds. At this time, the recorded AR video is automatically stored in the designated location for the user to view.

[0338] In one possible embodiment, the above data processing method further includes, but is not limited to, the following steps:

[0339] The data processing device receives a second instruction for configuring the display content and / or display style in the first data.

[0340] Optionally, the second instruction may include, but is not limited to, instructions in the form of voice, buttons, gestures, or central control interface operations; this application embodiment does not impose any restrictions on this.

[0341] Optionally, the content displayed in the first data includes at least one of the following: driving data, location, time, weather, navigation information, intelligent driving information, and status information of the first vehicle.

[0342] Optionally, the status information of the first vehicle includes, but is not limited to, vehicle speed, gear, steering, lights, acceleration / deceleration, and overtaking. Optionally, the status information of the first vehicle may also include the vehicle's driving mode information, such as the aforementioned status information when the vehicle is in track drift mode; this embodiment of the application does not impose any limitations on this.

[0343] Optionally, the display style in the first data includes at least one of the following: the font, size, color, transparency, brightness, and display style of the displayed content.

[0344] Optionally, the style of the background of the first video and / or any frame or multiple frames of the first video can be adjusted by configuring the display style of the first data.

[0345] It is understandable that by receiving and responding to the second instruction, the display content and / or display style in the first data can be configured, thereby generating videos and / or images that meet the user's expectations and improving the user's visual experience of augmented reality.

[0346] Optionally, after the trip ends and the vehicle stops, the augmented reality display content and / or display style can be arbitrarily configured through the embodiments of this application to generate videos and / or images with an augmented reality visual experience that meet the user's expectations, thereby improving the user experience.

[0347] For example, after parking at the end of the trip, if a user wants to configure the AR rendering content and effects displayed on the AR-HUD to obtain the desired AR video, they can perform operations including but not limited to the following:

[0348] Step 1: The user turns on the AR-HUD. The DVR records the forward video stream of the vehicle in the background in real time, and at the same time records all the data information required by the AR-HUD in real time when the AR-HUD is turned on.

[0349] Step 2: When the user plays back the DVR video, they can choose to configure the AR rendering content and effects of the AR-HUD display. After the configuration is completed, the data processing device will redraw the new AR-HUD display effect and overlay it on the DVR video to obtain the desired AR video, which will be saved to the specified location for the user to use.

[0350] In one possible embodiment, the above data processing method further includes, but is not limited to, the following steps:

[0351] The data processing device receives a third instruction, which instructs the export of the first video and / or any frame or multiple frames of images in the first video.

[0352] In response to a third instruction, the data processing device exports the first video and / or any frame or multiple frames of images from the first video.

[0353] Optionally, the third instruction may include, but is not limited to, instructions in the form of voice, buttons, gestures, or central control interface operations; this application embodiment does not impose any restrictions on this.

[0354] Understandably, by receiving and responding to third-party instructions, it can support the export of generated videos and / or images with augmented reality visual experiences, which can be provided to users including but not limited to the driver, front passenger, rear passengers, and other users for viewing. It can also support providing users with playback after the trip, greatly expanding the use cases of AR-HUD and improving the user experience.

[0355] In one possible embodiment, the above data processing method further includes, but is not limited to, the following steps:

[0356] The data processing device receives a fourth instruction, which instructs the first video and / or any frame or multiple frames of the first video to be sent to the target address.

[0357] In response to the fourth instruction, the data processing device sends the first video or the identifier corresponding to the first video to the target address, or sends any one or more frames of the first video and the corresponding identifier to the target address.

[0358] Optionally, the identifier corresponding to the first video may specifically be a Uniform Resource Locator (URL), and this embodiment of the application does not limit this.

[0359] Optionally, the fourth instruction may include, but is not limited to, instructions in the form of voice, buttons, gestures, or central control interface operations; this application embodiment does not impose any restrictions on this.

[0360] Understandably, by receiving and responding to the fourth instruction, it is possible to support sharing the generated videos and / or images with augmented reality visual experience to other platforms, providing them to a wider range of users for viewing. It can also support providing users with a review after the trip, greatly expanding the use cases of AR-HUD and improving the user experience.

[0361] Optionally, before sharing the generated AR videos and / or images to other platforms, the content to be shared can be de-identified, and the user's privacy information can be deleted before sharing. This application embodiment does not limit this.

[0362] Furthermore, this application embodiment can also combine the display method and data processing method described above to illustrate the data display and data processing involved in the entire process of vehicle driving in a track scenario, which may include, but is not limited to, the following stages:

[0363] (I) Pre-competition preparation stage

[0364] Obtain track and vehicle parameters, or you can run a lap of the track in advance to obtain actual test data, which can then be used to plan a basic path strategy.

[0365] The intelligent driving system can perform the following steps, including but not limited to:

[0366] (1) Call the vehicle-mounted high-precision map database or download the target track's 3D topology model, curve type (such as hairpin bend, gentle slope bend), speed limit threshold and other information from the cloud.

[0367] (2) Generate an initial path planning strategy based on vehicle performance parameters (such as motor torque range and braking response time, obtained through the vehicle control system).

[0368] (3) Combine positioning and camera recognition of the starting point of the track to complete the initial positioning.

[0369] The vehicle control system can perform the following steps, including but not limited to:

[0370] (1) Provide real-time vehicle status data (such as tire grip coefficient, suspension height, battery charge, etc.) to adapt to the preset mode of track driving.

[0371] (2) Complete the hardware self-test to ensure that the camera, inertial sensor (IMU) and other sensing modules are in a usable state.

[0372] (3) Activate track driving mode (such as locking the suspension to sport mode and limiting the intensity of kinetic energy recovery) and feed the status back to the intelligent driving system to verify consistency.

[0373] AR-HUD can perform the following steps, including but not limited to:

[0374] (1) Display the initialization progress bar and key parameters (e.g., “track loading”, “vehicle performance matching completed”), and provide an entry point for user interaction through the cockpit (e.g., confirm strategy or manually adjust preferences).

[0375] (2) Adjust the display brightness and contrast parameters of AR-HUD according to the current ambient lighting conditions.

[0376] (3) Project dynamic start prompts (e.g., “Ready, please shift into D”).

[0377] (4) Preview the virtual route markers of the first section of the track (overlaid on the real road in the form of semi-transparent dashed lines).

[0378] (II): Real-time driving guidance phase during the race

[0379] AR-HUD provides real-time dynamic guidance (including but not limited to vehicle control suggestions and / or vehicle control prompts; see the relevant description of First Data above for details), improving driver efficiency and vehicle driving safety.

[0380] The intelligent driving system can perform the following steps, including but not limited to:

[0381] (1) Path tracking and strategy adjustment.

[0382] (2) Every 50ms, the data from the camera, wheel speedometer and steering wheel angle are fused to calculate the lateral / longitudinal deviation of the vehicle from the preset route.

[0383] (3) Dynamically adjust the optimal cornering speed threshold based on real-time speed and tire slip ratio (e.g., "Recommended maximum speed for the current corner: 72km / h").

[0384] (4) Conduct risk warnings and trigger emergency strategy intervention when the driver's operation exceeds the limit (such as braking later than the safety window).

[0385] The vehicle control system can perform the following steps, including but not limited to:

[0386] (1) Provide millisecond-level vehicle status data streams (such as motor torque output and braking pressure) for accurate modeling of intelligent driving systems.

[0387] (2) Perform some auxiliary operations (such as automatic braking or limiting power output) under the authorization of the intelligent driving system.

[0388] AR-HUD can perform the following steps, including but not limited to:

[0389] (1) At the core guidance level, augmented reality routes (AR routes) can be projected, with the center line of the track projected as a highlighted dashed line in real time within the driver's field of vision. A dynamic speed ring is displayed 50 meters before the entrance to a curve, using color changes (green / orange / red) to indicate the difference between the current speed and the recommended speed. For example, the darker the color, the greater the difference.

[0390] (2) At the safety warning level, when lane departure or premature braking is detected, a full-screen flashing warning box can be projected with short vibration feedback. An "acceleration window" prompt (such as "Full throttle can be used for the last 30 meters") can also be displayed at the end of long straight sections.

[0391] The cockpit can perform, but is not limited to, the following steps:

[0392] (1) Supports voice interaction. Drivers can turn the HUD navigator display on and off and adjust the display brightness, contrast and other settings by voice.

[0393] (III): Post-match review and optimization phase

[0394] AR-HUD provides driving behavior analysis results and supports personalized strategy iteration.

[0395] The intelligent driving system can perform the following steps, including but not limited to:

[0396] (1) Integrate the data of the entire racing car driving process to generate a "heat map" and mark the driver's average speed difference and error point distribution on the curve.

[0397] (2) Adjust the tolerance threshold of the next guidance strategy according to the user's historical operating habits (such as preference for aggressive / conservative routes).

[0398] The vehicle control system can perform the following steps, including but not limited to:

[0399] (1) Download and analyze detailed data such as brake pedal pressure curve and steering wheel torque to help diagnose the driver's driving skills defects (such as "understeering accounts for 68% when entering a curve").

[0400] AR-HUD can perform the following steps, including but not limited to:

[0401] (1) Project a 3D animation review interface or AR video (the specific method for generating the AR video can be found in the data processing method above), and simultaneously display the comparison between the track route and the user's actual trajectory.

[0402] The cockpit can perform, but is not limited to, the following steps:

[0403] (1) Supports voice interaction. Drivers can turn the HUD navigator heat map on or off by voice.

[0404] (2) Supports displaying the generated heat map on the central control display screen.

[0405] Through the embodiments of this application, during the entire process of vehicle driving in a track setting, it can help drivers quickly grasp the characteristics of the track and the performance of the vehicle, enabling the vehicle to unleash its high-performance potential in track conditions and improving the user's driving experience. Furthermore, during the review of historical driving data after the trip, subsequent operations such as accident liability determination and driving behavior optimization can be performed more conveniently.

[0406] The methods of the embodiments of this application have been described in detail above. The following provides an apparatus for implementing any one of the methods in the embodiments of this application. For example, an apparatus is provided that includes a unit (or means) for implementing the steps performed by the device in any of the above methods.

[0407] Please see Figure 9 , Figure 9 This is a schematic diagram of the structure of a display device provided in an embodiment of this application.

[0408] like Figure 9 As shown, the display device 90 may include a communication unit 901 and a display unit 902. The communication unit 901 and the display unit 902 may be software, hardware, or a combination of both.

[0409] The communication unit 901 can implement sending and / or receiving functions, and can also be described as a transceiver unit. The communication unit 901 can also be a unit integrating an acquisition unit and a sending unit, wherein the acquisition unit is used to implement the receiving function, and the sending unit is used to implement the sending function. Optionally, the communication unit 901 can be used to receive information sent by other devices, and can also be used to send information to other devices.

[0410] In one possible design, the display device 90 may correspond to the above. Figure 5 The display device in the illustrated method embodiment, such as display device 90, can be an electronic device or a chip within an electronic device. Display device 90 may include components for performing the above-described... Figure 5 The unit in the method embodiment shown is the one that performs the operation by the display device, and each unit in the display device 90 is respectively for implementing the above-described operation. Figure 5 The operation performed by the display device in the illustrated method embodiment is described below:

[0411] Display unit 902 is used to display first data, the first data including vehicle control prompt information and / or vehicle control suggestion information corresponding to the first road segment environment where the first vehicle is located, the vehicle control prompt information being used to prompt the difference between the driving behavior of the driver of the first vehicle and the vehicle control suggestion information.

[0412] In one possible implementation, the device further includes a communication unit 901.

[0413] The display unit 902 is specifically used to acquire first data through the communication unit 901 and display the first data.

[0414] In one possible implementation, the device further includes a processing unit. Optionally, the processing unit may be integrated with the display unit in one module, or it may be deployed in a different module from the display unit.

[0415] The processing unit is specifically used to generate the first data.

[0416] Regarding the communication unit 901 and display unit 902 described in this design, the steps they perform can be referred to the corresponding steps described above. Figure 5 The implementation method shown corresponds to the display device in the method embodiment.

[0417] Regarding the technical effects of the implementation methods performed by the communication unit 901 and the display unit 902 described in this design, please refer to the corresponding methods described above. Figure 5 The technical effects of the illustrated method embodiments are described below.

[0418] According to the embodiments of this application, Figure 9 The various units in the illustrated device can be individually or entirely combined into one or more other units, or some of the units can be further divided into multiple functionally smaller units. This achieves the same operation without affecting the technical effects of the embodiments of this application. The above-mentioned units are based on logical function division. In practical applications, the function of one unit can also be implemented by multiple units, or the function of multiple units can be implemented by one unit. In other embodiments of this application, the electronic device may also include other units. In practical applications, these functions can also be implemented with the assistance of other units, and can be implemented collaboratively by multiple units.

[0419] It should be noted that the implementation of each unit can also refer to the above. Figure 5 The corresponding description of the method embodiments shown.

[0420] exist Figure 9 The described display device 90 can help drivers quickly grasp road characteristics and vehicle performance, enabling vehicles to unleash their high-performance potential on the road and improve the user's driving experience.

[0421] For cases where the aforementioned display device 90 can be an electronic device, please refer to [reference needed]. Figure 11 The diagram shows the structure of the electronic device.

[0422] It should be understood that Figure 11 The illustrated electronic device 110 is merely an example; the electronic device in this application embodiment may also include other components, or include components related to... Figure 11 Components with similar functions, or not necessarily including Figure 11 All components.

[0423] Electronic device 110 includes a transceiver interface 1101 and at least one processor 1102.

[0424] The electronic device 110 can correspond to a display device. The transceiver interface 1101 is used to transmit and receive signals, and at least one processor 1102 executes program instructions, causing the electronic device 110 to implement the corresponding flow of the method executed by the corresponding device in the above method embodiments.

[0425] In one possible design, the electronic device 110 may correspond to the above. Figure 5 The display device in the illustrated method embodiment, such as the electronic device 110, can be a display device or a chip within a display device. The electronic device 110 may include components for performing the operations performed by the display device in the above method embodiment, and each component in the electronic device 110 is specifically designed to implement the operations performed by the display device in the above method embodiment. Specifically, it can be as follows:

[0426] The processor 1102 is used to control the display of first data, the first data including vehicle control prompt information and / or vehicle control suggestion information corresponding to the first road segment environment where the first vehicle is located, the vehicle control prompt information being used to prompt the difference between the driving behavior of the driver of the first vehicle and the vehicle control suggestion information.

[0427] In one possible implementation, the device further includes a communication unit.

[0428] The processor 1102 is specifically used to acquire first data through the communication unit and control the display of the first data.

[0429] In one possible implementation, processor 1102 is specifically used to generate first data.

[0430] Regarding the transceiver interface 1101 and at least one processor 1102 described in this design, the steps performed can be referred to the corresponding steps described above. Figure 5 The implementation method shown corresponds to the display device in the method embodiment.

[0431] Regarding the technical effects of the transceiver interface 1101 and the implementation methods performed by at least one processor 1102 described in this design, please refer to the corresponding descriptions above. Figure 5 The technical effects of the illustrated method embodiments are described below.

[0432] In one implementation, the display device is a display apparatus. When the display device is a display apparatus, the communication unit can be a transceiver or an input / output interface; the processing unit can be at least one processor; and the display unit can be a monitor or a projection module. Optionally, the transceiver can be a transceiver circuit. Optionally, the input / output interface can be an input / output circuit.

[0433] In another implementation, the display device is a chip (system) or circuit used in a display device. When the display device is a chip (system) or circuit used in a display device, the communication unit can be a communication interface (input / output interface), interface circuit, output circuit, input circuit, pin, or related circuit on the chip (system) or circuit; the processing unit can be at least one processor, processing circuit, or logic circuit; and the display unit can be a projection module used to control the display.

[0434] exist Figure 11 The described electronic device 110 can help drivers quickly grasp road characteristics and vehicle performance, enabling the vehicle to unleash its high-performance potential on the road and improve the user's driving experience.

[0435] Please see Figure 10 , Figure 10 This is a schematic diagram of the structure of a data processing device provided in an embodiment of this application.

[0436] like Figure 10 As shown, the data processing device 100 may include a communication unit 1001 and a processing unit 1002. The communication unit 1001 and the processing unit 1002 may be software, hardware, or a combination of software and hardware.

[0437] The communication unit 1001 can implement sending and / or receiving functions, and can also be described as a transceiver unit. The communication unit 1001 can also be a unit integrating an acquisition unit and a sending unit, wherein the acquisition unit is used to implement the receiving function, and the sending unit is used to implement the sending function. Optionally, the communication unit 1001 can be used to receive information sent by other devices, and can also be used to send information to other devices.

[0438] In one possible design, the data processing device 100 may correspond to the above. Figure 8 The data processing apparatus in the illustrated method embodiment, such as data processing apparatus 100, can be an electronic device or a chip within an electronic device. The data processing apparatus 100 may include components for performing the above-described... Figure 8 The unit in the method embodiment shown is the one that performs the operation by the data processing device, and each unit in the data processing device 100 is respectively for implementing the above-mentioned... Figure 8 The operations performed by the data processing device in the illustrated method embodiment are as follows: The descriptions of each unit are as follows:

[0439] The processing unit 1002 is used to acquire first data and environmental data. The first data is used by the display device to display vehicle control prompt information and / or vehicle control suggestion information corresponding to the first road segment environment where the first vehicle is located. The vehicle control prompt information is used to prompt the difference between the driving behavior of the driver of the first vehicle and the vehicle control suggestion information. The environmental data includes data of the first road segment environment detected by the detection device.

[0440] The processing unit 1002 is configured to generate a first video and / or any frame or multiple frames of images in the first video based on the first data and environmental data.

[0441] In one possible implementation, the device further includes a communication unit 1001.

[0442] The processing unit 1002 is specifically used to acquire first data and environmental data through the communication unit 1001.

[0443] The steps performed by the communication unit 1001 and processing unit 1002 described in this design can be referred to the steps corresponding to the above. Figure 8The implementation of the data processing device in the method embodiment shown corresponds to the implementation method.

[0444] Regarding the technical effects brought about by the implementation methods performed by the communication unit 1001 and processing unit 1002 described in this design, please refer to the corresponding methods described above. Figure 8 The technical effects of the illustrated method embodiments are described below.

[0445] According to the embodiments of this application, Figure 10 The various units in the illustrated device can be individually or entirely combined into one or more other units, or some of the units can be further divided into multiple functionally smaller units. This achieves the same operation without affecting the technical effects of the embodiments of this application. The above-mentioned units are based on logical function division. In practical applications, the function of one unit can also be implemented by multiple units, or the function of multiple units can be implemented by one unit. In other embodiments of this application, the electronic device may also include other units. In practical applications, these functions can also be implemented with the assistance of other units, and can be implemented collaboratively by multiple units.

[0446] It should be noted that the implementation of each unit can also refer to the above. Figure 8 The corresponding description of the method embodiments shown.

[0447] exist Figure 10 In the data processing device 100 described above, during the review of historical driving data after the end of a trip, viewing the aforementioned videos and / or images with augmented reality visual experience makes it easier to perform subsequent operations such as accident liability determination and driving behavior optimization.

[0448] For cases where the aforementioned data processing device 100 can be an electronic device, please refer to [reference needed]. Figure 11 The diagram shows the structure of the electronic device.

[0449] It should be understood that Figure 11 The illustrated electronic device 110 is merely an example; the electronic device in this application embodiment may also include other components, or include components related to... Figure 11 Components with similar functions, or not necessarily including Figure 11 All components.

[0450] Electronic device 110 includes a transceiver interface 1101 and at least one processor 1102.

[0451] The electronic device 110 can correspond to a data processing device. The transceiver interface 1101 is used to transmit and receive signals, and at least one processor 1102 executes program instructions, causing the electronic device 110 to implement the corresponding flow of the method executed by the corresponding device in the above method embodiments.

[0452] In one possible design, the electronic device 110 may correspond to the above. Figure 8 The data processing apparatus in the illustrated method embodiment, such as the electronic device 110, can be a data processing device or a chip within a data processing device. The electronic device 110 may include components for performing the operations executed by the data processing device in the above method embodiment, and each component in the electronic device 110 is specifically designed to implement the operations executed by the data processing device in the above method embodiment. Specifically, it can be as follows:

[0453] The processor 1102 is used to acquire first data and environmental data. The first data is used by the display device to display vehicle control prompt information and / or vehicle control suggestion information corresponding to the first road segment environment where the first vehicle is located. The vehicle control prompt information is used to prompt the difference between the driving behavior of the driver of the first vehicle and the vehicle control suggestion information. The environmental data includes data of the first road segment environment detected by the detection device.

[0454] Processor 1102 is configured to generate a first video and / or any frame or multiple frames of images in the first video based on first data and environmental data.

[0455] In one possible implementation, the device further includes a transceiver interface 1101.

[0456] The processor 1102 is specifically used to acquire first data and environmental data through the transceiver interface 1101.

[0457] Regarding the transceiver interface 1101 and at least one processor 1102 described in this design, the steps performed can be referred to the corresponding steps described above. Figure 8 The implementation of the data processing device in the method embodiment shown corresponds to the implementation method.

[0458] Regarding the technical effects of the transceiver interface 1101 and the implementation methods performed by at least one processor 1102 described in this design, please refer to the corresponding descriptions above. Figure 8 The technical effects of the illustrated method embodiments are described below.

[0459] exist Figure 11 In the described electronic device 110, during the review of historical driving data after the end of the trip, viewing the aforementioned videos and / or images with augmented reality visual experience makes it easier to perform subsequent operations such as accident liability determination and driving behavior optimization.

[0460] For cases where the aforementioned display device 90 and / or data processing device 100 can be a chip or a chip system, please refer to [reference needed]. Figure 12 The diagram shows the structure of the chip.

[0461] like Figure 12 As shown, chip 120 includes processor 1201 and interface 1202. The number of processors 1201 can be one or more, and the number of interfaces 1202 can be multiple. It should be noted that the functions of processor 1201 and interface 1202 can be implemented through hardware design, software design, or a combination of both; no restrictions are placed here.

[0462] Optionally, the chip 120 may also include a memory 1203 for storing necessary program instructions and data.

[0463] In this application, processor 1201 can be used to call the implementation program of the data processing method provided in one or more embodiments of this application in a data processing device from memory 1203, and execute the instructions included in the program. Interface 1202 can be used to output the execution result of processor 1201. In this application, interface 1202 can be specifically used to output various messages or information of processor 1201.

[0464] The display method provided by one or more embodiments of this application can be referred to the foregoing. Figure 5 The various embodiments shown are not described in detail here.

[0465] For the data processing methods provided in one or more embodiments of this application, please refer to the foregoing. Figure 8 The various embodiments shown are not described in detail here.

[0466] The processor in this application embodiment can be a central processing unit (CPU), but it can also be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or any conventional processor.

[0467] The memory in this application embodiment is used to provide storage space, in which data such as operating system and computer programs can be stored. The memory includes, but is not limited to, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), or compact disc read-only memory (CD-ROM).

[0468] According to the method provided in the embodiments of this application, the embodiments of this application also provide a computer-readable storage medium storing a computer program. When the computer program is run on one or more processors, it can implement the above-mentioned... Figure 5 , Figure 8 The method shown.

[0469] According to the method provided in the embodiments of this application, the embodiments of this application also provide a computer program product, which includes a computer program. When the computer program runs on a processor, it can achieve the above-mentioned... Figure 5 , Figure 8 The method shown.

[0470] This application also provides a cockpit, which includes a display device and at least one data processing device 100, or electronic device 110, or chip 120.

[0471] This application also provides a system including a display device and a data processing device. The display device is used to perform the above-described... Figure 5 The method shown is used by the data processing apparatus to perform the above-described method. Figure 8 The method shown.

[0472] Optionally, the system may also include, but is not limited to, any one or more of the following: intelligent driving system, vehicle control system, and perception system.

[0473] This application provides a terminal, which includes at least one display device 90, or a data processing device 100, or an electronic device 110, or a chip 120, or the above-described system.

[0474] Optionally, the terminal can be a means of transportation, such as a car, truck, aircraft, drone, slow transport vehicle, spacecraft, or ship, or any other possible means of transportation used in any possible scenario. This application embodiment does not limit this.

[0475] Optionally, the terminal is used to implement the above. Figure 5, Figure 8 The method shown.

[0476] This application also provides a processing apparatus, including a processor and an interface; the processor is used to execute the method in any of the above method embodiments.

[0477] It should be understood that the above-described processing device can be a chip. The units in the various device embodiments and the electronic devices in the method embodiments correspond completely, with corresponding modules or units executing corresponding steps. For example, the communication unit (transceiver) executes the receiving or sending steps in the method embodiments, while other steps besides sending and receiving can be executed by the processing unit (processor). The specific functions of each unit can be found in the corresponding method embodiments. There can be one or more processors.

[0478] It is understood that in the embodiments of this application, the electronic device may perform some or all of the steps in the embodiments of this application. These steps or operations are merely examples, and the embodiments of this application may also perform other operations or variations thereof. Furthermore, the steps may be performed in different orders as presented in the embodiments of this application, and it is not necessarily necessary to perform all the operations in the embodiments of this application.

[0479] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0480] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0481] In addition, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0482] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the contributing part, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0483] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any changes or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application.

Claims

1. A display method, characterized in that, The display method includes: The first data is displayed, which includes vehicle control prompt information and / or vehicle control suggestion information corresponding to the first road segment environment where the first vehicle is located. The vehicle control prompt information is used to indicate the difference between the driving behavior of the driver of the first vehicle and the vehicle control suggestion information.

2. The display method according to claim 1, characterized in that, The vehicle control suggestion information includes one or more of the following: vehicle speed suggestion information, vehicle position suggestion information, vehicle gear suggestion information, steering angle suggestion information, and headlight control suggestion information.

3. The display method according to claim 1 or 2, characterized in that, The vehicle control prompt information is determined by the vehicle control suggestion information and the driving behavior of the driver of the first vehicle.

4. The display method according to any one of claims 1 to 3, characterized in that, The vehicle control suggestion information is determined by the environment of the first road segment.

5. The display method according to any one of claims 1 to 3, characterized in that, The vehicle control suggestion information is determined by the driver's historical driving behavior of the first vehicle.

6. The display method according to any one of claims 1 to 5, characterized in that, The display method further includes: Generate second data, which includes data on the driver's driving behavior in the first road segment environment.

7. The display method according to any one of claims 1 to 6, characterized in that, The first road segment environment includes the track environment, and the vehicle control suggestion information includes any one or more of the following: drift mode driving suggestion information, time trial mode driving suggestion information, pursuit mode driving suggestion information, obstacle course mode driving suggestion information, endurance course mode driving suggestion information, and formation driving suggestion information.

8. The display method according to any one of claims 1 to 7, characterized in that, The display method further includes: Obtain the first data; While the first vehicle is traveling in the environment of the first road segment, the first data is displayed in the spatial area between the observation point and the environment of the first road segment.

9. The display method according to any one of claims 1 to 8, characterized in that, The display method further includes: Acquire second data, which includes data on the driver's driving behavior in the first road segment environment; While the first vehicle is traveling in the environment of the first road segment, the second data is displayed in the spatial area between the observation point and the environment of the first road segment.

10. A data processing method, characterized in that, Applied to a first vehicle, the first vehicle including a display device and a detection device; the data processing method includes: Acquire first data and environmental data. The first data is used by the display device to display vehicle control prompt information and / or vehicle control suggestion information corresponding to the first road segment environment where the first vehicle is located. The vehicle control prompt information is used to prompt the difference between the driving behavior of the driver of the first vehicle and the vehicle control suggestion information. The environmental data includes the data of the first road segment environment detected by the detection device. Based on the first data and the environmental data, generate a first video and / or any frame or multiple frames of images from the first video.

11. The data processing method according to claim 10, characterized in that, The vehicle control suggestion information includes one or more of the following: vehicle speed suggestion information, vehicle position suggestion information, vehicle gear suggestion information, steering angle suggestion information, and headlight control suggestion information.

12. The data processing method according to claim 10 or 11, characterized in that, The vehicle control prompt information is determined by the vehicle control suggestion information and the driving behavior of the driver of the first vehicle.

13. The data processing method according to any one of claims 10 to 12, characterized in that, The vehicle control suggestion information is determined by the environment of the first road segment.

14. The data processing method according to any one of claims 10 to 12, characterized in that, The vehicle control suggestion information is determined by the driver's historical driving behavior of the first vehicle.

15. The data processing method according to any one of claims 10 to 14, characterized in that, The data processing method further includes: Acquire second data, which includes data on the driver's driving behavior in the first road segment environment; The step of generating a first video and / or any one or more frames of images from the first video based on the first data and the environmental data includes: Based on the first data, any one or more of the second data, and the environmental data, generate the first video and / or any one or more frames of the first video.

16. The data processing method according to any one of claims 10 to 15, characterized in that, The first road segment environment includes the track environment, and the vehicle control suggestion information includes any one or more of the following: drift mode driving suggestion information, time trial mode driving suggestion information, pursuit mode driving suggestion information, obstacle course mode driving suggestion information, endurance course mode driving suggestion information, and formation driving suggestion information.

17. The data processing method according to any one of claims 10 to 16, characterized in that, The step of generating a first video and / or any one or more frames of images from the first video based on the first data and the environmental data includes: The first data and the environmental data corresponding to the same timestamp are fused to obtain the first video and / or any frame or multiple frames of the first video.

18. The data processing method according to any one of claims 10 to 17, characterized in that, The first data is data under a first reference coordinate system, the origin of which is the observation point or the first calibration point inside the first vehicle; the environmental data is data under a second reference coordinate system, the origin of which is the position of the detection device or the second calibration point. The step of generating a first video and / or any one or more frames of images from the first video based on the first data and the environmental data includes: The environmental data is converted into data in the first reference coordinate system; The first data and the converted environmental data are fused to obtain the first video and / or any frame or multiple frames of the first video, wherein the first video is a video in the first reference coordinate system.

19. The data processing method according to any one of claims 10 to 18, characterized in that, The data processing method further includes: Receive a first instruction, the first instruction being used to instruct the target device to display the first video and / or any frame or multiple frames of the first video; In response to the first instruction, the first video and / or any frame or multiple frames of the first video are sent to the target device.

20. The data processing method according to claim 19, characterized in that, The target device includes at least one of the following: the central control display screen of the first vehicle, the passenger-side display screen of the first vehicle, the rear-seat display screen of the first vehicle, a mobile terminal, and the cloud.

21. The data processing method according to claim 19 or 20, characterized in that, The data processing method further includes: In response to the first instruction, the display device is instructed to display a first identifier in front of the observation point, the first identifier indicating that the first video and / or any frame or multiple frames of the first video are being synthesized.

22. The data processing method according to any one of claims 10 to 21, characterized in that, The data processing method further includes: Receive a second instruction, which is used to configure the display content and / or display style in the first data.

23. The data processing method according to claim 22, characterized in that, The displayed content in the first data includes at least one of the following: driving data, location, time, weather, navigation information, intelligent driving information, and the status information of the first vehicle; and / or, The display style in the first data includes at least one of the following: the font, size, color, transparency, brightness, and display style of the displayed content.

24. The data processing method according to any one of claims 10 to 23, characterized in that, The data processing method further includes: Receive a third instruction, the third instruction being used to instruct the export of the first video and / or any frame or multiple frames of the first video; In response to the third instruction, export the first video and / or any frame or multiple frames of the first video.

25. The data processing method according to any one of claims 10 to 24, characterized in that, The data processing method further includes: Receive a fourth instruction, the fourth instruction being used to instruct the first video and / or any frame or multiple frames of the first video to be sent to a target address; In response to the fourth instruction, the first video or its corresponding identifier is sent to the target address, or any frame or multiple frames of the first video and their corresponding identifier are sent to the target address.

26. A display device, characterized in that, Includes a unit for performing the method as described in any one of claims 1 to 9.

27. A display device, characterized in that, Includes a processor for performing the method as described in any one of claims 1 to 9.

28. A data processing apparatus, characterized in that, Includes units for performing the method as described in any one of claims 10 to 25.

29. A data processing apparatus, characterized in that, Includes a processor for performing the method as described in any one of claims 10 to 25.

30. A chip, characterized in that, It includes logic circuits and interfaces, wherein the logic circuits and the interfaces are coupled; The interface is used for inputting and / or outputting information, and the logic circuit is used for performing the method as described in any one of claims 1 to 25.

31. A system, characterized in that, It includes a display device and a data processing device; wherein the display device is used to perform the method as described in any one of claims 1 to 9, and the data processing device is used to perform the method as described in any one of claims 10 to 25.

32. A terminal, characterized in that, This includes the display device as claimed in claim 26, or the display device as claimed in claim 27, or the data processing device as claimed in claim 28, or the data processing device as claimed in claim 29, or the chip as claimed in claim 30, or the system as claimed in claim 31.

33. A computer-readable storage medium, characterized in that, The computer-readable storage medium is used to store a computer program, which, when executed, performs the method as described in any one of claims 1 to 25.

34. A computer program product, characterized in that, The computer program product includes a computer program, which, when executed, performs the method as described in any one of claims 1 to 25.

Images