Data processing method and device, vehicle, storage medium and computer program product

Abstract

The invention discloses a data processing method and device, a vehicle, a storage medium and a computer program product. The method comprises the steps that initial image data are acquired, the initial image data are used for representing image data acquired by an external image acquisition assembly of a target vehicle, and the image data are used for representing road conditions on the side and the rear of the target vehicle; performing conversion processing on the initial image data to obtain a data conversion result; performing adaptive enhancement processing on the data conversion result to obtain target image data; and displaying the target image data by using the target reflection area of the target vehicle in response to the fact that the panoramic image function of the target vehicle is in the open state. According to the invention, the technical problem of low driving safety and comfort caused by the fact that a driver needs to frequently adjust the sight focal length when checking the road conditions on the side and the rear of the vehicle in the prior art is solved.

Description

Technical Field

[0001] This invention relates to the field of automotive electronics and intelligent driving assistance systems, and more specifically, to a data processing method, apparatus, vehicle, storage medium, and computer program product. Background Technology

[0002] In the process of automotive intelligence, electronic exterior rearview mirrors, as an innovative technology to replace traditional optical rearview mirrors, aim to provide clearer and wider environmental perception. Related technologies typically display the electronic exterior rearview mirror image on an in-vehicle screen or head-up display (HUD) to reduce the frequency of driver eye shifts and improve driving safety. However, due to the difference in focal length between electronic exterior rearview mirrors and HUDs, drivers need to frequently adjust their focus, increasing visual burden and reducing driving comfort and safety. Furthermore, HUD images are prone to becoming blurry or even completely unreadable under strong sunlight, further exacerbating driving risks.

[0003] There is currently no effective solution to the above problems. Summary of the Invention

[0004] This invention provides a data processing method, apparatus, vehicle, storage medium, and computer program product to at least solve the technical problem in the related art where drivers need to frequently adjust their visual focus when checking road conditions to the side and rear of the vehicle, resulting in low driving safety and comfort.

[0005] According to one aspect of the present invention, a data processing method is provided, comprising: acquiring initial image data, wherein the initial image data is used to represent image data acquired by an external image acquisition component of a target vehicle, and the image data is used to represent road conditions to the side and rear of the target vehicle; performing conversion processing on the initial image data to obtain a data conversion result; performing adaptive enhancement processing on the data conversion result to obtain target image data; and displaying the target image data using the target reflection area of ​​the target vehicle in response to the target vehicle's panoramic imaging function being enabled.

[0006] Optionally, adaptive enhancement processing is performed on the data conversion result to obtain the target image data, including: preprocessing the data conversion result to obtain a preprocessed result; and performing adaptive enhancement processing on the preprocessed result to obtain the target image data.

[0007] Optionally, the data conversion result is preprocessed to obtain the preprocessing result, which includes: performing noise reduction processing on the data conversion result to obtain a noise reduction processing result; determining the image attribute parameters corresponding to the initial image data based on the noise reduction processing result; acquiring real-time illumination data and adjusting the image attribute parameters based on the real-time illumination data to obtain an image adjustment result, wherein the real-time illumination data is used to determine the driving scene in which the target vehicle is located; and performing distortion correction on the image adjustment result to obtain the preprocessing result.

[0008] Optionally, adaptive enhancement processing is performed on the preprocessing results to obtain target image data, including: performing display adaptation processing on the preprocessing results to obtain display adaptation results; and performing translation projection processing on the display adaptation results to obtain target image data.

[0009] Optionally, the external image acquisition component includes a left external image acquisition component and a right external image acquisition component. The preprocessing result is then subjected to display adaptation processing to obtain the display adaptation result, which includes: determining left and right image data based on the preprocessing result, wherein the left image data represents the image data acquired by the left external image acquisition component, and the right image data represents the image data acquired by the right external image acquisition component; obtaining first image display parameters corresponding to the left image data and second image display parameters corresponding to the right image data, wherein the first image display parameters include the resolution and frame rate of the left image data, and the second image display parameters include the resolution and frame rate of the right image data; synchronously adjusting the first and second image display parameters based on preset panoramic display parameters to obtain a synchronous adjustment result; and performing perspective compensation on the synchronous adjustment result based on preset projection parameters to obtain the display adaptation result.

[0010] Optionally, the data processing method in this embodiment of the invention further includes: determining a first display area corresponding to the left image data based on the user's driving habits, and determining a second display area corresponding to the right image data based on the user's driving habits, wherein the first display area and the second display area are located in the target reflection area.

[0011] According to another aspect of the present invention, a data processing apparatus is also provided, comprising: an acquisition module for acquiring initial image data, wherein the initial image data represents image data acquired by an external image acquisition component of a target vehicle, and the image data represents road conditions to the side and rear of the target vehicle; a first processing module for performing conversion processing on the initial image data to obtain a data conversion result; a second processing module for performing adaptive enhancement processing on the data conversion result to obtain target image data; and a display module for displaying the target image data using the target reflection area of ​​the target vehicle in response to the target vehicle's panoramic imaging function being enabled.

[0012] Optionally, the second processing module is further configured to: preprocess the data conversion result to obtain a preprocessed result; and perform adaptive enhancement processing on the preprocessed result to obtain the target image data.

[0013] Optionally, the second processing module is further configured to: perform noise reduction processing on the data conversion result to obtain a noise reduction result; determine the image attribute parameters corresponding to the initial image data based on the noise reduction result; acquire real-time illumination data, and adjust the image attribute parameters based on the real-time illumination data to obtain an image adjustment result, wherein the real-time illumination data is used to determine the driving scene in which the target vehicle is located; and perform distortion correction on the image adjustment result to obtain a preprocessing result.

[0014] Optionally, the second processing module is further configured to: perform display adaptation processing on the preprocessing result to obtain the display adaptation result; and perform translation projection processing on the display adaptation result to obtain the target image data.

[0015] Optionally, the external image acquisition component includes a left external image acquisition component and a right external image acquisition component. The second processing module is further configured to: determine left image data and right image data based on the preprocessing results, wherein the left image data represents the image data acquired by the left external image acquisition component, and the right image data represents the image data acquired by the right external image acquisition component; obtain a first image display parameter corresponding to the left image data and a second image display parameter corresponding to the right image data, wherein the first image display parameter includes the resolution and image frame rate of the left image data, and the second image display parameter includes the resolution and image frame rate of the right image data; synchronously adjust the first image display parameter and the second image display parameter based on preset panoramic display parameters to obtain a synchronous adjustment result; and perform perspective compensation on the synchronous adjustment result based on preset projection parameters to obtain a display adaptation result.

[0016] Optionally, the data processing device in this embodiment of the invention further includes: a determining module, configured to determine a first display area corresponding to the left image data based on the user's driving habits, and to determine a second display area corresponding to the right image data based on the user's driving habits, wherein the first display area and the second display area are located in the target reflection area.

[0017] According to another aspect of the present invention, a vehicle is also provided, comprising: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to execute instructions to implement the data processing method of the present invention.

[0018] According to another aspect of the present invention, a computer-readable storage medium is also provided, the computer-readable storage medium including a stored executable program, wherein, when the executable program is running, it controls the device where the storage medium is located to execute the data processing method of the present invention.

[0019] According to another aspect of the present invention, a computer program product is also provided, the computer program product including computer instructions that, when executed by a processor, implement the data processing method of the present invention.

[0020] In this embodiment of the invention, initial image data is acquired and converted to obtain a data conversion result. Then, adaptive enhancement processing is performed on the data conversion result to obtain target image data. Finally, when the panoramic imaging function of the target vehicle is turned on, the target image data is displayed using the target reflection area of ​​the target vehicle. This achieves the purpose of clearly and intuitively displaying the electronic rearview mirror image, thereby improving driving safety and comfort. It also solves the technical problem in related technologies where drivers need to frequently adjust their focus when viewing road conditions to the side and rear of the vehicle, resulting in low driving safety and comfort. Attached Figure Description

[0021] The accompanying drawings, which are included to provide a further understanding of the invention and form part of this invention, illustrate exemplary embodiments of the invention and are used to explain the invention, but do not constitute an undue limitation of the invention. In the drawings:

[0022] Figure 1 This is a flowchart of a data processing method according to one embodiment of the present invention;

[0023] Figure 2 This is a schematic diagram of a data processing system according to one embodiment of the present invention;

[0024] Figure 3 This is a structural block diagram of a data processing apparatus according to one embodiment of the present invention; Detailed Implementation

[0025] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present invention.

[0026] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of the invention described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0027] In the process of automotive intelligence, electronic exterior rearview mirrors, as an innovative technology to replace traditional optical rearview mirrors, aim to provide clearer and wider environmental perception. Related technologies typically display the electronic exterior rearview mirror image on an in-vehicle screen or head-up display (HUD) to reduce the frequency of driver eye shifts and improve driving safety. However, due to the difference in focal length between electronic exterior rearview mirrors and HUDs, drivers need to frequently adjust their focus, increasing visual burden and reducing driving comfort and safety. Furthermore, HUD images are prone to becoming blurry or even completely unreadable under strong sunlight, further exacerbating driving risks.

[0028] Specifically, when the electronic rearview mirror image is displayed on the HUD, the driver's eyes need to switch between different focal lengths when viewing the image because the focal length of the electronic rearview mirror does not match the long-distance imaging focal length designed for the HUD. This not only increases visual burden but may also affect the driver's ability to make immediate judgments about road conditions. Especially at high speeds, this frequent focus adjustment can lead to driver distraction, thereby reducing driving comfort and safety. Furthermore, while the HUD allows the driver to see key driving information while keeping their eyes forward, its display quality is significantly reduced under strong sunlight. Direct sunlight or reflections onto the HUD's imaging area can cause severe glare or even blackouts, making the electronic rearview mirror image blurry and difficult to read. In extreme cases, the driver may be completely unable to see the information displayed in the electronic rearview mirror, especially in scenarios requiring frequent checks of rear traffic (such as lane changes and overtaking). This display failure undoubtedly increases driving risk significantly and affects driving safety.

[0029] According to an embodiment of the present invention, a method embodiment of a data processing method is provided. It should be noted that the steps shown in the flowchart in the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions. Furthermore, although a logical order is shown in the flowchart, in some cases, the steps shown or described may be executed in a different order than that shown here.

[0030] This method embodiment can be executed in an electronic device or similar computing device that includes memory and a processor. Taking operation on a computer terminal as an example, the computer terminal may include one or more processors (processors may include, but are not limited to, central processing units (CPUs), graphics processing units (GPUs), digital signal processing (DSP) chips, microcontroller units (MCUs), field-programmable gate arrays (FPGAs), neural network processors (NPUs), tensor processors (TPUs), artificial intelligence (AI) type processors, etc.) and memory for storing data. Optionally, the computer terminal may also include transmission devices, input / output devices, and display devices for communication functions. Those skilled in the art will understand that the above structural description is merely illustrative and does not limit the structure of the computer terminal. For example, the computer terminal may include more or fewer components than described above, or have a different configuration than described above.

[0031] The memory can be used to store computer programs, such as application software programs and modules, like the computer program corresponding to the data processing method in this embodiment of the invention. The processor executes various functional applications and data processing by running the computer program stored in the memory, thereby implementing the aforementioned data processing method. The memory may include high-speed random access memory (RAM) and non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory may further include memory remotely located relative to the processor, and these remote memories can be connected to the mobile terminal via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks (LANs), mobile communication networks, and combinations thereof.

[0032] The transmission device is used to receive or send data via a network. Specific examples of the network described above may include a wireless network provided by the mobile terminal's communication provider. In one example, the transmission device includes a Network Interface Controller (NIC), which can connect to other network devices via a base station to communicate with the Internet. In another example, the transmission device may be a Radio Frequency (RF) module, used for wireless communication with the Internet.

[0033] Display devices can be, for example, touchscreen liquid crystal displays (LCDs) and touch displays (also referred to as "touchscreens" or "touch displays"). The LCD allows users to interact with the user interface of the mobile terminal. In some embodiments, the mobile terminal has a graphical user interface (GUI), which allows users to interact with the GUI through finger contact and / or gestures on a touch-sensitive surface. Optional human-computer interaction functions include: creating web pages, drawing, word processing, creating electronic documents, playing games, video conferencing, instant messaging, sending and receiving emails, call interfaces, playing digital video, playing digital music, and / or web browsing, etc. Executable instructions for performing the above human-computer interaction functions are configured / stored in one or more processor-executable computer program products or readable storage media.

[0034] Figure 1 This is a flowchart of a data processing method according to one embodiment of the present invention, such as... Figure 1 As shown, the method includes the following steps:

[0035] Step S11: Acquire initial image data, wherein the initial image data is used to represent image data acquired by the external image acquisition component of the target vehicle, and the image data is used to represent the road conditions to the side and rear of the target vehicle;

[0036] The aforementioned initial image data refers to the unprocessed, raw image information captured by the external image acquisition components on the target vehicle. Specifically, the initial image data typically includes pixel information about the environment surrounding the target vehicle, including but not limited to road conditions to the side and rear of the vehicle, other vehicles, pedestrians, obstacles, and weather conditions.

[0037] The external image acquisition component of the aforementioned target vehicle refers to the high-definition external camera in the electronic rearview mirror system. Specifically, the external high-definition camera is typically installed in the traditional rearview mirror position or other suitable locations to capture the vehicle's surroundings, responsible for real-time acquisition of road conditions to the left, right, and rear of the vehicle. To ensure image quality and timeliness, external high-definition cameras generally feature high resolution (at least 1080P) and high frame rate (e.g., 120fps), thus providing a clearer and smoother video stream for easier driver observation.

[0038] The aforementioned electronic exterior rearview mirrors refer to automotive accessories that use cameras and displays to replace traditional optical rearview mirrors. Specifically, these electronic exterior rearview mirrors typically include a high-definition camera mounted on the exterior of the vehicle to capture real-time images of the road conditions behind and to the sides, and an in-vehicle display system, such as a central control screen, a small screen on the dashboard, or an augmented reality head-up display. Electronic exterior rearview mirrors aim to provide a wider field of vision, reduce blind spots, and improve visibility in various environmental conditions, such as at night, in rain or snow, and in situations with strong glare. They also reduce wind resistance and improve fuel efficiency.

[0039] Step S12: Perform conversion processing on the initial image data to obtain the data conversion result;

[0040] For example, an external high-definition camera can capture real-time images of the road conditions to the left, right, and rear of the vehicle—the initial image data—and convert these images into raw digital signals (such as Low-Voltage Differential Signaling (LVDS)). Secondly, the initial image data is massive, and direct transmission may lead to bandwidth bottlenecks and latency, affecting real-time performance and data transmission efficiency. Compression coding can reduce data volume, accelerate transmission speed, and reduce energy consumption and costs during transmission while maintaining image quality. Simultaneously, compressed signals are typically more compact and have stronger anti-interference capabilities, and compression coding also helps combat electromagnetic interference. Furthermore, the image data captured by the external high-definition camera may exist in various formats, while the onboard central image processing unit usually has specific input requirements. Format conversion ensures that the image data is transmitted in a format acceptable to the central processing unit, avoiding data processing failures due to format incompatibility. Finally, in the complex environment of vehicle operation, electromagnetic interference may cause image signal distortion, affecting the driver's judgment. Shielded wiring harnesses can enhance the stability of signal transmission, ensuring that data transmission from the camera to the central processing unit is unaffected by interference. Therefore, by transmitting signals through shielded wiring harnesses that resist electromagnetic interference, the interference of the external electromagnetic environment on image signals can be reduced, maintaining the clarity and integrity of the signals.

[0041] LVDS, as described above, is a technology for short-range, high-speed data transmission. By using differential pairs to transmit data, it can effectively reduce electromagnetic radiation, improve anti-interference capabilities, and reduce power consumption. LVDS is widely used in data transmission between high-definition cameras and image processing units due to its high efficiency and stability.

[0042] Step S13: Perform adaptive enhancement processing on the data conversion result to obtain the target image data;

[0043] Step S14: In response to the target vehicle's panoramic imaging function being enabled, target image data is displayed using the target vehicle's target reflection area.

[0044] The aforementioned panoramic imaging function refers to the function of the Panoramic Heads-Up Display (PHUD) equipped in the target vehicle. This function can project a wide augmented reality image covering the front field of vision of the vehicle onto the windshield, so that the driver can obtain information about the surrounding environment without taking his eyes off the vehicle, including but not limited to navigation instructions, speed information, warning signals and the display screen of the electronic exterior rearview mirrors.

[0045] The aforementioned target reflection area refers to a specially treated area on the windshield that efficiently reflects the light signals emitted from the PHUD, forming a clear, distortion-free image. Specifically, the target reflection area is typically located directly in front of the driver, within their natural line of sight. The design must consider the driver's posture, head movement range, and optimal viewing angle to ensure the driver can see the PHUD-projected image directly and clearly without obstructing their view of the road, thus guaranteeing driving safety. This area can be a transparent coating or a special material on the windshield to enhance light reflection, reduce light loss, and ensure the visibility of the PHUD image under various lighting conditions.

[0046] Figure 2 This is a schematic diagram of a data processing system according to one embodiment of the present invention, such as... Figure 2 As shown, the system includes: an external image acquisition component, a central image processing unit, a panoramic head-up display domain controller, an image generation unit, and a target reflection area.

[0047] The aforementioned central image processing unit is responsible for receiving the raw digital signals from the external image acquisition components and performing in-depth processing on them, including but not limited to noise reduction, dynamic exposure adjustment, and distortion correction. This series of operations aims to ensure that even in complex weather and lighting conditions, the driver can obtain clear, undisturbed, and proportionally accurate road condition images, thereby improving driving safety and comfort.

[0048] The aforementioned panoramic head-up display domain controller is responsible for coordinating the interaction between the PHUD and the entire system, particularly the adaptation and transmission of image signals. Specifically, the panoramic head-up display domain controller can convert the processed image signal into a format suitable for PHUD display based on the PHUD's technical specifications, such as resolution, frame rate, and optical characteristics, and determine the optimal display position and size to achieve harmonious coexistence with other important vehicle information (such as speed and navigation instructions), while ensuring that the driver can effectively obtain rearview mirror information without shifting their gaze.

[0049] The aforementioned image generation unit is responsible for converting the digital signal optimized by the PHUD domain controller into an optical signal. By employing sub-millimeter light-emitting diodes (Mini LEDs), micro light-emitting diodes (Micro LEDs), or laser light sources, a high-brightness image matching the electronic rearview mirror image is created, which is then precisely projected onto the target reflection area via an optical lens assembly to form a clear and stable far-end projection image.

[0050] Based on the above steps S11 to S14, initial image data is acquired and converted to obtain a data conversion result. Then, adaptive enhancement processing is performed on the data conversion result to obtain target image data. Finally, when the panoramic imaging function of the target vehicle is turned on, the target image data is displayed using the target reflection area of ​​the target vehicle, achieving the purpose of clearly and intuitively displaying the electronic rearview mirror image. This achieves the technical effect of improving driving safety and comfort, and solves the technical problem in related technologies where drivers need to frequently adjust their eye focus when looking at the road conditions to the side and rear of the vehicle, resulting in low driving safety and comfort.

[0051] The data processing method in the embodiments of the present invention will be further described below.

[0052] Optionally, in step S13, adaptive enhancement processing is performed on the data transformation result to obtain target image data including:

[0053] Step S131: Preprocess the data conversion result to obtain the preprocessed result;

[0054] Step S132: Perform adaptive enhancement processing on the preprocessing results to obtain the target image data.

[0055] For example, an LVDS signal typically includes a pixel clock and a data channel, where the data channel carries image data and the pixel clock is used to synchronize data transmission and reception. After receiving the LVDS signal, the central image processing unit performs a series of image processing and optimization tasks to ensure the image quality of the electronic rearview mirror. Specifically, the parallel data transmitted via LVDS can be converted into a format that the central processing unit can understand, such as RGB or YUV format. Further, the preprocessed data can be preprocessed, and then the preprocessed result can be adaptively enhanced to obtain the target image data.

[0056] Based on the above steps S131 to S132, the data conversion result is preprocessed to obtain the preprocessed result, and then the preprocessed result is adaptively enhanced to obtain the target image data. This not only optimizes the image quality, but also improves the response speed and adaptability of the data processing system, providing drivers with more intuitive and accurate visual information.

[0057] Optionally, in step S131, the data conversion result is preprocessed to obtain the preprocessed result, which includes:

[0058] Step S1311: Perform noise reduction processing on the data conversion result to obtain the noise reduction result;

[0059] Step S1312: Based on the noise reduction processing results, determine the image attribute parameters corresponding to the initial image data;

[0060] Step S1313: Obtain real-time illumination data and adjust the image attribute parameters based on the real-time illumination data to obtain the image adjustment result. The real-time illumination data is used to determine the driving scene of the target vehicle.

[0061] Step S1314: Perform distortion correction on the image adjustment result to obtain the preprocessed result.

[0062] The aforementioned image attribute parameters refer to parameters that can define and adjust the appearance characteristics of an image, including but not limited to brightness, contrast, color saturation, sharpness, and white balance, which directly affect the visibility and detail of the image under different environmental conditions.

[0063] The aforementioned real-time lighting data refers to the ambient light intensity and direction information captured in real time by the electronic exterior rearview mirror system during operation. This includes, but is not limited to, various lighting conditions such as direct sunlight during the day, diffused light on cloudy days, streetlight illumination at night, and even the influence of vehicle interior lights. Acquiring real-time lighting data helps the system intelligently analyze the current driving scenario. For example, it can increase image brightness to combat overexposure in bright light conditions and enhance contrast in nighttime conditions to better distinguish distant objects, thereby improving driving safety.

[0064] The aforementioned distortion correction refers to a deformation correction applied to an image, primarily targeting image distortion caused by the optical characteristics of cameras (such as wide-angle lenses), especially edge stretching or compression. Specifically, distortion correction eliminates this distortion by performing mathematical operations on the image to remap pixel positions, restoring the image to a proportion and shape closer to the actual scene.

[0065] For example, since the camera of an electronic side mirror may capture images containing a lot of noise in adverse weather conditions (such as rain, snow, or nighttime), noise reduction algorithms are needed to eliminate the noise. Specifically, AI noise reduction technology can be used to identify and filter out unwanted image noise, such as spots, stripes, or other interfering factors, thereby improving image clarity and readability.

[0066] Furthermore, during driving, external lighting conditions (such as sunlight intensity, shadows, and changes in tunnel lighting) constantly change, which can affect the quality of the PHUD image. To address this, sensors on the vehicle collect lighting data in real time to dynamically adjust image attribute parameters, resulting in image adjustment effects that ensure optimal image display under various lighting conditions. For example, in bright light environments, it may be necessary to enhance image brightness and contrast, while in low light environments, noise can be reduced and color contrast increased to maintain clear visibility.

[0067] For example, since electronic side mirrors typically use wide-angle lenses to capture images, the images may exhibit edge distortion or aberration, especially when the image is magnified or reduced to fit the display scale of the PHUD. To make the image display in the PHUD more realistic and distortion-free, distortion correction can be applied to the image adjustment results to ensure that every part of the image is correctly presented, avoiding visual misleading due to distortion and improving the driver's accuracy in perceiving the surrounding environment.

[0068] Based on steps S1311 to S1314 above, the data conversion result is subjected to noise reduction processing to obtain the noise reduction result. Based on the noise reduction result, the image attribute parameters corresponding to the initial image data are determined. This process aims to improve image quality and eliminate noise introduced by environmental factors, thereby improving image clarity and detail. Subsequently, the system acquires real-time illumination data and dynamically adjusts the image attribute parameters based on this data to adapt to different driving scenarios, such as the transition from bright daytime to dim nighttime, or sudden changes in light at tunnel entrances. Furthermore, distortion correction is applied to the image adjustment result to eliminate edge distortion that may be caused by wide-angle camera shooting, ensuring the image's authenticity and accuracy. After this series of preprocessing steps, the obtained preprocessing result significantly enhances the image's usability and visual experience, allowing the driver to maintain attention on the road ahead while obtaining clearer, more intuitive, and more realistic information about the surrounding environment, thereby improving driving safety, comfort, and the overall driving experience.

[0069] Optionally, in step S132, adaptive enhancement processing is performed on the preprocessing result to obtain target image data including:

[0070] Step S1321: Perform display adaptation processing on the preprocessing results to obtain the display adaptation results;

[0071] Step S1322: Translate and project the display adaptation results to obtain target image data.

[0072] For example, during the adaptive enhancement of the preprocessing results to obtain the target image data, the system first performs display adaptation processing to ensure that the image is optimally presented on the PHUD. Specifically, display adaptation processing includes, but is not limited to, adjusting the image resolution, frame rate, and layout positioning to match the display characteristics of the PHUD. For instance, if the PHUD's native resolution and frame rate are 108 PPD and 60 fps respectively, the electronic rearview mirror's image will be synchronously adjusted to these parameters to avoid stuttering or blurring. Simultaneously, to avoid obstructing key driving information such as vehicle speed and navigation, the electronic rearview mirror image will be precisely positioned on both sides of the PHUD display area, ensuring that the driver can simultaneously observe both core vehicle information and the electronic rearview mirror image, improving driving safety and comfort.

[0073] Next, the system translates and projects the display adaptation results. This step is performed by the PHUD's image generation unit, which translates the digital signal into a light signal and generates a high-brightness light image that matches the rearview mirror image using Mini LED, Micro LED, or laser light sources. The light image then passes through the PHUD's precision optical lens group to reduce light energy loss during transmission and accurately project it onto the target reflection area of ​​the windshield.

[0074] Based on the above steps S1321 to S1322, the preprocessing result is subjected to display adaptation processing to obtain the display adaptation result. Then, the display adaptation result is subjected to translation and projection processing to obtain the target image data. This not only achieves perfect adaptation between the image signal and the PHUD display characteristics, but also, through the translation of light signals and precise optical projection, clearly and stably presents the image of the electronic rearview mirror in front of the driver, thereby enhancing the driver's driving experience and ensuring driving safety.

[0075] Optionally, the external image acquisition component includes a left external image acquisition component and a right external image acquisition component. In step S1321, the preprocessing result is subjected to display adaptation processing to obtain the display adaptation result, which includes:

[0076] Step S21: Based on the preprocessing results, determine the left image data and the right image data, wherein the left image data is used to represent the image data acquired by the left external image acquisition component, and the right image data is used to represent the image data acquired by the right external image acquisition component;

[0077] Step S22: Obtain the first image display parameters corresponding to the left image data and the second image display parameters corresponding to the right image data, wherein the first image display parameters include the resolution and image frame rate of the left image data, and the second image display parameters include the resolution and image frame rate of the right image data;

[0078] Step S23: Based on preset panoramic display parameters, the first image display parameters and the second image display parameters are synchronously adjusted to obtain the synchronous adjustment result;

[0079] Step S24: Perform perspective compensation on the synchronization adjustment result based on preset projection parameters to obtain the display adaptation result.

[0080] The aforementioned left-side and right-side external image acquisition components refer to the high-definition cameras installed on the left and right sides of the target vehicle respectively in the electronic exterior rearview mirror system, used to capture real-time images of the road conditions to the side of the vehicle. The left-side and right-side external image acquisition components feature high resolution (at least 1080P) and high frame rate (e.g., 120fps) to ensure a clear and smooth video stream, allowing the driver to observe details of the surrounding environment, including other vehicles, pedestrians, obstacles, and weather conditions.

[0081] The aforementioned preset panoramic display parameters refer to display characteristics related to the PHUD, such as resolution, frame rate, color depth, and field of view. These parameters are set during the vehicle design phase to ensure optimal visual effects and response speed when the electronic exterior rearview mirror image is displayed on the PHUD, while also coexisting harmoniously with other important vehicle information (such as speed and navigation instructions). During display adaptation processing, the central image processing unit adjusts the left and right image data according to the aforementioned preset parameters to ensure a clear, lag-free image that matches the display characteristics of the PHUD.

[0082] The aforementioned preset projection parameters refer to a series of technical specifications of the PHUD in terms of optical projection, including but not limited to imaging distance, field of view, light intensity distribution, and reflection efficiency. These parameters determine how the PHUD converts digital signals into light signals and forms a clear, distortion-free physical image through the target reflection area on the windshield. During the translation and projection processing, the system combines the aforementioned preset projection parameters to perform perspective compensation on the synchronously adjusted image data to eliminate image distortion or warping caused by the physical limitations of the vehicle structure and optical lens group. This ensures that when the driver faces the electronic rearview mirror image projected by the PHUD, they can obtain accurate depth perception and viewing angle, thereby enhancing driving safety and comfort.

[0083] For example, in the display adaptation process of the electronic rearview mirror image, the system first determines the left and right image data based on the preprocessing results (including noise reduction, image attribute parameter adjustment, and distortion correction). Then, it obtains the first and second image display parameters corresponding to the left and right image data, respectively. Next, the system synchronously adjusts the first and second image display parameters according to preset panoramic display parameters to match the display characteristics of the PHUD, avoiding stuttering or blurring during display. Finally, based on preset projection parameters, the system performs perspective compensation on the synchronously adjusted image data to ensure that the image projected onto the PHUD matches the driver's visual perception of distant road conditions, achieving a clear and stable display of the electronic rearview mirror image on the PHUD. These operations not only optimize image quality but also adjust the image display format and optical characteristics, achieving a perfect integration of the electronic rearview mirror image and the PHUD display, providing the driver with more intuitive, realistic, and practical driving assistance information.

[0084] For example, in the process of integrating the electronic exterior rearview mirror image into the PHUD, further processing—namely perspective compensation—is necessary to ensure that the driver can receive road condition information from the rear and sides naturally and accurately. This compensation process is based on the specific optical projection parameters of the PHUD and aims to adjust the image to match the driver's visual characteristics when viewing distant objects.

[0085] First, the PHUD's imaging distance determines which segment of the virtual plane on the windshield the image will be projected onto. Since this virtual plane is some distance from the driver's eyes, direct projection may make the image appear flat or distorted, especially for electronic side mirrors which already have a wide viewing angle. Therefore, the PHUD domain controller can adjust the image depth to simulate the realistic depth of distant scenes, ensuring that even when displayed on a virtual plane, the driver can accurately read distance information as if directly observing the external environment, reducing visual confusion. Second, the PHUD's field of view is a key factor affecting the width and height of the image coverage. The size and proportion of the electronic side mirror image need to match the PHUD's field of view to ensure that all critical road information is clearly presented within the driver's line of sight. If the field of view is too wide or too narrow, it will not only lead to missing information but may also distract the driver. Therefore, when performing perspective compensation, the image proportion must be finely adjusted to ensure that every detail appropriately fills the PHUD's display area, neither too crowded nor too empty. Finally, to achieve the above goals, image processing algorithms, including but not limited to geometric transformation and ray tracing technology, can be used to adjust the position and size of pixels in the electronic rearview mirror image. This ensures that when the image is finally projected through the precision optical components of the PHUD, it accurately reflects the actual road conditions behind and to the sides in terms of shape, proportion, and depth, thereby improving driving safety and comfort.

[0086] Based on steps S21 to S24 above, the left and right image data are determined based on the preprocessing results, and the first image display parameters corresponding to the left image data and the second image display parameters corresponding to the right image data are obtained. Then, the first and second image display parameters are synchronously adjusted based on preset panoramic display parameters to obtain a synchronous adjustment result. Finally, perspective compensation is performed on the synchronous adjustment result based on preset projection parameters to obtain a display adaptation result. This ensures that the electronic rearview mirror image perfectly matches the display characteristics of the PHUD, ensuring that the driver does not need to adjust eye focus when observing left and right rear road conditions, reducing visual fatigue and improving driving safety and comfort. Simultaneously, through the optimization of display parameters and perspective compensation, the image remains clear and stable even under complex lighting conditions, further enhancing the system's practicality and reliability.

[0087] Optionally, the data processing method in this embodiment of the invention further includes:

[0088] The first display area corresponding to the left image data is determined based on the user's driving habits, and the second display area corresponding to the right image data is determined based on the user's driving habits, wherein the first display area and the second display area are located in the target reflection area.

[0089] For example, a driver's usual gaze focus and preferred viewing angle can be identified and memorized through user configuration or automatic learning algorithms. For instance, some drivers may prefer the left rearview mirror, while others may rely more heavily on the right. Therefore, a camera or other sensor can monitor the driver's gaze, and models such as neural networks can analyze the driver's gaze distribution during driving to determine the driver's level of attention to the left and right rearview mirror images. Subsequently, based on the driver's gaze distribution data, the layout and size of the left and right images in the target reflection area can be dynamically adjusted.

[0090] For example, the first display area corresponding to the left-side image data and the second display area corresponding to the right-side image data can occupy the upper left and upper right corners of the reflective area, respectively, to avoid obstructing the display area of ​​core information such as vehicle speed and navigation. For drivers who prefer the left-side rearview mirror, the size of the first display area can be appropriately increased, and vice versa, to ensure that the driver can obtain the required information in the most comfortable and intuitive way.

[0091] For example, the display areas of the first display area and the second display area can be set to be less than 15%-20% of the target reflection area, that is, the sum of the display areas of the first display area and the second display area is less than 15%-40% of the target reflection area, thereby ensuring that vehicle speed, navigation instructions, warning information, etc. still occupy the main visual focus and are not obscured by the screen of the electronic rearview mirror.

[0092] Furthermore, it allows drivers to manually adjust the position and size of the first and second display areas to perfectly suit their driving habits. Specifically, this can be done via the in-vehicle touchscreen, voice commands, or specific gesture recognition, ensuring that drivers can easily and safely make settings while driving.

[0093] Based on the above optional embodiments, determining the first display area corresponding to the left-side image data based on the user's driving habits, and determining the second display area corresponding to the right-side image data based on the user's driving habits, can significantly improve the driving experience and safety. Drivers develop certain observation habits over long-term driving, exhibiting specific reliance on and viewing angles of the vehicle's left and right side mirrors. Arranging the image data of the electronic exterior rearview mirrors according to these habits ensures that when drivers view the rearview mirror images displayed on the PHUD, they can quickly and accurately understand the vehicle's surroundings without changing their original observation patterns, reducing distractions while driving and thus enhancing the driver's ability to make immediate judgments about road conditions, thereby improving driving safety.

[0094] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods according to the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of the present invention.

[0095] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this invention are all information and data authorized by the user or fully authorized by all parties. Furthermore, the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions, and corresponding operation entry points are provided for users to choose to authorize or refuse.

[0096] This invention also provides a data processing apparatus for implementing the above embodiments and preferred embodiments; details already described will not be repeated. As used below, the term "module" can refer to a combination of software and / or hardware that performs a predetermined function. Although the apparatus described in the following embodiments is preferably implemented in software, hardware implementation, or a combination of software and hardware, is also possible and contemplated.

[0097] Figure 3 This is a structural block diagram of a data processing apparatus according to one embodiment of the present invention, such as... Figure 3 As shown, the device includes:

[0098] The acquisition module 301 is used to acquire initial image data, wherein the initial image data represents the image data acquired by the external image acquisition component of the target vehicle, and the image data represents the road conditions to the side and rear of the target vehicle;

[0099] The first processing module 302 is used to convert the initial image data to obtain the data conversion result;

[0100] The second processing module 303 is used to perform adaptive enhancement processing on the data conversion result to obtain the target image data;

[0101] Display module 304 is used to display target image data using the target reflection area of ​​the target vehicle in response to the target vehicle's panoramic imaging function being turned on.

[0102] Optionally, the second processing module 303 is further configured to: preprocess the data conversion result to obtain a preprocessed result; and perform adaptive enhancement processing on the preprocessed result to obtain the target image data.

[0103] Optionally, the second processing module 303 is further configured to: perform noise reduction processing on the data conversion result to obtain a noise reduction processing result; determine the image attribute parameters corresponding to the initial image data based on the noise reduction processing result; acquire real-time illumination data, and adjust the image attribute parameters based on the real-time illumination data to obtain an image adjustment result, wherein the real-time illumination data is used to determine the driving scene in which the target vehicle is located; and perform distortion correction on the image adjustment result to obtain a preprocessing result.

[0104] Optionally, the second processing module 303 is further configured to: perform display adaptation processing on the preprocessing result to obtain the display adaptation result; and perform translation projection processing on the display adaptation result to obtain the target image data.

[0105] Optionally, the external image acquisition component includes a left external image acquisition component and a right external image acquisition component. The second processing module 303 is further configured to: determine left image data and right image data based on the preprocessing result, wherein the left image data represents the image data acquired by the left external image acquisition component, and the right image data represents the image data acquired by the right external image acquisition component; obtain a first image display parameter corresponding to the left image data and a second image display parameter corresponding to the right image data, wherein the first image display parameter includes the resolution and image frame rate of the left image data, and the second image display parameter includes the resolution and image frame rate of the right image data; synchronously adjust the first image display parameter and the second image display parameter based on preset panoramic display parameters to obtain a synchronous adjustment result; and perform perspective compensation on the synchronous adjustment result based on preset projection parameters to obtain a display adaptation result.

[0106] Optionally, the data processing apparatus in this embodiment of the invention further includes:

[0107] The determining module 305 is used to determine a first display area corresponding to the left image data based on the user's driving habits, and to determine a second display area corresponding to the right image data based on the user's driving habits, wherein the first display area and the second display area are located in the target reflection area.

[0108] It should be noted that the above modules can be implemented by software or hardware. For the latter, they can be implemented in the following ways, but are not limited to: all the above modules are located in the same processor; or, the above modules are located in different processors in any combination.

[0109] According to another aspect of the present invention, a vehicle is also provided, comprising: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to execute instructions to implement the data processing method of the present invention.

[0110] Optionally, in this embodiment, the processor can be configured to perform the following steps via a computer program:

[0111] Step S11: Acquire initial image data, wherein the initial image data is used to represent image data acquired by the external image acquisition component of the target vehicle, and the image data is used to represent the road conditions to the side and rear of the target vehicle;

[0112] Step S12: Perform conversion processing on the initial image data to obtain the data conversion result;

[0113] Step S13: Perform adaptive enhancement processing on the data conversion result to obtain the target image data;

[0114] Step S14: In response to the target vehicle's panoramic imaging function being enabled, target image data is displayed using the target vehicle's target reflection area.

[0115] According to another aspect of the present invention, a computer-readable storage medium is also provided, the computer-readable storage medium including a stored executable program, wherein, when the executable program is running, it controls the device where the storage medium is located to execute the data processing method of the present invention.

[0116] Optionally, in this embodiment, the storage medium may be configured to store a computer program for performing the following steps:

[0117] Step S11: Acquire initial image data, wherein the initial image data is used to represent image data acquired by the external image acquisition component of the target vehicle, and the image data is used to represent the road conditions to the side and rear of the target vehicle;

[0118] Step S12: Perform conversion processing on the initial image data to obtain the data conversion result;

[0119] Step S13: Perform adaptive enhancement processing on the data conversion result to obtain the target image data;

[0120] Step S14: In response to the target vehicle's panoramic imaging function being enabled, target image data is displayed using the target vehicle's target reflection area.

[0121] According to another aspect of the present invention, a computer program product is also provided, the computer program product including computer instructions that, when executed by a processor, implement the data processing method of the present invention.

[0122] Optionally, in this embodiment, the above-mentioned computer program product can be configured as a computer program that performs the following steps:

[0123] Step S11: Acquire initial image data, wherein the initial image data is used to represent image data acquired by the external image acquisition component of the target vehicle, and the image data is used to represent the road conditions to the side and rear of the target vehicle;

[0124] Step S12: Perform conversion processing on the initial image data to obtain the data conversion result;

[0125] Step S13: Perform adaptive enhancement processing on the data conversion result to obtain the target image data;

[0126] Step S14: In response to the target vehicle's panoramic imaging function being enabled, target image data is displayed using the target vehicle's target reflection area.

[0127] The sequence numbers of the above embodiments of the present invention are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0128] In the above embodiments of the present invention, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0129] In the several embodiments provided by this invention, it should be understood that the disclosed technical content can be implemented in other ways. The device embodiments described above are merely illustrative; for example, the division of units can be a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the displayed or discussed mutual coupling, direct coupling, or communication connection can be through some interfaces; the indirect coupling or communication connection of units or modules can be electrical or other forms.

[0130] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0131] Furthermore, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0132] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, read-only memory (ROM), random access memory (RAM), portable hard drives, magnetic disks, or optical disks.

[0133] The above description is only a preferred embodiment of the present invention. It should be noted that for those skilled in the art, several improvements and modifications can be made without departing from the principle of the present invention, and these improvements and modifications should also be considered within the scope of protection of the present invention.

Claims

1. A data processing method, characterized in that, include: Acquire initial image data, wherein the initial image data represents image data acquired by an external image acquisition component of the target vehicle, and the image data represents the road conditions to the side and rear of the target vehicle; The initial image data is converted to obtain the data conversion result; The data conversion result is subjected to adaptive enhancement processing to obtain the target image data; In response to the target vehicle's panoramic imaging function being enabled, the target image data is displayed using the target vehicle's target reflection area.

2. The data processing method according to claim 1, characterized in that, The adaptive enhancement processing of the data conversion result to obtain the target image data includes: The data conversion results are preprocessed to obtain preprocessed results; The preprocessing results are then subjected to adaptive enhancement processing to obtain the target image data.

3. The data processing method according to claim 2, characterized in that, The preprocessing of the data conversion result to obtain the preprocessed result includes: The data conversion result is subjected to noise reduction processing to obtain the noise reduction result; Based on the noise reduction result, determine the image attribute parameters corresponding to the initial image data; Real-time illumination data is acquired, and the image attribute parameters are adjusted based on the real-time illumination data to obtain an image adjustment result, wherein the real-time illumination data is used to determine the driving scene in which the target vehicle is located; The image adjustment result is subjected to distortion correction to obtain the preprocessing result.

4. The data processing method according to claim 2, characterized in that, The adaptive enhancement process performed on the preprocessing result to obtain the target image data includes: The preprocessing results are then subjected to display adaptation processing to obtain the display adaptation results; The display adaptation result is translated and projected to obtain the target image data.

5. The data processing method according to claim 4, characterized in that, The external image acquisition component includes a left external image acquisition component and a right external image acquisition component. The display adaptation processing of the preprocessing result to obtain the display adaptation result includes: Based on the preprocessing results, left-side image data and right-side image data are determined, wherein the left-side image data represents the image data acquired by the left-side external image acquisition component, and the right-side image data represents the image data acquired by the right-side external image acquisition component; Obtain the first image display parameters corresponding to the left image data and the second image display parameters corresponding to the right image data, wherein the first image display parameters include the resolution and image frame rate of the left image data, and the second image display parameters include the resolution and image frame rate of the right image data; Based on preset panoramic display parameters, the first image display parameters and the second image display parameters are synchronously adjusted to obtain a synchronous adjustment result; The synchronous adjustment result is subjected to perspective compensation based on preset projection parameters to obtain the display adaptation result.

6. The data processing method according to claim 5, characterized in that, The method further includes: The first display area corresponding to the left image data is determined based on the user's driving habits, and the second display area corresponding to the right image data is determined based on the user's driving habits, wherein the first display area and the second display area are located in the target reflection area.

7. A data processing apparatus, characterized in that, include: An acquisition module is used to acquire initial image data, wherein the initial image data represents image data acquired by an external image acquisition component of the target vehicle, and the image data represents the road conditions to the side and rear of the target vehicle; The first processing module is used to convert the initial image data to obtain the data conversion result; The second processing module is used to perform adaptive enhancement processing on the data conversion result to obtain target image data; The display module is used to display the target image data using the target reflection area of ​​the target vehicle in response to the target vehicle's panoramic imaging function being turned on.

8. A vehicle, characterized in that, include: processor; Memory used to store the processor's executable instructions; The processor is configured to execute the instructions to implement the data processing method according to any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes a stored executable program, wherein, when the executable program is executed, it controls the device on which the storage medium is located to perform the data processing method according to any one of claims 1 to 6.

10. A computer program product, characterized in that, The computer program product includes computer instructions that, when executed by a processor, implement the data processing method of any one of claims 1 to 6.

Images