Electronic rearview mirror field of view adjustment display method, device, terminal equipment and storage medium

Abstract

The application is suitable for the technical field of intelligent terminals, and provides an electronic rearview mirror field-of-view adjusting display method and device, a terminal equipment and a storage medium. The method comprises the following steps: based on an original video stream collected by a vehicle-mounted camera, a default field-of-view picture and an adjusting field-of-view picture are generated in parallel; the default field-of-view picture is superimposed on the adjusting field-of-view picture in a semi-transparent manner to generate a superimposed picture; based on the position relationship between the default field-of-view picture and the adjusting field-of-view picture in the corresponding field-of-view area in the original video stream, the area type in the adjusting field-of-view picture is determined; according to the determination result of the area type, the pixels of the corresponding area in the superimposed picture are color-coded to obtain a contrast display picture; and the contrast display picture is output to a vehicle-mounted display screen for display. The application can provide instant and effective visual feedback for the driver when the field of view of the electronic rearview mirror is adjusted, so as to reduce the cognitive burden of the driver and improve the adjusting efficiency.

Description

Technical Field

[0001] This application relates to the field of smart terminal technology, and in particular to an electronic rearview mirror field of view adjustment display method, device, terminal equipment and storage medium. Background Technology

[0002] With the development of automotive electronics technology, electronic rearview mirrors have gradually replaced traditional physical rearview mirrors. Electronic rearview mirrors capture environmental images through cameras and display them on an in-vehicle screen; their field of view can be digitally adjusted via software parameters.

[0003] However, this adjustment method is not as intuitive as adjusting the angle using a physical mirror. During the adjustment process, the driver can only see a single final image. Because it is impossible to directly compare the adjusted image with the default image, the driver finds it difficult to quickly and accurately understand the changes in field of vision. Often, the driver needs to rely on memory and repeatedly try to adjust the image, making the overall adjustment process less intuitive and less efficient.

[0004] Therefore, how to provide drivers with immediate and effective visual feedback when adjusting the field of view of electronic rearview mirrors, so as to reduce their cognitive burden and improve adjustment efficiency, is a problem that needs to be considered. Summary of the Invention

[0005] This application provides an electronic rearview mirror field of view adjustment display method, device, terminal equipment, and storage medium, which can provide drivers with immediate and effective visual feedback when adjusting the electronic rearview mirror field of view, thereby reducing their cognitive burden and improving adjustment efficiency.

[0006] In a first aspect, embodiments of this application provide an electronic rearview mirror field-of-view adjustment display method, including:

[0007] Based on the raw video stream captured by the vehicle-mounted camera, a default field of view and an adjusted field of view are generated in parallel. The default field of view is generated based on regulatory parameters, and the adjusted field of view is generated based on adjustment parameters. The default view screen is superimposed onto the adjusted view screen in a semi-transparent manner to generate an overlay image; Based on the positional relationship between the default view and the adjusted view in the original video stream, the region type in the adjusted view is determined, including overlapping regions, newly added view regions, and reduced view regions. Based on the determination result of the region type, the pixels of the corresponding region in the superimposed image are color-coded to obtain a comparison display image; The comparison display image is output to the vehicle display screen for display.

[0008] In one possible implementation of the first aspect, the step of overlaying the default view screen onto the adjusted view screen in a semi-transparent manner to generate an overlaid image includes: Based on the transparency coefficient, the pixel colors of the adjusted field of view and the corresponding pixel colors of the default field of view are mixed and calculated, and an overlay image is generated according to the result of the mixing calculation; the transparency coefficient is used to control the weight of the default field of view in the mixing calculation.

[0009] In one possible implementation of the first aspect, the method further includes: Receives user input of transparency adjustment instructions, which are input via physical buttons, touch sliders, or voice recognition; The transparency coefficient is dynamically adjusted according to the transparency adjustment command.

[0010] In one possible implementation of the first aspect, determining the region type in the adjusted field of view based on the positional relationship between the default field of view and the adjusted field of view in the original video stream specifically includes: Based on the field of view corresponding to the default field of view and the adjusted field of view, a reduced field of view area is determined. The reduced field of view area is the difference between the field of view corresponding to the default field of view and the field of view corresponding to the adjusted field of view. Determine the original coordinates of the pixels within the adjusted field of view in the original video stream; If the original coordinates are located within the field of view corresponding to both the default view and the adjusted view, then the pixel is determined to belong to the overlapping area. If the original coordinates are located within the field of view corresponding to the adjusted field of view, but not within the field of view corresponding to the default field of view, then the pixel is determined to belong to the newly added field of view.

[0011] In one possible implementation of the first aspect, the step of color encoding the pixels of the corresponding region in the overlay image according to the region type determination result includes: The identification color is determined based on the identified area type; Based on the determined identifier color, the pixels in the corresponding area of ​​the overlaid image are color-coded; Specifically, the overlapping area is identified by a first color, the newly added field of view area is identified by a second color, and the reduced field of view area is identified by a third color, wherein the first color, the second color, and the third color are all different from each other.

[0012] In one possible implementation of the first aspect, color encoding of pixels in the corresponding region of the overlay image based on a determined identifier color includes: The pixel is determined according to the following formula. Pixel color after color encoding:

[0013] in, For the pixel The pixel color after color encoding. For the pixel The pixel colors in the overlaid image, According to region type The designated identification color, where β is the color coding intensity coefficient.

[0014] In one possible implementation of the first aspect, before superimposing the default view image onto the adjusted view image in a semi-transparent manner to generate the superimposed image, the method further includes: When the resolution of the default view screen is inconsistent with that of the adjusted view screen, the default view screen is scaled using bilinear interpolation or bicubic interpolation to match its resolution with that of the adjusted view screen.

[0015] Secondly, embodiments of this application provide an electronic rearview mirror field-of-view adjustment display device, including: An initial image generation unit is used to generate a default field-of-view image and an adjusted field-of-view image in parallel based on the raw video stream captured by the vehicle-mounted camera. The default field-of-view image is generated based on regulatory parameters, and the adjusted field-of-view image is generated based on adjustment parameters. The image overlay unit is used to overlay the default view image onto the adjusted view image in a semi-transparent manner to generate an overlay image; The type determination unit is used to determine the region type in the adjusted field of view based on the positional relationship between the default field of view and the adjusted field of view in the original video stream. The region type includes overlapping region, newly added field of view region and reduced field of view region. The comparison image generation unit is used to color encode the pixels of the corresponding area in the superimposed image according to the determination result of the area type to obtain the comparison display image; The screen display unit is used to output the comparison display screen to the vehicle display screen for display.

[0016] Thirdly, embodiments of this application provide a terminal device, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, it implements the electronic rearview mirror field of view adjustment display method as described in the first aspect above.

[0017] Fourthly, embodiments of this application provide a computer-readable storage medium storing a computer program that, when executed by a processor, implements the electronic rearview mirror field-of-view adjustment display method as described in the first aspect above.

[0018] Fifthly, embodiments of this application provide a computer program product that, when run on a terminal device, causes the terminal device to execute the electronic rearview mirror field of view adjustment display method as described in the first aspect above.

[0019] In this embodiment, firstly, based on the original video stream captured by the vehicle-mounted camera, a default field-of-view image and an adjusted field-of-view image are generated in parallel. The default field-of-view image is generated based on regulatory parameters, and the adjusted field-of-view image is generated based on adjustment parameters. By simultaneously acquiring two field-of-view images corresponding to the adjustment benchmark and the adjustment result, the limitation of not being able to compare a single image is avoided. Then, the default field-of-view image is superimposed on the adjusted field-of-view image in a semi-transparent manner to generate a superimposed image, allowing the driver to observe the adjustment benchmark and the adjustment result on the same display interface at the same time, without having to remember the default field of view or repeatedly switch images, thus initially achieving intuitive field-of-view comparison. Based on the positional relationship of the corresponding field-of-view areas in the original video stream, the overlapping areas, newly added field-of-view areas, and reduced field-of-view areas in the adjusted field-of-view image are determined, clearly distinguishing the types of regional changes during the field-of-view adjustment process, allowing the driver to clearly understand the specific differences between the adjusted field of view and the regulatory default field of view. Then, based on the regional type determination results, the pixels of the corresponding areas in the superimposed image are color-coded, presenting the differences of different types of areas in an intuitive color form, further reducing the difficulty for the driver to identify field-of-view differences, without having to perform complex visual comparisons and mental filling. Finally, the color-coded comparison display image is output to the vehicle-mounted display screen for display. This proposed solution can provide drivers with immediate and intuitive visual feedback that contrasts their field of vision, significantly reducing their cognitive burden and thus improving the efficiency of visual field adjustment. Attached Figure Description

[0020] To more clearly illustrate the technical solutions in the embodiments of this application, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0021] Figure 1 This is a flowchart illustrating the implementation of the electronic rearview mirror field of view adjustment and display method provided in this application embodiment; Figure 2 This is a flowchart illustrating a specific implementation of adjusting the transparency coefficient in the electronic rearview mirror field of view adjustment display method provided in this application embodiment; Figure 3 This is a flowchart illustrating a specific implementation of step S103 in the electronic rearview mirror field of view adjustment and display method provided in this application embodiment; Figure 4 This is a flowchart illustrating a specific implementation of step S104 in the electronic rearview mirror field of view adjustment and display method provided in this application embodiment; Figure 5 This is a structural block diagram of the electronic rearview mirror field of view adjustment display device provided in the embodiments of this application; Figure 6 This is a schematic diagram of the terminal device provided in the embodiments of this application. Detailed Implementation

[0022] In the following description, specific details such as particular system architectures and techniques are set forth for illustrative purposes and not for limitation, in order to provide a thorough understanding of the embodiments of this application. However, those skilled in the art will understand that this application may also be implemented in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, apparatuses, circuits, and methods have been omitted so as not to obscure the description of this application with unnecessary detail.

[0023] It should be understood that, when used in this application specification and the appended claims, the term "comprising" indicates the presence of the described features, integrals, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components and / or a collection thereof.

[0024] It should also be understood that the term “and / or” as used in this application specification and the appended claims means any combination of one or more of the associated listed items and all possible combinations, and includes such combinations.

[0025] As used in this application specification and the appended claims, the term "if" may be interpreted, depending on the context, as "when," "once," "in response to determination," or "in response to detection." Similarly, the phrase "if determined" or "if detected [the described condition or event]" may be interpreted, depending on the context, as meaning "once determined," "in response to determination," "once detected [the described condition or event]," or "in response to detection [the described condition or event]."

[0026] Furthermore, in the description of this application and the appended claims, the terms "first," "second," "third," etc., are used only to distinguish descriptions and should not be construed as indicating or implying relative importance.

[0027] References to "one embodiment" or "some embodiments" as described in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0028] By way of example and not limitation, the electronic rearview mirror field of view adjustment display method provided in this application is applicable to various types of terminal devices that need to perform electronic rearview mirror field of view adjustment display. Specific terminal devices may include mobile phones, tablets, wearable devices, laptops, ultra-mobile personal computers (UMPCs), desktop computers, and servers, etc. This application does not impose any limitations on the specific type of terminal device.

[0029] Figure 1 The implementation flow of the electronic rearview mirror field of view adjustment display method provided in this application embodiment is illustrated. The method flow includes steps S101 to S105. The specific implementation principle of each step is as follows: Step S101: Based on the raw video stream captured by the vehicle-mounted camera, generate the default field-of-view image and the adjusted field-of-view image in parallel.

[0030] The vehicle-mounted camera is a core component of the electronic rearview mirror system, used to capture images of the vehicle's surrounding environment. Its parameters must meet the system's normal operating requirements. In one possible implementation, the vehicle-mounted camera has a resolution of at least 1920×1080, a frame rate of 30 frames per second or 60 frames per second, and a field of view of 100-130 degrees. In this embodiment, the raw video stream captured by the vehicle-mounted camera is transmitted to the video processing unit through a dedicated video interface, specifically MIPI CSI, LVDS, etc. The raw video stream refers to the sequence of original images of the vehicle's surrounding environment captured in real-time by the vehicle-mounted camera, without any cropping, scaling, or other image processing, containing complete environmental information from behind and to the sides of the vehicle.

[0031] The default field of view is a cropped view generated from the current frame of the original video stream based on regulatory parameters. These regulatory parameters refer to the image cropping parameters that electronic rearview mirrors must provide, as mandated by national or international vehicle safety standards. These parameters are fixed values ​​that define the starting position and rectangle size of the default field of view within the original video stream coordinate system. The default field of view serves as the reference image for the driver's field of view adjustments, ensuring that adjustments comply with regulatory requirements.

[0032] The adjusted field of view is a view cropped from the current frame of the original video stream (and the same frame cropped based on regulatory parameters) according to adjustment parameters. Adjustment parameters are image processing parameters input by the driver through human-machine interaction (such as buttons, touchscreens, or voice commands) to adjust the field of view. These parameters dynamically change with the driver's adjustments, defining the starting position and rectangular size of the adjusted field of view in the original video stream coordinate system, thus achieving the actual field of view effect after adjustments such as translation or scaling.

[0033] In this embodiment, the original video stream is processed simultaneously through parallel processing to synchronously obtain two different viewpoint images: a default viewpoint image and an adjusted viewpoint image. This avoids the delay caused by serial processing and ensures the synchronization of the two images. In one possible implementation, this parallel processing is executed on the graphics processor shader or a dedicated image signal processing chip, relying on its parallel computing capabilities to ensure the real-time generation of the images.

[0034] This application embodiment acquires the original video stream of the vehicle's surrounding environment and uses parallel processing to simultaneously generate a default view and an adjusted view. It also acquires the view adjustment benchmark (default view) and the adjustment result (adjusted view), solving the problem that a single view cannot be compared and ensuring the synchronization of the two views, thus avoiding delays that could affect the driver's visual experience.

[0035] Step S102: Overlay the default view screen onto the adjusted view screen in a semi-transparent manner to generate an overlaid image.

[0036] Overlaying refers to a composite image that combines the default view image with the adjustable view image in a semi-transparent manner, resulting in a composite image containing the content of both images. It simultaneously carries information from both the adjustable view image and the default view image.

[0037] The semi-transparent method refers to using graphic blending technology to overlay the default view screen on the adjustable view screen in a non-completely opaque state. This allows the default view screen to be displayed with only a certain degree of transparency, while the content of the adjustable view screen below can be partially revealed. Ultimately, this allows the driver to see the content of both screens simultaneously, including the actual environmental information from the adjustable view screen and the baseline information from the default view screen, without the two screens completely obscuring each other.

[0038] In one possible implementation, based on a transparency coefficient, the pixel colors of the adjusted field of view and the corresponding pixel colors of the default field of view are mixed and calculated, and an overlay image is generated according to the result of the mixing calculation; the transparency coefficient is used to control the weight of the default field of view in the mixing calculation.

[0039] For example, the pixel color of pixel (x,y) in the overlay image is determined according to the following formula (1). : (1) in, The pixel color of the (x, y) point in the view is used to adjust the field of view. This represents the pixel color of the (x, y) point in the default field of view. Transparency coefficient .

[0040] In this embodiment, the default field of view and the adjusted field of view are semi-transparently superimposed to generate an overlaid image, allowing the driver to simultaneously observe the adjustment reference and adjustment result on the same display interface without having to memorize the default field of view or repeatedly switch images, thus initially achieving intuitive comparison of field of view.

[0041] In one possible implementation, before the default view image is superimposed on the adjusted view image in a semi-transparent manner to generate the superimposed image, if the resolution of the default view image and the adjusted view image are inconsistent, bilinear interpolation or bicubic interpolation is used to scale the default view image so that its resolution matches that of the adjusted view image, ensuring the clarity of the scaled image and avoiding blurring or distortion.

[0042] As one possible implementation of this application Figure 2 The following is a detailed implementation process of adjusting the transparency coefficient in the electronic rearview mirror field of view adjustment display method provided in this application embodiment: A1: Receives user input of transparency adjustment instructions, which are input via physical buttons, touch sliders, or voice recognition.

[0043] The transparency adjustment command is an operation command issued by the user (i.e. the driver) to adjust the intensity of the semi-transparent overlay of the default field of view. The core function of this command is to transmit specific transparency adjustment requirements to the electronic rearview mirror system. The transparency adjustment command may include information such as adjustment direction and adjustment target value, which is used to trigger subsequent transparency coefficient adjustment operations.

[0044] Physical buttons are physical operation buttons located inside the vehicle, electrically connected to the electronic rearview mirror system. They are specifically designed to receive user input for transparency adjustments and serve as a physical interface for human-computer interaction. The number of physical buttons can be configured according to actual needs (e.g., two physical buttons, one for increasing transparency and the other for decreasing transparency). Pressing a physical button once triggers a transparency adjustment action.

[0045] The touch slider is a draggable interactive control displayed on the vehicle's screen. It is a virtual operation carrier for human-computer interaction. Users can drag the slider with their fingers to transmit continuous transparency adjustment requests to the electronic rearview mirror system. The drag range of the slider corresponds to the value range of the transparency coefficient, which can realize continuous adjustment of transparency.

[0046] Voice recognition refers to the process where users issue transparency adjustment commands via voice input. The electronic rearview mirror system receives and parses these commands through a voice recognition module, converting them into executable adjustment signals. This voice-based human-computer interaction allows users to adjust transparency without manual intervention, enhancing ease of use. User-input transparency adjustment commands can include specific adjustment requests, such as "increase transparency," "decrease transparency," or "set transparency to 50%." The electronic rearview mirror system then executes the corresponding adjustment operation based on the parsed command.

[0047] For example, when the electronic rearview mirror system is in operation, the default field of view is superimposed on the adjustable field of view in a semi-transparent manner. At this time, the driver feels that the superposition intensity of the default field of view is too high, affecting the observation of the adjustable field of view, and needs to reduce the transparency. The driver can input the transparency adjustment command in three ways: First, press the "reduce transparency" physical button set in the vehicle to issue an adjustment command to reduce the transparency; second, drag the touch slider on the vehicle display screen, dragging the slider from the current position in the direction of decreasing transparency to issue a continuous transparency adjustment command; third, speak the voice command "reduce transparency" to the in-vehicle voice acquisition device. The electronic rearview mirror system parses the command through the voice recognition module to obtain the transparency adjustment command. The driver can choose the three adjustment methods according to the convenience of the driving scenario.

[0048] In this embodiment, three adjustment methods are provided: physical buttons, touch sliders, and voice recognition, covering the operational needs of different driving scenarios. This ensures that drivers can conveniently and quickly issue adjustment commands, improve the human-computer interaction experience, and avoid affecting driving safety due to cumbersome operations.

[0049] A2: Dynamically adjust the transparency coefficient according to the transparency adjustment instruction.

[0050] The transparency coefficient is also a parameter used to control the intensity of the semi-transparent overlay of the default field of view, and its value ranges from 0 to 1. In this embodiment, the initial value of the transparency coefficient is preset to 0.5, and it can be dynamically adjusted according to user instructions. Dynamic adjustment means that after receiving a transparency adjustment instruction, the system responds to the instruction in real time, instantly changes the value of the transparency coefficient, and the adjustment process is synchronously fed back to the overlay image, allowing the driver to see the comparison effect after the transparency adjustment in real time. This achieves synchronization between the adjustment instruction and the adjustment effect, avoiding adjustment delays that affect the user experience.

[0051] When the transparency factor is 0, the default view image is completely transparently overlaid (in reality, only the adjusted view image is displayed, and the default view image is not displayed). When the transparency factor is 1, the default view image is completely transparently overlaid (in reality, the default view image is not displayed, and only the adjusted view image is displayed). When the transparency factor is 0.5, the default view image is overlaid with medium intensity semi-transparency to achieve a balanced contrast between the two images.

[0052] In one possible implementation, to improve adjustment efficiency, three quick settings for the transparency coefficient are preset: the first setting has a transparency coefficient of 0, which only shows the adjustment result and does not require comparison; the second setting has a transparency coefficient of 0.5, which defaults to a balanced comparison between the two images; and the third setting has a transparency coefficient of 0.8, which focuses on the coverage area of ​​the default field of view.

[0053] One possible implementation involves dynamically adjusting the transparency coefficient by smoothly changing it frame by frame within a predetermined transition time, thus avoiding visual discomfort caused by sudden changes in the transparency coefficient. For example, to avoid visual discomfort caused by abrupt changes in transparency, a smooth transition is performed frame by frame within a predetermined transition time (e.g., 200 ms - 500 ms), with the transparency coefficient increasing by a factor of 1 for each frame. Calculate according to the following formula (2): (2) in, The current transparency coefficient, The target transparency coefficient, Transition time (seconds) f Frame rate (frames per second).

[0054] In this embodiment, in response to the user's adjustment needs, the semi-transparent overlay intensity of the default field of view is adjusted by changing the value of the transparency coefficient, thereby changing the display effect of the overlay image. The dynamic adjustment ensures that the transparency adjustment command can be instantly converted into visual feedback, allowing the driver to flexibly control the contrast intensity between the default field of view and the adjusted field of view according to their own observation preferences and driving scenarios. This avoids the default field of view from obscuring the adjusted field of view while ensuring that the differences between the two images can be clearly compared, further improving the intuitiveness and convenience of field of view adjustment and helping to reduce the cognitive burden on the driver.

[0055] In one possible implementation, at the boundary of the overlapping area between the default view and the adjusted view, the transparency coefficient is smoothed. Specifically, within a preset smoothing width on both sides of the overlapping area boundary, the transparency coefficient used for blending calculations is adjusted based on the distance from the current pixel to the overlapping area boundary, so that the transparency coefficient decreases as the distance decreases. This gradual change in transparency at the overlapping area boundary avoids hard edges and improves the visual smoothness of the overlaid image.

[0056] For example, to avoid obvious hard edges at the boundaries of overlapping areas, a gradient of transparency is applied near the boundaries of overlapping areas by a preset number of pixels (2-5 pixels), specifically according to the following formula (3): (3) Where d is the distance from the current pixel to the boundary of the overlapping region. For a smooth transition width, This is the transparency coefficient after smoothing. This allows for a more natural transition at the edges of the overlaid images.

[0057] Step S103: Based on the positional relationship between the default view and the adjusted view in the original video stream, determine the region type in the adjusted view.

[0058] The field of view (FOV) refers to the specific area in the original video stream corresponding to each FOV frame (default FOV frame, adjusted FOV frame). In other words, each FOV frame is obtained by cropping a specific area of ​​the original video stream, and that specific area is the FOV frame corresponding to that FOV frame. Each FOV frame can be accurately defined by its starting coordinates and cropping size in the original video stream.

[0059] Positional relationships include the relative positions and overlap ranges of the field of view corresponding to the default field of view and the field of view corresponding to the adjusted field of view in the original video stream. In one possible implementation, the positional relationship includes whether the two field of view areas overlap, the size of the overlap, and the expansion or contraction of the adjusted field of view area relative to the default field of view area.

[0060] Region type refers to the type of view change corresponding to different areas in the adjusted view. Region types include overlapping regions, newly added view areas, and reduced view areas. Among them, overlapping regions are view areas that are visible before and after adjustment, and are shared by the default view and the adjusted view; newly added view areas are view areas newly acquired after adjustment, which are not visible in the default view; reduced view areas are view areas lost after adjustment, and are not visible in the adjusted view.

[0061] As one possible implementation of this application Figure 3 A specific implementation flow of step S103 in the electronic rearview mirror field of view adjustment display method provided in the embodiment of this application is shown below: B1: Based on the field of view corresponding to the default field of view and the adjusted field of view, a reduced field of view area is determined, wherein the reduced field of view area is the difference between the field of view corresponding to the default field of view and the field of view corresponding to the adjusted field of view.

[0062] The field of view corresponding to the default viewpoint refers to the specific range of the default viewpoint within the original video stream. Similar to the field of view corresponding to the adjustable viewpoint, this field of view is fully defined by its starting coordinates and cropping size, and its range can be clearly defined using coordinates. The field of view corresponding to the adjustable viewpoint refers to the specific range of the adjustable viewpoint within the original video stream. It is also fully defined by its starting coordinates and cropping size, and its range can be clearly defined using coordinates.

[0063] The difference between the field of view area corresponding to the default view and the field of view area corresponding to the adjusted view specifically refers to the remaining area within the field of view area corresponding to the default view, excluding the overlapping portion. All pixels within this remaining area are located within the default field of view but not within the adjusted field of view. Reducing the field of view area visually reflects the shrinkage range after adjustment, helping drivers quickly identify the lost visual content and preventing the loss of critical visual information due to over-adjustment.

[0064] B2: Determine the original coordinates of the pixels within the adjusted field of view in the original video stream.

[0065] The pixels within the adjusted field of view refer to each smallest display unit of the image contained in the adjusted field of view. Each pixel has its local coordinates in the coordinate system of the adjusted field of view itself. These local coordinates are used to identify the specific position of the pixel within the adjusted field of view. The original coordinates of the pixel in the original video stream can locate the actual position of the pixel in the original video stream, and thus determine the field of view area to which the pixel belongs (default field of view area or adjusted field of view area).

[0066] B3: If the original coordinates are located within the field of view corresponding to both the default view and the adjusted view, then the pixel is determined to belong to the overlapping area.

[0067] Simultaneous location of original coordinates within two visual field areas means that the original coordinates of a pixel satisfy both the coordinate range requirements of the default visual field area and the coordinate range requirements of the adjusted visual field area. In other words, the original video stream position corresponding to that pixel is simultaneously covered by both visual field areas. By determining whether the original coordinates of pixels within the adjusted visual field are simultaneously located within two visual field areas, the overlapping area is accurately identified. The overlapping area clearly identifies the areas that remain unchanged during the visual field adjustment process, ensuring that the driver can clearly perceive the unchanged parts and reduce cognitive load.

[0068] B4: If the original coordinates are located within the field of view corresponding to the adjusted field of view, but not within the field of view corresponding to the default field of view, then the pixel is determined to belong to the newly added field of view.

[0069] If the original coordinates are within the field of view corresponding to the adjusted view, it means that the pixel is part of the adjusted view and corresponds to the adjusted view content. If the original coordinates are not within the field of view corresponding to the default view, it means that the original video stream position corresponding to the pixel was not covered by the default view area. In other words, the view content corresponding to the pixel was not visible before adjustment (in the default view) and is newly added content after the view adjustment. The newly added view area can intuitively reflect the expanded range after the view adjustment, helping the driver quickly identify the newly acquired view content after adjustment.

[0070] In one possible implementation, a coordinate system is established based on the adjusted view screen; the default view screen is mapped to the reference coordinate system to establish a pixel-level correspondence, so that the two screens are aligned in the same coordinate system, ensuring the accuracy of the superposition.

[0071] For example, the starting coordinates of the cropping area of ​​the view are adjusted to be... The cutting size is The default starting coordinates of the cropped area of ​​the view are... The cutting size is The starting coordinates and cropping size can fully define the range of the adjustable field of view in the original video stream.

[0072] First, calculate the original coordinates (x, y) of the pixel point in the adjusted view according to the following formula (4). The original coordinates refer to the specific position coordinates of a pixel within the adjusted field of view, corresponding to the position in the original video stream captured by the vehicle-mounted camera. The core function of the original coordinates is to locate the actual position (x, y) of the pixel in the original video stream. (4) Secondly, determine whether the pixel (x,y) is within the default field of view according to the following formula (5): ,and, (5) Finally, if pixel (x,y) is also within the default view, calculate the local coordinates of pixel (x,y) in the default view according to the following formula (6). These local coordinates are used to identify the specific location of the pixel (x, y) within the default field of view: (6) In this embodiment, by analyzing the positional relationship of the visual field regions corresponding to the two visual field images in the original video stream, the overlapping areas, newly added visual field regions, and reduced visual field regions in the adjusted visual field image are clearly determined. This clearly distinguishes the types of regional changes during the visual field adjustment process, allowing the driver to know the specific differences between the adjusted visual field image and the default visual field image. This provides a clear basis for subsequent color coding, making subsequent regional difference identification more targeted and further improving the intuitiveness of visual field comparison.

[0073] Step S104: Based on the determination result of the region type, color-encode the pixels of the corresponding region in the superimposed image to obtain a comparison display image.

[0074] The determination of the region type refers to the region type marker (overlapping region, newly added field of view region, reduced field of view region) corresponding to each pixel in the adjusted field of view. This provides a clear basis for color coding, ensuring that different region types can be accurately identified. Color coding refers to a process of using preset fixed colors to mark pixels corresponding to different region types in the overlaid image with semi-transparent colors. Different region types can be intuitively distinguished through color differences, allowing drivers to quickly identify changes in field of view without the need for complex visual comparisons and memorization.

[0075] In this application, color coding is performed on the overlay image and does not disrupt the original visual content of the overlay image. The comparison display image refers to the final comparison image obtained after color coding the overlay image. It includes both the original default and adjusted visual content of the overlay image, as well as color indicators for different area types. It can intuitively show the contrast differences and area changes before and after visual adjustment and is the final visual image output to the driver.

[0076] As one possible implementation of this application Figure 4 A specific implementation flow of step S104 in the electronic rearview mirror field of view adjustment display method provided in this application embodiment is shown below: C1: Determine the identifier color based on the identified area type.

[0077] The identification color refers to a preset, fixed color used to intuitively distinguish different area types. Its function is to clearly mark the boundaries and ranges of the three area types on the overlay screen through color differences, allowing drivers to quickly and intuitively identify different visual change areas without the need for complex visual comparisons and memorization, thus reducing the cognitive burden on drivers. This color is a preset, fixed value.

[0078] One possible implementation employs a three-color coding scheme to ensure clear and distinguishable identification of different region types. Specifically, a first color is assigned to the overlapping region, a second color is assigned to the newly added field of vision region, and a third color is assigned to the reduced field of vision region. The first color is used to identify stable regions visible both before and after field of vision adjustment; the second color is used to identify newly expanded regions after field of vision adjustment; and the third color is used to identify contracted regions lost after field of vision adjustment. The first, second, and third colors are all distinct, meaning their red, green, and blue (RGB) values ​​are significantly different, preventing color confusion and ensuring that the driver can quickly distinguish the three region types under varying background brightness.

[0079] C2: Based on the determined identifier color, color-encode the pixels in the corresponding area of ​​the overlay image.

[0080] The corresponding area refers to the specific area in the overlay image that corresponds one-to-one with the three area types, namely the part of the overlay image that belongs to the overlapping area, the part that belongs to the newly added field of view area, and the part that belongs to the reduced field of view area.

[0081] In one possible implementation, color encoding refers to a process of weighted mixing of the identifier color and the pixel colors in the overlaid image using a semi-transparent color overlay method. In one possible implementation, the pixel is determined according to the following calculation formula (7). Pixel color after color encoding: (7) in, For the pixel The pixel color after color encoding. For the pixel In the overlay image, each pixel maintains a region type marker for its color. , For example, 1 indicates an overlapping area, 2 indicates a newly added area of ​​view, and 3 indicates a reduced area of ​​view. According to region type Determined identifier color, For color coding intensity coefficient, .

[0082] The color coding intensity factor is used to control the display intensity of the identification color, ensuring that the color markings are clearly visible without obscuring the original image. In one possible implementation, the color coding intensity factor is 0.3.

[0083] In this embodiment, based on the determination result of the region type, a semi-transparent three-color encoding method is used to color-code different region types in the superimposed image, presenting the regional differences before and after vision adjustment in an intuitive color form, allowing the driver to quickly and clearly identify overlapping areas, newly added vision areas, and reduced vision areas without the need for complex visual comparisons and mental filling, further reducing the driver's cognitive burden, and finally generating a comparison display image that integrates vision comparison information and region difference indicators, providing the driver with complete and intuitive vision adjustment feedback.

[0084] In one possible implementation, to maintain good visual effects under different levels of transparency, the color coding intensity... With transparency coefficient Adaptive adjustment, the calculation formula is as follows (8): (8) in, For transparency coefficient Adaptive adjustment of color coding intensity The baseline coding strength coefficient (e.g., 0.3). When When =0.5, = Maintain the baseline color coding intensity; when =0 or When =1, =1.5× Increased by 50%; The further away from 0.5, the higher the color coding intensity, making it easier to identify area markers on the field of view.

[0085] In one possible implementation, to ensure that the color markers are clearly visible under different background brightness levels, the brightness of the marker color is adaptively adjusted according to the background brightness of each pixel during the color encoding process. Specifically, when the background brightness is higher than a first preset threshold (e.g., 200), the marker color brightness is reduced; when the background brightness is lower than a second preset threshold (e.g., 50), the marker color brightness is increased. The first preset threshold is greater than the second preset threshold. When the background brightness is between the second preset threshold and the first preset threshold, the baseline brightness of the marker color is maintained.

[0086] For example, the grayscale value of pixel (x,y) is calculated based on the red, green, and blue color channel values ​​of pixel (x,y). As shown in equation (9): (9) in, . This represents the value of the red channel. This indicates the value for the green channel. This represents the value of the blue channel. , , This is the weight value. In one possible implementation, , , .

[0087] Based on the calculated grayscale value Determine the background brightness and adjust the marker color accordingly. Specifically, adjust the marker color of pixel (x,y) according to the following formula (10): (10) in, According to region type Determined identifier color, The marker color is adjusted according to the background brightness.

[0088] For example, when the grayscale value is greater than 200, the brightness of the corresponding marker color is reduced; when the grayscale value is less than 50, the brightness of the corresponding marker color is increased; when the grayscale value is between 50 and 200, the baseline brightness of the marker color is maintained.

[0089] In this embodiment, by adaptively adjusting the brightness of the marker color, the color marker is ensured to be clearly visible under different background brightness environments, which can improve the applicability and reliability of color encoding.

[0090] Step S105: Output the comparison display screen to the vehicle display screen for display.

[0091] The comparison display integrates the baseline, adjustment result, and regional difference information of the field of vision adjustment, and is the core image for the driver to observe the comparison of the field of vision. The in-vehicle display screen is the terminal device in the electronic rearview mirror system used to display the field of vision image. It is connected to the video processing unit to receive and display the processed field of vision image, ensuring that the driver can clearly observe the surrounding environment of the vehicle and the comparison information of the field of vision adjustment.

[0092] In this embodiment, the comparison display image is transmitted from the video processing unit to the vehicle display screen and rendered and displayed in real time on the vehicle display screen. This process must ensure the real-time performance and stability of the image transmission, avoid image delay, stuttering or distortion, and ensure that the driver can see the corresponding comparison display image immediately while adjusting their field of vision, thus achieving real-time visual feedback.

[0093] In one possible implementation, auxiliary user interface elements are overlaid on the vehicle display screen, including color legends and transparency control sliders. The color legends are used to mark the area types corresponding to different colors to help the driver quickly understand the meaning of the color symbols. The transparency control sliders are used for the driver to continuously adjust the transparency to improve the human-computer interaction experience. However, the overlay of auxiliary user interface elements does not affect the content and display effect of the display screen itself.

[0094] In this embodiment, a comparison display screen integrating field of view comparison information and regional difference indicators is output to the vehicle display screen in real time for display. This provides the driver with intuitive and clear feedback on field of view adjustment, allowing the driver to instantly observe the comparison between the adjusted field of view and the default field of view, as well as the differences in regional changes. This achieves synchronization between field of view adjustment and visual feedback, further improving the efficiency of field of view adjustment and reducing the cognitive and operational burden on the driver. At the same time, by overlaying auxiliary user interface elements, the driver can quickly understand the meaning of color indicators, improving the human-computer interaction experience and ensuring the smoothness of the field of view adjustment process.

[0095] In one possible implementation, the adjustment parameters are dynamically updated based on the real-time received field-of-view adjustment commands, and the comparison display is synchronously updated within each video frame processing cycle. The field-of-view adjustment commands include panning or zooming commands.

[0096] Field of view adjustment commands can also be input via physical buttons, touch sliders, or voice recognition to adjust the field of view. Dynamically updating adjustment parameters means that upon receiving a field of view adjustment command, the adjustment parameters are immediately modified and updated in real time to ensure that the adjustment parameters are synchronized with the driver's adjustment operations. The video frame processing cycle refers to the processing time of a single video frame in the original video stream. Typically, the video frame rate of an electronic rearview mirror system is 30fps, corresponding to a processing cycle of approximately 33ms per video frame. Within each video frame processing cycle, the system completes the entire process of updating adjustment parameters, image extraction, processing, and displaying, ensuring real-time performance.

[0097] The adjustment parameters specifically include adjusting the starting coordinates of the field of view area corresponding to the view screen. and cutting size The updated parameters take effect immediately and are used for subsequent extraction of the field of view.

[0098] In response to the translation command, the starting coordinates of the field of view region corresponding to the adjusted view in the original video stream are updated according to a preset translation step size. The preset translation step size refers to the pre-set offset of the starting coordinates after each received translation command. The translation step size is divided into horizontal translation step size. and vertical translation step size These correspond to horizontal (left-right) translation and vertical (up-down) translation of the field of view, respectively.

[0099] In one possible implementation, the translation step size The translation step size is typically set to 1%-3% of the original video size. This step size can be adaptively adjusted according to the resolution of the original video stream to ensure the fineness of the translation adjustment. It avoids both excessively large step sizes that cause sudden changes in the field of view and affect observation, and excessively small step sizes that result in low adjustment efficiency.

[0100] The correspondence between translation commands and starting coordinate updates: Translation commands are divided into four types: up, down, left, and right, each corresponding to different update logics of the starting coordinates. When receiving an up translation command, the field of view is adjusted to translate upwards, and the starting coordinates are updated accordingly. The value decreases, and the decrease is equal to the vertical translation step size. When receiving a downward translation command, adjust the field of view to translate downwards, starting at the specified coordinates. As the value increases, the increase is equal to the vertical translation step size. When receiving a left-shift command, adjust the field of view to shift left, starting at the specified coordinates. The value decreases, and the decrease is equal to the horizontal translation step size. When receiving a right-shift command, adjust the field of view to shift to the right, starting at the specified coordinates. As the value increases, the increase is equal to the horizontal translation step size. .

[0101] In response to the zoom command, the size of the field of view corresponding to the adjusted view is updated according to a preset zoom ratio change, and its starting coordinates are adjusted synchronously to maintain the center of the field of view unchanged. The preset zoom ratio change refers to a pre-set zoom ratio change value that is applied to the size of the field of view corresponding to the adjusted view each time a zoom command is received. This indicates that the value of Δs is typically in the range of 0.05-0.1. This value ensures the smoothness of the scaling adjustment and avoids sudden changes in the scaling ratio that could cause visual discomfort to the driver.

[0102] In one possible implementation, the scaling command is divided into two types: zoom-in command and zoom-out command, corresponding to... Different values: When receiving an amplification command, Taking a positive value magnifies the field of view; when pressing the compression command, Taking a negative value reduces the field of view.

[0103] Adjust the size of the field of view corresponding to the image, that is, adjust the cropping size in the parameters. . The horizontal width of the field of view. The vertical height of the field of view is the focal length. The size directly determines the range of the adjustable field of view; a larger size results in a wider field of view (zoom in), while a smaller size results in a narrower field of view (zoom out). Updating this size involves adjusting the zoom level based on the scaling factor Δs. and Perform synchronous scaling calculations to obtain the updated size parameters. After updating the field of view size, adjust the starting coordinates. The value ensures that the center position of the field of view remains consistent before and after zooming, avoiding the shift of the observation focus due to field of view zooming and improving the driver's adjustment experience.

[0104] For example, the scaled cropping size Calculate according to the following formula (11): , (11) To keep the center position of the cutting area unchanged, the starting coordinates are adjusted synchronously according to the following formula (12). : , (12) As can be seen from the above, in this embodiment, firstly, based on the original video stream captured by the vehicle-mounted camera, a default field of view and an adjusted field of view are generated in parallel. The default field of view is generated based on regulatory parameters, and the adjusted field of view is generated based on adjustment parameters. By simultaneously acquiring two field of view images corresponding to the adjustment benchmark and the adjustment result, the limitation of not being able to compare a single image is avoided. Then, the default field of view is superimposed on the adjusted field of view in a semi-transparent manner to generate a superimposed image, allowing the driver to observe the adjustment benchmark and the adjustment result on the same display interface at the same time, without having to remember the default field of view or repeatedly switch images, thus initially achieving intuitiveness in field of view comparison. Based on the positional relationship of the corresponding field of view areas in the original video stream, the overlapping areas, newly added field of view areas, and reduced field of view areas in the adjusted field of view image are determined, clearly distinguishing the types of regional changes during the field of view adjustment process, allowing the driver to clearly understand the specific differences between the adjusted field of view and the regulatory default field of view. Then, based on the regional type determination results, the pixels of the corresponding areas in the superimposed image are color-coded, presenting the differences of different types of areas in an intuitive color form, further reducing the difficulty for the driver to identify field of view differences, without having to perform complex visual comparisons and mental filling. Finally, the color-coded comparison display image is output to the vehicle-mounted display screen for display. This proposed solution can provide drivers with immediate and intuitive visual feedback that contrasts their field of vision, significantly reducing their cognitive burden and thus improving the efficiency of visual field adjustment.

[0105] It should be understood that the sequence number of each step in the above embodiments does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0106] Corresponding to the electronic rearview mirror field of view adjustment and display method described in the above embodiments, Figure 5 A structural block diagram of the electronic rearview mirror field of view adjustment display device provided in the embodiments of this application is shown. For ease of explanation, only the parts related to the embodiments of this application are shown.

[0107] Reference Figure 5 The electronic rearview mirror field-of-view adjustment display device includes: an initial image generation unit 51, an image overlay unit 52, a type determination unit 53, a comparison image generation unit 54, and an image display unit 55, wherein: The initial image generation unit 51 is used to generate a default field of view and an adjusted field of view in parallel based on the original video stream captured by the vehicle-mounted camera. The default field of view is generated based on regulatory parameters, and the adjusted field of view is generated based on adjustment parameters. The image overlay unit 52 is used to overlay the default field of view onto the adjusted field of view in a semi-transparent manner to generate an overlay image; The region determination unit 53 is used to determine the region type in the adjusted field of view based on the positional relationship between the default field of view and the adjusted field of view in the original video stream. The region type includes overlapping region, newly added field of view and reduced field of view. The comparison image generation unit 54 is used to color encode the pixels of the corresponding area in the superimposed image according to the determination result of the area type to obtain the comparison display image; The screen display unit 55 is used to output the comparison display screen to the vehicle display screen for display.

[0108] As one possible implementation of this application, the image overlay unit 52 includes: The hybrid processing module is used to perform hybrid calculations on the pixel colors of the adjusted field of view and the corresponding pixel colors of the default field of view based on the transparency coefficient, and generate an overlay image according to the hybrid calculation result; the transparency coefficient is used to control the weight of the default field of view in the hybrid calculation.

[0109] As one possible implementation of this application, the image overlay unit 52 further includes: An adjustment instruction receiving module is used to receive transparency adjustment instructions input by the user, which are input via physical buttons, touch sliders, or voice recognition. A transparency coefficient adjustment module is used to dynamically adjust the transparency coefficient according to the transparency adjustment command.

[0110] As one possible implementation of this application, the region determination unit 53 includes: The first region determination module is used to determine the reduced field of view region based on the field of view regions corresponding to the default field of view and the adjusted field of view. The reduced field of view region is the difference between the field of view region corresponding to the default field of view and the field of view region corresponding to the adjusted field of view. The original coordinate determination module is used to determine the original coordinates of the pixels in the adjusted field of view in the original video stream; The second region determination module is used to determine that if the original coordinates are located within the field of view corresponding to both the default field of view and the adjusted field of view, the pixel belongs to the overlapping region. The third region determination module is used to determine that if the original coordinates are located within the field of view corresponding to the adjusted field of view, but not within the field of view corresponding to the default field of view, the pixel belongs to the newly added field of view.

[0111] As one possible implementation of this application, the comparison image generation unit 54 includes: The color identification module is used to determine the identification color based on the determined area type; wherein, a first color is assigned to the overlapping area for identification, a second color is assigned to the newly added field of view area for identification, and a third color is assigned to the reduced field of view area for identification, and the first color, the second color, and the third color are all different from each other; The color encoding module is used to color encode the pixels of the corresponding area in the overlay image based on a determined identifier color.

[0112] As one possible implementation of this application, the pixel is determined according to the following calculation formula. Pixel color after color encoding:

[0113] in, For the pixel The pixel color after color encoding. For the pixel The pixel colors in the overlaid image, According to region type The designated identification color, where β is the color coding intensity coefficient.

[0114] As one possible implementation of this application, the electronic rearview mirror field-of-view adjustment display device further includes: Resolution matching for a single eye is used to scale the default field of view using bilinear interpolation or bicubic interpolation when the resolution of the default field of view is inconsistent with that of the adjusted field of view, so that its resolution matches that of the adjusted field of view.

[0115] As can be seen from the above, in this embodiment, firstly, based on the original video stream captured by the vehicle-mounted camera, a default field of view and an adjusted field of view are generated in parallel. The default field of view is generated based on regulatory parameters, and the adjusted field of view is generated based on adjustment parameters. By simultaneously acquiring two field of view images corresponding to the adjustment benchmark and the adjustment result, the limitation of not being able to compare a single image is avoided. Then, the default field of view is superimposed on the adjusted field of view in a semi-transparent manner to generate a superimposed image, allowing the driver to observe the adjustment benchmark and the adjustment result on the same display interface at the same time, without having to remember the default field of view or repeatedly switch images, thus initially achieving intuitiveness in field of view comparison. Based on the positional relationship of the corresponding field of view areas in the original video stream, the overlapping areas, newly added field of view areas, and reduced field of view areas in the adjusted field of view image are determined, clearly distinguishing the types of regional changes during the field of view adjustment process, allowing the driver to clearly understand the specific differences between the adjusted field of view and the regulatory default field of view. Then, based on the regional type determination results, the pixels of the corresponding areas in the superimposed image are color-coded, presenting the differences of different types of areas in an intuitive color form, further reducing the difficulty for the driver to identify field of view differences, without having to perform complex visual comparisons and mental filling. Finally, the color-coded comparison display image is output to the vehicle-mounted display screen for display. This proposed solution can provide drivers with immediate and intuitive visual feedback that contrasts their field of vision, significantly reducing their cognitive burden and thus improving the efficiency of visual field adjustment.

[0116] It should be noted that the information interaction and execution process between the above-mentioned devices / units are based on the same concept as the method embodiments of this application. For details on their specific functions and technical effects, please refer to the method embodiments section, and they will not be repeated here.

[0117] This application embodiment also provides a computer-readable storage medium storing a computer program, which, when executed by a processor, implements... Figures 1 to 4 The steps of any electronic rearview mirror field of view adjustment display method are represented.

[0118] This application embodiment also provides a terminal device, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, it implements... Figures 1 to 4 The steps of any electronic rearview mirror field of view adjustment display method are represented.

[0119] This application also provides a computer program product that, when run on a terminal device, causes the terminal device to execute the implementation of... Figures 1 to 4 The steps of any electronic rearview mirror field of view adjustment display method are represented.

[0120] Figure 6This is a schematic diagram of a terminal device provided in an embodiment of this application. For example... Figure 6 As shown, the terminal device 6 in this embodiment includes: a processor 60, a memory 61, and a computer program 62 stored in the memory 61 and executable on the processor 60. When the processor 60 executes the computer program 62, it implements the steps in the various embodiments of the electronic rearview mirror field-of-view adjustment display method described above, for example... Figure 1 Steps S101 to S105 are shown. Alternatively, when the processor 60 executes the computer program 62, it implements the functions of each module / unit in the above-described device embodiments, for example... Figure 5 The functions of units 51 to 55 shown.

[0121] For example, the computer program 62 may be divided into one or more modules / units, which are stored in the memory 61 and executed by the processor 60 to complete this application. The one or more modules / units may be a series of computer-readable instruction segments capable of performing a specific function, which describe the execution process of the computer program 62 in the terminal device 6.

[0122] The terminal device 6 may include, but is not limited to, a processor 60 and a memory 61. Those skilled in the art will understand that... Figure 6 This is merely an example of terminal device 6 and does not constitute a limitation on terminal device 6. It may include more or fewer components than shown, or combine certain components, or different components. For example, terminal device 6 may also include input / output devices, network access devices, buses, etc.

[0123] The processor 60 can be a Central Processing Unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or any conventional processor.

[0124] The memory 61 can be an internal storage unit of the terminal device 6, such as a hard disk or memory of the terminal device 6. The memory 61 can also be an external storage device of the terminal device 6, such as a plug-in hard disk, smart media card (SMC), secure digital (SD) card, flash card, etc., equipped on the terminal device 6. Furthermore, the memory 61 can include both internal and external storage units of the terminal device 6. The memory 61 is used to store the computer program and other programs and data required by the terminal device. The memory 61 can also be used to temporarily store data that has been output or will be output.

[0125] It should be noted that the information interaction and execution process between the above-mentioned devices / units are based on the same concept as the method embodiments of this application. For details on their specific functions and technical effects, please refer to the method embodiments section, and they will not be repeated here.

[0126] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the above-described division of functional units and modules is merely an example. In practical applications, the above functions can be assigned to different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit. Furthermore, the specific names of the functional units and modules are only for easy differentiation and are not intended to limit the scope of protection of this application. The specific working process of the units and modules in the above system can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0127] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the methods of the above embodiments of this application can be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed by a processor, it can implement the steps of the various method embodiments described above. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or certain intermediate forms. The computer-readable medium can include at least: any entity or device capable of carrying computer program code to a device / terminal equipment, a recording medium, a computer memory, a read-only memory (ROM), a random access memory (RAM), an electrical carrier signal, a telecommunication signal, and a software distribution medium. Examples include USB flash drives, portable hard drives, magnetic disks, or optical disks. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electrical carrier signals or telecommunication signals.

[0128] In the above embodiments, the descriptions of each embodiment have different focuses. For parts that are not described in detail or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0129] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application, and should all be included within the protection scope of this application.

Claims

1. A method for adjusting the field of view display of an electronic rearview mirror, characterized in that, include: Based on the raw video stream captured by the vehicle-mounted camera, a default field of view and an adjusted field of view are generated in parallel. The default field of view is generated based on regulatory parameters, and the adjusted field of view is generated based on adjustment parameters. The default view screen is superimposed onto the adjusted view screen in a semi-transparent manner to generate an overlay image; Based on the positional relationship between the default view and the adjusted view in the original video stream, the region type in the adjusted view is determined, including overlapping regions, newly added view regions, and reduced view regions. Based on the determination result of the region type, the pixels of the corresponding region in the superimposed image are color-coded to obtain a comparison display image; The comparison display image is output to the vehicle display screen for display.

2. The method according to claim 1, characterized in that, The step of overlaying the default view image onto the adjusted view image in a semi-transparent manner to generate an overlaid image includes: Based on the transparency coefficient, the pixel colors of the adjusted field of view and the corresponding pixel colors of the default field of view are mixed and calculated, and an overlay image is generated according to the result of the mixing calculation; the transparency coefficient is used to control the weight of the default field of view in the mixing calculation.

3. The method according to claim 2, characterized in that, The method further includes: Receives user input of transparency adjustment instructions, which are input via physical buttons, touch sliders, or voice recognition; The transparency coefficient is dynamically adjusted according to the transparency adjustment command.

4. The method according to claim 1, characterized in that, The determination of the region type in the adjusted field of view based on the positional relationship between the default field of view and the adjusted field of view in the original video stream specifically includes: Based on the field of view corresponding to the default field of view and the adjusted field of view, a reduced field of view area is determined. The reduced field of view area is the difference between the field of view corresponding to the default field of view and the field of view corresponding to the adjusted field of view. Determine the original coordinates of the pixels within the adjusted field of view in the original video stream; If the original coordinates are located within the field of view corresponding to both the default view and the adjusted view, then the pixel is determined to belong to the overlapping area. If the original coordinates are located within the field of view corresponding to the adjusted field of view, but not within the field of view corresponding to the default field of view, then the pixel is determined to belong to the newly added field of view.

5. The method according to claim 1, characterized in that, The step of color encoding the pixels of the corresponding region in the overlay image based on the region type determination result includes: The identification color is determined based on the identified area type; Based on the determined identifier color, the pixels in the corresponding area of ​​the overlaid image are color-coded; Specifically, the overlapping area is identified by a first color, the newly added field of view area is identified by a second color, and the reduced field of view area is identified by a third color, wherein the first color, the second color, and the third color are all different from each other.

6. The method according to claim 5, characterized in that, The step of color encoding the pixels in the corresponding area of ​​the overlaid image based on the determined identifier color includes: The pixel is determined according to the following formula. Pixel color after color encoding: in, For the pixel The pixel color after color encoding. For the pixel The pixel colors in the overlaid image According to region type The designated identification color, where β is the color coding intensity coefficient.

7. The method according to any one of claims 1 to 6, characterized in that, Before the step of overlaying the default view image onto the adjusted view image in a semi-transparent manner to generate the overlaid image, the method further includes: When the resolution of the default view screen is inconsistent with that of the adjusted view screen, the default view screen is scaled using bilinear interpolation or bicubic interpolation to match its resolution with that of the adjusted view screen.

8. An electronic rearview mirror field-of-view adjustment display device, characterized in that, include: An initial image generation unit is used to generate a default field-of-view image and an adjusted field-of-view image in parallel based on the raw video stream captured by the vehicle-mounted camera. The default field-of-view image is generated based on regulatory parameters, and the adjusted field-of-view image is generated based on adjustment parameters. The image overlay unit is used to overlay the default view image onto the adjusted view image in a semi-transparent manner to generate an overlay image; The type determination unit is used to determine the region type in the adjusted field of view based on the positional relationship between the default field of view and the adjusted field of view in the original video stream. The region type includes overlapping region, newly added field of view region and reduced field of view region. The comparison image generation unit is used to color encode the pixels of the corresponding area in the superimposed image according to the determination result of the area type to obtain the comparison display image; The screen display unit is used to output the comparison display screen to the vehicle display screen for display.

9. A terminal device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the electronic rearview mirror field of view adjustment display method as described in any one of claims 1 to 7.

10. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by the processor, it implements the electronic rearview mirror field of view adjustment display method as described in any one of claims 1 to 7.

Images