A method and apparatus for determining the stitching area of ​​a vehicle and its surround view system.

By calculating and adjusting the camera's field of view boundary lines, a balanced stitching area was determined, solving the problem of uneven stitching in the vehicle surround view system and improving the stitching effect and success rate.

CN116091656BActive Publication Date: 2026-11-17NINGBO GEELY AUTOMOBILE RES & DEV CO LTD +1
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202310102263.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-01-29
Publication Date
2026-11-17
Estimated Expiration
2043-01-29

AI Technical Summary

Technical Problem

In existing vehicle surround view systems, the fixed field of view stitching cannot meet the optimal stitching requirements of special installation positions of vehicles in diversified markets, resulting in uneven brightness, uneven image clarity and poor distortion of the stitched image.

Method used

By calculating the angle between adjacent half-fields of view of the cameras to be stitched and adjusting the position of the field of view boundary line so that the angle difference is less than or equal to a preset threshold, the stitching area is determined, ensuring the intersection of the camera's field of view on the vehicle's ground plane and forming a balanced stitching area.

Benefits of technology

It achieves balanced brightness, balanced image clarity, and good distortion control when splicing multiple images, thus improving the splicing success rate and image display effect.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116091656B_ABST
    Figure CN116091656B_ABST
Patent Text Reader

Abstract

This application discloses a method and apparatus for determining the stitching area of ​​a vehicle surround view system. The method includes: calculating the field-of-view angles of adjacent half-fields of view of a first camera and a second camera, denoted as the first angle and the second angle; adjusting the positions of the first field-of-view boundary line of the first camera and / or the second field-of-view boundary line of the second camera, and determining the first and second intersection points of the first and second field-of-view boundary lines with the planar stitching area, such that the difference between the first and second angles is less than or equal to a difference threshold; determining the third intersection point of the fields of view of the first camera and the second camera on the ground plane stitching area that is closest to the vehicle; and using the area determined by the line connecting the first, second, and third intersection points as the stitching area for field-of-view fusion. This embodiment can obtain a better surround view stitching area, improving the brightness uniformity of image display, the overall clarity of the stitched image, and the stitching success rate.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to vehicle control technology, and more particularly to a method and apparatus for determining the stitching area of ​​a vehicle and its surround view system. Background Technology

[0002] Currently, most vehicle surround view systems use a fixed field of view for stitching. However, the diverse market dictates that vehicles have varied shapes, sizes, designs, and camera installation positions and angles. Clearly, using a fixed field of view for surround view stitching cannot meet the optimal stitching requirements of each vehicle's unique installation location in terms of brightness balance, image clarity balance, and stitching algorithm optimization. Summary of the Invention

[0003] This application provides a method and apparatus for determining the stitching area of ​​a vehicle and its surround view system, which can obtain a better surround view stitching area, ensure that the brightness, image clarity and distortion of the stitched multi-channel images are kept balanced, and improve the brightness balance of image display, the overall clarity of the stitched image and the stitching success rate.

[0004] This application provides a method for determining the stitching area of ​​a vehicle surround view system, the method including:

[0005] Calculate the required field-of-view angles of adjacent half-fields of view of the first and second cameras to be stitched together, and denot them as the first angle and the second angle.

[0006] Adjust the position of the first field-of-view boundary line of the half-field of view corresponding to the first camera and / or the second field-of-view boundary line of the half-field of view corresponding to the second camera, and determine the first intersection point of the first field-of-view boundary line with the preset planar stitching area and the second intersection point of the second field-of-view boundary line with the planar stitching area, so that the difference between the size of the first included angle and the second included angle is less than or equal to the preset difference threshold.

[0007] The point where the field of view of the first camera and the field of view of the second camera intersect the ground plane at the point closest to the vehicle is determined and denoted as the third intersection point.

[0008] The area defined by the line connecting the first intersection point, the second intersection point, and the third intersection point is used as the stitching area where the fields of view of the first camera and the second camera are blended.

[0009] In an exemplary embodiment of this application, the step of calculating the required field-of-view angles of adjacent half-fields of view of the first camera and the second camera to be stitched together, denoted as the first angle and the second angle, may include:

[0010] Arbitrarily select a field of view boundary line from the half-field of view of the first camera near the second camera, and denote it as the first field of view boundary line; arbitrarily select a field of view boundary line from the half-field of view of the second camera near the first camera, and denote it as the second field of view boundary line; the first field of view boundary line intersects with the outer edge of the preset ground plane splicing area at a first intersection point, and the second field of view boundary line intersects with the outer edge of the ground plane splicing area at a second intersection point;

[0011] Calculate the angle between the selected first field of view boundary line and the first optical axis of the first camera, and use it as the first angle; and calculate the angle between the selected second field of view boundary line and the second optical axis of the second camera, and use it as the second angle.

[0012] In an exemplary embodiment of this application, the step of arbitrarily selecting a field-of-view boundary line from the half-field of view of the first camera near the second camera, denoted as the first field-of-view boundary line; and arbitrarily selecting a field-of-view boundary line from the half-field of view of the second camera near the first camera, denoted as the second field-of-view boundary line, may include:

[0013] Determine the first mounting position of the first camera and the second mounting position of the second camera on the vehicle;

[0014] From the half field of view of the first camera on the side closer to the second camera, arbitrarily select a line segment that starts from the first installation position and ends at any first intersection point on the outer edge of the ground plane splicing area, as the boundary line of the first field of view;

[0015] From the half-field of view of the second camera on the side closer to the first camera, arbitrarily select a line segment that starts from the second installation position and ends at any second intersection point on the outer edge of the ground plane splicing area, and use it as the boundary line of the second field of view.

[0016] In an exemplary embodiment of this application, adjusting the position of the first field-of-view boundary line corresponding to the first camera's half-field of view may include:

[0017] Drag the first intersection point of the first field of view boundary line and the outer edge of the ground plane splicing area along the outer edge of the ground plane splicing area, and calculate the size of the first included angle in real time until the difference between the size of the first included angle and the second included angle is less than or equal to the difference threshold.

[0018] In an exemplary embodiment of this application, adjusting the position of the second field-of-view boundary line corresponding to the second camera's half-field of view may include:

[0019] Drag the second intersection point of the second field of view boundary line and the outer edge of the ground plane splicing area along the outer edge of the ground plane splicing area, and calculate the size of the second included angle in real time until the difference between the size of the first included angle and the second included angle is less than or equal to the difference threshold.

[0020] In an exemplary embodiment of this application, determining the point on the ground plane stitching area where the field of view of the first camera and the field of view of the second camera are closest to the vehicle, denoted as the third intersection point, may include:

[0021] The boundary line closest to the vehicle in the projection of the half field of view of the first camera on the side closest to the second camera onto a preset ground plane is denoted as the first projection boundary line.

[0022] The boundary line closest to the vehicle in the projection of the half field of view of the second camera on the side closest to the first camera onto a preset ground plane is denoted as the second projection boundary line.

[0023] The intersection of the first projection boundary line and the second projection boundary line is taken as the third intersection point.

[0024] In an exemplary embodiment of this application, the method may further include: pre-determining the ground plane splicing area on a preset ground plane located around the vehicle;

[0025] The ground plane splicing area is an area where field of view fusion can be performed.

[0026] In an exemplary embodiment of this application, the step of pre-determining the ground plane splicing area on a preset ground plane located around the vehicle may include:

[0027] Obtain the outermost boundary of the projection of the field of view of all cameras of the vehicle onto the ground plane, and use the area enclosed by the outermost boundary as the ground plane stitching area.

[0028] This application also provides a device for determining the stitching area of ​​a vehicle surround view system, which may include a processor and a computer-readable storage medium. The computer-readable storage medium stores instructions, and when the instructions are executed by the processor, the method for determining the stitching area of ​​the vehicle surround view system is implemented.

[0029] This application also provides a vehicle that may include the stitching area determination device of the vehicle surround view system.

[0030] Compared with related technologies, the embodiments of this application may include: calculating the required field-of-view angles of adjacent half-fields of view of the first camera and the second camera to be stitched together, denoted as the first angle and the second angle; adjusting the positions of the first field-of-view boundary line of the half-field of view corresponding to the first camera and / or the second field-of-view boundary line of the half-field of view corresponding to the second camera, and determining the first intersection point of the first field-of-view boundary line with a preset planar stitching area and the second intersection point of the second field-of-view boundary line with the planar stitching area, such that the difference between the first angle and the second angle is less than or equal to a preset difference threshold; determining the closest intersection point of the field of view of the first camera and the field of view of the second camera on the ground plane stitching area to the vehicle, denoted as the third intersection point; and using the area determined by the line connecting the first intersection point, the second intersection point, and the third intersection point as the stitching area where the fields of view of the first camera and the second camera are blended. Through this embodiment, a better surround-view stitching area is obtained, ensuring that the brightness, image clarity, and distortion of the stitched multi-channel images remain balanced, thus improving the stitching success rate.

[0031] Other features and advantages of this application will be set forth in the following description, and will be apparent in part from the description, or may be learned by practicing the application. Other advantages of this application can be realized and obtained by means of the solutions described in the description and the accompanying drawings. Attached Figure Description

[0032] The accompanying drawings are used to provide an understanding of the technical solutions of this application and constitute a part of the specification. They are used together with the embodiments of this application to explain the technical solutions of this application and do not constitute a limitation on the technical solutions of this application.

[0033] Figure 1 This is a flowchart of the method for determining the stitching area of ​​the vehicle surround view system according to an embodiment of this application;

[0034] Figure 2 This is a schematic diagram of the method for determining the stitching area of ​​a vehicle surround view system according to an embodiment of this application.

[0035] Figure 3 This is a block diagram of the stitching area determination device of the vehicle surround view system according to an embodiment of this application;

[0036] Figure 4 This is a block diagram of the vehicle components according to an embodiment of this application. Detailed Implementation

[0037] This application describes several embodiments, but these descriptions are exemplary and not restrictive, and it will be apparent to those skilled in the art that many more embodiments and implementations are possible within the scope of the embodiments described herein. Although many possible combinations of features are shown in the drawings and discussed in the detailed description, many other combinations of the disclosed features are also possible. Unless specifically limited, any feature or element of any embodiment may be used in combination with, or may replace, any feature or element of any other embodiment.

[0038] This application includes and contemplates combinations of features and elements known to those skilled in the art. The embodiments, features, and elements disclosed in this application may also be combined with any conventional features or elements to form a unique inventive scheme as defined by the claims. Any feature or element of any embodiment may also be combined with features or elements from other inventive schemes to form another unique inventive scheme as defined by the claims. Therefore, it should be understood that any feature shown and / or discussed in this application may be implemented individually or in any suitable combination. Therefore, the embodiments are not limited except by the limitations imposed by the appended claims and their equivalents. Furthermore, various modifications and changes may be made within the scope of the appended claims.

[0039] Furthermore, in describing representative embodiments, the specification may have presented methods and / or processes as a specific sequence of steps. However, the method or process should not be limited to the specific order of steps described herein, to the extent that it does not depend on such a specific order. As will be understood by those skilled in the art, other sequences of steps are also possible. Therefore, the specific order of steps set forth in the specification should not be construed as a limitation of the claims. Moreover, the claims concerning the method and / or process should not be limited to the steps performed in the written order, and those skilled in the art will readily understand that these orders can be varied and still remain within the spirit and scope of the embodiments of this application.

[0040] This application provides a method for determining the stitching area of ​​a vehicle surround view system, such as... Figure 1 As shown, the method may include steps S101-S104:

[0041] S101. Calculate the required field-of-view angles of adjacent half-fields of view of the first camera and the second camera to be stitched together, and denot them as the first angle and the second angle.

[0042] S102. Adjust the position of the first field of view boundary line of the half field of view corresponding to the first camera and / or the second field of view boundary line of the half field of view corresponding to the second camera, and determine the first intersection point of the first field of view boundary line with the preset planar splicing area and the second intersection point of the second field of view boundary line with the planar splicing area, so that the difference between the first included angle and the second included angle is less than or equal to the preset difference threshold.

[0043] S103. Determine the point on the ground plane stitching area where the field of view of the first camera and the field of view of the second camera are closest to the vehicle, and record it as the third intersection point;

[0044] S104. The area defined by the line connecting the first intersection point, the second intersection point, and the third intersection point is taken as the stitching area for the fusion of the fields of view of the first camera and the second camera.

[0045] In an exemplary embodiment of this application, the first camera and the second camera can be any two adjacent cameras with overlapping views mounted on the vehicle. For example... Figure 2 As shown, the first camera can be a camera M1 at the front of the vehicle, and the second camera can be a front left camera M2 located at the left rearview mirror of the vehicle; or, the first camera can be a camera M1 at the front of the vehicle, and the second camera can be a front right camera M3 located at the right rearview mirror of the vehicle; or, the first camera can be a camera M4 at the rear of the vehicle, and the second camera can be a rear right camera M5 located at the right rear corner of the vehicle; or, the first camera can be a camera M4 at the rear of the vehicle, and the second camera can be a rear left camera M6 located at the left rear corner of the vehicle.

[0046] In exemplary embodiments of this application, as Figure 2 As shown, the first camera can refer to the camera M1 at the front of the vehicle, and the second camera can refer to the front left camera M2 located at the left rearview mirror of the vehicle.

[0047] In the exemplary embodiments of this application, the field of view of the first camera and the field of view of the second camera both refer to the optical field of view, which can be understood as the illuminated area.

[0048] In an exemplary embodiment of this application, the step of calculating the required field-of-view angles of adjacent half-fields of view of the first camera and the second camera to be stitched together, denoted as the first angle and the second angle, may include steps S201-S202:

[0049] S201. Randomly select a field of view boundary line from the half-field of view of the first camera on the side closer to the second camera, and denot it as the first field of view boundary line; randomly select a field of view boundary line from the half-field of view of the second camera on the side closer to the first camera, and denot it as the second field of view boundary line; the first field of view boundary line intersects with the outer edge of the preset ground plane splicing area at a first intersection point, and the second field of view boundary line intersects with the outer edge of the ground plane splicing area at a second intersection point.

[0050] In an exemplary embodiment of this application, the step of arbitrarily selecting a field-of-view boundary line from the half-field of view of the first camera near the second camera, denoted as the first field-of-view boundary line; and arbitrarily selecting a field-of-view boundary line from the half-field of view of the second camera near the first camera, denoted as the second field-of-view boundary line, may include:

[0051] Determine the first mounting position of the first camera and the second mounting position of the second camera on the vehicle;

[0052] From the half field of view of the first camera on the side closer to the second camera, arbitrarily select a line segment that starts from the first installation position and ends at any first intersection point on the outer edge of the ground plane splicing area, as the boundary line of the first field of view;

[0053] From the half-field of view of the second camera on the side closer to the first camera, arbitrarily select a line segment that starts from the second installation position and ends at any second intersection point on the outer edge of the ground plane splicing area, and use it as the boundary line of the second field of view.

[0054] In an exemplary embodiment of this application, a line can be drawn arbitrarily in the half-field of view of the side of camera M1 closest to camera M2, starting from camera M1 (i.e., the first installation position mentioned above), intersecting with a preset ground plane splicing area (e.g., ...). Figure 2 Line 1 shown in the diagram is used as the initial field-of-view boundary line for camera M1. The intersection of line 1 and the ground plane stitching area is considered the foremost stitching point of camera M1 in the ground plane stitching area, i.e., the aforementioned first intersection point (as shown in the diagram). Figure 2 Point 1 shown in the diagram.

[0055] Similarly, in the exemplary embodiments of this application, a line can be drawn arbitrarily in the half-field of view of the side of camera M2 closest to camera M1, starting from camera M2 (i.e., the first installation position mentioned above), intersecting with the preset ground plane splicing area (e.g., ...). Figure 2Line 2 shown in the diagram is used as the initial field-of-view boundary line for camera M2. The intersection of line 2 and the ground plane stitching area is considered the foremost stitching point of camera M2 in the ground plane stitching area, i.e., the aforementioned second intersection point (as shown in the diagram). Figure 2 Point 2 shown in the diagram.

[0056] In an exemplary embodiment of this application, the method may further include: pre-determining the ground plane splicing area on a preset ground plane located around the vehicle;

[0057] The ground plane splicing area is an area where field of view fusion can be performed.

[0058] In an exemplary embodiment of this application, the step of pre-determining the ground plane splicing area on a preset ground plane located around the vehicle may include:

[0059] Obtain the outermost boundary of the projection of the field of view of all cameras of the vehicle onto the ground plane, and use the area enclosed by the outermost boundary as the ground plane stitching area.

[0060] In an exemplary embodiment of this application,

[0061] S202. Calculate the angle between the selected first field of view boundary line and the first optical axis of the first camera, and use it as the first angle; and calculate the angle between the selected second field of view boundary line and the second optical axis of the second camera, and use it as the second angle.

[0062] In exemplary embodiments of this application, as Figure 2 As shown, the first optical axis of the first camera (i.e., camera M1) can be denoted as the X-axis, and the second optical axis of the second camera (i.e., camera M2) can be denoted as the Y-axis.

[0063] In an exemplary embodiment of this application, the angle between line 1 and the X-axis is taken as the first angle, such as... Figure 2 As shown in the diagram, the angle between line 2 and the Y-axis is taken as the second angle. Figure 2 ∠B shown.

[0064] In the exemplary embodiments of this application, due to the imaging characteristics of the camera, the brightness ratio relative to the center of the field of view decreases towards the optical edge; the sharpness decreases towards the optical edge; and the distortion increases towards the optical edge. During panoramic stitching, the greater the distortion, the more difficult the calculation method of the software algorithm becomes. Therefore, if the stitching areas of the first camera's field of view and the second camera's field of view are unbalanced—for example, the stitching area of ​​the first camera's field of view is much larger than that of the second camera's field of view, or vice versa—the stitching area will inevitably incorporate more edge fields of view, severely affecting the fusion effect.

[0065] In an exemplary embodiment of this application, by calculating to make the first included angle and the second included angle comparable (i.e., making the difference between the first included angle and the second included angle less than or equal to the difference threshold, for example, making ∠A = ∠B), the stitching area of ​​the field of view of the first camera and the field of view of the second camera can be balanced. That is, the area of ​​the field of view of the first camera participating in the stitching is about the same size as the area of ​​the field of view of the second camera participating in the stitching (e.g., completely the same). This makes the brightness ratio of the multi-channel images stitched by the field of view of the first camera and the second camera comparable (i.e., the brightness difference is small), thereby achieving the purpose of more balanced brightness of the stitched multi-channel images. It also makes the clarity of the multi-channel images stitched by the field of view of the first camera and the second camera comparable (i.e., the clarity difference is small), thereby achieving the purpose of more balanced clarity of the stitched multi-channel images. Finally, it makes the distortion of the multi-channel images stitched by the field of view of the first camera and the second camera comparable (i.e., the distortion difference is small), thereby achieving the purpose of a simpler stitching algorithm and a higher stitching success rate.

[0066] In an exemplary embodiment of this application, the positions of the first field of view boundary line and / or the second field of view boundary line can be adjusted to make the difference between the first included angle and the second included angle less than or equal to a preset difference threshold.

[0067] In an exemplary embodiment of this application, adjusting the position of the first field-of-view boundary line corresponding to the first camera's half-field of view may include:

[0068] Drag the first intersection point of the first field of view boundary line and the outer edge of the ground plane splicing area along the outer edge of the ground plane splicing area, and calculate the size of the first included angle in real time until the difference between the size of the first included angle and the second included angle is less than or equal to the difference threshold.

[0069] In exemplary embodiments of this application, as Figure 2As shown, line 1 can be dragged along the outer edge of the ground plane splicing area to change the size of ∠A. During this process, line 1 should not be dragged too far or too little into the field of view of camera M2; the maximum and minimum values ​​of ∠A can be preset.

[0070] In an exemplary embodiment of this application, adjusting the position of the second field-of-view boundary line corresponding to the second camera's half-field of view may include:

[0071] Drag the second intersection point of the second field of view boundary line and the outer edge of the ground plane splicing area along the outer edge of the ground plane splicing area, and calculate the size of the second included angle in real time until the difference between the size of the first included angle and the second included angle is less than or equal to the difference threshold.

[0072] In exemplary embodiments of this application, as Figure 2 As shown, line 2 can be dragged along the outer edge of the ground plane splicing area to change the size of ∠B. During this process, line 1 should not be deflected too much or too little from the field of view of camera M1; the maximum and minimum values ​​of ∠B can be preset.

[0073] In an exemplary embodiment of this application, an angle of ∠A = ∠B or a corresponding threshold can be determined within a preset range. That is, during the process of dragging line 1 and / or line 2, an angle can be determined from the preset range such that ∠A = ∠B or a corresponding threshold; or a fixed target angle of ∠A = ∠B or a corresponding threshold can be directly determined. After determining the initial angle of ∠A = ∠B or a corresponding threshold, by dragging line 1 and / or line 2, ∠A and ∠B are made equal to the target angle or the corresponding threshold angle, thereby achieving ∠A = ∠B or a corresponding threshold.

[0074] In an exemplary embodiment of this application, after determining the positions of line 1 and line 2 that make ∠A = ∠B or the corresponding threshold angle, the positions of the first intersection point (point 1) and the second intersection point (point 2) can be determined.

[0075] In an exemplary embodiment of this application, determining the point on the ground plane stitching area where the field of view of the first camera and the field of view of the second camera are closest to the vehicle, denoted as the third intersection point, may include:

[0076] The boundary line closest to the vehicle in the projection of the half field of view of the first camera on the side closest to the second camera onto a preset ground plane is denoted as the first projection boundary line.

[0077] The boundary line closest to the vehicle in the projection of the half field of view of the second camera on the side closest to the first camera onto a preset ground plane is denoted as the second projection boundary line.

[0078] The intersection of the first projection boundary line and the second projection boundary line is taken as the third intersection point.

[0079] In exemplary embodiments of this application, as Figure 2 As shown, the first projection boundary line can refer to boundary 1, the second projection boundary line can refer to boundary 2, and the intersection of boundary 1 and boundary 2 is point 3. Point 3 is the closest intersection of the field of view of the first camera and the field of view of the second camera on the ground plane splicing area, which is the closest point to the vehicle.

[0080] In an exemplary embodiment of this application, the area enclosed by the line connecting points 1, 2, and 3 can be used as the stitching area for the blending of the fields of view of camera M1 and camera M2.

[0081] This application embodiment also provides a stitching area determination device 10 for a vehicle surround view system, which may include a processor 11 and a computer-readable storage medium 12. The computer-readable storage medium 12 stores instructions, and when the instructions are executed by the processor 11, the stitching area determination method of the vehicle surround view system is implemented.

[0082] In the exemplary embodiments of this application, any of the embodiments in the foregoing vehicle surround view system stitching area determination method embodiments are applicable to this device embodiment, and will not be described in detail here.

[0083] This application embodiment also provides a vehicle 20, which may include the stitching area determination device 10 of the vehicle surround view system.

[0084] In the exemplary embodiments of this application, any of the embodiments in the foregoing vehicle surround view system stitching area determination method embodiments are applicable to the vehicle embodiment, and will not be described in detail here.

[0085] It will be understood by those skilled in the art that all or some of the steps, systems, or apparatuses disclosed above, and their functional modules / units, can be implemented as software, firmware, hardware, or suitable combinations thereof. In hardware implementations, the division between functional modules / units mentioned above does not necessarily correspond to the division of physical components; for example, a physical component may have multiple functions, or a function or step may be performed collaboratively by several physical components. Some or all components may be implemented as software executed by a processor, such as a digital signal processor or microprocessor, or as hardware, or as an integrated circuit, such as an application-specific integrated circuit (ASIC). Such software may be distributed on a computer-readable medium, which may include computer storage media (or non-transitory media) and communication media (or transient media). As is known to those skilled in the art, the term computer storage media includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data). Computer storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disc (DVD) or other optical disc storage, magnetic cartridges, magnetic tape, disk storage or other magnetic storage devices, or any other medium that can be used to store desired information and can be accessed by a computer. Furthermore, it is well known to those skilled in the art that communication media typically contain computer-readable instructions, data structures, program modules, or other data in modulated data signals such as carrier waves or other transmission mechanisms, and may include any information delivery medium.

Claims

1. A method for determining the stitching area of ​​a vehicle surround view system, characterized in that, The method includes: Calculate the required field-of-view angles of adjacent half-fields of view of the first and second cameras to be stitched together, and denot them as the first angle and the second angle. Adjust the position of the first field of view boundary line of the half field of view corresponding to the first camera and / or the second field of view boundary line of the half field of view corresponding to the second camera, and determine the first intersection point of the first field of view boundary line with the preset ground plane splicing area and the second intersection point of the second field of view boundary line with the ground plane splicing area, so that the difference between the size of the first included angle and the second included angle is less than or equal to a preset difference threshold. The point of intersection of the field of view of the first camera and the field of view of the second camera on the ground plane stitching area, which is closest to the vehicle, is determined and denoted as the third intersection point; The area defined by the line connecting the first intersection point, the second intersection point, and the third intersection point is taken as the stitching area where the fields of view of the first camera and the second camera are blended. Adjusting the position of the first field-of-view boundary line corresponding to the first camera's half-field of view includes: Drag the first intersection point of the first field of view boundary line and the outer edge of the ground plane splicing area along the outer edge of the ground plane splicing area, and calculate the size of the first included angle in real time until the difference between the size of the first included angle and the second included angle is less than or equal to the difference threshold.

2. The method for determining the stitching area of ​​a vehicle surround view system according to claim 1, characterized in that, The step of calculating the required field-of-view angles of adjacent half-fields of view of the first and second cameras to be stitched together, denoted as the first angle and the second angle, includes: Arbitrarily select a field of view boundary line from the half-field of view of the first camera near the second camera, and denote it as the first field of view boundary line; arbitrarily select a field of view boundary line from the half-field of view of the second camera near the first camera, and denote it as the second field of view boundary line; the first field of view boundary line intersects with the outer edge of the preset ground plane splicing area at a first intersection point, and the second field of view boundary line intersects with the outer edge of the ground plane splicing area at a second intersection point; Calculate the angle between the selected first field of view boundary line and the first optical axis of the first camera, and use it as the first angle; and calculate the angle between the selected second field of view boundary line and the second optical axis of the second camera, and use it as the second angle.

3. The method for determining the stitching area of ​​a vehicle surround view system according to claim 2, characterized in that, The first field of view boundary line is arbitrarily selected from the half field of view of the first camera on the side closer to the second camera. Arbitrarily select a field-of-view boundary line from the half-field of view of the second camera closest to the first camera, denoted as the second field-of-view boundary line, including: Determine the first mounting position of the first camera and the second mounting position of the second camera on the vehicle; From the half field of view of the first camera on the side closer to the second camera, arbitrarily select a line segment that starts from the first installation position and ends at any first intersection point on the outer edge of the ground plane splicing area, as the boundary line of the first field of view; From the half-field of view of the second camera on the side closer to the first camera, arbitrarily select a line segment that starts from the second installation position and ends at any second intersection point on the outer edge of the ground plane splicing area, and use it as the boundary line of the second field of view.

4. The method for determining the stitching area of ​​a vehicle surround view system according to any one of claims 1-3, characterized in that, Adjusting the position of the second field-of-view boundary line corresponding to the second camera's half-field of view includes: Drag the second intersection point of the second field of view boundary line and the outer edge of the ground plane splicing area along the outer edge of the ground plane splicing area, and calculate the size of the second included angle in real time until the difference between the size of the first included angle and the second included angle is less than or equal to the difference threshold.

5. The method for determining the stitching area of ​​a vehicle surround view system according to any one of claims 1-3, characterized in that, The step of determining the closest intersection point of the field of view of the first camera and the field of view of the second camera on the ground plane stitching area, denoted as the third intersection point, includes: The boundary line closest to the vehicle in the projection of the half field of view of the first camera on the side closest to the second camera onto a preset ground plane is denoted as the first projection boundary line. The boundary line closest to the vehicle in the projection of the half field of view of the second camera on the side closest to the first camera onto a preset ground plane is denoted as the second projection boundary line. The intersection of the first projection boundary line and the second projection boundary line is taken as the third intersection point.

6. The method for determining the stitching area of ​​a vehicle surround view system according to any one of claims 1-3, characterized in that, The method further includes: pre-determining the ground plane splicing area on a preset ground plane located around the vehicle; The ground plane splicing area is an area where field of view fusion can be performed.

7. The method for determining the stitching area of ​​a vehicle surround view system according to claim 1, characterized in that, The ground plane splicing area is pre-determined on a predetermined ground plane surrounding the vehicle, including: Obtain the outermost boundary of the projection of the field of view of all the cameras of the vehicle onto the ground plane, and use the area enclosed by the outermost boundary as the ground plane stitching area.

8. A device for determining the stitching area of ​​a vehicle surround view system, characterized in that, The system includes a processor and a computer-readable storage medium, wherein the computer-readable storage medium stores instructions that, when executed by the processor, implement the method for determining the stitching area of ​​a vehicle surround view system as described in any one of claims 1-7.

9. A vehicle, characterized in that, Includes the stitching area determination device for the vehicle surround view system as described in claim 8.

Citation Information

Patent Citations

  • Mirror replacement system with dynamic stitching

    CN113498527A

  • Around view image fusion splicing method and device, electronic equipment and storage medium

    CN113989112A