A method and apparatus for capturing images of the exterior of an automobile, and an automobile

Abstract

To provide a method and an apparatus for capturing an image outside a motor vehicle and the motor vehicle.SOLUTION: A method (100) and an apparatus (1000) for capturing an image outside a motor vehicle (10) and the motor vehicle (10) having the apparatus (1000) are disclosed. The method (100) includes the following steps: capturing an image outside the motor vehicle (10) using a camera device (40), the captured image being distorted due to the nature of the camera device (40); capturing a property of the camera device (40); equalizing the image on the basis of the property of the camera device (40); providing to the image an overlay image (51b, 52b, 54) which overlays at least a portion of the image; and providing the equalized image together with the overlay image (51b, 52b, 54) to a user of the motor vehicle (10).SELECTED DRAWING: Figure 1

Description

[[Technical Field]]

[0001] The present invention relates to a method and an apparatus for capturing images of an exterior of a motor vehicle, and also to a motor vehicle comprising such an apparatus. [[Background Art]]

[0002] Motor vehicles comprising indistinct attachments protruding onto the road, which are not visible or only barely visible from the driver's seat, require electronic monitoring using a camera device.

[0003] However, such monitoring is particularly computationally intensive, especially when it is intended or required to comply with one or more safety standards. [[Summary of the Invention]] [[Problem to be Solved by the Invention]]

[0004] Accordingly, it is an object of the present invention to identify an improved method and an improved apparatus for capturing images of an exterior of a motor vehicle. [[Means for Solving the Problem]]

[0005] This object is achieved by the subject matter of the independent claims. Advantageous developments are defined in the dependent claims.

[0006] According to a first aspect, there is provided a method for capturing an image of an exterior of a motor vehicle.

[0007] Herein, the method according to the present invention includes the steps of capturing an image of the outside of an automobile using a camera device, wherein the captured image is distorted due to the nature of the camera device; capturing the characteristics of the camera device; equalizing the image based on the characteristics of the camera device; providing an overlay image on the image, wherein the overlay image is overlaid on at least a portion of the image; and providing the equalized image together with the overlay image to the user of the automobile.

[0008] The method according to the present invention is used, in particular, to provide a simple and cost-effective method for checking the equalization of camera images with respect to accuracy and functionality.

[0009] In particular, embodiments of the method according to the present invention enable the recognition or confirmation of the attachment position of a camera device, especially its orientation and / or position or coordinate system, in particular with respect to the environment of the camera device, thereby enabling the determination and correction of incorrect attachment, in particular the tilt, displacement, twist and / or rotation of the camera and / or the mount of the camera device.

[0010] Automobiles are vehicles that have extra-large external dimensions, such as transport and / or agricultural vehicles, and that include attachments and / or equipment such as trailers, buckets, forks, troughs and / or mowing devices, especially rotary mowers.

[0011] For this purpose, at least one image of the outside of the vehicle is captured using a camera device.

[0012] A camera device is a device designed to record one or more, particularly continuous, images of the outside of a vehicle.

[0013] In particular, camera devices are designed to record external images continuously and / or periodically, for example, in video or video stream.

[0014] For this purpose, a camera device (sometimes called a camera or image acquisition device) may be positioned or fixed in particular on or near the outer side of the vehicle.

[0015] In this case, the camera device can be permanently or fixedly mounted on the vehicle, or it can be designed to be detachable or removable.

[0016] For example, the camera may be positioned or mounted on the outer side of the vehicle, particularly on or near an attachment of the vehicle, and therefore, where appropriate or as needed, within one or more fixed devices such as a mount or receptacle.

[0017] The camera device is a camera equipped with special lenses or special objective lenses that produce disproportionate images, such as so-called wide-angle lenses and / or fisheye lenses, which may have an aperture or image angle of at least 180°, 200°, 220°, 240°, 260°, 280° or more.

[0018] This means that the image captured by the camera device is distorted and / or displayed incorrectly, in particular, incorrectly displayed at least partially in a curved, barrel-shaped, and / or fisheye manner.

[0019] In a further step, at least one characteristic of the camera device is captured.

[0020] Characteristics, sometimes referred to as the background of the camera device, characterize and define one or more parameters of the camera device, such as the type or nature of the camera or lens used, its position, and / or the image section or angle that can be captured, as will be described later.

[0021] In particular, the characteristics include instructions or assignments to the type, and / or the degree of distortion of the recorded image, and / or the orientation, tilt, displacement, twist, and / or rotation of the camera device.

[0022] In particular, the characteristics can be acquired herein via communication between the camera device and a control device, wherein the control device executes this step and the steps of the method described below, and can also cause or trigger the acquisition of one or more images by the camera device.

[0023] For example, the camera can provide its own parameters, in particular the parameters of an installed lens, to the control device.

[0024] Furthermore, a suitable sensor, in particular a short-range sensor such as an NFC and / or RFID sensor, arranged on or in a mount and communicating with the control device can detect the position of the camera.

[0025] Alternatively or additionally, a code such as a barcode or QR code arranged in, on or near a mount can also be read by the camera device, thereby enabling indication of the position of the camera device.

[0026] In this case, the camera device and the control device can communicate with each other both by wire and wirelessly, and can provide the characteristics of the camera device.

[0027] Similarly, the characteristics can also be acquired by the camera device or the control device itself, for the reason that, for example, an image or an acquired image section is analyzed, and thus conclusions regarding the position and / or attachment position of the camera device are drawn.

[0028] In this case, the step of acquiring the characteristics can be executed before, during or after the step of acquiring an image.

[0029] In particular, this step is executed first, that is, before a first image is acquired by the camera device.

[0030] Optionally, an image section can be selected from the captured image, and this image section includes only a partial area or portion of the captured image, for example, only a specific aperture angle, in particular, only a specific horizontal and / or vertical aperture angle of the possible total aperture angle.

[0031] For example, only a horizontal aperture angle of 30° and a vertical aperture angle of 20° are selected.

[0032] This can be done, for example, by cutting and / or trimming.

[0033] The image section can also be selected here, particularly based on the characteristics of the camera device.

[0034] The image or image section is equalized based on the characteristics captured by the camera device.

[0035] In this case, the captured image, which is distorted due to the characteristics of the camera, is equalized as follows: specifically, images that are already distorted or improperly displayed, in particular images that are severely barrel-shaped and / or fisheye-shaped when captured by the camera device, are equalized so that they are imaged on an undistorted or improperly displayed image, in particular on a gnomon image, a linear image, an orthographic projection image, or an angular-precision image.

[0036] To achieve this, image processing algorithms are used to edit, arrange, and organize pixels so that an equalized image is produced.

[0037] The precise equalization of distorted images can be achieved, in particular, by the control unit accessing a database that stores one or more instructions for equalization based on each camera characteristic.

[0038] For example, a predetermined equalization routine or instruction can be stored in this database for multiple camera types, lens types, and / or attachment positions, and then the images can be equalized based on this.

[0039] In this case, the database can be located or stored on or within the camera device, and on or within the control device.

[0040] Alternatively or additionally, the database can also be stored on a remote computing unit, from which it can be retrieved wirelessly as needed.

[0041] Optionally, after the characteristics of the camera have been identified, these characteristics can be provided to the vehicle user, particularly the driver, especially for the purpose of verifying the captured characteristics.

[0042] This can be provided, for example, to output devices such as display devices, monitors, or displays, that are located inside a vehicle and can be viewed from the driver's seat while the vehicle is in motion.

[0043] Along with the camera's characteristics, the characteristics of the attachment that appear at least partially in the captured image can also be provided.

[0044] An overlay image is provided on the image, which is to be overlaid on at least a portion of the image.

[0045] An overlay image is a particularly predefined image that is substantially the same size as and / or substantially the same dimensions as the equalized image or section of the equalized image, overlaps with and / or covers with at least a portion of the image.

[0046] In this case, the overlay image may be at least partially transparent, and in particular, partially transparent, for example, 25%, 50%, or 75%.

[0047] The overlay image may be colored, in particular, with one or more of the following indicator colors, red, blue, green, or yellow, with high color saturation and / or high contrast, for example, with respect to the colors present in the particularly equalized image.

[0048] The overlay image may include geometric shapes, such as squares, rectangles, trapezoids, triangles, ellipses, circles, and / or polygons, particularly highlighted in terms of color by the overlay image within the area corresponding to the equalized image, and / or by the line elements and / or surface elements.

[0049] The overlay image may include captured characteristics of the camera and / or attachment.

[0050] In particular, the overlay image is an overlay image that corresponds to at least one camera characteristic.

[0051] For example, a database may contain predefined overlay images relating to multiple camera types, lens types, and / or attachment positions, from which the appropriate one can be selected.

[0052] In this embodiment, the overlay image is, in particular, an image that corresponds to an undistorted and equalized image.

[0053] An equalized image or equalized image section, along with an overlay image, is provided to the automotive user.

[0054] Therefore, the equalized image, overlaid with the overlay image, is output to the user.

[0055] The output can be provided here to an output device, for example, as described above.

[0056] The solution according to the present invention makes it possible to provide automotive users with a simple, quick, and possible method for verifying the equalization process or algorithm.

[0057] An alternative embodiment provides a method for capturing images of the exterior of a vehicle.

[0058] Herein, the method according to the present invention includes the steps of capturing an image of the outside of an automobile using a camera device, wherein the captured image is distorted due to the nature of the camera device; capturing the characteristics of the camera device; providing a distorted overlay image on the image based on the characteristics, wherein the overlay image is overlaid on at least a portion of the image; equalizing the image and the overlay image based on the characteristics of the camera device; and providing the equalized image together with the overlay image to the user of the automobile.

[0059] This method is also used to provide a simple, cost-effective, and possible method for checking the equalization of camera images, particularly in terms of accuracy and functionality.

[0060] This, therefore, has the same purpose and solves the same problem as described above.

[0061] According to this embodiment, at least one image of the outside of the automobile is also detected by the camera device, and the captured image is distorted due to the nature of the camera device, and at least one characteristic of the camera device is also captured, and they are both distorted and captured in essentially the same way as described above in relation to the first embodiment.

[0062] Image sections can also be formed arbitrarily.

[0063] However, in contrast to the first embodiment, according to this embodiment, an overlay image is provided on the image to be overlaid on at least a portion of the image, and the overlay image is pre-distorted based on its characteristics.

[0064] This pre-distorted overlay image is also a particularly predefined image that is substantially the same size as and / or substantially the same dimensions as the distorted image or section of the distorted image, overlaps with and / or covers with at least a portion of the distorted image.

[0065] In this case, this pre-distorted overlay image may also be transparent, at least partially, and particularly partially, for example, 25%, 50%, or 75% transparent.

[0066] The pre-distorted overlay image may also be colored with one or more of the following colors, particularly one or more indicator colors, such as red, blue, green, or yellow, with high color saturation and / or high contrast, for example, with respect to the colors present in the particularly equalized image.

[0067] The pre-distorted overlay image may also include one or more line elements, in particular straight or non-curved line elements, such as a fixed point or a diagonal line tracing a point, and / or geometric shapes such as squares, rectangles, trapezoids, triangles, ellipses, circles and / or polygons, which are highlighted in particular in terms of color by the overlay image within the area corresponding to the equalized image.

[0068] The pre-distorted overlay image is also an overlay image corresponding to the characteristics of at least one camera, which is stored in a database containing predetermined overlay images relating to multiple camera types, lens types, and / or attachment positions, from which the appropriate image can then be selected.

[0069] In particular, the distorted overlay image is not initially distorted during the execution of the method, but rather is pre-distorted, for example, by a safe, verified and / or tested distortion algorithm based on predefined criteria, particularly with respect to the characteristics of various cameras, and stored in a database accessible to the control device.

[0070] The image or image section and the overlay image are then equalized based on the characteristics of the camera device.

[0071] The distorted images from the camera device and the overlay images thereon are therefore equalized together, in particular as follows: that, when captured by the camera device, pre-distorted or improperly displayed images, especially severely barrel-distorted and / or fisheye-distorted images, are equalized together with similarly distorted overlay images so that they are imaged on an undistorted or improperly displayed image, in particular on gnomon images, linear images, orthographic projection images, and / or angular-precision images.

[0072] To accomplish this, image processing algorithms are used to edit, position, and organize pixels or pixels so that an equalized image with an overlay image is generated.

[0073] An equalized image or a section of an equalized image, comprising an equalized overlay image, is provided to the user of the automobile.

[0074] Therefore, as an alternative to the first embodiment described in this aspect, a pre-distorted overlay image according to the characteristics of the camera is first placed on the image captured by the camera device, and then the images are equalized together.

[0075] Both embodiments provide a cost-effective, rapid, and possible method for checking the equalization of camera images in terms of accuracy and functionality.

[0076] All of the subsequent developments are applicable to both the first and second embodiments.

[0077] According to one developmental form, the method further includes the steps of capturing user input in response to an equalized image and enabling the functions of the vehicle in accordance with the user input.

[0078] Automobile users, particularly drivers, therefore have the potential to perform an entry in response to the display of an equalized image with an (equalized) overlay image.

[0079] In particular, images with overlays can be provided along with input prompts.

[0080] In this case, the user may be asked to compare the overlay image with the equalized image or its features, and based on the comparison, to authorize or deny whether the equalization process for the distorted image was performed properly.

[0081] If the user approves the provided image, the vehicle's functions can be optionally enabled.

[0082] However, if the user does not authorize the provided images, the vehicle's functions will not be enabled and may be blocked or restricted.

[0083] In particular, this can be done in conjunction with information provided regarding limited functionality. Alternatively, this could also be a case where no input prompts and / or user input are performed, and the user is free to decide whether the displayed equalized image is correct, and based on this, make a positive or negative assessment regarding the functional status, and / or put the function and / or vehicle into an operational state or not.

[0084] For example, requests to the user may be provided responsively, in which case the user is requested to check the camera device, change its spatial or local position, and / or restart the control device or startup process.

[0085] The function may be, in particular, an automotive function performed by an element that is at least partially located within the field of view or image section and reproduces the image from the camera device.

[0086] In particular, the functions relate to items of attachments and / or equipment such as trailers, buckets, forks, troughs and / or mowing devices, and especially to elements positioned on the vehicle in a manner that is not visible or even visible from the driver's seat, or at least not sufficiently visible or even visible from the driver's seat.

[0087] For example, it is a bucket, fork, trough, or mowing device that protrudes from the front of a vehicle and extends into intersecting roads, especially at narrow and / or poorly visible intersections.

[0088] Furthermore, for example, it is a trailer in which the driver cannot see the rear end, especially when reversing, to the extent that they can safely start or continue moving.

[0089] Next, this function can be blocked if the user or driver tampers with the provided image through user input, i.e., if they do not enable it.

[0090] For example, the operation of an attachment may be restricted or prevented, or forward and / or backward movement, i.e., the initiation of such movement, may be prevented or permitted only at a limited speed, for example, walking speed, in particular less than 30 km / h, 10 km / h, 5 km / h, or 3 km / h.

[0091] This development allows computationally intensive processes (particularly those related to image equalization) to be performed on computing units that do not meet, or only partially meet, one or more safety standards, e.g., ASIL, especially ASIL A and / or B. In particular, by enabling the driver, it becomes possible to retrospectively verify and thus ensure the safety and especially accuracy of the equalization process.

[0092] According to one developmental form, the characteristics of a camera include a model of the camera device.

[0093] The model of the camera device includes, in particular, the characteristics, type, and / or properties of one or more components of the camera device, especially the sensor and / or objective lens or lens, such as the manufacturer, type, manufacturing model, and / or period.

[0094] In particular, the camera device model includes the objective lens or the focal length and / or aperture angle of the lens.

[0095] The camera device model may also include data or information relating to the housing and / or mounting of the camera device, in particular data from simulation and / or manufacturing, such as so-called CAD data, i.e., data derived from computer-aided design and substantially corresponding to actual values, and in particular, dimensions of the camera device and / or mounting.

[0096] In particular, the model also includes the sensor's resolution, format, aspect ratio, and / or possible image sections.

[0097] This developmental form makes it possible to perform equalization with particular precision.

[0098] According to one developmental form, the overlay image conforms to the characteristic outlines within the image.

[0099] The distinctive external features in the image are, in particular, the lines and / or edges of the automotive components that have clear lines, such as the body parts, especially the fenders, hood, rear cover, pillars, especially the A-, B- and / or C-pillars, and / or roof.

[0100] In this case, at least one line and / or one area in the overlay image follows at least one, in particular, one or more characteristic outlines in the image.

[0101] In particular, lines in the overlay image coincide with and / or correspond to lines in the image, and / or areas in the overlay image coincide with and / or correspond to areas in the overlay image.

[0102] In particular, the overlay image is formed in such a manner that it conforms to or matches one or more of these characteristic outlines with tolerances of 5 pixels, 3 pixels, 2 pixels, or less than 1 pixel, and / or with pixel accuracy or pixel precision.

[0103] This advanced form, in particular, makes it easier for users to check images.

[0104] According to one developmental form, the overlay image contains a rectangular frame.

[0105] A rectangular frame specifically refers to an outline of an image in or near its outer dimensions, and more specifically, an outline where less than 10%, 5%, 2%, or 1% of the image or image section of the image exists outside of it, or where no further image information exists at all, and / or an outline where less than 20, 10, 5, 2, or 1 pixel of the entire image exists outside of it, or where no pixels of the entire image exist at all.

[0106] In particular, the outermost pixels of an image or image section are overlaid by the overlay image.

[0107] In this case, the rectangular frame is included within the overlay image, particularly in an equalized or undistorted state.

[0108] In other words, in a pre-distorted overlay image, the frame is also pre-distorted and therefore does not have a rectangular shape; however, the rectangular shape is subsequently generated by an equalization process.

[0109] This makes it possible to check, in particular, the manner and / or functional status of the equalization process.

[0110] In the case of a distorted image equalization step that is not fully functional, such as when a distorted image is combined with a pre-distorted overlay image that includes a pre-distorted frame, this frame will not be displayed as a perfect rectangle and / or may not be recognized as a frame.

[0111] Using frames is also beneficial for applying pre-distorted overlay images, as it allows you to check the exact image section.

[0112] This evolved form makes it particularly easy for users to check images.

[0113] In one evolved form, the method further includes the step of calculating the histogram of the image, where the overlay image is provided based on the histogram.

[0114] A histogram, sometimes called a luminance and / or intensity profile, determines the corresponding values ​​of luminance and / or intensity for each pixel in an image, particularly the mean values, for an image from a camera device that is distorted or already equalized.

[0115] Therefore, the overlay image can be adjusted in terms of color and / or contrast and / or intensity.

[0116] For example, a dominant dark image from a camera device can be used in relation to a dominant bright overlay image, and vice versa.

[0117] In particular, alpha blending can be used for this purpose.

[0118] This evolved form makes it particularly easy for users to check images.

[0119] To perform the steps described, it is possible to provide a processor circuit having programming or software that includes program instructions, which, when executed, cause the processor circuit to perform an embodiment of this method.

[0120] The processor circuit may have at least one microprocessor and / or microcontroller for this purpose.

[0121] Program instructions can be stored in the data memory of the processor circuit.

[0122] In a further embodiment, an apparatus designed to perform one of the aforementioned embodiments of the method according to the present invention is identified.

[0123] Here, this device may include and / or have access rights to one or more camera devices.

[0124] This device may also include the control and processor circuits described above.

[0125] In a further embodiment, an automobile having such a device is identified.

[0126] The present invention also includes further forms of the apparatus and automobile according to the present invention, which have features such as those already described in relation to further forms of the method according to the present invention.

[0127] Therefore, we will not discuss the corresponding developmental forms of the apparatus and automobile according to the present invention again here.

[0128] For use cases or application situations that may arise in this method but are not explicitly described herein, measures may be taken to ensure that error messages and / or requests for user feedback are output in accordance with this method, and / or that default settings and / or predetermined initial states are set.

[0129] The present invention also includes combinations of the features of the embodiments described.

[0130] Exemplary embodiments of the present invention are described below. [Brief explanation of the drawing]

[0131] [Figure 1] A schematic plan view of an embodiment of a device for capturing images of the exterior of a vehicle and the vehicle itself is shown. [Figure 2] A detailed view of Figure 1 is shown. [Figure 3] The results of an embodiment of a method for capturing images of the exterior of a vehicle are shown. [Figure 4] The results of a further embodiment of the method for capturing images of the exterior of a vehicle are shown. [Figure 5] The results of a further embodiment of the method for capturing images of the exterior of a vehicle are shown. [Figure 6] A schematic flowchart of embodiments of a device and method for capturing images of the exterior of a vehicle is shown. [Figure 7] A schematic flowchart of an alternative embodiment of an apparatus and method for capturing images of the exterior of a vehicle is shown. [Modes for carrying out the invention]

[0132] The exemplary embodiments described below are preferred embodiments of the present invention.

[0133] In exemplary embodiments, the components described in the embodiments each represent individual features of the present invention, which should be considered independently of each other, and which can each independently develop the present invention and therefore be considered as part of the present invention, individually or in combinations other than those shown.

[0134] Furthermore, the embodiments described may be complemented by further features of the present invention already described.

[0135] In the diagram, elements with the same function are each given the same reference numeral.

[0136] Figure 1 shows a schematic plan view of an embodiment of a device for capturing images of the outside of a car and a car 10.

[0137] The vehicle 10 moves along the direction of movement indicated by the arrow and is equipped with an attachment 20 or attachment device, which is shown here as a grass cutting device as an example.

[0138] In this context, the attachment or attachment device is, for example, a front attachment or front attachment device.

[0139] Automobile 10 also has a camera device, but this is not shown in Figure 1 for clarity.

[0140] Here, the camera device captures an acquisition area 30 that is nearly spherical and has acquisition angles of 220° in both the horizontal and vertical directions.

[0141] In this embodiment shown, the section indicated by reference numeral "31" is particularly relevant here because it incorporates an important part of the attachment 20.

[0142] Here, these sections are still distorted spherically due to the camera device's capture area or angle.

[0143] Figure 2 shows a detailed view of Figure 1.

[0144] In Figure 2, the camera device 40 is shown here, for example, with a fisheye lens that captures the right-hand portion of the attachment in section 31.

[0145] Figure 3 shows the results of an embodiment of a method for capturing an image of the outside of the automobile 10.

[0146] In this case, image section 31 of Figure 2 was equalized to equalized image section 31b and displayed together with overlay image 54 within the image with overlay image 50r.

[0147] In this case, the overlay image 54 can be provided in both an equalized form overlaid on the equalized image section 31b and a pre-distorted form on the distorted image section that can be equalized together with it, as will be described in more detail in relation to Figures 6 and 7.

[0148] The overlay image, as an example here, is shown to include multiple lines or diagonal lines, which are oriented at fixed points and follow the distinctive outline of the automobile.

[0149] Figure 4 shows the results of a further embodiment of the method for capturing images of the exterior of a vehicle.

[0150] In this case, as an alternative to the embodiment shown in Figure 3, the overlay image 51b is shown as a rectangular frame.

[0151] Figure 5 shows the results of a further embodiment of the method for capturing images of the exterior of a vehicle.

[0152] This again illustrates how the right section 31 and the left section 32 are equalized into equalized image sections 31b and 32b, which are then superimposed with overlay images 51b and 52b in the form of rectangular frames, providing a display device 60 for a car user (not shown) with an overlay image 50l on the left image and an overlay image 50r on the right image, side by side.

[0153] Figure 6 shows a schematic flowchart of an embodiment of the apparatus 1000 and method 100 for capturing images of the exterior of a vehicle.

[0154] Here, the apparatus 1000 performs the method and steps described below.

[0155] Method 100 according to the present invention begins in step 105, where one or more characteristics or backgrounds of the camera device 40 are determined.

[0156] In a further step 110, the camera device 40 is configured based on the determined characteristics.

[0157] This is done by accessing the memory or database 115 where information about the camera device 40 is stored.

[0158] Next, one or more images or videos, including multiple consecutive images of the outside of the car, are captured using the camera device 40 in step 120.

[0159] Here, the image is distorted due to the characteristics of the camera device.

[0160] Next, in step 125, the captured images are equalized using an appropriate image equalization algorithm and based on the characteristics of the camera.

[0161] Based on the determined characteristics of the camera device 40, an undistorted overlay image is retrieved from the database 115 in step 130.

[0162] This overlay image is combined with the image captured by the camera device, and the combined image is generated such that at least a portion of the captured and equalized image is overlaid by the overlay image.

[0163] In step 135, the equalized image is displayed to the car user on the display device along with the overlay image.

[0164] In step 140, user input regarding the provided image is captured along with the overlay image, and in step 145, in response to the user input, the functions of the vehicle are enabled or disabled according to the user input.

[0165] Figure 7 shows a schematic flowchart of an alternative embodiment of the apparatus 1000 and method 100 for capturing images of the exterior of a vehicle.

[0166] This embodiment differs from the embodiment shown in Figure 6, in particular, in that a pre-distorted overlay image is provided on top of a distorted image, and then both are equalized together as described below.

[0167] Method 100 according to the present invention begins in step 105, where one or more characteristics or backgrounds of the camera device 40 are determined.

[0168] In a further step 110, the camera device 40 is configured based on the determined characteristics.

[0169] This is done by accessing memory or a database 115 that stores information about the camera device 40.

[0170] Next, an image or video containing multiple consecutive images of the outside of the car is captured using the camera device 40 in step 120.

[0171] Here, the image is distorted due to the characteristics of the camera device.

[0172] Based on the determined characteristics of the camera device 40, in step 121, a pre-distorted overlay image is retrieved from the database 115 and merged with the image captured by the camera device, so that at least a portion of the captured and equalized image is overlaid with the overlay image.

[0173] Next, in step 125, the captured images are equalized together with the overlay image using an appropriate image equalization algorithm and based on the characteristics of the camera, generating an equalized overlay image, which is provided in step 135.

[0174] In step 135, the equalized image is displayed to the car user on the display device along with the overlay image.

[0175] In step 140, user input regarding the provided image is captured along with the overlay image, and in step 145, in response to the user input, the functions of the vehicle are enabled or disabled according to the user input.

[0176] Overall, the examples illustrate how cost-effective methods can be provided for the functionally safe operation of automotive camera devices. [Explanation of Symbols]

[0177] 10. Automobiles 20 Attachments 30 Capture Area 31 Sections 31b Equalization Section 32 sections 32b Equalization Section 40 Camera Devices Image with 50L overlay image Image with 50r overlay image 51b Overlay image 52b Overlay image 54 Overlay Images 60 Display devices 100 ways 105 Method Steps 110 Method Steps 115 Databases 120 Method Steps 121 Method Steps 125 Method Steps 130 Method Steps 135 Method Steps 140 Method Steps 145 Method Steps 1000 devices

Claims

1. A method (100) for capturing an image of the outside of a car (10), - The camera device (40) is used to capture an image of the outside of the automobile (10), and the captured image is distorted due to the properties of the camera device (40), - To capture the characteristics of the camera device (40), - To equalize the image based on the characteristics of the camera device (40), - Providing the image with overlay images (51b, 52b, 54) that are overlaid on at least a portion of the image, wherein the overlay images (51b, 52b, 54) have a geometric shape, and the region in the equalized image corresponding to the geometric shape is emphasized by the overlay images (51b, 52b, 54), - To provide the user of the automobile (10) with the equalized image together with the overlay images (51b, 52b, 54), - The user is instructed to input whether the step of comparing the overlay images (51b, 52b, 54) with the equalized image or the features of the equalized image, and whether the step of equalizing the distorted image has been properly performed based on the comparison. A method (100) comprising: enabling the functions of the vehicle if authorized by the user, and blocking or restricting the functions of the vehicle if not authorized by the user.

2. A method (100) for capturing an image of the outside of a car (10), - The camera device (40) is used to capture an image of the outside of the automobile (10), and the captured image is distorted due to the properties of the camera device (40), - To capture the characteristics of the camera device (40), - To provide the image with distorted overlay images (51b, 52b, 54) that are overlaid on at least a portion of the image, based on the characteristics of the camera device (40), - Equalizing the image and the overlay images (51b, 52b, 54) based on the characteristics of the camera device (40), - To provide the user of the automobile (10) with the equalized image together with the equalized overlay images (51b, 52b, 54) Includes, The overlay images (51b, 52b, 54) have a geometric shape, and the region in the equalized image corresponding to the geometric shape is emphasized by the overlay images (51b, 52b, 54). The above method (100) further includes, - The user is instructed to input whether the step of equalizing the distorted image has been properly performed by comparing the equalized overlay images (51b, 52b, 54) with the equalized image or the features of the equalized image, and based on the comparison, to authorize whether the step of equalizing the distorted image has been properly performed. - If the user authorizes, the functions of the vehicle will be enabled; if the user does not authorize, the functions of the vehicle will be blocked or restricted. Method (100), including the method (100).

3. The method (100) according to claim 1 or 2, wherein the characteristics of the camera device (40) include a model of the camera device (40).

4. The method according to claim 1 or 2 (100), wherein the overlay images (51b, 52b, 54) conform to the characteristic outline (54) in the image.

5. The method according to claim 1 or 2 (100), wherein the overlay images (51b, 52b, 54) include rectangular frames (51b, 52b).

6. - Further including calculating a histogram of the aforementioned image, The method according to claim 1 or 2 (100), wherein the overlay images (51b, 52b, 54) are provided based on the histogram.

7. A device (1000) for capturing an image of the outside of an automobile (10), the device (1000) is designed to perform the method (100) described in claim 1 or 2.

8. An automobile (10) including the apparatus (1000) described in claim 7.

Images