Method and apparatus for capturing image outside motor vehicle and motor vehicle

Abstract

To provide a method and an apparatus for capturing an image outside a motor vehicle and the motor vehicle.SOLUTION: A method (100) and an apparatus (1000) for capturing an image outside a motor vehicle (10) and the motor vehicle (10) having the apparatus (1000) are disclosed. The method (100) includes the following steps: capturing an image outside the motor vehicle (10) using a camera device (40), the captured image being distorted due to the nature of the camera device (40); capturing a property of the camera device (40); equalizing the image on the basis of the property of the camera device (40); providing to the image an overlay image (51b, 52b, 54) which overlays at least a portion of the image; and providing the equalized image together with the overlay image (51b, 52b, 54) to a user of the motor vehicle (10).SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a method and device for capturing images of the exterior of a motor vehicle, and to a motor vehicle comprising such a device. [Background technology]

[0002] Automobiles with obscure attachments that protrude onto the road and are not visible or barely visible from the driver's seat require electronic monitoring using camera devices.

[0003] However, such monitoring can be computationally intensive, especially if it is intended or required to comply with one or more safety standards. Summary of the Invention [Problem to be solved by the invention]

[0004] It is therefore an object of the present invention to identify an improved method and an improved apparatus for capturing images of the exterior of a motor vehicle. [Means for solving the problem]

[0005] This object is achieved by the subject matter of the independent claims. Advantageous developments are specified in the dependent claims.

[0006] According to a first aspect, a method for capturing an image of the exterior of a motor vehicle is provided.

[0007] Here, a method according to the present invention includes the steps of capturing an image of the exterior of the vehicle using a camera device, where the captured image is distorted due to properties of the camera device; capturing characteristics of the camera device; equalizing the image based on the characteristics of the camera device; providing an overlay image on the image, where the overlay image overlays at least a portion of the image; and providing the equalized image together with the overlay image to a user of the vehicle.

[0008] The method according to the invention is used in particular to provide a simple and cost-effective possible way by which the equalization of the camera images can be checked with regard to accuracy and functionality.

[0009] In particular, embodiments of the method according to the invention make it possible to know or verify the attachment position of a camera device, in particular its orientation and / or position or coordinate system, in particular relative to the environment of the camera device, thereby determining and correcting erroneous attachments, in particular tilts, displacements, twists and / or rotations of the camera and / or the mount of the camera device.

[0010] Motor vehicles are in particular vehicles having oversized exterior dimensions, such as transport and / or agricultural vehicles, and in particular including attachments and / or equipment, such as trailers, buckets, forks, troughs and / or mowing devices, in particular rotary mowers.

[0011] For this purpose, at least one image of the exterior of the motor vehicle is captured by means of a camera device.

[0012] A camera device is an apparatus designed to record one or more, in particular continuous, images of the exterior of a motor vehicle.

[0013] In particular, the camera device is designed to continuously and / or periodically record an outside image, for example in a video or video stream.

[0014] For this purpose, a camera device (sometimes called a camera or image capture device) may be positioned or fixed, in particular at or near the outer side of the motor vehicle.

[0015] In this case, the camera device may be permanently or fixedly arranged in the vehicle, or may be designed to be removable or detachable.

[0016] For example, the camera may be positionable or disposable on the exterior side of the vehicle, particularly on or near an attachment to the vehicle, and thus within one or more fixed devices such as a mount or receptacle, where appropriate or necessary.

[0017] The camera device is in particular a camera equipped with a special lens or a special objective lens generating a non-proportional image, such as a so-called wide-angle lens and / or a fisheye lens, which may have an aperture or image angle of at least 180°, 200°, 220°, 240°, 260°, 280° or more.

[0018] This means that the image captured by the camera device is distorted and / or misrepresented, in particular at least partially, in a curved and / or barrel-shaped and / or fish-eye manner.

[0019] In a further step, at least one characteristic of the camera device is captured.

[0020] The characteristics, sometimes referred to as the background of the camera device, characterize and define one or more parameters of the camera device, such as the type or nature of the camera or lens used, the position and / or the image section or angle that can be captured, as described below.

[0021] In particular, the characteristics include an indication or assignment to a type and / or a degree of distortion of the recorded image and / or an orientation, tilt, displacement, twist and / or rotation of the camera device.

[0022] The characteristics may be captured here, inter alia, by communication between the camera device and a control device, which may in particular perform this step and the steps of the method described below, and may also cause or trigger the capture of one or more images by the camera device.

[0023] For example, the camera may provide its own parameters, in particular the parameters of the installed lens, to the control device.

[0024] Additionally, suitable sensors, such as short-range sensors, particularly NFC and / or RFID sensors, located on or in the mount and in communication with the controller, can detect the position of the camera.

[0025] Alternatively or additionally, a code located in, on or near the mount, such as a bar code or QR code, may be read by the camera device, thereby enabling the location of the camera device to be indicated.

[0026] In this case, the camera device and the control device can communicate with each other in both wired and wireless manners and provide the capabilities of the camera device.

[0027] Similarly, characteristics may also be captured by the camera device or control device itself, for example so that images or captured image sections are analyzed and conclusions are therefore drawn regarding the position and / or attachment position of the camera device.

[0028] In this case, the step of capturing the characteristics may be performed before, during, or after capturing the image.

[0029] In particular, this step is performed initially, i.e. before the first image is captured by the camera device.

[0030] Optionally, an image section can be selected from the captured image, which image section includes only a partial area or a partial amount of the captured image, for example only a particular aperture angle, in particular only a particular horizontal and / or vertical aperture angle of the total possible aperture angle.

[0031] For example, only a horizontal aperture angle of 30° and a vertical aperture angle of 20° are selected.

[0032] This can be done, for example, by cutting and / or clipping.

[0033] Image sections can also be selected here, particularly based on the characteristics of the camera device.

[0034] The image or image section is equalized based on the captured characteristics of the camera device.

[0035] In this case, the captured images distorted due to the camera characteristics are equalized as follows, i.e., specifically, such that pre-distorted or incorrectly displayed images, in particular images that are severely barrel-distorted and / or fish-eye-distorted when captured by the camera device, are imaged onto non-distorted or non-incorrectly displayed images, in particular gnomon, rectilinear, orthographic, angular precision images.

[0036] To do this, image processing algorithms are used to edit, arrange and organize the picture elements or pixels so that an equalized image is produced.

[0037] How exactly the distorted image is equalized can be performed by the control device in particular by accessing a database in which one or more instructions for equalization based on each camera characteristic are stored.

[0038] For example, predetermined equalization routines or instructions can be stored in this database for multiple camera types, lens types and / or attachment positions, and images can then be equalized accordingly.

[0039] In this case, the database may be located or stored both on or in the camera device and on or in the control device.

[0040] Alternatively or additionally, the database may be stored on a remote computing unit, from which it may be wirelessly retrieved as required.

[0041] Optionally, after the camera characteristics have been identified, they may be provided to a user of the vehicle, in particular the driver, in particular for confirmation of the captured characteristics.

[0042] This may for example be provided to an output device such as a display device, for example a monitor or display, which is particularly located inside the vehicle and which is viewable from the driver's seat while the vehicle is being driven.

[0043] Along with the characteristics of the camera, characteristics of the attachment that appears at least partially in the captured image may also be provided.

[0044] An overlay image is provided on the image that overlays at least a portion of the image.

[0045] An overlay image is an image, which may be specifically predefined, that is substantially about the same size and / or has substantially the same dimensions as the equalized image or equalized image section, overlaps at least a portion of the image, and / or covers at least a portion of the image.

[0046] In this case, the overlay image may be at least partially transparent, in particular partially, for example 25%, 50% or 75% transparent.

[0047] The overlay image may be colored with one or more indicator colors, particularly in one or more of red, blue, green or yellow, e.g., with high color saturation and / or high contrast, particularly relative to the colors present in the equalized image.

[0048] The overlay image may include, in particular, one or more line elements and / or geometric shapes, such as surface elements, such as squares, rectangles, trapezoids, triangles, ellipses, circles and / or polygons, that are highlighted, in particular in terms of color, by the overlay image in the area corresponding to the equalized image.

[0049] The overlay image may include captured characteristics of the camera and / or attachments.

[0050] In particular, the overlay image is an overlay image that corresponds to at least one camera characteristic.

[0051] For example, predefined overlay images for a number of camera types, lens types, and / or attachment positions may be stored in a database from which a correspondingly appropriate one can then be selected.

[0052] In this embodiment, the overlay image is specifically an image that is not distorted and corresponds to the equalized image.

[0053] The equalized image or equalized image section together with the overlay image are provided to a user of the vehicle.

[0054] Thus, the equalized image overlaid with the overlay image is output to the user.

[0055] The output may then be provided to an output device, for example, as described above.

[0056] The solution according to the invention makes it possible to provide the user of the vehicle with a simple and fast possible way of validating the equalization process or algorithm.

[0057] According to an alternative aspect, a method for capturing an image of an exterior of a motor vehicle is provided.

[0058] Here, the method according to the present invention includes the steps of capturing an image of the exterior of the vehicle using a camera device, where the captured image is distorted due to properties of the camera device; capturing characteristics of the camera device; and providing a distorted overlay image on the image based on the characteristics, where the overlay image overlays at least a portion of the image; equalizing the image and the overlay image based on the characteristics of the camera device; and providing the equalized image together with the overlay image to a user of the vehicle.

[0059] This method is also used in particular to provide a simple and cost-effective possible way in which the equalization of the camera images can be checked for accuracy and functionality.

[0060] It therefore has the same objective and solves the same problem as the one above.

[0061] According to this embodiment, at least one image of the exterior of the vehicle is also detected by a camera device, and the captured image is distorted due to properties of the camera device and at least one characteristic of the camera device is captured, both of which are distorted and captured essentially as described above in connection with the first embodiment.

[0062] Image sections may also optionally be formed.

[0063] However, in contrast to the first embodiment, according to this embodiment an overlay image is provided on the image overlaying at least a portion of the image, the overlay image being pre-distorted based on the property.

[0064] This pre-distorted overlay image may also be a specifically predefined image that is substantially approximately the same size and / or has substantially the same dimensions as the distorted image or distorted image section, overlaps at least a portion of the distorted image and / or covers at least a portion of the distorted image.

[0065] In this case, this pre-distorted overlay image may in particular also be at least partially transparent, in particular partially, for example 25%, 50% or 75% transparent.

[0066] The pre-distorted overlay image may also be colored with one or more indicator colors, particularly in one or more of red, blue, green or yellow, e.g., with high color saturation and / or high contrast, particularly relative to the colors present in the equalized image.

[0067] The pre-distorted overlay image may also include one or more line elements, in particular one or more line elements that are straight or non-curved, for example in particular a diagonal line that traces a fixed point or points up to it, and / or geometric shapes, such as surface elements, such as squares, rectangles, trapezoids, triangles, ellipses, circles and / or polygons, that are highlighted, in particular in terms of color, by the overlay image in the area corresponding to the equalized image.

[0068] The pre-distorted overlay image may also be an overlay image that corresponds to at least one camera characteristic, which may be stored, for example, in a database with pre-defined overlay images for multiple camera types, lens types, and / or attachment positions, from which a correspondingly appropriate image may then be selected.

[0069] In particular, the distorted overlay image is not, however, initially pre-distorted during the execution of the method, but is, for example, pre-distorted by a secure verified and / or tested distortion algorithm based on predefined criteria, in particular with respect to the characteristics of the various cameras, and is stored in a database accessible to the control device.

[0070] The image or image section and the overlay image are then equalized based on the characteristics of the camera device.

[0071] The distorted image from the camera device and the overlay image thereon are therefore equalized together with one another, in particular as follows, i.e., equalized so that an image that was pre-distorted or incorrectly displayed when captured by the camera device, in particular a severely barrel-distorted and / or fish-eye-distorted image, is imaged together with a similarly distorted overlay image onto an undistorted or incorrectly displayed image, in particular a gnomon, rectilinear, orthographic and / or angular precision image.

[0072] To do this, image processing algorithms are used to edit, arrange and organize the picture elements or pixels so that an equalized image comprising the overlay image is produced.

[0073] The equalized image or equalized image section with the equalized overlay image is provided to a user of the vehicle.

[0074] Thus, as an alternative to the first described embodiment according to this aspect, a pre-distorted overlay image according to the camera characteristics is first placed on the image captured by the camera device and then the images are equalized together.

[0075] Both embodiments provide a cost-effective, fast and possible method to check the equalization of the camera images for accuracy and functionality.

[0076] All developments described below are applicable to both the first and the second embodiment.

[0077] According to one development, the method further comprises the steps of capturing a user input in response to the equalized image and activating a function of the vehicle in response to the user input.

[0078] A user of the motor vehicle, in particular the driver, therefore has the possibility to perform an entry in response to the display of the equalised image with the (equalised) overlay image.

[0079] In particular, an image with an overlay image can be provided along with an input prompt.

[0080] In this case, the user may be specifically requested to compare the overlay image with the equalized image or its features and, based on the comparison, approve or disapprove as to whether the equalization process of the distorted image has been properly performed.

[0081] If the user approves of the provided image, the vehicle functionality may optionally be enabled.

[0082] However, if the user does not approve of the images provided, the functionality of the vehicle may not be enabled and may be blocked or limited.

[0083] In particular, this can be done together with information provided regarding restricted functionality. Alternatively, it can also be the case that no input prompts and / or user inputs are implemented and the user is free to decide whether the displayed equalized image is correct and, based on this, to make a positive or negative assessment regarding the functional status and / or to put or not put the functionality and / or the car into operation.

[0084] For example, a request to a user may be provided responsively, where the user is requested to check the camera device, change its spatial or local position, and / or restart a control device or initiate a process.

[0085] The function may in particular be a function of the vehicle that is performed by an element that is at least partially located within the field of view or image section and reproduces an image of the camera device.

[0086] In particular, the functions relate to attachments and / or items of equipment such as trailers, buckets, forks, troughs and / or mowing devices, and in particular to elements arranged in the vehicle in a manner that is not visible or discernible from the driver's seat, or at least not sufficiently visible or discernible from the driver's seat.

[0087] For example, it may be a bucket, fork, trough or mowing device that protrudes in front of the vehicle and into the intersecting roadway, particularly at narrow and / or poorly visible intersections.

[0088] Again, for example, it is a trailer whose rear end the driver cannot see over, particularly when reversing, to an extent that allows him to safely commence or continue a journey.

[0089] This feature can then be blocked if the user or driver tampers with the provided image with user input, ie, does not enable it.

[0090] For example, operation of the attachment may be limited or prevented, or forward and / or backward movement, i.e. the initiation of such movement, may be prevented or may only be permitted at limited speeds, e.g. only at walking speeds, in particular below 30km / h, 10km / h, 5km / h or 3km / h.

[0091] This development makes it possible that particularly computationally intensive processes (particularly those relating to image equalization) can be executed on computing units that do not or only partially meet one or more safety standards, for example ASILs, in particular ASIL A and / or B. In particular, the validation given by the driver makes it possible to retrospectively check and thus ensure the safety and in particular the correctness of the equalization process.

[0092] According to one development, the camera characteristics include a model of the camera device.

[0093] The model of the camera device includes, among other things, the characteristics, type and / or properties of one or more components of the camera device, in particular the sensor and / or the objective or lens, such as the manufacturer, type, production model and / or period.

[0094] In particular, the model of the camera device includes the focal length and / or aperture angle of the objective lens or lenses.

[0095] The model of the camera device may also include data or information relating to the housing and / or the fixing device of the camera device, in particular data from simulation and / or manufacturing, for example so-called CAD data, i.e. data derived from computer-aided design and which substantially correspond to actual values, and in particular the dimensions of the camera device and / or the fixing device.

[0096] In particular, the model also includes the sensor resolution, format, aspect ratio and / or possible image sections.

[0097] This development makes it possible to carry out the equalization particularly precisely.

[0098] According to one development, the overlay image follows characteristic contours in the image.

[0099] Characteristic features in the image are in particular lines and / or edges of components of a motor vehicle having clear lines, such as body parts, in particular fenders, bonnets, rear covers, pillars, in particular A-, B- and / or C-pillars, and / or roofs.

[0100] In this case, at least one line and / or an area in the overlay image follows at least one, in particular several, characteristic contours in the image.

[0101] In particular, lines in the overlay image may match and / or correspond to lines in the image, and / or areas in the overlay image may match and / or correspond to areas in the overlay image.

[0102] In particular, the overlay image is formed in a manner such that it follows or matches one or more of these characteristic contours with a tolerance of less than 5 pixels, 3 pixels, 2 pixels, 1 pixel, and / or with pixel accuracy or precision.

[0103] This development makes it particularly easy for the user to check the images.

[0104] According to one development, the overlay image comprises a rectangular frame.

[0105] Rectangular frame means in particular an outline at or near the outer dimensions of the image, in particular an outline outside which there is less than 10%, 5%, 2%, 1% of further image information of the image or image section or no further image information at all, and / or outside which there are less than 20 pixels, 10 pixels, 5 pixels, 2 pixels, 1 pixel of the entire image or no pixels of the entire image at all.

[0106] In particular, the outermost pixels of the image or image section are overlaid by the overlay image.

[0107] In this case, the rectangular frame is included in the overlay image in particular in an equalized or undistorted state.

[0108] In other words, in a pre-distorted overlay image, the frames are also pre-distorted and therefore do not have a rectangular shape, however a rectangular shape is subsequently generated by the equalization process.

[0109] This makes it possible in particular to check the modality and / or functional status of the equalization process.

[0110] In the case of a less than fully functional equalization step of the warped image together with the pre-distorted overlay image that includes the pre-distorted frame, the frame will not be displayed as a perfect rectangle and / or may not be recognizable as a frame.

[0111] The use of a frame is also beneficial for the application of overlay images that are not pre-distorted, as it means that a precise image section can be checked.

[0112] This development makes it particularly easy for the user to check the image.

[0113] According to one development, the method further comprises a step of calculating a histogram of the image, whereby the overlay image is provided on the basis of the histogram.

[0114] A histogram, sometimes called a luminance and / or intensity profile, determines the corresponding value, particularly the average value, of the luminance and / or intensity of each pixel in an image for a camera device image that has been distorted or already equalized.

[0115] The overlay images can thus be adjusted in color and / or with respect to contrast and / or intensity.

[0116] For example, for a dominant dark image of a camera device, a dominant light overlay image can be used, and vice versa.

[0117] In particular, alpha blending can be used for this purpose.

[0118] This development makes it particularly easy for the user to check the image.

[0119] To carry out the described steps, a processor circuit may be provided having programming or software including program instructions that, when executed, cause the processor circuit to carry out embodiments of the method.

[0120] The processor circuitry may comprise at least one microprocessor and / or microcontroller for this purpose.

[0121] The program instructions may be stored in a data memory of the processor circuit.

[0122] According to a further aspect, an apparatus designed to carry out one of the aforementioned embodiments of the method according to the invention is specified.

[0123] Here, the device may include and / or have access to one or more camera devices.

[0124] The device may also include controller and processor circuitry as previously described.

[0125] According to a further aspect, a vehicle having such a device is identified.

[0126] The invention also comprises developments of the device according to the invention and of the motor vehicle according to the invention, which have features such as those already described in connection with the developments of the method according to the invention.

[0127] For this reason, the device according to the invention and corresponding developments of the motor vehicle according to the invention will not be described again here.

[0128] For use cases or application situations that may arise in the method but are not explicitly described herein, steps can be taken so that error messages and / or requests for user feedback are output in accordance with the method and / or default settings and / or predefined initial states are set.

[0129] The present invention also includes combinations of features of the embodiments described.

[0130] Exemplary embodiments of the invention are described below. [Brief description of the drawings]

[0131] [Figure 1] 1 shows a schematic plan view of an embodiment of a vehicle and an apparatus for capturing images of the exterior of the vehicle; [Diagram 2] A detailed view of FIG. [Diagram 3] 4 illustrates the results of an embodiment of a method for capturing images of the exterior of a vehicle. [Figure 4] 4 shows the results of a further embodiment of a method for capturing images of the exterior of a motor vehicle. [Diagram 5] 4 shows the results of a further embodiment of a method for capturing images of the exterior of a motor vehicle. [Figure 6] 1 shows a schematic flow chart of an embodiment of an apparatus and method for capturing images of the exterior of a motor vehicle. [Figure 7] 4 shows a schematic flow chart of an alternative embodiment of an apparatus and method for capturing images of the exterior of a motor vehicle. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0132] The exemplary embodiments described below are preferred embodiments of the present invention.

[0133] In the exemplary embodiments, the described components of the embodiments each represent individual features of the invention, which should be considered independently of one another, each develops the invention independently of the other, and therefore may also be considered part of the invention individually or in combinations other than those shown.

[0134] Moreover, the described embodiments may be supplemented with further features of the invention already described.

[0135] In the figures, elements having the same function are each given the same reference numbers.

[0136] FIG. 1 shows a schematic plan view of an embodiment of a vehicle 10 and an apparatus for capturing images of the exterior of the vehicle.

[0137] The vehicle 10 moves along a direction of movement indicated by an arrow and is equipped with an attachment 20 or attachment device, shown here by way of example as a mowing device.

[0138] The attachment or attachment device here is by way of example a front attachment or a front attachment device.

[0139] The vehicle 10 is also equipped with a camera device, which is not shown in this FIG. 1 for the sake of clarity.

[0140] Here, the camera device captures a capture area 30 that is approximately spherical and has both horizontal and vertical capture angles of 220°.

[0141] In the embodiment shown, the section designated by reference numeral "31" is of particular relevance here as it incorporates a significant portion of the attachment 20.

[0142] Here, these sections are still spherically distorted due to the capture area or angle of the camera device.

[0143] FIG. 2 shows a detailed view of FIG.

[0144] In this FIG. 2, camera device 40 is shown, here by way of example, with a fisheye lens capturing the right-hand portion of the attachment in section 31 .

[0145] FIG. 3 shows the result of an embodiment of a method for capturing an image of the exterior of a vehicle 10.

[0146] In this case, image section 31 of FIG. 2 has been equalized to equalized image section 31b and displayed together with overlay image 54 in an image with overlay image 50r.

[0147] In this case, the overlay image 54 can be provided both in an equalized form overlaid on the equalized image section 31b, as will be described in more detail in connection with Figures 6 and 7, and in a pre-distorted form over the distorted image section and which can be equalized therewith.

[0148] The overlay image is shown here by way of example to include a number of lines or diagonals, which are oriented at fixed points and follow the characteristic contours of the automobile.

[0149] FIG. 4 shows the result of a further embodiment of a method for capturing an image of the exterior of a motor vehicle.

[0150] In this case, as an alternative to the embodiment shown in FIG. 3, the overlay image 51b is shown to be a rectangular frame.

[0151] FIG. 5 shows the result of a further embodiment of a method for capturing an image of the exterior of a motor vehicle.

[0152] This again shows how the right section 31 and the left section 32 are equalized into equalized image sections 31b and 32b and overlaid with overlay images 51b and 52b in the form of rectangular frames, and provided side-by-side on a display device 60 for a user of the vehicle (not shown), with overlay image 50l on the left image and overlay image 50r on the right image.

[0153] FIG. 6 shows a schematic flow chart of an embodiment of an apparatus 1000 and method 100 for capturing images of the exterior of a vehicle.

[0154] Here, the apparatus 1000 performs the methods and steps described below.

[0155] The method 100 according to the present invention begins at step 105 where one or more characteristics or background of the camera device 40 are determined.

[0156] In a further step 110, the camera device 40 is configured based on the determined characteristics.

[0157] This is done by accessing a memory or database 115 in which information about the camera device 40 is stored.

[0158] One or more images or videos including multiple consecutive images of the exterior of the vehicle are then captured using the camera device 40 at step 120 .

[0159] Here, the image is distorted due to the characteristics of the camera device.

[0160] The captured image is then equalized in step 125 using an appropriate image equalization algorithm and based on the characteristics of the camera.

[0161] Based on the determined characteristics of the camera device 40 , a pre-undistorted overlay image is retrieved from the database 115 in step 130 .

[0162] The overlay image is merged with the captured image of the camera device and a combined image is generated such that at least a portion of the captured equalized image is overlaid by the overlay image.

[0163] In step 135, the equalized image is displayed to a user of the vehicle on a display device along with the overlay image.

[0164] At step 140, user input regarding the provided image is captured along with the overlay image, and at step 145, in response to the user input, vehicle functions are enabled or inhibited depending on the user input.

[0165] FIG. 7 shows a schematic flow chart of an alternative embodiment of the apparatus 1000 and method 100 for capturing images of the exterior of a vehicle.

[0166] This embodiment differs from the embodiment shown in FIG. 6, notably in that a pre-distorted overlay image is provided over the distorted image, and then both are equalized together as described below.

[0167] The method 100 according to the present invention begins at step 105 where one or more characteristics or background of the camera device 40 are determined.

[0168] In a further step 110, the camera device 40 is configured based on the determined characteristics.

[0169] This is done by accessing a memory or database 115 in which information about the camera device 40 is stored.

[0170] An image or video comprising multiple successive images of the exterior of the vehicle is then captured using the camera device 40 at step 120 .

[0171] Here, the image is distorted due to the characteristics of the camera device.

[0172] Based on the determined characteristics of the camera device 40, in step 121, a pre-distorted overlay image is retrieved from the database 115 and merged with the captured image of the camera device, so that at least a portion of the captured equalized image is overlaid by the overlay image.

[0173] Then, in step 125, equalization of the captured image is performed using an appropriate image equalization algorithm and based on the camera characteristics together with the overlay image to generate an equalized overlay image, which is provided in step 135.

[0174] In step 135, the equalized image is displayed to a user of the vehicle on a display device along with the overlay image.

[0175] At step 140, user input regarding the provided image is captured along with the overlay image, and at step 145, in response to the user input, vehicle functions are enabled or inhibited depending on the user input.

[0176] Overall, the example shows how a method can be provided for cost-effective implementation of functionally safe operation of a camera device in an automobile. [Explanation of symbols]

[0177] 10. Automobiles 20 Attachment 30 Capture Area 31 Section 31b Equalization Section 32 Section 32b Equalization Section 40 Camera Devices 50l Image with overlay image 50r Image with overlay image 51b Overlay Image 52b Overlay Image 54 Overlay Images 60 Display Device 100 ways 105 Method Steps 110 Method Steps 115 Database 120 Method Steps 121 Method Steps 125 Method Steps 130 Method Steps 135 Method Steps 140 Method Steps 145 Method Steps 1000 devices

Claims

1. A method (100) for capturing an image of the exterior of a motor vehicle (10), comprising: - capturing an image of the exterior of the motor vehicle (10) using a camera device (40), the captured image being distorted due to the nature of said camera device (40); - capturing the characteristics of said camera device (40); - equalizing the image based on the characteristics of the camera device (40); - providing said image with an overlay image (51b, 52b, 54) which overlays at least a part of said image; - providing said equalized image together with said overlay image (51b, 52b, 54) to a user of said vehicle (10); The method (100) comprising:

2. A method (100) for capturing an image of the exterior of a motor vehicle, comprising: - capturing an image of the exterior of the vehicle using a camera device, the captured image being distorted due to the nature of said camera device; - capturing the characteristics of said camera device; - providing a distorted overlay image to said image based on said characteristics, said distorted overlay image overlaying at least a portion of said image; - equalizing said image and said overlay image based on the characteristics of said camera device; - providing said equalized image together with said equalized overlay image (51b, 52b, 54) to a user of said vehicle (10); The method (100) comprising:

3. - capturing user input in response to said equalized image; - enabling functions of the vehicle in response to the user input; The method (100) of claim 1 or 2, further comprising:

4. The method (100) of any one of claims 1 to 3, wherein the camera characteristics include a model of the camera device (40).

5. The method (100) according to any one of the preceding claims, wherein said overlay image (51b, 52b, 54) follows a characteristic contour (54) in said image.

6. The method (100) according to any one of the preceding claims, wherein the overlay image (51b, 52b, 54) comprises a rectangular frame (51b, 52b).

7. - calculating a histogram of said image, The method (100) according to any one of the preceding claims, wherein the overlay image (51b, 52b, 54) is provided based on the histogram.

8. A device (1000) for capturing an image of the exterior of a motor vehicle (10), the device (1000) being designed to carry out the method (100) according to any one of the preceding claims.

9. A motor vehicle (10) comprising the device (1000) of claim 8.

Images