Image capture method for motor vehicles

Abstract

Image capture method for a motor vehicle (100), the motor vehicle (100) comprising at least one camera of a first type (111, 112, 113, 114, 115, 116, 117), capable of capturing images of a space outside the motor vehicle (100), and a memory (61, 72), characterized in that it comprises: - a first step (E1) of selection by a user of the motor vehicle (100) of a point of interest (20, 40, 60, 70) located on the map (3), then - a second step (E2) of planning at least one image capture, comprising: o a determination of at least one preferred shooting angle associated with the point of interest (20, 40, 60, 70), o a determination of at least one route segment (64, 401) of the map (3) passing near the point of interest (20, 40, 60, 70), or a determination of at least one capture position (42, 43, 613, 614, 615, 711, 713) located on at least one route segment (64, 401) such that,when the motor vehicle (100) is located at at least one capture position (42, 43, 613, 614, 615), the point of interest (20, 40, 60, 70) is within the range of at least one camera of the first type, the at least one camera of the first type (111, 112, 113, 114, 115, 116, 117) allowing image capture of the point of interest (20, 40, 60, 70) according to at least one preferred shooting angle associated with the point of interest, o a memorization of at least one capture position (42, 43, 613, 614, 615, 711, 713) and of at least one camera of the first type (111, 112, 113, 114, 115, 116, 117) associated with at least one capture position (42, 43, 613, 614, 615). Figure for the abstract: 6,

Description

Title of the invention: Image capture method for a vehicle

[0001] The invention relates to an image capture method for a motor vehicle. The invention also relates to an image capture device for a motor vehicle. The invention also relates to a computer program implementing the mentioned method.

[0002] Motor vehicles are increasingly incorporating features using cameras, for example a driving scene recording function, which makes it possible to document after the fact the circumstances leading to an accident.

[0003] Vehicles can also be equipped with infotainment systems, which in particular have the capacity to film a user's face in order to identify, from the direction of their gaze, a monument or remarkable place observed by the user.

[0004] Thus, many vehicles are equipped with cameras that can capture 360-degree images around the motor vehicle, with virtually no blind spots. In addition, other cameras can film inside the vehicle.

[0005] However, in the context of recreational use, the possibilities of using the vehicle's cameras to film the interior or exterior of the vehicle are relatively limited, despite the large number of cameras present on the vehicle. In particular, if a user wishes to film the exterior of the vehicle during a journey, he is currently limited to the use of the vehicle's front camera.

[0006] The aim of the invention is to overcome this drawback. In particular, the invention relates to an image capture method for a motor vehicle which is simple and reliable, and improves the use of the vehicle's cameras.

[0007] To this end, the invention relates to an image capture method for a motor vehicle, the motor vehicle comprising at least one camera of a first type, capable of capturing images of a space outside the motor vehicle, and a memory, characterized in that it comprises

[0008] - a first step of selection by a user of the motor vehicle of a point of interest located on the map, then

[0009] - a second step of planning at least one image capture, comprising:

[0010] o a determination of at least one preferred shooting angle associated with the point of interest,

[0011] o a determination of at least one route segment of the map passing near the point of interest,

[0012] o a determination of at least one capture position located on the at least one route segment such that, when the motor vehicle is located on the at least one capture position, the point of interest is located within the range of the at least one camera of the first type, the at least one camera of the first type allowing an image capture of the point of interest according to the at least one preferred shooting angle associated with the point of interest,

[0013] o a storage of the at least one capture position and of the at least one camera of the first type associated with the at least one capture position.

[0014] The motor vehicle comprising a system for locating the motor vehicle on a map, the method may comprise a third step of implementing at least one image capture of the point of interest,

[0015] the third step comprising, when the vehicle is located by the location system at a capture position,

[0016] o a verification of a relevance, at the instant of capture, of an image capture of the point of interest by the at least one camera of the first type associated with the capture position,

[0017] o if an image capture is relevant, a capture of an image of the point of interest by the at least one camera of the first type associated with the capture position,

[0018] and checking the relevance of a capture may include:

[0019] - a comparison to a maximum threshold of a distance calculated between the at least one camera of the first type associated with the capture position and the point of interest, and / or

[0020] - a verification, at the instant of capture, of a relative position of the sun with respect to at the point of interest and / or,

[0021] - a detection of an intense light source in a field of vision of the au at least one camera of the first type associated with the capture position, and / or

[0022] - an anticipation of an irruption of a vehicle or an element of an environment of the motor vehicle interposing itself between the at least one camera of the first type associated with the capture position and the point of interest, the intrusion of a vehicle being anticipated from the data provided by the driving assistance system.

[0023] The third step may further comprise a sub-step of real-time adjustment of image capture conditions by the at least one camera of the first type comprising:

[0024] - an adjustment, as a function of a speed of movement of the motor vehicle, of a shutter speed or exposure time of the at least one camera of the first type and / or a number of image captures made in one second by the at least one camera of the first type, and / or

[0025] - a setting of an exposure time of the at least one camera of the first type in function of lighting conditions of the point of interest, and / or

[0026] - just before a triggering time of an image capture given by the au less one camera of the first type,

[0027] a first processing of recognition of a shape of the point of interest, the shape being estimated as a function of a shooting angle of the at least one camera of the first type, then,

[0028] if recognition fails, a cancellation of the given image capture.

[0029] The first selection step may include:

[0030] - a selection step by a user of the motor vehicle via an interface man-machine of one or more points of interest from a predefined list of points of interest, and / or

[0031] - a step of definition via a human-machine interface of a point of interest by its position on the map and / or,

[0032] - a step of association via a human-machine interface of one or more angles of favorite shots at a point of interest.

[0033] The human-machine interface may be a human-machine interface of the motor vehicle, in particular a human-machine interface of an info-navigation system of the motor vehicle and / or a human-machine interface of a telephone of a user of the motor vehicle and / or a human-machine interface of a digital tablet of a user of the motor vehicle.

[0034] The determination of the at least one route segment of the map can take into account:

[0035] - a route planned in a navigation system fitted to the vehicle at car, and / or

[0036] - a set of routes passing near the point of interest.

[0037] According to embodiments:

[0038] - the motor vehicle may further comprise at least one camera of a second type, capable of capturing images of a passenger compartment of the motor vehicle, and, in the third step, images of a passenger compartment of the motor vehicle can be captured by the at least one camera of the second type simultaneously with the capture of images of the point of interest by the at least one camera of the first type, and / or

[0039] - in the third step, at least two cameras of the first type can capture simultaneously images of a point of interest from different viewing angles, and / or

[0040] - in the third step, a sound recording can be made in a space outside the motor vehicle or in a passenger compartment of the motor vehicle, simultaneously with the capture of images of the point of interest.

[0041] The at least one camera of the first type and / or the at least one camera of the second type may comprise a camera of a telephone and / or a camera of a digital tablet of a user of the motor vehicle.

[0042] The invention also relates to a device for capturing an image of a vehicle at car, the motor vehicle being equipped with cameras, a system for locating the motor vehicle on a map, a navigation system, a driving assistance system and an infotainment system, the device comprising hardware and / or software elements implementing the method as described above, in particular hardware and / or software elements designed to implement the method as described above, and / or the device comprising means for implementing as described above.

[0043] The invention also relates to a motor vehicle comprising an image capture device as described above.

[0044] The invention also relates to a computer program product comprising program code instructions recorded on a computer-readable medium for implementing the steps of the method as described above when said program operates on a computer or computer program product downloadable from a communication network and / or recorded on a data medium readable by a computer and / or executable by a computer, characterized in that it comprises instructions which, when the program is executed by the computer, lead the latter to implement the method as described above.

[0045] The invention also relates to a computer-readable data recording medium on which is recorded a computer program comprising program code instructions for implementing the method as described above or a computer-readable recording medium comprising instructions which, when executed by a computer, cause the latter to implement the method as described above.

[0046] The invention also relates to a signal of a data carrier, carrying the computer program product mentioned above.

[0047] The attached drawings represent, by way of example, an embodiment of an image capture device according to the invention and an embodiment of an image capture method according to the invention.

[0048] [Fig. 1] represents an embodiment of a motor vehicle implementing an image capture method according to the invention.

[0049] [Fig.2] illustrates an example of the installation of cameras in a motor vehicle.

[0050] [Fig.3] illustrates a definition of a shooting angle of a point of interest of a camera of a motor vehicle.

[0051] [Fig.4] is a flowchart of an image capture method according to the invention.

[0052] [Fig.5] illustrates a step of planning at least one image capture.

[0053] [Fig.6] is a first illustration of the progress of an image capture step. of the method according to the invention.

[0054] [Fig.7] is a second illustration of the progress of an image capture step of the method according to the invention.

[0055] The motor vehicle 100 according to the embodiment of the invention may be a vehicle of any type, in particular a passenger vehicle, a utility vehicle, a truck or even a public transport vehicle such as a bus or a shuttle.

[0056] An embodiment of a motor vehicle equipped with the invention is described below with reference to Figures 1 and 2. The motor vehicle 100 is in particular equipped with a first set 1 of at least one camera, or even at least two cameras 111, 112, 113, 114, 115, 116, 117, 121, 122 and a system 2 for locating the motor vehicle 100 on a map 3.

[0057] In the remainder of the document, the term “mission” is used to define a journey of the vehicle between a time of starting the engine(s) of the motor vehicle 100 and a time of stopping the engine(s) of the motor vehicle 100. Alternatively, the term mission may cover a journey of the motor vehicle 100 comprising several driving sequences interrupted by stopping the engine(s) of the motor vehicle 100.

[0058] In the remainder of the document, the expression “capture an image” is used to designate indifferently the action of photographing or filming.

[0059] The invention described relates to automatic image capture while the vehicle is moving. In particular, the shooting angles are selected in accordance with the respective orientations and / or fields of vision of the cameras of the motor vehicle 100, during movement of the motor vehicle 100 on its route.

[0060] In the remainder of the document, the term “point of interest” designates a place or site of which the user wishes to capture an image while moving along his route. A point of interest can be, for example, a monument, a landscape, a village.

[0061] The implementation of the invention requires defining at least one point of interest of which an image is to be captured. The definition of a point of interest comprises at least the location of the point of interest on a map 3. The map 3 may be a high definition map. Alternatively, the map 3 may be a standard definition map.

[0062] A point of interest can be selected by a user from a database of points of interest, the database being stored in a memory of the motor vehicle 100. The database can be a predefined database, for example a database stored in a memory 61 of an infotainment system 6 of the motor vehicle 100, or a database specific to the invention, in particular a database recorded in a memory 72 of a calculation unit 7 implementing the method according to the invention.

[0063] In addition or alternatively, a point of interest can be defined manually by a user, for example by entering the GPS coordinates of the point of interest or by pointing the position of the point of interest on a screen displaying the map 3. Advantageously, a point of interest defined manually by a user can be recorded in the points of interest database.

[0064] In addition or alternatively, the coordinates of a point of interest can be provided by a navigation system 4 of the motor vehicle 100.

[0065] Thus, the database of points of interest recorded in the memory 61 and / or in the memory 72 may contain a set of remarkable points of interest, for example sites listed in tourist guides. The database of points of interest may also contain points of interest defined by a user of the motor vehicle 100.

[0066] Advantageously, keywords are associated with certain points of interest recorded in the database to allow a user to select a subset of points of interest by keywords. For example, the keywords may include “cathedral”, “bridge”, “landscape”.

[0067] Defining a point of interest may also include defining one or more preferred viewing angles for image capture. The viewing angle may also be referred to as a "viewing angle" in the remainder of the document.

[0068] In the remainder of the document, the term “viewing angle” designates a direction in which the user captures an image of a given point of interest.

[0069] For example, with reference to [Fig. 3], an absolute terrestrial reference frame 80 is defined comprising a center 81, and three orthonormal axes, 82, 82, 84. A reference frame 90 is further defined, centered on the GPS coordinates 91 of a point of interest 20. The reference frame 90 comprises three orthonormal axes, 92, 93, 94, respectively parallel to the axes 82, 82, 84 of the absolute terrestrial reference frame 80.

[0070] With reference to [Fig. 3], a viewing angle 95 of a camera 113 of a first type relative to the point of interest 20 can be defined as being an angle 95 measured between the axis 92 of the reference mark 90 and a line 96, the line 96 connecting the center 91 of the reference mark 90 to the position of the camera 113.

[0071] In addition, a total field angle 97 is defined, corresponding to the total field angle that the camera 113 can capture, and a partial field angle 98, corresponding to the field angle necessary to capture a complete image of the point of interest 20.

[0072] One or more predefined viewing angles may be associated with certain points of interest in the database. For example, a viewing angle corresponding to a view of a main facade may be associated with a monument; in addition or alternatively Typically, a viewing angle corresponding to a profile view of the monument can be associated with a monument. In the rest of the document, a predefined viewing angle may also be called "preferred viewing angle" or "preferred shooting angle".

[0073] In the remainder of the document, the term “capture position” is used to define a geographical position of the motor vehicle 100 from which at least one camera can capture an image of a point of interest according to a preferred shooting angle associated with the point of interest. A capture position corresponds to a driving position of the motor vehicle 100, that is to say a position of the motor vehicle 100 while it is moving on a traffic lane.

[0074] In an advantageous embodiment, the first assembly 1 comprises cameras used by other functions of the motor vehicle 100.

[0075] Thus, the first set 1 comprises a first subset 11 of cameras, said to be of a first type, capable of capturing views of the exterior of the passenger compartment of the motor vehicle 100. For example, in the embodiment presented in [Fig.2], four cameras of the first type 111, 112, 113, 114, making it possible to capture a view of almost 360 degrees of the exterior of the vehicle. In the embodiment described, the exterior cameras 111, 112, 113, 114 are respectively placed at a front hood, at a rear hood, on a left rearview mirror and on a right rearview mirror of the motor vehicle 100. Other cameras of the first type can equip the motor vehicle 100 while being installed in the passenger compartment of the vehicle, for example the cameras 115, 116 arranged in the passenger compartment of the vehicle and oriented towards an exterior zone located at the front of the vehicle.In one embodiment, the camera 115 is intended to record the driving scene, thus making it possible to document after the fact the circumstances that led to an accident. In addition or alternatively, the camera 116 captures images intended for driver assistance systems. The so-called first-type cameras may further comprise a rear-view camera 117 located on the rear shelf of the vehicle and capturing images of a rear exterior view of the vehicle.

[0076] In addition, a second subset 12 of cameras of a second type make it possible to capture views of the interior of the passenger compartment. The interior cameras may comprise a camera 121, 122 oriented towards the driver's face, and used by a driver vigilance monitoring system. In addition or alternatively, the camera 121, 122 may be used by an infotainment system 6, capable for example of determining the direction of the driver's gaze and informing the driver of the name of the point of interest that he is currently looking at.

[0077] Furthermore, the first set 1 of cameras may also include cameras of a third type, for example a camera of a mobile phone 13 or a camera 14 of a user's digital tablet. Depending on the orientation of the telephone or tablet, cameras of the third type can successively film the interior or exterior of the motor vehicle 100. However, the use of cameras of a third type is more complex than the use of cameras of the first and second types. One problem concerns the instability of the position of a camera of the third type, whose orientation in space can vary in real time. Automation of image capture via such a camera is therefore more complex to implement. Since the orientation of a camera of the third type depends on the user, elaborate shape recognition of the point of interest appears essential before image capture. Despite everything, whatever the processing carried out in the method according to the invention, the proper functioning of the invention requires correct orientation of the camera by the user.Thus, the predictive nature of the position of the cameras of the first and second type, which are fixed relative to the motor vehicle 100, is an advantage for the implementation of the method.

[0078] As a note, preferably, the use of so-called "global shutter" cameras will be favored, on which a closure of the lens takes place simultaneously on the entire captured image, in other words for which the capture of all the pixels of the image is simultaneous. Indeed, so-called "rolling shutter" cameras, on which a closure of the lens or more precisely the capture of the image takes place progressively, for example from one end to another of the captured image, can generate a desynchronization between an upper part of the image and a lower part of the image.

[0079] The geolocation system 2 of the motor vehicle 100 may, for example, be a GPS system making it possible to determine the position of the motor vehicle 100 on the map 3.

[0080] The motor vehicle 100 may also comprise a navigation system 4 managing a route of the motor vehicle 100. The route may or may not be entered by a user in the navigation system 4. The navigation system 4 may also provide information relating to the position and space occupied by known obstacles, such as buildings, bridges, etc. This information makes it possible to exclude capture positions upstream of the mission of the motor vehicle 100. Furthermore, the information provided by the navigation system 4 may be incomplete or obsolete. It may be checked during the course of the mission, in particular just before an instant of capturing an image.

[0081] The motor vehicle 100 may also comprise a driving assistance system AD AS 5, which provides information on the position, estimated route, and speed of the vehicles located in the traffic surrounding the motor vehicle 100. The information relating to the surrounding traffic makes it possible in particular to anticipate a intrusion of a vehicle into the total field 97 or the partial field 98 of a camera of the first type of the motor vehicle 100.

[0082] The motor vehicle 100 is also advantageously equipped with an electronic memory containing a database of points of interest, the memory being able to be a memory 61 of an infotainment system 6 presented below or a memory 72 of a calculation unit 7 intended to implement the method of capturing an image according to the invention.

[0083] The motor vehicle 100 further comprises a human-machine interface allowing a user to enter a list of at least one point of interest. The human-machine interface also allows a user to associate one or more preferred shooting angles with each point. In one embodiment, the human-machine interface may be a tablet or smartphone screen capable of communicating with a memory containing a list of points of interest.

[0084] In addition or alternatively, the human-machine interface may be a human-machine interface 62 of an infotainment system 6 equipping the motor vehicle 100. The infotainment system 6 makes it possible, for example, to select a list of at least one point of interest from a database of points of interest. In this embodiment, the infotainment system 6 comprises a memory 61 containing a database of points of interest. The human-machine interface 62 of the infotainment system 6 notably allows a user to enter a list of at least one point of interest and to associate one or more preferred shooting angles with each point of interest.

[0085] The motor vehicle 100 further comprises a computing unit 7 comprising a microprocessor 71, an electronic memory 72 and communication interfaces 73 allowing the microprocessor to communicate with the memory 72, the first set 1 of cameras, the geolocation system 4, the AD AS system 5 and the infotainment system 6. Advantageously, the computing unit 7 communicates with the electronic memory 61 of the infotainment system and with the human-machine interface of the infotainment system. In one embodiment, the computing unit 7 can be integrated into the infotainment system 6.

[0086] In one embodiment, the microprocessor 71 makes it possible to execute software comprising the following modules, which collaborate with each other:

[0087] - a module 711 for determining a first list of shooting angles,

[0088] - a module 712 for planning at least one image capture,

[0089] - a module 713 for implementing at least one image capture.

[0090] As a note, throughout the document, image capture means taking photos photography, therefore of a still image, or the production of a video.

[0091] A first mode of execution of the image capture method is described below in reference to [Fig.4].

[0092] In a first step E1, the user selects at least one point of interest of which he wishes to capture at least one image.

[0093] In one embodiment, the user can use a human-machine interface dedicated to an image capture device according to the invention. Alternatively, if the image capture device is integrated into the infotainment system 6, the user uses the human-machine interface 61 of the infotainment system 6.

[0094] The first selection step may comprise a selection of a list of at least one point of interest from a predefined list of points of interest. Alternatively, if the human-machine interface allows it, the user can designate one or more points of interest by selecting them on an interactive screen. In one embodiment, the human-machine interface 61 advantageously makes it possible to designate a point of interest not appearing in the predefined list of points of interest. For this, the human-machine interface 61 allows the user to designate a particular location, for example by pointing at it on a graphical navigation map, or by providing its GPS coordinates.

[0095] The first selection step may further comprise an association of one or more preferred viewing angles with each point of interest in the selected list.

[0096] The user can associate one or more viewing angles with a specific point of interest, i.e. establish the viewing angles point of interest by point of interest. Alternatively, the user can select a set of points of interest, in particular by using keywords defined in the database, for example “cathedral”, “bridge”, “landscape”, and define one or more common preferred viewing angles for the set of selected points of interest.

[0097] During the first step E1, the user also has the possibility of modifying the shooting choices defined by default in the points of interest database recorded in the memory 61, 72. For example, a default choice defined in the database may be to take a view of a facade of a castle and not to take a view of the rear of a castle. Such a default choice may be deactivated by the user so as not to restrict the number of viewing angles and therefore the number of possible captures.

[0098] At the end of step E1, one or more viewing angles have been defined for each point of interest.

[0099] In the remainder of the document, the image capture method is described with reference to an image capture of a given point of interest. However, the steps described may relate to a given point of interest, or a set of points of interest defined for the mission of the motor vehicle 100.

[0100] In a second step E2, at least one image capture of the point of interest is planned. For this, we determine: - at least one preferred shooting angle associated with the point of interest, then - at least one route segment of map 3 passing near the point of interest, then - at least one capture position located on the at least one route segment such that, when the motor vehicle is located on a capture position, the point of interest is located within the range of the at least one camera of the first type, the at least one camera of the first type allowing an image capture of the point of interest according to a shooting angle from the first list.

[0101] Then in the second step E2, at least one camera of the first type associated with each capture position of the set of capture positions is recorded in memory.

[0102] Thus, in step E2 the relevance of the viewing angles associated with each selected point of interest is analyzed, even when the viewing angle has been defined by a user.

[0103] For this, the route of the vehicle is analyzed. If a given route of the vehicle is defined in the navigation system 4, then the feasibility of the image captures is analyzed according to the defined viewing angles by considering a movement of the motor vehicle 100 according to the given route. If no route of the vehicle is defined in the navigation system 4, then a set of routes that can be taken by the motor vehicle 100 to perform the defined image captures is considered.

[0104] In one embodiment, even when a route has been defined in the navigation system 4, it is also possible to envisage analyzing alternative routes, and possibly to suggest to the user to modify his route to optimize his image captures.

[0105] A simulated movement of the motor vehicle 100 on the envisaged route(s) is then calculated, and the feasibility of the viewing angles associated with the point of interest is analyzed. For this, the range and the total field of the cameras of the first type of the motor vehicle 100 are materialized as the motor vehicle 100 moves on the envisaged route(s). It is detected whether at least one so-called “capture” position of the motor vehicle 100 on the envisaged routes allows image capture according to a viewing angle from the first list of preferred shooting angles.

[0106] In particular, the presence of obstacles is detected between the cameras of the first type of the motor vehicle 100 and the point of interest. Information concerning the position and dimensions of obstacles (buildings, constructions, bridges, etc.) may advantageously be provided by the navigation system 4.

[0107] In addition, if the navigation system 4 is activated, the vehicle's mission is known. Thus, the processing carried out during the second step E2 makes it possible to calculate the best viewing angles over the entire mission, allowing the requested videos or photos to be captured.

[0108] Thus, in the second step E2 it is detected that certain sections of trajectory do not allow an image capture to be carried out under satisfactory conditions. The given segments will then not be taken into consideration in the processing of the third step E3.

[0109] In addition, when an image capture envisaged by the user is of the video capture type, then the start and end positions of capture are calculated, - the capture start position being a first route point having a shooting angle appearing in the first list of preferred shooting angles, - and the capture end position being a second route point beyond which the shooting angles do not appear in the first list of preferred shooting angles.

[0110] In one embodiment, the method comprises several iterations of the second step E2. Advantageously, one of the iterations of step E2 takes place just before the start of the mission. The iterations of step E2 make it possible in particular to make the driver aware of the possibility or not of capturing images of certain points of interest. The driver can also be informed of the fact that a detour would be necessary in order to take better positions for capturing certain points of interest.

[0111] The invention will thus be able to offer the user, via the navigation system 4, possible detours to capture images according to the best viewing angles on the chosen point(s) of interest.

[0112] At the end of step E2, a set of capture positions has been determined making it possible to capture, via one or more cameras of the first type, one or more images according to the preferred viewing angle(s) associated with the point of view.

[0113] The camera(s) of the first type making it possible to capture one or more images according to the preferred viewing angle(s) associated with the viewpoint are then recorded in memory 61, 72, for each capture position.

[0114] An example of a mode of execution of the second step E2 is illustrated by [Fig. 5]. The motor vehicle 100 is traveling on the A51 motorway approaching a point of interest 40 (the city of Carcassonne). A user of the motor vehicle 100 has requested a video of the point of interest 40. In this example, the route of the vehicle has not been entered in the navigation system 4. The vehicle can take a first route 401 while remaining on the A51 motorway, or a second route 402 while leaving the motorway to take a departmental road allowing it to approach the point of interest.

[0115] In the situation represented by [Fig.5], the at least one route segment of the map passing close to the point of interest is a portion of the A51 motorway between points 41 and 44.

[0116] The first list of preferred shooting angles associated with the point of interest 40 includes a front view of the point of interest, and excludes side views of the point of interest 40.

[0117] In the situation shown, four capture positions 41, 42, 43, 44 are envisaged, some of which may have been defined by the user during step E1. The partial field angles 411, 421, 431, 441 of the camera 114 are respectively associated with the capture positions 41, 42, 43, 44.

[0118] [Fig.5] describes an iteration of step E2 preceding the start of the implementation of the image captures. The first viewpoint 41, whose partial field angle is materialized by the zone 411, is excluded because it is considered too lateral and of little interest. Between the capture position 41 and the capture position 42, constructions 45 obscure the view, so it is determined that the video shooting will start from the capture position 42. After the capture position 42, the video capture will continue, in particular up to the capture position 43, presenting both a direct, close-up and unobstructed view and an interesting viewpoint on the point of interest 40. From the viewpoint 44, the forest 46 indicated by the mapping is likely to obscure the view.

[0119] The set of capture positions associated in step E2 with the point of interest 40 corresponds to the positions traveled by the motor vehicle 100 moving on the track 61 between the points 42 and 44.

[0120] The capture positions traveled by the motor vehicle 100 moving on the track 61 between the points 42 and 44 are then recorded in memory 61, 72, and the camera 113 is associated with them, which makes it possible to capture one or more images according to the preferred viewing angle(s) associated with the point of interest 40.

[0121] Following the second step E2, the method comprises a third step E3 of implementing at least one image capture of the point of interest, the third step E3 comprising a movement of the motor vehicle on the at least one route segment. During this movement, when the vehicle is located by the location system 2 on a capture position of the set of capture positions, the relevance, at the capture time, of an image capture of the point of interest by the at least one camera of the first type associated with the capture position is verified.

[0122] If an image capture is relevant, an image of the point of interest is captured via the at least one camera of the first type associated with the capture position.

[0123] Verifying the relevance of an image capture by a camera of the first type of the set of cameras comprises: - a comparison with a maximum threshold of a distance calculated between the at least one camera of the first type associated with the capture position and the point of interest, and / or - a verification of the position of the sun at the time of capture and / or, - a detection of an intense light source in a field of vision of the at least one camera of the first type associated with the capture position, and / or - an anticipation of an irruption of a vehicle or of an element of an environment of the motor vehicle 100 interposing itself between the at least one camera of the first type associated with the capture position and the point of interest, the irruption of a vehicle being anticipated from the data provided by the driving assistance system 5.

[0124] Thus, in step E3, the vehicle automatically captures images of the selected points of interest as it moves along the first segment of the journey. The position of the motor vehicle 100 is provided at any time by the geolocation system 2. In addition, in step E3, the relevance of the image capture positions determined during the execution of the second step E2 is re-evaluated as the motor vehicle 100 moves.

[0125] Firstly, depending on the expected time of arrival at an image capture point, the brightness conditions at said time of arrival are refined according to the position of the sun, the brightness conditions varying according to the time and the time of year. In this way, backlit shooting angles will be avoided. Similarly, certain image capture points may be deleted if the geolocation system locates them near a source of intense lighting, for example near a football stadium.

[0126] Furthermore, in an advantageous embodiment, the information provided by the driving assistance system 5 makes it possible to anticipate an imminent intrusion of a second vehicle in a viewing angle of a camera of the first type, in particular between the motor vehicle 100 and the point of interest. The use of this camera is then inhibited during the passage of the second vehicle.

[0127] Furthermore, image capture may be automatically interrupted or suspended when an evaluated distance between the camera(s) and the point of interest exceeds a maximum distance threshold. As a note, the maximum threshold may be fixed and predetermined or may be variable. For example, it may depend on the field of view of the camera involved, as each camera may have a native zoom that “brings” its view closer or further away from the point of interest. Thus, more generally, the maximum threshold may depend on one or more parameters specific to each camera and therefore be specific to each camera.

[0128] Thus, in step E3, the position of the vehicle relative to the point of interest is adapted in real time, not only in terms of longitude and latitude, but also in terms of the height of the vehicle relative to the obstacles located between the vehicle and the point of interest.

[0129] Step E3 further comprises a sub-step of real-time adjustment of the settings and / or image capture conditions.

[0130] In particular, the shutter speed or the exposure time of the camera of the first type and / or the number of image captures per second can be adapted to the speed of movement of the motor vehicle 100. In particular, to promote the sharpness of the images, the shutter speed or the exposure time of the cameras of the first type can increase with the speed of movement of the motor vehicle 100.

[0131] In the case where a camera with “rolling shutter” is used, several images can be captured in succession in order to correct any desynchronization between the top and the bottom of the image. Advantageously, the image correction algorithm used takes into account the speed of movement of the motor vehicle 100.

[0132] In addition, the exposure time of a camera of the first type is adapted according to the lighting conditions of the point of interest.

[0133] Then, at the instant when the vehicle is ideally positioned to capture an image according to one of the selected viewing angles, a view is captured via the camera of the first type positioned according to the selected viewing angle.

[0134] Under certain image capture conditions, post-processing of the captured image may be necessary to refocus the resulting image. Alternatively, if the camera capturing the image has an optical zoom, and if the camera is not in use by another vehicle system at the time of capture, the image could be zoomed in just before being captured.

[0135] Advantageously, the real-time adjustment sub-step may comprise shape recognition processing essentially used to detect in real time an obstacle masking the point of interest. Thus, just before triggering the image capture, it is determined whether the shape perceived by the camera corresponds at least roughly to the shape of the point of interest. Advantageously, the data from the navigation system 4 make it possible to determine the shape that the point of interest should take depending on the camera's viewing angle.

[0136] Thus, in the case of a video capture, thanks to the shape recognition processing, the capture start position can be slightly shifted to avoid the presence of the obstacle on the first captured images. As a note, when a video capture is in progress, it is accepted that the capture is continued when an obstacle temporarily obstructs the shot.

[0137] With regard to still image capture, the point of interest can be more finely detected in the image in real time and the shooting time adjusted.

[0138] In the case of a video capture, the method may implement a transition between a first and a second camera of the first type during the duration of a single capture, the point of interest being visible without interruption by one or the other of the two cameras during the entire capture. In one embodiment, an assembly between the images from the first and second cameras of the first type may be carried out between be done automatically. The same principle can naturally be applied with more than two cameras.

[0139] Advantageously, the user will be able to configure the invention to capture images of a point of interest by simultaneously using two cameras of the first type having two different viewing angles on the same point of view. From these two simultaneous image captures, composite images will be able to be generated, showing the point of interest simultaneously from two viewing angles.

[0140] Other compositions of simultaneous shots are also possible. For example, simultaneously with the taking of shots of a point of interest by a first camera of the first type, a second camera of the second type can film reactions of the passengers of the vehicle observing the point of view, possibly also recording a sound from the passenger compartment.

[0141] A first illustration of the progress of the third step E3 is described below with reference to [Fig.6].

[0142] The motor vehicle 100 travels on a lane 61 and approaches a point of interest 60. [Fig. 5] represents, on the path of the motor vehicle 100, a route segment 64 comprising five viewpoints 611, 612, 613, 614, 615 selected during step E2. Associated with each viewpoint are, - on the one hand a total field angle 6131 of a camera of the motor vehicle 100 which is capable of capturing shots of the point of interest 60, and - on the other hand a partial field angle 6132 desired for image capture at this point of view.

[0143] The position 62 of the sun is also represented, and it will be taken into account within the framework of the method.

[0144] The first point of view 611 had initially been identified in step E2 as interesting, considering in particular that the lateral vision is as interesting as the facade for the point of interest 60.

[0145] Now, in step E3, the light conditions are checked just before the arrival of the motor vehicle at the first viewpoint 611, in particular the position 62 of the sun relative to the partial field angle 6112 is checked. Thus, depending on the date, the time, the position of the motor vehicle 100 and its orientation in an XY plane, it is detected that the sun is positioned opposite the shot, which would then be taken against the light. In step E3, the image capture that was initially planned at viewpoint 611 is therefore canceled.

[0146] Similarly, at the initially selected viewpoint 612, the presence of an obstacle 63 is detected which obstructs the partial field angle 6122. The obstruction is sufficiently coarse to be recognized by a fast image recognition algorithm (the shape of the tree 63 is very far from the shape expected for the point of interest 60). In step E3, the image capture that was initially planned at viewpoint 612 is therefore also canceled.

[0147] Concerning the point of view 613, in step E2 it has already been predetermined that the front camera of the motor vehicle 100 has the best viewing angle for the capture. Alternatively or in addition, the determination of the camera having the best viewing angle can be carried out during step E3. An image capture step is then started. The image can be captured on the total field angle 6131 or on the partial field angle 6132. In the case where the image is captured on the partial field angle 6132, it can be advantageously zoomed.

[0148] Similarly, at viewpoint 614, a side camera 114 of the motor vehicle 100 is determined to have the best viewing angle to continue the capture initiated at viewpoint 613. Then at viewpoint 615, the rear camera 112 of the motor vehicle 100 is determined to have the best viewing angle to continue the capture.

[0149] At viewpoint 616, it is detected that the image capture must be stopped because the motor vehicle 100 is located too far from the point of interest.

[0150] A second illustration of the progress of the third step E3 is described below with reference to [Fig.7].

[0151] The motor vehicle 100 travels on a first lane 71 located opposite a point of interest 70 of which a user wishes to capture a video. At the point of view 711, the distance between the vehicle 100 and the point of interest 70 having become less than a predefined maximum distance, the image capture can begin via the front camera of the motor vehicle 100.

[0152] At viewpoint 712, the vehicle reaches an intersection and turns right. The point of interest is then located in a blind spot of the cameras of the motor vehicle 100. Image capture is then interrupted. It resumes at viewpoint 713 when the point of interest enters the range of the left side camera of the motor vehicle 100.

[0153] Finally, the method according to the invention allows a user of the motor vehicle 100 to configure automatic captures of images of points of interest located on the route of the vehicle. The implementation of the method uses hardware means, in particular cameras, which are already present in the motor vehicle 100. In other words, the invention adapts to an existing architecture of a vehicle, in particular to the number and positioning of the cameras available on the vehicle. The cost of implementing the invention is therefore limited to a software development cost.

[0154] The method according to the invention is particularly advantageous when the vehicle does not have the possibility of parking to take image captures (for example when the vehicle is moving on a motorway or in a built-up area) or when users do not wish to stop.

[0155] In addition to automating image capture, the method according to the invention optimizes the shooting conditions, in particular by automatically calculating the best viewing angle, by selecting the best moment during the vehicle's journey and the vehicle camera having the best viewing angle in order to record the most beautiful views of each of the selected points of interest.

[0156] The method according to the invention also makes it possible to configure the settings of the cameras, for example as a function of the speed of the motor vehicle 100. Shape recognition processing is also carried out to verify that the captured image corresponds to a point of interest selected by a user.

[0157] The method furthermore makes it possible to automate coordinated image captures between different cameras of the vehicle, for example coordinated captures between a camera of the first type (performing image captures of the exterior of the vehicle) and a camera of the second type (performing image captures of the passenger compartment). Thus, the method makes it possible, for example, to capture the reactions of the vehicle's passengers when they observe the point of interest. In addition, the method makes it possible to record sounds in the passenger compartment in parallel with the image captures.

[0158] In addition or alternatively, the method makes it possible to synchronize image captures from two cameras of the first type, and to provide montages of synchronized views of the point of interest according to two different viewing angles. Alternatively, there may be overlaps of viewing angles, and in this case, one could have a montage with more than two cameras, for example three cameras.

[0159] Furthermore, the method according to the invention allows a user to enrich and exploit a database of points of interest, in particular to configure according to his preferences, and according to multiple sorting criteria, preferred viewing angles relating to a point of interest or relating to a set of points of interest in the database.

[0160] .

Claims

Claims

1. Image capture method for a motor vehicle (100), the motor vehicle (100) comprising at least one camera of a first type (111, 112, 113, 114, 115, 116, 117), capable of capturing images of a space outside the motor vehicle (100), and a memory (61, 72), characterized in that it comprises: - a first step (El) of selection by a user of the motor vehicle (100) of a point of interest (20, 40, 60, 70) located on the map (3), then - a second step (E2) of planning at least one image capture, comprising: • a determination of at least one preferred shooting angle associated with the point of interest (20, 40, 60, 70), • a determination of at least one route segment (64, 401) of the map (3) passing near the point of interest (20, 40, 60, 70), • a determination of at least one capture position (42, 43, 613, 614, 615, 711, 713) located on the at least one route segment (64, 401) such that,when the motor vehicle (100) is located on the at least one capture position (42, 43, 613, 614, 615), the point of interest (20, 40, 60, 70) is located within the range of the at least one camera of the first type, the at least one camera of the first type (11, 112, 113, 114, 115, 116, 117) allowing an image capture of the point of interest (20, 40, 60, 70) according to the at least one preferred shooting angle associated with the point of interest, • a storage of the at least one capture position (42, 43, 613, 614, 615, 711, 713) and of the at least one camera of the first type (111, 112, 113, 114, 115, 116, 117) associated with the at least one capture position (42, 43, 613, 614, 615).,

2. Capture method according to the preceding claim, the motor vehicle (100) comprising a vehicle location system (2) automobile (100) on a map (3), characterized in that it comprises a third step (E3) of implementing at least one image capture of the point of interest (20, 40, 60, 70), the third step (E3) comprising, when the vehicle is located by the location system (2) on a capture position (42, 43, 613, 614, 615, 711, 713), • a verification of a relevance, at the instant of capture, of an image capture of the point of interest (20, 40, 60, 70) by the at least one camera of the first type (111, 112, 113, 114, 115, 116, 117) associated with the capture position (20, 40, 60, 70), • if an image capture is relevant, a capture of an image of the point of interest (20, 40, 60, 70) by the at least one camera of the first type (111, 112, 113, 114, 115, 116, 117) associated with the capture position (42, 43, 613, 614, 615, 711, 713), and in that the verification of the relevance of a capture comprises - a comparison with a maximum threshold of a distance calculated between the at least one camera of the first type (111, 112, 113, 114, 115, 116, 117) associated with the capture position (42, 43, 613, 614, 615, 711, 713) and the point of interest (20, 40, 60, 70), and / or - a verification, at the time of capture, of a relative position of the sun in relation to the point of interest (20, 40, 60, 70) and / or, - a detection of an intense light source in a field of vision of the at least one camera of the first type (111, 112, 113, 114, 115, 116, 117) associated with the capture position (20, 40, 60, 70), and / or - an anticipation of an irruption of a vehicle or of an element of an environment of the motor vehicle (100) interposing itself between the at least one camera of the first type (111, 112, 113, 114, 115, 116, 117) associated with the capture position (42, 43, 613, 614, 615, 711, 713) and the point of interest (20, 40, 60, 70), the irruption of a vehicle being anticipated from the data provided by the driving assistance system (5).

3. Capture method according to one of the preceding claims, characterized in that the third step (E3) further comprises a sub-step of real-time adjustment of image capture conditions by the at least one camera of the first type (111, 112, 113, 114, 115, 116, 117) comprising: - an adjustment, depending on the vehicle's travel speed, mobile (100), a shutter speed or the exposure time of the at least one camera of the first type (111, 112, 113, 114, 115, 116, 117) and / or a number of image captures made in one second by the at least one camera of the first type (111, 112, 113, 114, 115, 116, 117), and / or - a setting of an exposure time of the at least one camera of the first type (111, 112, 113, 114, 115, 116, 117) depending on lighting conditions of the point of interest (20, 40, 60, 70), and / or - just before a trigger time of a given image capture by the at least one camera of the first type (111, 112, 113, 114, 115, 116, 117), a first processing of recognition of a shape of the point of interest (20, 40, 60, 70), the shape being estimated as a function of a shooting angle of the at least one camera of the first type (111, 112, 113, 114, 115, 116, 117), then, if the recognition fails, a cancellation of the given image capture.

4. Capture method according to one of the preceding claims, characterized in that the first selection step (El) comprises: - a step of selection by a user of the motor vehicle (100) via a human-machine interface (62) of one or more points of interest from a predefined list of points of interest, and / or - a step of definition via a human-machine interface (62) of a point of interest by its position on the map (3) and / or, - a step of association via a human-machine interface (62) of one or more preferred shooting angles with a point of interest (20, 40, 60, 70).

5. Capture method according to the preceding claim, characterized in that the human-machine interface is a human-machine interface of the motor vehicle (100), in particular a human-machine interface (62) of an info-navigation system (6) of the motor vehicle (100) and / or a human-machine interface of a telephone (13) of a user of the motor vehicle (100) and / or a human-machine interface of a digital tablet of a user of the motor vehicle (100).

6. Capture method according to one of the preceding claims, characterized in that the determination of the at least one route segment (64, 401) of the map (3) takes into account: - a route planned in a navigation system (4) equipping the motor vehicle (100), and / or - a set of routes passing near the point of interest (20, 40, 60, 70).

7. Capture method according to one of the preceding claims, characterized in that - the motor vehicle further comprises at least one camera of a second type (121, 122), capable of capturing images of a passenger compartment of the motor vehicle (100), and in that, in the third step (E3), images of a passenger compartment of the motor vehicle (100) are captured by the at least one camera of the second type (121, 122) simultaneously with the captures of images of the point of interest (20, 40, 60, 70) by the at least one camera of the first type (111, 112, 113, 114, 115, 116, 117), and / or - in the third step (E3), at least two cameras of the first type (111, 112, 113, 114, 115, 116, 117) simultaneously capture images of a point of interest (20, 40, 60, 70) from different viewing angles, and / or - in the third step (E3), a sound recording is made in a space outside the motor vehicle (100) or in a passenger compartment of the motor vehicle (100),simultaneously with image captures of the point of interest (20, 40, 60, 70).,

8. Capture method according to one of the preceding claims, characterized in that the at least one camera of the first type (111, 112, 113, 114, 115, 116, 117) and / or the at least one camera of the second type (121, 122) comprises a camera of a telephone and / or a camera of a digital tablet of a user of the motor vehicle (100).

9. Device (10) for capturing an image of a motor vehicle (100), the motor vehicle being equipped with cameras (111, 112, 113, 114, 115, 116, 117, 121, 122), a system (2) for locating the motor vehicle on a map (3), a navigation system (4), a driver assistance system (5) and an infotainment system (6), the device comprising hardware and / or software elements (7, 71, 72, 73, 711, 712, 713) implementing the method according to one of claims 1 to 8, in particular hardware elements (71, 72, 73) and / or software designed to implement the method according to one of the preceding claims, and / or the device comprising means for implementing the method according to one of the preceding claims.

10. Motor vehicle (100) comprising an image capture device (10) according to the preceding claim.

Images