Method for controlling at least one camera module, and associated computer program, control device and imaging system

The control method detects and adjusts camera modules to ensure the observer's area of interest is central in the acquired image, addressing fixed orientations and improving information sharing and stereoscopic display quality.

WO2025163252A1PCT designated stage Publication Date: 2025-08-07FOGALE OPTIQUE
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
PCT/FR2024/050122
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-01-30
Publication Date
2025-08-07

AI Technical Summary

Technical Problem

Existing camera module control methods fail to adapt to the observer's area of interest and do not coordinate multiple camera modules effectively, resulting in fixed or predetermined image acquisition orientations that do not personalize the scene display and hinder information sharing.

Method used

A control method that detects the observer's current area of interest and generates orientation signals to adjust camera modules so that a predetermined pixel, such as the central pixel, represents this area, ensuring it appears in the acquired image, with optional features like neutral perimeters and movement speed adjustments based on detected area changes.

Benefits of technology

The method personalizes scene display by ensuring the observer's area of interest is consistently visible, facilitates information sharing, and supports stereoscopic displays with reduced parallax errors, enhancing viewer comfort and image clarity.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure FR2024050122_07082025_PF_FP_ABST
    Figure FR2024050122_07082025_PF_FP_ABST
Patent Text Reader

Abstract

The invention relates to a method for controlling at least one camera module (10), each camera module (10) being configured to acquire at least one image representative of a scene (4), the method being implemented by computer and comprising the steps of: - detecting, for an observer (8), a corresponding current region of interest (6) in the scene (4), the current region of interest (6) being associated with a current time; and - for each camera module (10), generating an orientation signal for controlling an orientation of the camera module (10) such that, for at least one image acquired by the camera module (10) at a time that is later than the current time, at least one predetermined pixel of the acquired image is representative of a point in the current region of interest (6).
Need to check novelty before this filing date? Find Prior Art

Description

Method for controlling at least one camera module, computer program, control device and associated imaging system DESCRIPTION Technical field

[0001] The present invention relates to a method for controlling at least one camera module.

[0002] The invention also relates to a computer program, a control device configured to implement such a method, and an imaging system comprising such a control device.

[0003] The invention applies to the field of image acquisition, in particular using camera modules, such as digital cameras or digital photographic devices. State of the art

[0004] It is known to acquire an image of a scene observed by an observer by means of one or more camera module(s).

[0005] Traditionally, the observer scans the scene to identify the area(s) likely to be of interest to him.

[0006] However, such an acquisition does not give complete satisfaction.

[0007] Indeed, the currently known camera module control methods that allow the acquisition of an image of a scene carry out the acquisition of said image following an orientation that is generally fixed, or else variable following a predetermined trajectory (scanning of the scene). As a result, such acquisition methods do not adapt at all to the observer and confine a user to observing the acquired images of the scene according to the orientation choice made prior to the acquisition of the images of the scene.

[0008] Furthermore, such control methods are unable to coordinate a plurality of camera modules to account for changes in the observer's area of interest over time.

[0009] An aim of the present invention is to remedy at least one of the drawbacks of the state of the art.

[0010] Another aim of the invention is to propose a solution for acquiring an image of a scene which is indicative of the part of the scene which is of interest to the observer. Statement of the invention

[0011] To this end, the invention relates to a control method of the aforementioned type, in which each camera module is configured to acquire at least one image representative of a scene, the method being implemented by computer and comprising the steps: - detection, for an observer, of a corresponding current area of interest of the scene, the current area of interest being associated with a current instant; and - for each camera module, generation of an orientation signal to control an orientation of said camera module so that, for at least one image acquired by said camera module at a time subsequent to the current time, at least one predetermined pixel of said acquired image is representative of a point of the current area of interest.

[0012] Indeed, thanks to the detection step, an area of interest, corresponding to a target area of the scene in which the observer is interested, is detected.

[0013] In this way, using the orientation signal dependent on the detected area of interest, the orientation of the camera module is adjusted so that the part of the scene in which the observer is interested lies in a predetermined part of the acquired image (e.g., a central part). As a result, at least a part of the area of interest always appears in the acquired image, for all controlled camera modules. In other words, each camera module tracks the area detected as being of interest to the user.

[0014] As a result, the scene display is personalized and adapts to the observer, particularly to the target area on which the observer's interest is focused.

[0015] Another advantage is that the images acquired using this method directly indicate, to a third party who might become aware of them, the areas of the scene in which the observer has focused their interest. Indeed, the third party only needs to focus on the same predetermined part in the acquired images to identify the (or each) area of interest of the observer. Information sharing is thus facilitated.

[0016] Advantageously, the method according to the invention has one or more of the following characteristics, taken in isolation or in any technically possible combination:

[0017] the at least one predetermined pixel is a central pixel of the acquired image;

[0018] detection of the area of interest depends on an output of an imaging device arranged to image the observer;

[0019] the control method further comprises: - an association of a neutral perimeter with the detected area of interest, the neutral perimeter being a region of space comprising the current area of interest; and - for each camera module oriented according to the current area of interest, a command to immobilize said camera module as long as the areas of interest detected subsequently to the area of interest current are included in the neutral perimeter associated with the current area of interest;

[0020] the orientation signal is a signal for controlling an orientation of each camera module according to a movement speed depending on a distance between a newly detected area of interest and a previous area of interest;

[0021] the movement speed is an increasing function of the distance between the newly detected area of interest and the previous area of interest;

[0022] the control method further comprises a display of a first image of the scene acquired by a first camera module intended for the right eye of the observer, and of a second image of the scene acquired by a second camera module, distinct from the first camera module, intended for the left eye of the observer, the generation of the orientation signal comprising a calculation of a combined area of interest from the area of interest detected for the right eye and the area of interest detected for the left eye, the orientation signal generated being a function of the calculated combined area of interest;

[0023] the control method further comprises, for each camera module, and for each image acquired by said camera module, a recording, in association with said acquired image, of corresponding orientation information representative of an orientation of said camera module relative to a respective mobile support, at the time of acquisition of said image, the orientation information being, preferably, also representative of a position of said mobile support in a predetermined reference frame;

[0024] the control method further comprises, for each camera module, a generation of a focusing signal to control an adjustment of an optical system of said camera module so that at least one point of the detected area of interest belongs to a sharpness interval of the camera module, the sharpness interval being an interval: - comprising a point located at a distance from the camera module equal to a focusing distance of the camera module; and having an extent, along an optical axis of the camera module, equal to the depth of field of the camera module;

[0025] each camera module comprises at least one pair of matched photodetectors arranged to image the same point of the scene, the focusing signal being a function of a difference in light flux received by each photodetector of at least one pair of matched photodetectors imaging the area of interest;

[0026] the focusing signal is a function of: - distance information between each camera module and at least one point in the area of interest, delivered by a telemetry device; and / or - a sharpness value of the part of the acquired image representative of the area of interest.

[0027] According to another aspect of the invention, there is provided a computer program comprising executable instructions which, when executed by computer, implement the steps of the method as defined above.

[0028] The computer program can be in any computer language, such as machine language, C, C++, JAVA, Python, etc.

[0029] According to another aspect of the invention, there is provided a control device for controlling at least one camera module, each camera module being configured to, in use, acquire at least one image representative of a scene, the control device being configured to: - detect, for an observer, a corresponding current area of interest of the scene, the current area of interest being associated with a current instant; and - for each camera module, generate an orientation signal to control an orientation of said camera module so that, for at least one image acquired by said camera module at a time subsequent to the current time, at least one predetermined pixel of said acquired image is representative of a point of the current area of interest.

[0030] The device according to the invention can be any type of device such as a server, a computer, a tablet, a calculator, a processor, a computer chip, programmed to implement the method according to the invention, for example by executing the computer program according to the invention.

[0031] According to another aspect of the invention, there is provided an imaging system comprising a control device as defined above, at least one camera module configured to deliver at least one image representative of an acquired scene, and, for each camera module, a mobile support on which said camera module is mounted, the control device being connected to each mobile support to control an orientation of the corresponding camera module.

[0032] Advantageously, the imaging system further comprises a display medium configured to display at least one image acquired by at least one camera module.

[0033] Preferably, the imaging system is a smart mobile phone (or "smartphone" in English), also called a ordiphone or multifunction mobile phone).

[0034] In this case, the invention also relates to a use of a control device according to the invention and / or a method according to the invention, within the smart mobile phone, for controlling an orientation of a camera module (for example, included in the smart mobile phone) from a current area of interest, for an observer, in a scene.

[0035] Alternatively, the imaging system is a touchscreen tablet.

[0036] In this case, the invention also relates to a use of a control device according to the invention and / or a method according to the invention, within the touch pad, for controlling an orientation of a camera module (for example, included in the touch pad) from a current area of interest, for an observer, in a scene.

[0037] Alternatively, the imaging system is a computer.

[0038] In this case, the invention also relates to a use of a control device according to the invention and / or a method according to the invention, within the computer, for controlling an orientation of a camera module (for example, included in the computer) from a current area of interest, for an observer, in a scene.

[0039] Alternatively, the imaging system is a television or display terminal.

[0040] In this case, the invention also relates to a use of a control device according to the invention and / or a method according to the invention, within the television or the display terminal, for controlling an orientation of a camera module (for example, included in the television or the display terminal) from a current area of interest, for an observer, in a scene.

[0041] Alternatively, the imaging system is a virtual reality headset or an augmented reality headset.

[0042] In this case, the invention also relates to a use of a control device according to the invention and / or a method according to the invention, within the virtual reality headset, or within the augmented reality headset, for controlling an orientation of a camera module (for example, included in the virtual reality headset or the augmented reality headset) from a current area of interest, for an observer, in a scene.

[0043] Alternatively, the imaging system is included in a medical imaging device, for example an endoscope.

[0044] In this case, the invention also relates to a use of a control device according to the invention and / or a method according to the invention, within the medical imaging device, for controlling an orientation of a camera module (for example, included in the medical imaging device) from a current area of interest, for an observer, in a scene.

[0045] Alternatively, the imaging system is included in a vehicle, autonomous or not, such as a land vehicle (e.g., a car), an aircraft (e.g., a drone, an airplane, a helicopter, etc.) or a maritime vehicle (e.g., a boat, a submarine, etc.).

[0046] In this case, the invention also relates to a use of a control device according to the invention and / or a method according to the invention, within the vehicle, for controlling an orientation of a camera module (for example, included in the vehicle) from a current area of interest, for an observer, in a scene. Brief description of the figures

[0047] The invention will be better understood on reading the description which follows, given solely as a non-limiting example and made with reference to the appended drawings in which:

[0048] Figure 1 is a schematic representation of a first embodiment of an imaging system according to the invention;

[0049] Figure 2 is a schematic representation of a camera module and a corresponding mobile support of the imaging system of Figure 1;

[0050] Figure 3 is a flowchart of a control method implemented by the imaging system of Figure 1;

[0051] Figure 4 is a schematic representation of a second embodiment of an imaging system according to the invention;

[0052] Figure 5 is a schematic representation of a variation of the imaging system of Figure 4; and

[0053] Figure 6 is a schematic representation of a camera module of any of the imaging systems of Figures 1, 4 and 5.

[0054] It is understood that the embodiments which will be described below are in no way limiting. In particular, it is possible to imagine variants of the invention comprising only a selection of characteristics described below isolated from the other characteristics described, if this selection of features is sufficient to confer a technical advantage or to differentiate the invention from the state of the prior art. This selection includes at least one preferably functional feature without structural details, or with only part of the structural details if it is this part which is only sufficient to confer a technical advantage or to differentiate the invention from the state of the prior art.

[0055] In particular, all the variants and embodiments described can be combined with each other if there is no technical obstacle to this combination.

[0056] In the figures and in the rest of the description, the elements common to several figures retain the same reference. Detailed description

[0057] An imaging system 2 according to the invention is illustrated in Figure 1.

[0058] The imaging system 2 is, in particular, intended to image a scene 4 (i.e. to acquire at least one image of the scene 4). The imaging system 2 is also capable of detecting an area of interest 6 of the scene 4. Furthermore, the imaging system 2 is intended to image the scene 4 as a function of the detected area of interest 6.

[0059] In this case, by "area of interest" is meant an area, in scene 4, on which the attention of an observer 8 is focused.

[0060] The imaging system 2 comprises at least one camera module 10, and, for each camera module 10, a corresponding mobile support 12 on which said camera module 10 is mounted. The imaging system 2 also comprises a control device 14, each mobile support 12 being connected to the control device 14.

[0061] Preferably, the imaging system 2 comprises an imaging device 16 arranged to image the observer 8. In this case, correspondence data between a marker attached to the imaging device 4 and a marker attached to the mobile support 12 have, advantageously, been previously recorded in the control device 14. Such data correspondence were, for example, determined during a preliminary calibration of the imaging system 2.

[0062] More preferably, the imaging system 2 comprises a display support 18 connected to the control device 14 and configured to display the at least one image acquired by the camera module 10, to form a displayed image 20. Camera module 10

[0063] Each camera module 10 is configured to acquire at least one image, in particular at least one image of the scene 4.

[0064] Conventionally, the camera module 10 comprises a sensor associated with an optical system (not shown). The optical system has an optical axis A.

[0065] Preferably, and as will be described later, an adjustment of the optical system of the camera module 10 is a function of a focusing signal delivered by the control device 14. Mobile support 12

[0066] As indicated previously, each camera module 10 is mounted on a corresponding movable support 12. Such a movable support 12 is adapted to move the corresponding camera module 10 according to at least one degree of freedom.

[0067] An adjustment of the mobile support 12 (and, consequently, an adjustment of an orientation of the corresponding camera module 10) is a function of an orientation signal delivered by the control device 14. This results, in particular, in that a direction of the optical axis A of the camera module 10 is a function of the orientation signal.

[0068] Such an orientation of the camera module 10 comprises at least one rotation around a predetermined axis and / or at least one translation along a predetermined axis.

[0069] Preferably, the mobile support 12 is configured to rotate the camera module 10 around at least one predetermined axis, for example around at least one of the axes Ox, Oy and Oz shown in FIG. 2. In other words, the mobile support 12 is adapted to rotate the camera module 10.

[0070] For example, by the action of the movable support 12, the camera module 10 is movable in rotation around the Ox axis and the Oz axis. In other words, the camera module is able to tilt upwards or downwards (rotation around the Ox axis), and to pivot to the left or to the right (rotation around the Oz axis).

[0071] Alternatively, or in addition, the mobile support 12 is configured to cause the camera module 10 to translate along at least one predetermined axis, for example along at least one of the axes Ox, Oy and Oz.

[0072] Preferably, to set the camera module 10 in motion, the mobile support 12 comprises any actuator known to those skilled in the art and likely to be suitable for the use case. For example, to set the camera module 10 in motion, the mobile support 12 comprises electric motors, rack systems, piezoelectric ceramics, electrostatic actuators, magnetostrictive actuators, microelectromechanical systems (or MEMS), etc. Control device 14

[0073] The control device 14 is configured to detect the area of interest associated with the observer 8 and to control each mobile support 12 according to a result of the detection.

[0074] To carry out such a control, the control device 14 is configured to implement a control method 30, illustrated by FIG. 3.

[0075] As shown in this figure, the control method 30 comprises a step 32 of detecting an area of interest (called “step of detection”) and a step 34 of generating an orientation signal for the camera module 10 (called “signal generation step”). Detection step 32

[0076] More precisely, the control device 14 is configured to, during the detection step 32, detect, in the scene 4, a current area of interest 6 associated with the observer 8, for a current instant.

[0077] Preferably, the area of interest 6 is the part of the scene which is observed by the observer 8. Alternatively, or in a complementary manner, the area of interest 6 is the part of the scene 4 which is pointed at by the observer 8, by means of a part of his body (such as a finger) or an object (such as a stylus).

[0078] In this case, the control device 14 is associated with the previously mentioned imaging device 16. Furthermore, in this case, the control device 14 is configured to detect, from an output of the imaging device 16, the area of interest 6 associated with the observer 8.

[0079] For example, the control device 14 is configured to detect the area of interest 6 as being a region around a point of intersection of a direction D of the gaze of the observer 8 (and / or a pointing direction of the observer 8) with an object of the scene 4.

[0080] In the example of Figure 1, line D illustrates the direction of gaze of observer 8. Observer 8 observes a part of scene 4, detected as being area of interest 6. Area of interest 6 of observer 8 is surrounded by dotted lines and corresponds, in this example, to a tree in scene 4.

[0081] According to another variant, the area of interest 6 is the part of the scene 4 which is designated by the observer 8 by means of any appropriate human / machine interface (such as a mouse, a keyboard, or even a joystick). Signal generation step

[0082] Furthermore, the control device 14 is configured to generate, during the signal generation step 34, an orientation signal for the camera module 10.

[0083] More precisely, the control device 14 is configured to generate the orientation signal to control an adjustment of the mobile support 12 so that, for at least one image acquired at a time subsequent to the current time, at least one predetermined pixel of the acquired image 12 is representative of a point of the current area of interest 6.

[0084] In the case of using the imaging device 16 to determine the area of interest 6, the control device 14 is preferably configured to generate the orientation signal from the predetermined correspondence data.

[0085] As a result, in the case of a plurality of camera modules 10, all of the camera modules are oriented simultaneously to follow the detected area of interest: simple, simultaneous and automatic coordination of the orientation of a set of camera modules is thus achieved.

[0086] Advantageously, the at least one predetermined pixel is a central pixel of the acquired image 12.

[0087] For the purposes of the present invention, the term "central pixel" means the pixel associated with the photodetector located at the intersection of the middle row and column of photodetectors of the sensor of the camera module 10. In the case where the number of rows and / or the number of columns is even, the central pixel is chosen from the pixels associated with the photodetectors located at the intersection of the two middle rows and / or the two middle columns of photodetectors of the sensor of the camera module 10.

[0088] In other words, the orientation signal is intended to control the mobile support 12 to orient the camera module 10 so that, in the image 12 acquired by said camera module 10, the representation of the area of interest 6 in the acquired image is centered, that is to say positioned at the center of said acquired image 12.

[0089] Preferably, the control device 14 is configured to associate a neutral perimeter 32 with the detected area of interest 6. More specifically, the neutral perimeter 32 is a region of space comprising the current area of interest 6.

[0090] In this case, the control device 14 is configured to generate the orientation signal so as to command an immobilization of the camera module 10 as long as the areas of interest detected subsequently to the current area of interest are located (i.e. included) in the neutral perimeter 32 associated with the current area of interest. Naturally, such an immobilization is implemented once the camera module 10 is oriented according to the current area of interest 6, i.e. once at least one predetermined pixel of the or each image acquired by the camera module 10 is representative of a point of the current area of interest 6.

[0091] In other words, the neutral perimeter 32 defines an area in which the observer's attention can move without causing the camera module 10 to repoint.

[0092] Such a feature is advantageous, insofar as it introduces a tolerance to movements of the observer's attention, which avoids unwanted fluctuations of the camera module over time, resulting in untimely shifts between successive acquired images.

[0093] For example, the neutral perimeter 32 has a predetermined geometry, such as a hollow sphere encompassing the current area of interest 6.

[0094] According to another example, the neutral perimeter 32 is a cone whose: - the top belongs to the optical system of the camera module 10; - the axis is the optical axis of the camera module 10; and - the angle has a sufficient value so that the area of interest is inscribed in the cone.

[0095] More preferably, the control device 14 is configured to generate the orientation signal so as to control the mobile support. 12 to orient the camera module 10 according to a movement speed (linear and / or angular speed) depending on a distance between a newly detected area of interest and a previous area of interest.

[0096] Preferably, such a speed is an increasing function of the distance between the newly detected area of interest and the previous area of interest.

[0097] Such a feature is advantageous, as it helps to reduce the registration time when the distance between the new area of interest and the previous area of interest is large.

[0098] Advantageously, for each camera module 10, and for each image acquired by said camera module 10, the control device is configured to write, in a memory (not shown), in association with said image, corresponding orientation information.

[0099] For each acquired image, such orientation information is representative of an orientation of the corresponding camera module relative to the respective mobile support, at the time of acquisition of said image. Preferably, the orientation information is, in addition, representative of a position of the mobile support in a predetermined reference frame.

[0100] Such a feature is advantageous, as such recording allows possible subsequent calculations of parallax modification from the acquired images.

[0101] A second embodiment of the imaging system according to the invention is illustrated in Figure 4.

[0102] The imaging system 2 of Figure 4 is distinguished from the imaging system 2 of Figure 1 in that the control device 14 is configured to detect the area of interest 6 as a function of a displayed area 42 of the displayed image 20, on which the interest of the observer 8 is focused. More precisely, the area of interest 6 is the part of the scene 4 which is represented, in the displayed image 20, by the displayed area 42 on which the interest of the observer 8 is focused.

[0103] For example, the control device 14 is configured to detect the displayed area 42 as a region around a point of intersection of a direction D of gaze of the observer 8 (and / or with a pointing direction of the observer 8) with the display medium 18.

[0104] Alternatively, and as shown in FIG. 5, the imaging system 2 comprises two display supports 18. More precisely, each display support 18 is intended to present an image 20 to a respective eye 44 of the observer 8.

[0105] In this case, each display medium 18 is associated with a respective camera module 10 and is configured to display each image acquired by the corresponding camera module 10.

[0106] Furthermore, in this case, the imaging system 2 comprises two imaging devices 16, each intended to image a respective eye 44 of the observer 8.

[0107] In this case, the control device 14 is, in particular, configured to detect an area of interest 6 associated with each eye 44 of the observer from each of the images 20 which are displayed to it and from the signals delivered by the two imaging devices 16. More precisely, for each eye 44, the corresponding area of interest 6 is the part of the scene 4 which is represented, in the respective displayed image 20, by a respective displayed area 42 on which the interest of said eye 44 of the observer is focused.

[0108] Furthermore, in this case, the processing device 8 is configured to calculate, during the signal generation step 34, a combined area of interest from the area of interest detected for each eye 44 of the observer.

[0109] Preferably, in this case, at a given instant, the combined area of interest is the result of the superposition (for example, a union or an intersection) of the areas of interest detected for each eye 44. In this way, the combined area of interest is indicative of all the displayed areas 42 of the displayed images 20 on which the interest of the observer is focused (through each of his eyes 44).

[0110] Furthermore, in this case, the control device 14 is configured to generate the orientation signal to control an adjustment of the movable support 12 associated with each camera module 10 such that, for each camera module 10, the at least one predetermined pixel of the corresponding acquired image (i.e., in this case, of the corresponding displayed image) is representative of a point of the combined area of interest.

[0111] As a result, thanks to the orientation signal, the two acquired images correspond as best as possible, that is to say that a maximum number of points of the scene 4 are represented by pixels of the images acquired by each of the two camera modules 10.

[0112] Such a feature is advantageous in the case of such a stereoscopic display. Indeed, in such an imaging system 2, the distance difference between the camera modules 10 gives a disparity effect between the two acquired images, resulting in an impression of a 3D view. Consequently, such an orientation control results in an automatic correction of parallax error.

[0113] Such parallax error correction is advantageous, as it allows the imaging system 2 to create a more realistic depth perception. By adjusting the parallax, the 3D effect is more comfortable for the viewer 8, this helps to reduce the eye strain of the viewer 8 and minimizes unwanted distortions.

[0114] Advantageously, if this orientation is not possible, the control device 14 is configured to correct the parallax error by sliding (i.e. shifting) one acquired image at least to obtain a better match between the two images.

[0115] Optionally, for each of the embodiments described previously, the control device 14 is, in addition, configured to control an adjustment of each camera module 10 (and in particular of the corresponding optical system) as a function of the result of the detection of the area of interest 6.

[0116] Such a feature is advantageous, insofar as it allows the control device 14 to automatically adjust the focus of the camera module 10 on a specific part of the scene 4 (namely the detected area of interest 6), in particular to ensure that the representation of the area of interest 6 is clear in the acquired image.

[0117] In this case, the control device 14 is preferably configured to generate, during the signal generation step 34, a focusing signal for the camera module 10. More specifically, the control device 14 is configured to generate the focusing signal to control an adjustment of the optical system of the camera module 10 so that at least one point of the detected area of interest 6 belongs to a sharpness interval of the camera module 10.

[0118] Such a sharpness interval, between planes PI and P2 of Figure 6, is defined as an interval: - comprising a point OF located at a distance from the camera module 10 equal to a focusing distance F of the camera module 10; and - having an extent E, along the optical axis A of the camera module 10, equal to the depth of field of the camera module 10.

[0119] For example, the control device 14 is configured to generate the focusing signal as a function of distance information delivered by a telemetry device and representative of the distance at which the area of interest 6 is located relative to the camera module 10.

[0120] According to another example, the control device 14 is configured to generate the focusing signal to maximize a sharpness of the portion of the acquired image which is representative of the area of interest 6.

[0121] According to yet another example, the control device 14 is configured to generate the focusing signal according to a known method called “phase detection autofocus”. In this case, the camera module 16 comprises at least one pair of matched photodetectors arranged to image the same point of the scene 4, and is configured so that each photodetector of the same pair is respectively illuminated by two complementary angular sectors whose union corresponds to all of the light coming from the optical system of the camera module 16. In addition, the control device 14 is configured to measure a luminous flux received by each photodetector of at least one pair of matched photodetectors which image a point of the area of interest 6 (called “photodetectors of interest”). More precisely still, the control device 14 is configured to control the camera module 16 in order to modify its focusing distance in a direction which depends on the difference in luminous flux received by the photodetectors of each pair of photodetectors of interest. When the luminous flux measured for the photodetectors of at least one same pair of photodetectors of interest is equal, the acquired image is considered to be sharp in its part representative of the area of interest 6. Functioning

[0122] The operation of the imaging system 2 will now be described with reference to Figure 1.

[0123] During the detection step 32, the control device 14 detects, for the observer 8, a current area of interest 6 corresponding to the scene 4, for the current moment.

[0124] Then, during the signal generation step 34, the control device 14 generates an orientation signal for the camera module 10 to control an orientation of the camera module 10 so that, for at least one image acquired by the camera module 10 at a time subsequent to the current time, at least one predetermined pixel of the acquired image is representative of a point in the current area of interest 6.

[0125] A similar operation is provided for the imaging device 2 described in FIG. 4, except that the area of interest 6 is detected from a displayed image 18 representative of the scene 4.

[0126] Of course, the invention is not limited to the examples which have just been described.

Claims

CLAIMS 1. Method for controlling at least one camera module (10), each camera module (10) being configured to acquire at least one image representative of a scene (4), the method being implemented by computer and comprising the steps: - detection (32), for an observer (8), of a current area of interest (6) corresponding to the scene (4), the current area of interest (6) being associated with a current instant; and - for each camera module (10), generation (34) of an orientation signal to control an orientation of said camera module (10) so that, for at least one image acquired by said camera module (10) at a time subsequent to the current time, at least one predetermined pixel of said acquired image is representative of a point of the current area of interest (6).

2. Control method according to claim 1, wherein the at least one predetermined pixel is a central pixel of the acquired image.

3. Control method according to claim 1 or 2, wherein the detection (32) of the area of interest (6) depends on an output of an imaging device (16) arranged to image the observer (8).

4. Control method according to any one of claims 1 to 3, further comprising: - an association of a neutral perimeter (32) with the detected area of interest (6), the neutral perimeter (32) being a region of space comprising the current area of interest (6); and - for each camera module (10) oriented according to the current area of interest (6), a command to immobilize said camera module (10) as long as the areas of interest detected subsequent to the current area of interest (6) are included in the neutral perimeter (32) associated with the current area of interest.

5. Control method according to any one of claims 1 to 4, wherein the orientation signal is a signal for controlling an orientation of each camera module (10) according to a movement speed depending on a distance between a newly detected area of interest and a previous area of interest.

6. A control method according to claim 5, wherein the movement speed is an increasing function of the distance between the newly detected area of interest and the previous area of interest.

7. Method according to any one of claims 1 to 6, further comprising a display of a first image (18) of the scene (4) acquired by a first camera module (10) intended for the right eye (44) of the observer (8), and of a second image (18) of the scene (4) acquired by a second camera module (10), distinct from the first camera module, intended for the left eye (44) of the observer, the generation of the orientation signal comprising a calculation of a combined area of interest from the area of interest (6) detected for the right eye and the area of interest (6) detected for the left eye, the generated orientation signal being a function of the calculated combined area of interest.

8. Method according to any one of claims 1 to 7, further comprising, for each camera module (10), and for each image acquired by said camera module (10), a recording, in association with said acquired image, of corresponding orientation information representative of an orientation of said camera module (10) relative to a respective mobile support (12), at the time of acquisition of said image, the orientation information being, preferably, also representative of a position of said mobile support (12) in a predetermined reference frame.

9. Control method according to any one of claims 1 to 8, further comprising, for each camera module (10), a generation of a focusing signal to control an adjustment of an optical system of said camera module (10) so that at least one point of the detected area of interest (6) belongs to a sharpness interval of the camera module (10), the sharpness interval being an interval: - comprising a point (OF) located at a distance from the camera module equal to a focusing distance (F) of the camera module; and - having an extent (E), along an optical axis of the camera module, equal to the depth of field of the camera module.

10. Method according to claim 9, in which each camera module (10) comprises at least one pair of matched photodetectors arranged to image the same point of the scene (4), the focusing signal being a function of a difference in light flux received by each photodetector of at least one pair of matched photodetectors imaging the area of interest (6).

11. Method according to claim 9 or 10, in which the focusing signal is a function of: - distance information between each camera module and at least one point in the area of interest, delivered by a telemetry device; and / or - a sharpness value of the part of the acquired image representative of the area of interest.

12. A computer program comprising executable instructions which, when executed by a computer, implement the steps of the method according to any one of claims 1 to 11.

13. Control device (14) for controlling at least one camera module (10), each camera module (10) being configured to, in use, acquire at least one image representative of a scene (4), the control device (14) being configured to: - detect, for an observer (8), a current area of interest (6) corresponding to the scene (4), the current area of interest (6) being associated with a current instant; and - for each camera module (10), generating an orientation signal to control an orientation of said camera module (10) so that, for at least one image acquired by said camera module (10) at a time subsequent to the current time, at least one predetermined pixel of said acquired image is representative of a point of the current area of interest (6).

14. Imaging system comprising a control device according to claim 13, at least one camera module configured to deliver at least one image representative of an acquired scene, and, for each camera module, a mobile support on which said camera module is mounted, the control device being connected to each mobile support to control an orientation of the corresponding camera module.

15. The imaging system of claim 14, further comprising a display medium configured to display at least one image acquired by at least one camera module.

Citation Information

Patent Citations

  • Method and device for object recognition by analysis of digital image signals representative of a scene

    EP3070643B1

  • Method and apparatus for determining a convergence angle of a stereo camera

    US20120062707A1

  • Method of providing object image based on object tracking

    US20170201723A1

  • Predictive camera control system and method

    US20180077345A1