Method for imaging and representing a scene, associated imaging device and electronic apparatus

By using multiple camera modules with varying field angles for panoramic image acquisition and dynamic field angle adjustment, the method enhances detail in distant areas of panoramic images, addressing the lack of clarity in traditional panoramic imaging.

WO2026003443A1PCT designated stage Publication Date: 2026-01-02FOGALE OPTIQUE
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
PCT/FR2024/050848
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-06-27
Publication Date
2026-01-02

AI Technical Summary

Technical Problem

Existing panoramic imaging methods often lack detail in the central part of the image, particularly in the band around the horizon line, leading to unsatisfactory zooming capabilities for distant areas.

Method used

Implementing an imaging device with multiple camera modules having different field angles, allowing for simultaneous or asynchronous image acquisition, generation of panoramic images, and construction of an enriched panoramic image by combining these images, followed by dynamic field angle adjustment for enhanced detail and resolution.

Benefits of technology

Enriched panoramic images provide a richer representation of the scene with improved detail in distant areas, enabling personalized and navigable display on screens.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure FR2024050848_02012026_PF_FP_ABST
    Figure FR2024050848_02012026_PF_FP_ABST
Patent Text Reader

Abstract

The invention relates to a method for imaging a scene (15), implementing an imaging device (4) comprising a plurality of camera modules (10), each camera module (10) comprising an optical lens (12) associated with an image sensor (14), the respective optical lenses (12) of the camera modules (10) having different field angles, the method comprising the steps of: - for each of at least two camera modules (10) of the imaging device (4): • obtaining a plurality of images, acquired by the camera module, of the scene (15), the imaging device (4) being in motion; • generating a panoramic image from the plurality of images acquired by the camera module (10); and - constructing (28) an enriched panoramic image from at least two generated panoramic images associated with different field angles.
Need to check novelty before this filing date? Find Prior Art

Description

Method for imaging and representing a scene, imaging device and associated electronic apparatus DESCRIPTION technical field

[0001] The present invention relates to a method for imaging a scene.

[0002] The invention also relates to a computer program, a method for representing a scene, an imaging device and an electronic apparatus comprising such an imaging device.

[0003] The invention applies to the field of capturing images of a scene. State of the art

[0004] It is known to use an electronic device equipped with an imaging device in a so-called "panoramic" mode to image a scene.

[0005] In this mode of operation, a user moves the imaging device, for example, by rotating it gradually around an axis. In this case, software within the imaging device controls the successive acquisition of images by a camera module of said device, with the successively acquired images exhibiting non-zero spatial overlap. In other words, two successive images include, at least partially, the same part of the scene.

[0006] In addition, the software generates a panoramic image by merging the acquired images, at the level of their overlapping areas (which correspond, for two distinct images, to the pixels representing the same points of the scene).

[0007] However, such a method does not provide complete satisfaction.

[0008] Indeed, the central part of the panoramic image often lacks detail.

[0009] In particular, when the scene is a landscape, there is often a band in the distance within the field of view, below and / or around the horizon line, which is of interest to the user because it is rich in buildings, natural elements (trees, animals, vehicles, installations, etc.), ships, sailboats, and so on. However, such a band, corresponding to a vast expanse, is geometrically projected onto a small area of ​​the camera module's sensor, so that the acquired image lacks definition in the portion representing this band (i.e., the horizon line). Consequently, zooming in on such a panorama, and especially on the band described above, is often unsatisfactory due to the lack of detail in the corresponding part of the panoramic image.

[0010] Conversely, this lack of detail is often less pronounced in the portion of the panoramic image representing the scene close to the user during image acquisition, because this area is geometrically projected onto a larger area of ​​the sensor, requiring more pixels for the same extent (or surface) of the scene. Consequently, zooming in on objects close to the user will be more effective than zooming in on the same area further away.

[0011] One object of the present invention is to remedy at least one of the drawbacks of the prior art.

[0012] Another objective of the invention is to propose a method of panoramic image acquisition in which the central part of the image (in particular when it corresponds to a distant area in the field of vision) presents a satisfactory level of detail.

[0013] To this end, the invention relates to a method of the aforementioned type, implementing an imaging device comprising a plurality of modules camera, each camera module comprising an optical lens associated with an image sensor, the respective optical lenses of said camera modules having different field angles, the process being implemented by computer and comprising the steps: - for each of at least two camera modules of the imaging system: • obtaining a plurality of images acquired by said camera module of said scene, the imaging device being in motion; • generation of a panoramic image from the plurality of images acquired by said camera module; and - construction of an enriched panoramic image from at least two generated panoramic images associated with different field angles.

[0014] Indeed, enhanced panoramic images allow for a richer representation of the scene and include more information compared to a standard panoramic image. Therefore, enhanced panoramic images can be used to display the scene on a screen, such as a display or projection surface, in a way that is personalized for a user and allows that user to navigate within the scene displayed on the screen.

[0015] Advantageously, the process according to the invention has one or more of the following characteristics, taken individually or in any technically feasible combination:

[0016] The enhanced panoramic image is a stack of images, including at least two panoramic images generated from images acquired at different field angles;

[0017] for at least two camera modules, the acquisition of images by said camera modules is simultaneous;

[0018] for at least two camera modules, the acquisition of images by said camera modules is not synchronous;

[0019] an image acquisition frequency decreases as a function of the field angle;

[0020] for at least two camera modules, the respective panoramic images include at least one of the same object represented at a different position in the scene, the method further including a modification of all or part of said panoramic images to standardize a position of said object in the representation of the scene by said panoramic images;

[0021] The plurality of camera modules includes at least: - a wide-angle module, preferably with a field of view greater than 60°; - a module with a standard field of view, preferably with a field of view of 45°; and / or - a telephoto lens module, preferably with a field of view of less than 45°;

[0022] for at least one camera module, the generation of the corresponding panoramic image includes the suppression, in at least a part of the images acquired by said camera module, of the same object appearing in overlapping areas of said images.

[0023] According to another aspect of the invention, a computer program is proposed comprising executable instructions which, when executed by computer, implement the steps of the process as defined above.

[0024] The computer program can be in any computer language, such as for example machine language, C, C++, JAVA, Python, etc.

[0025] According to another aspect of the invention, a method is proposed for representing a scene on a display medium, based on an image enhanced panoramic view obtained by implementing the process as defined above, the representation process comprising the following steps: - display of a first panoramic image acquired according to a current field angle; - updating the current field angle based on a received instruction to modify the field angle; and - display of a second panoramic image associated with the same enhanced panoramic image acquired according to the updated current field angle.

[0026] Advantageously, the representation method according to the invention has one or more of the following characteristics, taken individually or in combination:

[0027] The instruction to modify the field of view is a zoom on an area of ​​interest in the displayed panoramic image, the updated field of view corresponding to the field of view of the panoramic image, among the panoramic images associated with the same enhanced panoramic image, in which the area of ​​interest is represented and: - which has the smallest field of view; and / or - in which the area of ​​interest has the best resolution and / or sharpness;

[0028] the display of the second panoramic image includes, in addition, a display of part of at least one other panoramic image associated with the same enhanced panoramic image, to occupy an entire display area of ​​a display medium.

[0029] According to another aspect of the invention, an imaging device is proposed comprising a plurality of camera modules, each camera module comprising an optical lens associated with an image sensor, the respective optical lenses of said camera modules having different field angles, the imaging device further comprising a control module configured to: - for each of at least two camera modules: • to command the acquisition of a plurality of images of the same scene by said camera module; • generate a panoramic image from the plurality of images acquired by said camera module; and - construct an enriched panoramic image from at least two generated panoramic images associated with different field angles.

[0030] According to another aspect of the invention, an electronic device comprising an imaging device as defined above is proposed.

[0031] Advantageously, the electronic device according to the invention has the following characteristic:

[0032] The electronic device also includes a display stand, and the control module is further configured to: - to control the display support so as to display a panoramic image acquired according to a current field angle, the panoramic image being associated with a panoramic image enriched with a scene; - update the current field angle based on a received instruction to modify the field angle; and - commands the display support to display a panoramic image associated with the same enhanced panoramic image acquired according to the updated current field angle.

[0033] For example, an electronic device is a user device such as a smart phone ("smartphone"), tablet, computer, etc.

[0034] In another example, the electronic device is a television, a camera, a camcorder, a virtual reality headset and / or an augmented reality headset.

[0035] In another example, the electronic device is a medical imaging device, such as an endoscope, an ultrasound machine, etc.

[0036] In yet another example, the electronic device is a vehicle, semi-autonomous, autonomous or not, such as a land vehicle (by example, a car), a flying vehicle (for example, a drone, an airplane, a helicopter) or a marine vehicle (for example, a boat or a submarine). Brief description of the figures

[0037] The invention will be better understood upon reading the following description, given solely by way of non-limiting example and made with reference to the accompanying drawings in which:

[0038] Figure 1 is a schematic representation of an electronic device according to the invention;

[0039] Figure 2 is a flowchart of a method for imaging a scene according to the invention; and

[0040] Figure 3 is a flowchart of a method for representing the image scene according to the method of Figure 2.

[0041] It is understood that the embodiments described below are by no means exhaustive. In particular, variants of the invention may be conceived comprising only a selection of the features described below, isolated from the other features described, if this selection of features is sufficient to confer a technical advantage or to differentiate the invention from the prior art. This selection includes at least one preferably functional feature without structural details, or with only a portion of the structural details if this portion alone is sufficient to confer a technical advantage or to differentiate the invention from the prior art.

[0042] In particular, all the variants and embodiments described can be combined with each other if there are no technical obstacles to this combination.

[0043] In the figures and in the rest of the description, elements common to several figures retain the same reference. Detailed description

[0044] An electronic device 2 according to the invention is illustrated by figure 1.

[0045] The electronic device 2 includes, in particular, an imaging device 4.

[0046] Preferably, the electronic device 2 also includes a display support 6.

[0047] Display support 6 can be any type of display support, for example a display screen (such as a touch screen, etc.) or a projector projecting images onto a display surface.

[0048] Electronic device 2 is, for example, a digital camera, a camcorder, a smartphone, a tablet, a computer, etc.

[0049] The imaging device 4 comprises a control module 8 and at least two camera modules 10.

[0050] More specifically, each camera module 10 includes a lens 12 associated with a sensor 14, the sensor 14 being arranged to acquire an image of a scene 15 viewed through the lens 12. The lens 12 and the sensor 14 are, for example, mounted in a housing 16 to form said camera module 10.

[0051] Each camera module 10 is associated with a corresponding angle of view, defined as the angle that the camera module 10 can capture.

[0052] For the purposes of this invention, "angle of view" means the angle at which a scene is imaged, relative to the optical axis of a lens or camera module.

[0053] In particular, at least two camera modules 10 of the imaging device 4 exhibit different field angles.

[0054] Preferably, the imaging device 4 includes at least one camera module called "wide angle" (or "short focal length"), one camera module called "standard field angle" (or "normal focal length") and / or one camera module called "telephoto" (or "long focal length").

[0055] Such a wide-angle module preferably has a field of view greater than 60°.

[0056] Furthermore, such a module with a standard field angle preferably has a field angle of 45°.

[0057] In addition, such a telephoto module preferably has a field of view angle of less than 45°.

[0058] The control module 8 is connected to each camera module 10 to control the operation of said camera module 10, and to receive the images acquired by said camera module 10.

[0059] Preferably, the control module 8 is also connected to the display support 6 for the transmission of image(s) to be displayed, as will be described later. Imaging process

[0060] More specifically, the control module 8 is configured to implement a process 20 (figure 2) to image scene 15.

[0061] Preferably, the control module 8 is configured to implement the process 20 in response to a specific instruction, such as a user instruction. Such an instruction corresponds, in particular, to the activation of a particular operating mode of the imaging device 4, generally called "panoramic", "panoramic", or "enhanced panoramic".

[0062] The process 20 comprises an acquisition step 24, a panoramic image generation step 26 (called the "generation step") and a step 28 of enriched panoramic image construction (called "construction stage").

[0063] More specifically, the control module 8 is configured to, during the acquisition step 24, control the operation of at least two separate camera modules 10, presenting different field angles.

[0064] More specifically, the control module 8 is configured to control each of said at least two camera modules 10 to acquire a plurality of respective images of said scene 15.

[0065] During the implementation of acquisition step 24, the imaging device 4 is in motion.

[0066] In particular, the imaging device 4 is in motion to perform a scan of the scene 15. For example, the imaging device 4 is worn by a user and rotated around a vertical axis (i.e., parallel to a direction of the gravitational field). Such an axis is not necessarily physical and can be dynamically created by the movement of the user holding the imaging device 4, thus forming a virtual axis.

[0067] Subsequently, each of the said at least two camera modules 10 controlled by the control module 8 during the acquisition step 24 will be called the "active module".

[0068] Advantageously, the control module 8 is configured to control the active modules in order to simultaneously acquire images of the scene 15 (within the opening time, which may be different from one camera module 10 to another).

[0069] Such a characteristic is advantageous, insofar as it leads to substantially identical content in the parts of scene 15 imaged in common by the active modules 10.

[0070] This is especially true in the case of the presence of a moving object in the scene: the moving object will be easier to identify and, above all, its superimposition between the different views, at the same acquisition time, will be obtained, because the object will be placed in a spatially identical way in scene 15.

[0071] Alternatively, or in addition, the control module 8 is configured to control the active modules in order to acquire images of scene 15 sequentially (i.e. asynchronously).

[0072] In this case, the control module 8 is preferably configured to impose on the active modules an acquisition frequency such that the parts of the scene 15 represented in the images acquired by each active module are found entirely in the images acquired by the active module presenting the immediately higher field angle.

[0073] In this case, the control module 8 is advantageously configured to control the active modules to acquire images at an image acquisition frequency that decreases as a function of the field angle.

[0074] For example, the acquisition frequency is a function of the speed of movement of the imaging device 4 (for example determined by the control module 8 by means of appropriate sensors).

[0075] In addition, the control module 8 is configured to, during generation step 26, generate, for each active module, an IP panoramic image from the plurality of images acquired by said active module.

[0076] The generation of an IP panoramic image from a plurality of images acquired successively by means of a camera module 10 is known to those skilled in the art.

[0077] For example, for each active module, command module 8 is configured to: - identify the overlapping areas of the corresponding acquired images; and - generate the IP panoramic image by assembling the images acquired at the level of the identified overlap areas.

[0078] Preferably, in the case of a moving object in scene 15, resulting in the presence of said object in different positions in the overlap areas of at least two acquired images, the control module 8 is configured to remove said object from a part of said acquired images.

[0079] For example, command module 8 is configured to replace the pixels representing said moving object in an acquired image with those corresponding to the background, available in one of the other acquired images.

[0080] In addition, the control module 8 is configured to, during construction step 28, construct an enriched IPE panoramic image from the IP panoramic images generated at the end of generation step 26.

[0081] More specifically, the control module 8 is configured to combine the generated IP panoramic images to obtain the enriched IPE panoramic image of scene 15.

[0082] Preferably, if two (or more) panoramic images include at least one of the same objects shown at a different position in the scene 15 (for example, due to object movement during asynchronous image acquisition by the corresponding camera modules), the control module 8 is configured to modify all or part of said panoramic images to standardize the object's position between them. In other words, after such a modification, the object appears at the same position in the scene in each of the modified panoramic images (hereafter simply referred to as "panoramic images").

[0083] Preferably, the command module 8 is configured to combine the generated IP panoramic images into an image stack, to form the enriched IPE panoramic image.

[0084] For example, such a stack of images is represented by a set of matrices of values, each matrix corresponding to one of the images IP panoramas from which the enriched panoramic IPE image is constructed.

[0085] Preferably, in this case, for each IP panoramic image in the stack, the corresponding matrix includes the values ​​captured by the sensor 14 of the camera module 10 used for the acquisition of said IP panoramic image.

[0086] In addition, preferably, each matrix is ​​associated with an indicative value of the field of view angle and / or an identifier of the camera module 10 with which the IP panoramic image was acquired. Such a value is optionally stored in association with the corresponding matrix, or directly included in each cell of the corresponding matrix.

[0087] For example, for any given IP panoramic image in the stack of IP panoramic images forming the enriched IPE panoramic image, each cell in the matrix includes the values: (AV, R, G, B) where: - AV is an indicative value of the field of view at which the panoramic image was acquired (for example, AV=45° for a lens with a standard field of view); and - R, G and B are respectively the values ​​of the three colours red, green and blue captured by a pixel of the sensor 14 of the corresponding camera module 10.

[0088] Alternatively, the enhanced panoramic image is represented by a single matrix of values. In this case, at least one cell of the matrix contains multiple sets of values: {(AV1, R1, G1, B1), ..., (AVn, Rn, Gn, Bn)} where: n is an integer greater than or equal to 2; AV is an indicative value of the field angle at which the i-th panoramic image was acquired; and Ri, Gi and Bi are respectively the values ​​of the three colours red, green and blue captured by a pixel of sensor 14 of camera module 10 corresponding to said i-th panoramic image.

[0089] Alternatively, the value sets do not include the AVi field angle value. In this case, the order and number in which each value set is stored is representative of each camera module, and is therefore indicative of the field angle.

[0090] Of course, some cells in the matrix may contain fewer sets of values ​​than the IP panoramic images used to generate the IPE enhanced panoramic image. This is due in particular to the fact that some parts of scene 15 may not be imaged by the camera modules 10 with the smallest field of view.

[0091] Alternatively, the single matrix is ​​sized to cover the widest field angle associated with IP panoramic images, but with a resolution (number of cells per row and per column) corresponding at least to the resolution of the best angularly resolved field angle.

[0092] For example, if the IP panoramic image set includes: - a panoramic image from a wide-angle module producing 2048x1600 pixels with a field of view of 120°x93°; - a panoramic image from a standard camera module producing 4096x3072 pixels with a field of view of 45°x33.7°; and - a panoramic image from a telephoto module producing 2048x1600 pixels with a field of view of 5°x3.9°, then the single matrix covers at least the 120°x93° of the largest available field of view, with a resolution (in pixels / 0field of view) finer than the finest available resolution, namely 409 pixels / °.

[0093] In this case, the value of each cell, when not available in the corresponding panoramic image (for example, due to insufficient resolution) is likely to be obtained by interpolation, or by flattening (so as to retain only the RGB data of the higher resolution lens covering a given field region).

[0094] The control module 8 is also configured to save the IPE enhanced panoramic image in a memory of the imaging device 4, the electronic device 2, or remotely from the electronic device 2 (for example on a remote server or in the cloud). Representation of the scene

[0095] As previously stated, the control module 8 is preferably connected to the display support 6 for the transmission of images to be displayed.

[0096] More specifically, the control module 8 is configured to implement a method 30 for representing scene 15 on the display support 6, from the enriched panoramic image IPE associated with said scene 15.

[0097] More specifically, and as illustrated by Figure 3, the process 30 comprises a first display step 34, a processing step 36 and a second display step 38.

[0098] In particular, the control module 8 is configured to, during the first display step 34, control the display support 6 to display the scene 15 according to a given current field angle.

[0099] In other words, for the IPE enriched panoramic image representative of scene 15, the control module 8 is configured to transmit, to the display support 6, the corresponding IP panoramic image which is associated with the current field angle, for its display.

[0100] For example, during the initial implementation of the first display step 34, the current field of view is the largest field of view. In other words, during the initial implementation of the first display step 34, the control module 8 is configured to transmit the IP panoramic image corresponding to the largest field of view to the display support 6. In this way, the entire scene 15 is displayed by the display support 6.

[0101] The IP panoramic image displayed at the end of the first display step 34 will subsequently be called the "initial panoramic image".

[0102] In addition, the control module 8 is configured to, during processing step 36, process a received instruction to modify the field angle, and update the current field angle accordingly.

[0103] The instruction to change the field angle is, for example, entered manually by a user observing the displayed scene, for example through a user interface such as a keyboard, mouse, touch screen, etc.

[0104] Alternatively, or in a complementary manner, the modification instruction is detected automatically, for example, by detecting an area of ​​interest in the displayed scene 15 on which the user's attention is focused.

[0105] In particular, an instruction to change the field of view corresponds to the user zooming in on a part of the initial panoramic image displayed (for example, its central banner).

[0106] If, after zooming, the ZI part of scene 15 (called "area of ​​interest") which is displayed by the display support 6 is represented on one or more other panoramic image(s) IP (called "candidate panoramic images") associated with the same enriched panoramic image IPE, then the instruction to modify the field angle corresponds to the selection of the smallest field angle associated with the candidate panoramic images.

[0107] In this case, the updated current field angle corresponds to said smallest field angle associated with the candidate panoramic images.

[0108] Alternatively, or in addition, the field angle modification instruction corresponds to the selection of the panoramic image field angle in which the area of ​​interest has the best resolution and / or sharpness.

[0109] In particular, if the smallest field angle does not lead to the best resolution or sharpness for the representation of the area of ​​interest of the corresponding candidate panoramic image, at processing step 36, a candidate panoramic image with better resolution, or even better sharpness in the area of ​​interest under consideration, could be selected.

[0110] Such sharpness is, for example, determined by analysis of the highest variance, zone by zone, in the panoramic image.

[0111] This feature is advantageous because, in some cases, the smallest (and highest resolution) 10-inch camera module might result in insufficient sharpness of the area of ​​interest (ZI) in the corresponding panoramic image due to a focal length that could not be set (for example, because it was beyond the available range) or was not set to a suitable value. In such cases, a camera module with a larger (and lower resolution) field of view can lead to greater sharpness of the ZI in the corresponding panoramic image.

[0112] Furthermore, the control module 8 is configured, during the second display step 38, to command the display support 6 to display the scene 15 according to the updated current field angle. In other words, the control module 8 is configured to transmit, to the display support 6, the IP panoramic image (referred to as the "selected panoramic image") which is associated with the updated current field angle, for its display.

[0113] In the case of the zoom described with reference to processing step 36, the control module 8 is preferably configured to control the display support 6 in order to display, at the end of the second display step 38, the part of the selected panoramic image which is representative of the area of ​​interest ZI of the scene 15, mentioned previously.

[0114] Advantageously, the control module 8 is configured to supplement the panoramic image selected for display with one or more panoramic image(s) or part(s) of a panoramic image(s). The field of view is adjusted to be lower, equal, or higher than the periphery of the selected panoramic image representing the area of ​​interest, so as to occupy the entire display area of ​​the display support 6, where possible. In this way, the image of the second display 38 is adapted to the format of the display support 6 (which may extend beyond the selected panoramic image).

[0115] Advantageously, the control module 8 is configured to implement the processing steps 36 and second display 38 on each detection of a new field angle modification instruction.

[0116] This is advantageous, since such a feature allows the display of the panoramic image with the best resolution for the current area of ​​interest (ZI). Functioning

[0117] The operation of electronic device 2 will now be described.

[0118] To image scene 15, the control module 8 implements process 20.

[0119] As mentioned previously, the control module 8 implements process 20, preferably in response to a specific instruction, such as a user instruction, in particular the activation of an "enhanced panoramic" mode.

[0120] More specifically, during acquisition step 24, the control module 8 controls the operation of at least two separate camera modules 10 (called "active modules"), which have different field angles. In this way, a plurality of respective images of said scene 15 are acquired, with the imaging device 4 in motion.

[0121] Then, during generation step 26, the control module 8 generates, for each active module, an IP panoramic image from the plurality of images acquired by said active module.

[0122] Then, during construction step 28, the control module 8 constructs an enriched panoramic IPE image from the IP panoramic images generated at the end of generation step 26.

[0123] Preferably, the control module 8 saves the enhanced panoramic image IPE in a memory of the imaging device 4, the electronic device 2, or remotely from the electronic device 2 (for example on a remote server or in the cloud).

[0124] Preferably, to represent scene 15, the control module 8 implements process 30.

[0125] In particular, during the first display step 34, the control module 8 commands the display support 6 to display the scene 15 according to a given current field angle.

[0126] In other words, the control module 8 transmits to the display support 6 the panoramic image IP associated with the enriched panoramic image IPE which is representative of the scene 15, and which was acquired at the current field angle.

[0127] For example, during the first implementation of the first display step 34, the current field angle is the largest field angle.

[0128] Then, during processing step 36, the control module 8 detects and processes a received instruction to modify the field angle, and updates the current field angle accordingly.

[0129] For example, in the case of zooming on the currently displayed IP panoramic image, the control module 8 determines whether, after zooming, the area of ​​interest currently displayed by the display support 6 is represented on one or more other candidate IP panoramic image(s) associated with the same enriched IPE panoramic image. In this In this case, command module 8 determines that the field of view modification instruction corresponds to the selection of the smallest field of view associated with the candidate panoramic images (or alternatively, to the selection of the field of view associated with the panoramic image for which the area of ​​interest has the best resolution or sharpness). In this case, the updated current field of view corresponds to the selected field of view.

[0130] Furthermore, during the second display step 38, the control module 8 commands the display support 6 to display the scene 15 according to the updated current field angle. In other words, the control module 8 transmits the selected panoramic IP image, which is associated with the updated current field angle, to the display support 6 for display.

[0131] In the case of the zoom described with reference to processing step 36, the control module 8 preferably controls the display support 6 in order to display, at the end of the second display step 38, the part of the selected panoramic image which is representative of the area of ​​interest of the scene 15.

[0132] Advantageously, the control module 8 again implements the processing steps 36 and second display 38 at each detection of a new field angle modification instruction.

[0133] Of course, the invention is not limited to the examples that have just been described.

Claims

DEMANDS 1. A method (20) for imaging a scene (15), implementing an imaging device (4) comprising a plurality of camera modules (10), each camera module (10) comprising an optical lens (12) associated with an image sensor (14), the respective optical lenses (12) of said camera modules (10) having different field angles, the method (20) being implemented by computer and comprising the steps: - for each of at least two camera modules (10) of the imaging device (4): • obtaining (24) a plurality of images acquired by said camera module of said scene (15), the imaging device (4) being in motion; • generation (26) of a panoramic image (PI) from the plurality of images acquired by said camera module (10); and - construction (28) of an enriched panoramic image (IPE) from at least two generated panoramic images (IP) associated with different field angles.

2. Method (20) according to claim 1, wherein the enriched panoramic image (IPE) is a stack of images, comprising at least two panoramic images (IP) generated from images acquired at different field angles.

3. Method (20) according to claim 1 or 2, wherein, for at least two camera modules (10), the acquisition of images by said camera modules (10) is simultaneous.

4. A method according to any one of claims 1 to 3, wherein, for at least two camera modules (10), the acquisition of images by said camera modules (10) is not synchronous.

5. Method (20) according to claim 4, wherein an image acquisition frequency is decreasing as a function of the field angle.

6. Method (20) according to claim 4 or 5, wherein, for at least two camera modules (10), the respective panoramic images (PI) include at least one of the same object represented at a different position in the scene (15), the method (20) further comprising a modification of all or part of said panoramic images (PI) to standardize a position of said object in the representation of the scene (15) by said panoramic images (PI).

7. A method (20) according to any one of claims 1 to 6, wherein the plurality of camera modules (10) comprises at least: - a wide-angle module, preferably with a field of view greater than 60°; - a module with a standard field of view, preferably with a field of view of 45°; and / or - a telephoto lens module, preferably with a field of view of less than 45°.

8. Method (20) according to any one of claims 1 to 7, wherein, for at least one camera module (10), the generation of the corresponding panoramic image (PI) includes a suppression, in at least a part of the images acquired by said camera module (10), of the same object appearing in overlapping areas of said images.

9. Computer program comprising executable instructions which, when executed by a computing device, implement the steps of the process according to any one of claims 1 to 8.

10. A method (30) for representing a scene (15) on a display medium (6), from an enhanced panoramic image (EPI) obtained by implementing the method (20) according to any one of claims 1 to 8, the representation method (30) comprising the steps: - display (34) of a first panoramic image (IP) acquired according to a current field angle; - updating (36) the current field angle based on a received instruction to modify the field angle; and - display (36) of a second panoramic image (IP) associated with the same enhanced panoramic image (IPE) and acquired according to the updated current field angle.

11. Method (30) according to claim 10, wherein the field angle modification instruction is a zoom on an area of ​​interest of the displayed panoramic image, the updated field angle corresponding to the field angle of the panoramic image (PI), among the panoramic images (PI) associated with the same enhanced panoramic image (EPI), in which the area of ​​interest is represented and: - which has the smallest field of view; and / or - in which the area of ​​interest has the best resolution and / or the best sharpness.

12. Method (30) according to claim 10 or 11, wherein the display (36) of the second panoramic image further comprises a display of a part of at least one other panoramic image (PI) associated with the same enhanced panoramic image (EPI), to occupy an entire display area of ​​a display support (6).

13. Imaging device (4) comprising a plurality of camera modules (10), each camera module (10) comprising an optical lens (12) associated with an image sensor (14), the respective optical lenses (12) of said camera modules (10) having different field angles, the imaging device (4) further comprising a control module (8) configured to: - for each of at least two camera modules: • to command the acquisition of a plurality of images of the same scene by said camera module; • generate a panoramic image from the plurality of images acquired by said camera module; and - construct an enriched panoramic image from at least two generated panoramic images associated with different field angles.

14. Electronic device (2) comprising an imaging device according to claim 13.

15. Electronic device (2) according to claim 14, further comprising a display support (6), the control module (8) being further configured to: - to control the display support (6) so as to display a panoramic image (IP) acquired according to a current field angle, the panoramic image (IP) being associated with an enriched panoramic image (IPE) of a scene (15); - update (36) the current field angle based on a received field angle modification instruction; and - commands the display support (6) so as to display a panoramic image (IP) associated with the same enhanced panoramic image (IPE) and acquired according to the updated current field angle.

Citation Information

Patent Citations

  • A shooting method and equipment

    CN114071009B

  • Camera switching method, and electronic device

    EP4344240A1