Photographic apparatus and control method of image photographic synthesis system
By using sensors to detect environmental information and synchronously adjust the optical characteristics of the lens unit in the image synthesis system, the problem of asynchronous optical characteristics of the fixed-focus lens unit under environmental changes is solved, achieving high-precision image synthesis and system miniaturization.
Patent Information
- Application Number
- CN202210567615.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2020-12-04
- Filing Date
- 2021-09-15
- Publication Date
- 2026-11-10
- Estimated Expiration
- 2041-09-15
AI Technical Summary
When existing image synthesis systems use lens units with fixed focus and fixed focal length, it is difficult to achieve high-precision image synthesis. Furthermore, the optical characteristics of the lens units are prone to becoming out of sync under environmental changes, which makes image synthesis difficult.
It employs multiple lens units with roughly the same specifications, uses sensors to detect environmental information, and utilizes an electric drive device to synchronously and stepwise change the optical characteristics of the lens units to adapt to environmental changes and ensure that the optical characteristics of each lens unit are consistent.
It achieves synchronization of the optical characteristics of the lens unit under environmental changes, reduces image magnification differences, improves the naturalness and accuracy of image synthesis, and reduces the data requirements of the system, thus promoting the miniaturization and cost reduction of the system.
Smart Images

Figure CN114845003B_ABST
Abstract
Description
[0001] This application is a divisional application of the application filed on September 15, 2021, with application number 2021110787564 and invention title "VR system, panoramic system photography device and control method thereof". Technical Field
[0002] This disclosure relates to image photographic compositing technology, and more particularly to a photographic apparatus and control method for an image photographic compositing system. Background Technology
[0003] VR systems and panoramic systems, which create composite images such as 3D VR (Virtual Reality) images and panoramic images by using multiple lens units to capture images from all angles and then compositing the captured images, have been widely used. These image compositing systems use lens units with fixed focus and fixed focal length. Because the characteristics of each lens unit in the image compositing system are consistent, it is easy to composite the images captured by each lens unit.
[0004] However, image compositing systems using fixed-focus, fixed-focal-length lens units sometimes fall short in handling high-precision image processing, thus creating a need for image compositing systems capable of focus adjustment. Furthermore, even when using fixed-focus, fixed-focal-length lens units, the focus position of the lens unit can change due to environmental variations such as temperature, thus requiring correction for these changes in focus position.
[0005] As is well known, the aforementioned focus adjustment and focus position correction will cause changes in the optical characteristics of the lens unit. In an image synthesis system with multiple lens units, if focus adjustment or focus position correction is performed on each lens unit, the degree of focus adjustment or focus position correction required for each lens unit may not be the same, resulting in different optical characteristics for each lens unit. Consequently, the size of the images produced by each lens unit may differ, making it difficult to synthesize the images captured by each lens unit. Summary of the Invention
[0006] In view of this, the present disclosure proposes a photographic apparatus and control method for an image photographic compositing system that ensures the performance of each lens unit and facilitates the compositing of images captured by each lens unit.
[0007] According to one aspect of this disclosure, a photographic apparatus for an image photographic synthesis system is provided. The photographic apparatus has multiple lens units of approximately the same size. The image photographic synthesis system synthesizes images captured by the multiple lens units to obtain a planar image or a three-dimensional image. The photographic apparatus includes: a sensor that detects environmental information related to the photographic apparatus; and an electric drive device that acquires detection signals output from the sensor and synchronously and stepwise changes the optical characteristics of the multiple lens units.
[0008] According to another aspect of this disclosure, a control method for a photographic apparatus of an image photographic synthesis system is provided. The photographic apparatus has multiple lens units of approximately the same specifications. The image photographic synthesis system synthesizes images captured by the multiple lens units to obtain a planar image or a three-dimensional image. The control method includes: detecting environmental information related to the photographic apparatus using a sensor; acquiring a detection signal output from the sensor; and synchronously and stepwise changing the optical characteristics of the multiple lens units.
[0009] According to the photographic apparatus and control method of the image compositing system described above, the photographic apparatus synchronously and stepwise changes the optical characteristics of multiple lens units according to changes in the environment. This divides the environmental changes into a finite number of steps, with each step representing a larger change in magnification. Therefore, the ratio of magnification differences in the image caused by deviations in each photographic optical system is small, becoming a negligible value for image compositing, thus resulting in a natural composite image. Furthermore, in cases of higher-precision compositing, the number of temperature steps is limited when inputting magnification data based on the focusing lens position of each photographic optical system to the image compositing circuit. This allows for image compositing with a smaller data volume, thereby achieving system miniaturization and cost reduction. Therefore, the performance of each lens unit can be ensured, and the compositing of images captured by each lens unit is easily achieved.
[0010] Other features and aspects of this disclosure will become clear from the following detailed description of exemplary embodiments with reference to the accompanying drawings. Attached Figure Description
[0011] The accompanying drawings, which are included in and form part of this specification, illustrate exemplary embodiments, features, and aspects of this disclosure together with the specification and serve to explain the principles of this disclosure.
[0012] Figure 1 The appearance of the camera in this embodiment is shown.
[0013] Figure 2 The circuit structure of the camera in this embodiment is shown.
[0014] Figure 3 The structure of a lens unit of the camera in this embodiment is shown.
[0015] Figure 4 The control circuit structure of the focusing lens section drive motor of each lens unit in this embodiment is shown.
[0016] Figure 5 The appearance of one lens unit of the camera in this embodiment is shown.
[0017] Figure 6 A cross-section of the focus adjustment structure of the lens unit of the camera according to this embodiment is shown.
[0018] Figure 7 yes Figure 6 The plan view of the section along line ii-ii shown.
[0019] Figure 8 This shows the relationship between temperature and the amount of movement of the focusing lens.
[0020] Figure 9 This shows the relationship between the lens magnification m, the distance a from the subject, and the distance b from the lens to the image.
[0021] Figure 10 It is a diagram used to illustrate the depth of focus.
[0022] Figure 11 The relationship between temperature and depth of focus range is shown.
[0023] Figure 12 This is a table used for setting the initial position of the lens.
[0024] Figure 13 This is a table used for setting the initial position of the lens.
[0025] Figure 14 This diagram illustrates an example of the stepping action of the focusing lens drive motor in this embodiment.
[0026] Figure 15 This is a flowchart illustrating the control method of the lens unit in this embodiment.
[0027] Figure 16 This is a flowchart illustrating the initial startup setting process of this embodiment.
[0028] Figure 17 This is a flowchart illustrating the temperature response process in this embodiment.
[0029] Figure 18 This is a flowchart illustrating the abnormal warning handling in this embodiment. Detailed Implementation
[0030] Various exemplary embodiments, features, and aspects of this disclosure will now be described in detail with reference to the accompanying drawings. The same reference numerals in the drawings denote elements that have the same or similar functions. Although various aspects of the embodiments are shown in the drawings, they are not necessarily drawn to scale unless specifically indicated otherwise.
[0031] The term “exemplary” as used herein means “serving as an example, embodiment, or illustration.” Any embodiment illustrated herein as “exemplary” is not necessarily to be construed as superior to or better than other embodiments.
[0032] Furthermore, to better illustrate this disclosure, numerous specific details are set forth in the following detailed description. Those skilled in the art will understand that this disclosure can be practiced without certain specific details. In some instances, methods, means, components, and circuits well known to those skilled in the art have not been described in detail in order to highlight the main points of this disclosure.
[0033] In this embodiment, the photographic apparatus of the image compositing system comprises multiple lens units of approximately identical specifications. The photographic apparatus synchronously and progressively alters the optical characteristics of these multiple lens units according to changes in the environment, thereby ensuring that the optical characteristics of the multiple lens units are changed to the same setting regardless of environmental changes. Since the environmental changes are divided into a finite number of steps, each step represents a significant change in magnification. Therefore, the ratio of magnification differences in the image caused by deviations in each photographic optical system is small, becoming a negligible value in image compositing, resulting in a natural composite image. Furthermore, in cases of higher-precision compositing, the number of temperature steps is limited when inputting magnification data based on the focusing lens position for each photographic optical system to the image compositing circuit. This allows for image compositing with a smaller data volume, thereby achieving system miniaturization and cost reduction. Therefore, not only is the performance of each lens unit ensured, but the compositing of images captured by each lens unit can also be easily performed.
[0034] The following example, using a camera with image compositing capabilities, illustrates the function and structure of the image compositing system in this embodiment.
[0035] Figure 1 The appearance of the camera in this embodiment is shown. For example... Figure 1 As shown, the camera has six lens units 1 to 6 with roughly the same specifications. Each lens unit 1 to 6 has an imaging sensor that converts the image into an electrical signal. The field of view of each lens unit is, for example, 120 degrees or more. Therefore, by combining the images captured by three lens units that are separated by one lens unit, it is possible to perform full-range 360-degree photography and obtain a full-range 360-degree stereoscopic image. Figure 1The camera is organized into two groups of three lens units, each separated by one lens unit.
[0036] exist Figure 1 In the example, adjacent lens units 1 and 2 each have a viewing angle of 120° and an optical axis tilt of 60°, thus generating a stereoscopic image that overlaps by 60°, representing half of the image. Furthermore, the same configuration exists between adjacent lens units 2 and 3, 3 and 4, 4 and 5, 5 and 6, and 6 and 1. By combining the six stereoscopic images obtained from the six lens units, a full 360° stereoscopic image is obtained.
[0037] These two lens units can be switched, thus extending the camera's lifespan. Furthermore, even if one lens unit cannot capture a full 360° view, it can be switched to the other lens unit to continue capturing 360° footage, preventing any oversights in the camera's recording.
[0038] In this embodiment, a camera with 6 lens units is used as an example, but the number of lens units of the camera is not limited to this, and can also be 2 or more, preferably 6 or more.
[0039] Figure 2 The circuit structure of the camera in this embodiment is shown. For example... Figure 2 As shown, the camera includes lens units 1-6, each with an imaging sensor 7-12, image recording devices 13-18, a memory 19, an image synthesis device 20, and an observation device 21. Lens units 1-6 are connected to image recording devices 13-18, and image recording devices 13-18 are connected to the memory 19.
[0040] Lens units 1-6 output the captured image information to image recording devices 13-18 respectively. Image recording devices 13-18 store the image information and also store it in memory 19. Image synthesis device 20 reads the image information from memory 19 and performs image synthesis based on the read image information to obtain a 360° stereoscopic image. The stereoscopic image synthesized by image synthesis device 20 is output to viewing device 21, allowing the user to observe the stereoscopic image synthesized by image synthesis device 20 through viewing device 21.
[0041] Furthermore, the camera may not have image recording devices 13-18, and the lens units 1-6 may directly output the captured image information to the memory 19. Alternatively, the camera may not have an observation device 21 but may have a wireless communication unit, through which the camera communicates with the wireless communication unit of the observation device to transmit the stereoscopic image synthesized by the camera. Alternatively, the camera may not have an image synthesis device 20 and an observation device 21 but may have a wireless communication unit, through which the camera communicates with the wireless communication unit of the image synthesis device to transmit the image information stored in the memory 19 to the image synthesis device.
[0042] Figure 3 The structure of the lens unit 1 of the camera in this embodiment is shown. Figure 3 As shown, the lens unit 1 includes a front lens section 30, an aperture 31, an aperture drive motor 32, a focusing lens section 33, a focusing lens section drive motor 34, a temperature sensor 35, an imaging sensor substrate 36, a substrate tilt adjustment screw 37, a substrate force spring 38, and a screw fixing part 39.
[0043] The front lens group 30 is the main component of the lens unit and typically includes multiple lenses. The position of the front lens group 30 is fixed and cannot be moved. The aperture stop 31 is a component used to adjust the brightness of the lens unit 1. The aperture stop drive motor 32, for example a stepper motor, drives the aperture stop 31 to adjust the brightness of the lens unit 1. The focusing lens group 33 includes one or more lenses and is movable along the optical axis. The focusing lens group drive motor 34, for example a stepper motor, drives the focusing lens group 33 to move along the optical axis, thereby moving the focal point position of the lens unit 1. Although not shown, the focusing lens group drive motors 34 of each lens unit are arranged in the same plane, and the drive shafts of the focusing lens group drive motors 34 of adjacent lens units are arranged in opposite directions. A temperature sensor 35 is disposed within the lens unit 1 and is used to measure the temperature of the lens unit 1.
[0044] An imaging sensor 7, such as a CMOS sensor, is disposed on an imaging sensor substrate 36. Two substrate tilt adjustment screws 37 pass through the portions of the imaging sensor substrate 36 located on both sides of the imaging sensor 7, and the caps of the two substrate tilt adjustment screws 37 abut against one side of each portion. Furthermore, each of the two substrate tilt adjustment screws 37 passes through a substrate force spring 38, and the ends of the two substrate tilt adjustment screws 37 opposite to their caps are threaded into screw fixing portions 39. By rotating the substrate tilt adjustment screws 37, the tilt angle of the imaging sensor substrate 36, i.e., the tilt angle of the imaging sensor 7, can be adjusted, thereby adjusting the focal position of the lens unit 1.
[0045] Figure 4The control circuit structure of the focusing lens section drive motor of each lens unit in this embodiment is shown. For example... Figure 4 As shown, temperature sensors (temperature sensors 1-6) 35, motor control circuits (M1-M6) 41, and focusing lens drive motors (M1A-M6A) 34 are correspondingly arranged. Each temperature sensor 35 detects the temperature of its corresponding lens unit and outputs the detection results to the control circuit 42. The control circuit 42 instructs the rotation of each focusing lens drive motor 34 based on the detection results of each temperature sensor 35. For example, the average temperature, maximum temperature, minimum temperature, etc., of the detection results can be used as representative temperatures, and the focusing lens drive motors of each lens unit can be controlled according to certain rules based on these representative temperatures. For example, the rotation direction and rotation amount of the focusing lens drive motors 34 can also be controlled based on the detection results of the temperature sensors 35 and the distance setting information illustrated below. Each motor control circuit 41 is connected to each focusing lens drive motor 34, and each motor control circuit 41 controls the rotation of its corresponding focusing lens drive motor 34 based on the instructions input from the control circuit 42. The motor control circuit 41 and the control circuit 42 correspond to the "electric drive device drive unit" of the present invention.
[0046] In this embodiment, the motor control circuit 41 and the temperature sensor 35 are separate and independent circuits, but the motor control circuit 41 and the temperature sensor 35 can also be integrated into one circuit.
[0047] Figure 5 The appearance of the lens unit 1 of the camera in this embodiment is shown. Figure 5 As shown, the lens unit 1 consists of an optical component part 51 and an imaging sensor part 52. The optical component part 51 houses the aforementioned front lens group 30, aperture 31, aperture drive motor 32, focusing lens part 33, focusing lens part drive motor 34, and temperature sensor 35. The imaging sensor part 52 includes an imaging sensor substrate 36, a substrate tilt adjustment screw 37, a substrate force spring 38, and a screw fixing part 39.
[0048] Figure 6 A cross-section of the focus adjustment structure of the lens unit 1 of the camera in this embodiment is shown. Figure 6 As shown, the focusing lens unit 33 includes a focus adjustment lens 57. Additionally, the focusing lens unit 33 also includes a reduction gear train 53, a gear 54, a focus adjustment frame 55, and a screw 56. The focus adjustment lens 57 is fixed within the focus adjustment frame 55, and the reduction gear train 53, gear 54, focus adjustment frame 55, and screw 56 are mounted on the main lens frame. The front lens unit 30 includes a fixed lens 58 located on the image-side closest to the image.
[0049] The rotation of the focusing lens drive motor 34 is transmitted to the focus adjustment frame 55 via the reduction gear set 53 and gear 54, and is transformed into the movement of the focus adjustment frame 55 in the optical axis direction of the lens of the lens unit by the screw 56. As a result, the focus adjustment lens 57, which is fixed to the focus adjustment frame 55, moves along the optical axis direction as the focus adjustment frame 55 moves, causing a change in the distance between the focus adjustment lens 57 and the fixed lens 58, thereby adjusting the focus position of the lens unit.
[0050] Figure 7 yes Figure 6 The plan view of the section along line ii-ii is shown. Figure 7 As shown, the outer portion of the focus adjustment frame 55 has teeth 55a that mesh with the gear 54. The teeth 55a actually mesh with the gear 54 via a threaded screw 56, which is omitted from the illustration. An optical interruptor 61 is fixed to the main lens frame and is used to detect the origin of the rotational position of the focus adjustment frame 55, i.e., the origin of the focus adjustment lens 57 in the optical axis direction. The optical interruptor 61 is generally referred to as PI, and will therefore be abbreviated as PI below. A light-shielding plate 62 is disposed on the focus adjustment frame 55 and can rotate integrally with it. Furthermore, the relative position of the light-shielding plate 62 and the focus adjustment frame 55 can be adjusted circumferentially.
[0051] When the light-shielding plate 62 rotates with the focus adjustment frame 55 and enters the detection area of the PI 61, the light emitted by the light source of the PI 61 is blocked by the light-shielding plate 62 and cannot enter the detector of the PI 61. When the light-shielding plate 62 rotates with the focus adjustment frame 55 and leaves the detection area of the PI 61, the light emitted by the light source of the PI 61 is not blocked by the light-shielding plate 62 and enters the detector of the PI 61. The reference position of the focus adjustment frame 55 can be detected by detecting the switching of the PI 61 from the L state (the state where light is detected without being blocked by the light-shielding plate 62) to the S state (the state where light is not detected by being blocked by the light-shielding plate 62) or from the S state to the L state.
[0052] Figure 8 The relationship between temperature and the amount of focusing lens movement is shown. The amount of focusing lens movement refers to the amount of movement of the focusing lens 57 in the optical axis direction, based on the position of the focusing lens 57 in the optical axis direction at 20°C, that is, the change in the distance between the focusing lens 57 and the fixed lens 58.
[0053] Since the change in the focal position due to temperature change is linear with respect to temperature change, therefore... Figure 8 As shown, the amount of focusing lens movement relative to temperature change is also linear with respect to the change in the focal position.
[0054] exist Figure 8 In the above, with 20℃ as the reference, on the high-temperature side, the amount of focusing lens movement is adjusted negatively, that is, in order to reduce the distance between the focusing adjustment lens 57 and the fixed lens 58. On the low-temperature side, the amount of focusing lens movement is adjusted positively, that is, in order to increase the distance between the focusing adjustment lens 57 and the fixed lens 58.
[0055] Figure 9 This illustrates the relationship between the lens magnification *m*, the subject distance *a*, and the distance *b* from the lens to the image. For example... Figure 10 As shown, their relationship is expressed by the formula m = b / a. When the distance b from the lens to the image changes, the image magnification changes, and thus the image size changes. When the temperature changes of each lens unit differently, after each lens unit has undergone focus position correction, the position of the focus adjustment lens 57 in the optical axis direction within the corresponding lens unit is different. This results in different image sizes produced by each lens unit, making image synthesis difficult.
[0056] Figure 10 This is a diagram used to illustrate depth of focus. Depth of focus refers to the range within which a lens will not lose focus even if the focal point deviates slightly. The smallest unit that converts light into an electrical signal in a CMOS sensor is called a pixel, and four pixels (BGGR, the three primary colors) form one pixel. A pixel is the smallest unit that makes up an image. If the defocus is within two pixels, the CMOS sensor will not detect it. This range is called the circle of confusion, and the diameter of the circle of confusion is called the circle of confusion diameter.
[0057] In the diagram, δ' represents the size of one pixel, 2δ' represents the diameter of the minimum circle of confusion, D represents the depth of focus, and Fno represents the brightness of the lens. Fno satisfies the relationship Fno = focal length / effective aperture. The triangle represented by D / 2δ' has a similar relationship to Fno = focal length / effective aperture. Therefore, according to Fno = D / 2δ', the depth of focus D can be represented by D = 2δ'·Fno.
[0058] For example, when Fno = 3.5 and pixel size = 4μm,
[0059] D = 3.5 x 4 x 2 = 28 μm = 0.028 mm
[0060] Because of the depth of focus D, even if the focal position deviates from the reference position by 0.028mm due to temperature changes, it will not be out of focus (blurred). Conversely, if the focal position deviates from the reference position by more than 0.028mm due to temperature changes, it will be out of focus (blurred).
[0061] Figure 11The relationship between temperature and depth of focus range is shown. In the implementation, as... Figure 11 As shown, the temperature is divided into a finite number of steps, each step being 20℃. Based on the temperature point 20℃, the numbers T(-4) to T(4) are marked. For each temperature point, the focusing lens movement and focal depth range are set. When T(0) = 20℃, the focal depth range is -0.028mm to 0.028mm. The focal depth range of the adjacent temperature point T(1) is -0.048mm to 0.008mm, and the focal depth range of T(0) overlaps with that of T(1). Figure 11 The arrows below indicate the depth of focus range at each temperature point, and the ◇ mark indicates the focus position. For example... Figure 11 As shown, the depth of focus range at each temperature point overlaps with the focus position (◇ mark) at the adjacent temperature point. Therefore, even if the focus position moves according to the amount of movement set for the adjacent temperature point instead of the amount of movement set for the current temperature point, that is, the focus position deviates by 1 step, it will not be out of focus.
[0062] Figure 12 This is a table used for setting the initial position of the lens. Figure 12 It is used as a flowchart. Figure 15 The table used when setting the initial position of the lens. Figure 12 The table shows the temperature range corresponding to each temperature point T(m), the number of rotation steps n1 required for the focusing lens drive motor 34 to rotate from the reference position (the position of the focusing lens drive motor 34 at 20°C) to correct the focal point position, where m = -4 to 4. Figure 12 The table also shows the number of correction steps m, where the number of correction steps Δm is the number of rotation steps of the focusing lens drive motor 34 required for the correction focal position between adjacent temperature points. Figure 12 The values of temperature point T(m), temperature range, and number of rotation steps in the table are just examples; of course, other values are also possible.
[0063] Figure 13 This is a table used for setting the initial position of the lens. In this embodiment, the amount of movement of the focus adjustment lens 57 required to correct the focus position, i.e., the number of rotation steps n2 of the focusing lens unit drive motor 34, can be set according to whether the focus is on the far point (F) or the near point (N). Figure 13 The table shows the movement of the focus adjustment lens 57 (2m and 1.2m) corresponding to the far point (F) and near point (N), and the number of rotation steps (pulse number) of the focus lens drive motor 34. Figure 13 The values for movement and rotation steps in the table are just examples; of course, other values can also be used.
[0064] Figure 14This diagram illustrates an example of the stepping action of the focusing lens unit drive motor in this embodiment. (See diagram below.) Figure 14 As shown, the stepping action of the focusing lens drive motor is based on... Figure 12 The setting, Figure 13 The settings and the switching of the PI61's output signal from S state to L state are performed.
[0065] The origin of the focusing lens unit drive motor 34 is defined as the position of the rotor of the focusing lens unit drive motor 34 when the PI61 signal switches from state S to state L. Assuming the current temperature is 20°C, based on... Figure 13 The table shows that the focusing lens unit drive motor 34 rotates 542 steps to reach the far point F, or the focusing lens unit drive motor 34 rotates 767 steps to reach the near point N. Afterwards, based on... Figure 12 The table calculates the number of steps the focusing lens drive motor 34 should rotate further at the temperature point corresponding to the temperature result detected by the temperature sensor 35, and drives the focusing lens drive motor 34 to rotate further by that number of steps.
[0066] Figure 15 This is a flowchart illustrating the control method of the lens unit in this embodiment. For example... Figure 15 This means that the lens unit in this embodiment is controlled as follows.
[0067] In step S101, the power switch is turned on to connect the camera's power supply and make the camera start working.
[0068] In step S102, initial power-on settings are performed, setting the rotor position of the focusing lens drive motor 57 to a predetermined position, for example... Figure 14 The reset position is shown. The specific details of the initial power-on settings process will be described in detail later.
[0069] In step S103, starting from the reset position, the focusing lens drive motor 34 begins to rotate.
[0070] In step S104, it is detected whether the output signal of PI 61 changes from the S state to the L state, that is, whether the state of detecting light without being blocked by the light-blocking plate 62 changes to the state of not detecting light when blocked by the light-blocking plate 62. If the output signal of PI 61 changes from the S state to the L state, proceed to step S105.
[0071] In step S105, initial position setting processing is performed. That is, based on... Figure 12 The table sets the number of rotation steps n1 required for the focusing lens drive motor 34 to start rotating based on the current temperature.
[0072] In step S106, the focus is adjusted via autofocus or manual selection to indicate whether to focus on the near or far point. Furthermore, based on... Figure 13 The table indicates the number of steps n2 required for the focusing lens drive motor 34 to rotate.
[0073] In step S107, a temperature response process is performed. The specific details of the temperature response process will be described in detail later.
[0074] In step S108, the rotor of the focusing lens drive motor 34 is rotated n1+n2 steps to perform temperature-based focus position correction.
[0075] In step S109, an abnormal warning is performed to prevent the focusing lens drive motor 34 from burning out if the motor cannot be stopped due to a fault in the mechanism system.
[0076] In step S110, it is determined that the power switch is off. If the power switch is off, proceed to step S111; if the power switch is not off, return to step S106.
[0077] In step S111, the rotor of the focusing lens drive motor 34 is returned to the reset position.
[0078] In step S112, the power is cut off, thereby stopping the camera from working.
[0079] Figure 15 The control method can also omit steps S109, S111, etc.
[0080] Figure 16 This is a flowchart illustrating the initial startup settings process of this embodiment. The specific process is as follows.
[0081] In step S121, it is detected whether the output signal of PI 61 is in state S or state L to determine the current position of the rotor of the focusing lens drive motor 34. If the output signal of PI 61 is in state S, proceed to step S122; if the output signal of PI 61 is in state L, proceed to step S124.
[0082] In step S122, the focusing lens drive motor 34 is rotated in a direction that increases the distance between the focus adjustment lens 57 and the fixed lens 58.
[0083] In step S123, it is detected whether the output signal of PI 61 changes from state S to state L. If the output signal of PI 61 changes from state S to state L, proceed to step S124. If the output signal of PI 61 does not change from state S to state L, step S123 is repeated.
[0084] In step S124, the focusing lens drive motor 34 is rotated in the direction that reduces the distance between the focusing adjustment lens 57 and the fixed lens 58.
[0085] In step S125, it is detected whether the output signal of PI 61 changes from the L state to the S state. If the output signal of PI 61 changes from the L state to the S state, proceed to step S126. If the output signal of PI 61 does not change from the L state to the S state, step S125 is repeated.
[0086] In step S126, the focusing lens drive motor 34 is rotated three steps in the direction that increases the distance between the focus adjustment lens 57 and the fixed lens 58, and then stopped. That is, the rotor position of the focusing lens drive motor 34 is adjusted to the position three steps prior to the rotor position corresponding to the change of the PI signal from state S to state L, and then stopped. This is done to ensure the accuracy of the continued rotation of the focusing lens drive motor 34. Here, three steps are just an example; other numbers of steps are also possible.
[0087] Figure 17 This is a flowchart illustrating the temperature response process in this embodiment. The specific process is as follows.
[0088] In step S141, it is determined whether the current temperature exceeds [the specified limit]. Figure 12 The temperature range corresponding to the temperature when step number n1 was set in step S105 is entered into an adjacent temperature range. If the current temperature enters an adjacent temperature range, proceed to step S142; if the current temperature does not enter an adjacent temperature range, proceed to step S143.
[0089] Assuming the temperature is 20°C when setting step number n1 in step S105, Figure 12 In the above, the corresponding temperature number is T(0), and the corresponding temperature range is 10℃<T≤30℃. Determine whether the current temperature exceeds the temperature range of T(0) (10℃<T≤30℃) and enters the adjacent temperature range of T(1) (30℃<T≤50℃) or the temperature range of T(-1) (-10℃). <T≤10℃。
[0090] In step S142, if the current temperature enters an adjacent temperature range, based on Figure 12 The table sets the number of rotation steps n1 required for the focusing lens drive motor 34 to correspond to the number of steps in the adjacent temperature range.
[0091] For example, when the current temperature enters the temperature range of 30℃ < T ≤ 50℃ of the adjacent temperature T(1), the number of steps n1 required for the focusing lens drive motor 34 to rotate is set to the step value corresponding to the adjacent temperature T(1), i.e., 46.
[0092] In step S143, the value of the number of steps n1 required for the focusing lens drive motor 34 to rotate remains unchanged, and is still the value of the number of steps n1 set in step S105.
[0093] Figure 18 This is a flowchart illustrating the abnormal warning handling in this embodiment. The specific handling is as follows.
[0094] In step S130, the timer starts running, and it is determined whether the timer has exceeded the specified time. If the timer has exceeded the specified time, proceed to step S131. If the timer has not exceeded the specified time, the timer continues to run.
[0095] In step S131, the power supply to the focusing lens drive motor 34 is stopped.
[0096] In step S132, an abnormal warning is issued to the user.
[0097] According to the photographic apparatus and control method of the aforementioned image synthesis system, the temperature is divided into a finite number of steps, with each step having a relatively large change in magnification. Therefore, the ratio of magnification differences in the image caused by deviations in each photographic optical system is small, becoming a negligible value in image synthesis, thus obtaining a natural synthesized image. Furthermore, in the case of higher-precision synthesis, the number of temperature steps is limited when inputting magnification data based on the focusing lens position of each photographic optical system into the image synthesis circuit. Therefore, image synthesis can be performed with a smaller amount of data, thereby achieving system miniaturization and cost reduction.
[0098] The above explanation exemplifies the case of correcting the focus position in response to changes in ambient temperature. However, it can also be applied to all changes in the optical characteristics of a photographic device that occur in response to changes in ambient temperature, such as changes in aperture, focal length in the case of a zoom lens, and the loading and unloading of filters. In these scenarios, the same effect can be achieved by synchronously changing the lens states of multiple lens units by a predetermined amount.
[0099] The various embodiments of this disclosure have been described above. These descriptions are exemplary and not exhaustive, and are not limited to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen to best explain the principles, practical applications, or technical improvements to the technology in the market, or to enable others skilled in the art to understand the embodiments disclosed herein.
Claims
1. A photographic apparatus for an image photographic compositing system, the photographic apparatus comprising six or more lens units of approximately the same size, the image photographic compositing system combining images captured by the six or more lens units to obtain a planar image or a three-dimensional image, the photographic apparatus being characterized in that it comprises: A sensor that detects environmental information related to the photographic device; An electric drive unit acquires the detection signal output from the sensor and synchronously and stepwise changes the optical characteristics of the six or more lens units. The photographic apparatus further includes an electric drive unit, which receives a detection signal representing environmental information from the sensor and sends a drive signal corresponding to the detection signal to drive the electric drive unit. The optical characteristic is the focal position or focal length. The sensor detects the ambient temperature of the lens unit. The drive unit of the electric drive device receives a detection signal representing the ambient temperature from the sensor and sends a drive signal corresponding to the detection signal to the electric drive device. The pre-defined correspondence between multiple pre-divided temperature ranges and the changes in focal position is established. The electric drive unit determines the current temperature of the lens unit based on the detection signal representing the ambient temperature received from the sensor, and sends a drive signal to the electric drive unit to synchronously and stepwise change the focal position of the six or more lens units based on the current temperature of the lens unit and the corresponding relationship.
2. The photographic apparatus of the image photographic synthesis system according to claim 1, characterized in that, Equipped with only one of the aforementioned sensors, The electric drive device acquires a detection signal output from one of the sensors and synchronously and stepwise changes the optical characteristics of the six or more lens units.
3. The photographic apparatus of the image photographic synthesis system according to claim 1, characterized in that, Equipped with multiple of the aforementioned sensors, The electric drive device acquires a representative value of the detection signals output from the multiple sensors and synchronously and stepwise changes the optical characteristics of the six or more lens units.
4. The photographic apparatus of the image photographic synthesis system according to claim 3, characterized in that, The representative value is the average value of the detection signals output from the multiple sensors.
5. The photographic apparatus of the image photographic synthesis system according to claim 3, characterized in that, The representative value is the maximum value of the detection signals output from the plurality of said sensors.
6. The photographic apparatus of the image photographic synthesis system according to claim 3, characterized in that, The representative value is the minimum value of the detection signals output from the plurality of said sensors.
7. The photographic apparatus of the image photographic synthesis system according to claim 1, characterized in that, The change in the focal position is within the depth of focus corresponding to the current temperature of the lens unit.
8. The photographic apparatus of the image photographic synthesis system according to claim 1, characterized in that, The lens unit includes an aperture stop, and the optical characteristic is the aperture stop value.
9. A control method for a photographic apparatus of an image photographic synthesis system, wherein the photographic apparatus has six or more lens units of approximately the same specifications, and the image photographic synthesis system synthesizes images captured by the six or more lens units to obtain a planar image or a three-dimensional image, the control method being characterized by comprising: The sensor is used to detect environmental information related to the photographic device; The electric drive unit receives a detection signal representing environmental information from the sensor and sends a drive signal corresponding to the detection signal to drive the electric drive unit. The optical characteristics of the six or more lens units are changed synchronously and in a stepwise manner using the electric drive device. The optical characteristic is the focal position or focal length. The sensor is used to detect the ambient temperature of the lens unit. The electric drive unit receives a detection signal representing the ambient temperature from the sensor and sends a drive signal corresponding to the detection signal to the electric drive unit. The pre-defined correspondence between multiple pre-divided temperature ranges and the changes in focal position is established. The electric drive unit determines the current temperature of the lens unit based on the detection signal representing the ambient temperature received from the sensor, and sends a drive signal to the electric drive unit to synchronously and stepwise change the focal position of the six or more lens units based on the current temperature of the lens unit and the corresponding relationship.
10. The control method for the photographic apparatus of the image photographic synthesis system according to claim 9, characterized in that, The photographic device has only one sensor. The detection signal output from one of the sensors is acquired, and the optical characteristics of the six or more lens units are changed synchronously and in a stepwise manner.
11. The control method for the photographic apparatus of the image photographic synthesis system according to claim 9, characterized in that, The photographic device is equipped with multiple of the aforementioned sensors. A representative value of the detection signals output from the multiple sensors is obtained, and the optical characteristics of the six or more lens units are changed synchronously and in a stepwise manner.
12. The control method for the photographic apparatus of the image photographic synthesis system according to claim 11, characterized in that, The representative value is the average value of the detection signals output from the plurality of sensors, the maximum value of the detection signals output from the plurality of sensors, or the minimum value of the detection signals output from the plurality of sensors.
13. The control method for the photographic apparatus of the image photographic synthesis system according to claim 9, characterized in that, The change in the focal position is within the depth of focus corresponding to the current temperature of the lens unit.
14. The control method for the photographic apparatus of the image photographic synthesis system according to claim 9, characterized in that, The lens unit includes an aperture stop, and the optical characteristic is the aperture stop value.
Citation Information
Patent Citations
Photographing device of image photographing and synthesizing system
CN216162754U
Lens device, photographing device and photographing system
JP2003131103A
Optical apparatus and control method thereof
JP2012103394A
Camera device, camera system and image processing method
US20020122117A1
