Imaging device

The imaging device uses a single ultra-wide-angle camera with zoom processing to emulate both wide-angle and ultra-wide-angle functionality, reducing costs and improving user experience.

JP7717489B2Active Publication Date: 2025-08-04SHARP KK
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2021079364
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-05-07
Publication Date
2025-08-04
Estimated Expiration
2041-05-07

AI Technical Summary

Technical Problem

The cost of imaging devices equipped with both a wide-angle and an ultra-wide-angle camera is high, and there is a need for a user-friendly solution that mimics the operation of both types of cameras without the added expense.

Method used

An imaging device with a single ultra-wide-angle camera that performs zoom processing to set a predetermined focal length between 23mm and 26mm as the default, mimicking the functionality of both cameras.

Benefits of technology

Reduces costs while providing an operation feeling similar to having both wide-angle and ultra-wide-angle cameras, enhancing user experience and usability.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007717489000001
    Figure 0007717489000001
  • Figure 0007717489000002
    Figure 0007717489000002
  • Figure 0007717489000003
    Figure 0007717489000003
Patent Text Reader

Abstract

To provide, at low cost, an imaging device having high usability and providing an operational feeling of having both a wide-angle camera and an ultra wide-angle camera.SOLUTION: A mobile terminal, which is an imaging device, includes: an ultra wide-angle camera that has a 35 mm equivalent focal length of 20 mm or less; a display unit that displays a captured image; a zoom processor that zooms in / out on the captured image; and an operation unit that receives input of an amount of the zoom process. In default shooting by the camera, the zoom processor performs the zoom process to obtain a focal length of a predetermined value between 23 mm and 26 mm in 35 mm equivalent, and uses an angle of view obtained through the zoom process as a default angle of view.SELECTED DRAWING: Figure 4
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to an imaging device.

Background Art

[0002] Conventionally, imaging devices such as smartphones and mobile phones equipped with a wide-angle camera have been known (for example, Patent Document 1). The 35mm equivalent focal length corresponding to the angle of view of the wide-angle camera is generally 23 mm to 26 mm.

[0003] Also, today, in addition to wide-angle cameras, imaging devices equipped with an ultra-wide-angle camera or a telephoto camera, or both, are also supplied on the market. The 35mm equivalent focal length of the ultra-wide-angle camera is generally 20 mm or less. The 35mm equivalent focal length of the telephoto camera varies depending on the model, such as 50 mm, 70 mm, 120 mm, but is generally 50 mm or more.

[0004] Even in an imaging device equipped with a plurality of cameras having different angles of view, the angle of view at the time of default shooting is the full angle of view of the wide-angle camera, similar to conventional products equipped with only a wide-angle camera.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0006] In a configuration equipped with both a wide-angle camera and an ultra-wide-angle camera as a plurality of cameras having different angles of view, the cost is inevitably increased by providing two cameras.

[0007] One aspect of the present invention aims to realize an imaging device that can obtain an operation feeling as if it is equipped with both a wide-angle camera and an ultra-wide-angle camera while reducing costs and being user-friendly.

Means for Solving the Problems

[0008] In order to solve the above problems, an imaging device according to one aspect of the present invention includes an imaging unit with a 35mm equivalent focal length of 20mm or less, a display unit that displays an image captured by the imaging unit, a zoom processing unit that performs zoom processing on the image captured by the imaging unit, and a reception unit that receives an input of the processing amount by the zoom processing unit. The zoom processing unit performs zoom processing so as to obtain a predetermined value between 23mm and 26mm in terms of 35mm equivalent focal length during default shooting by the imaging unit, and sets the zoomed angle of view as the default angle of view.

Effects of the Invention

[0009] According to one aspect of the present invention, it is possible to obtain an operation feeling as if it is equipped with both a wide-angle camera and an ultra-wide-angle camera while reducing costs and being user-friendly.

Brief Description of the Drawings

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Embodiments for Carrying Out the Invention

[0011] Hereinafter, the imaging device according to each embodiment of the present invention will be described with reference to the drawings. In the following description, the same members are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed descriptions thereof will not be repeated.

[0012] The imaging device is, for example, a mobile terminal such as a smartphone, a tablet computer, a digital camera, or the like. Hereinafter, as an example, a mobile terminal having an imaging function will be described as an example.

[0013] (1. Configuration of the Mobile Terminal) FIG. 1 is a diagram for explaining the appearance of the mobile terminal 1 according to the present embodiment. Reference numeral 1001 is a front view of the mobile terminal 1, and reference numeral 1002 is a rear view of the mobile terminal 1.

[0014] As shown by reference numeral 1001, the mobile terminal 1 includes a display unit 2 and an operation unit 4 or the like on the front surface of the housing 1A. The display unit 2 has a touch panel function and includes an operation unit (reception unit) 4. As shown by reference numeral 1002, the mobile terminal 1 includes a camera (imaging unit) 10 on the rear surface facing the front surface of the housing 1A. The camera 10 images a subject visible to the user (photographer).

[0015] When the user activates an application (hereinafter referred to as the "imaging application") on the mobile terminal 1 to implement the imaging function, the camera 10 starts imaging, and the display unit 2 displays the image captured by the camera 10 and the imaging switch 8. Hereinafter, activating the application to implement the imaging function is referred to as activating the camera 10. Also, terminating the application is referred to as terminating the camera 10.

[0016] When the user touches the imaging switch 8, the mobile terminal 1 can capture the image displayed on the display unit 2 as a single photo. In the case of a video, video imaging can be started. Also, when the user touches the display unit 2 and performs a zoom-up operation to enlarge and display the image of the touched part, the display unit 2 displays the enlarged image. Further, when the user touches the display unit 2 and performs a zoom-out operation to reduce and display the image of the touched part, the display unit 2 displays the reduced image.

[0017] The magnification of the enlarged image depends on the amount of operation of the zoom-up operation. Similarly, the magnification of the reduced image depends on the amount of operation of the zoom-out operation. There are respectively set limit magnifications for the enlargement magnification and the reduction magnification, and the enlargement and reduction are up to the limit magnifications.

[0018] (2. Functional Blocks of the Mobile Terminal) FIG. 2 is a functional block diagram showing an example of the schematic configuration of the mobile terminal 1. The mobile terminal 1 includes, in addition to the above-described camera 10, display unit 2, and operation unit 4, a control unit 5 and a storage unit 6.

[0019] The control unit 5 controls the camera 10 and the display unit 2 by executing a control program. The control unit 5 reads out the control program stored in the storage unit 6 and executes it in a temporary storage unit (not shown) composed of, for example, RAM (Random Access Memory) or the like, thereby executing various processes. The control unit 5 has the function of a zoom processing unit that performs zoom processing on the image captured by the camera 10.

[0020] The operation unit 4 receives inputs of various operation commands by the user, including operation commands for the camera 10. The operation unit 4 is also a reception unit that receives the input of the processing amount by an image processing unit (zoom processing unit) 14 described later. In the present embodiment, the touch panel function of the display unit 2 is exemplified as the operation unit 4, but it may be configured by operation buttons and their interfaces or the like.

[0021] The display unit 2 displays various images, including the image captured by the camera 10. The display unit 2 is, for example, a liquid crystal display, a self-emitting display (such as an OLED).

[0022] The storage unit 6 stores (1) control programs for each unit executed by the control unit 5, (2) an OS program, (3) various application programs including an imaging application, and (4) various data read when these programs are executed.

[0023] The camera 10 includes a lens 11, a sensor 12, an A / D (Analog / Digital) conversion unit 13, and an image processing unit 14. In the sensor 12, imaging by the camera 10 is performed by receiving imaging light. The photocurrent generated by the sensor 12 receiving the imaging light is sent to the A / D conversion unit 13. The A / D conversion unit 13 converts the analog signal output from the sensor 12 into a digital signal.

[0024] The image processing unit 14 performs image processing on the image (image data) from the A / D conversion unit 13. The image processing includes predetermined pixel interpolation processing, color conversion processing, and the like. The image processing unit 14 receives, via the control unit 5, the operation commands for the camera 10 input by the user to the operation unit 4, and executes various processes. The image generated in the image processing unit 14 is sent to the control unit 5 and displayed on the display unit 2 via the control unit 5. The image displayed on the display unit 2 may be stored in the storage unit 6.

[0025] (3. Configuration of the Camera 10) FIG. 3 is a schematic diagram showing an example of the structure of the camera 10 mounted on the mobile terminal 1. As shown in FIG. 3, the camera 10 includes a lens 11, a sensor 12, an actuator 18, a lid glass 17, and the like.

[0026] The lens 11 includes a plurality of lenses arranged in layers. The plurality of lenses are integrally assembled by a lens barrel 15. The sensor 12 is, for example, a color image sensor or a monochrome image sensor composed of CMOS, CCD, or the like. The sensor 12 is mounted on a substrate 16 and converts an optical signal received through the lens 11 into an electrical signal.

[0027] The actuator 18 is composed of, for example, a VCM (Voice Coil Motor). The actuator 18 controls the driving of the lens 11 in the optical axis direction and realizes an autofocus (AF) function. The lid glass 17 has a transmission characteristic, transmits light having a predetermined wavelength, and blocks light having other wavelengths.

[0028] The camera 10 having such a configuration is a so-called ultra-wide-angle camera with a 35 mm equivalent focal length of 20 mm or less. When the mobile terminal 1 performs shooting by default using the camera 10, zoom processing is performed so that a predetermined value between 23 mm and 26 mm in terms of 35 mm equivalent focal length is obtained, and the zoomed angle of view is set as the default angle of view. That is, when the mobile terminal 1 performs shooting by default using the camera 10, instead of an image of the full angle of view of the camera 10 which is an ultra-wide-angle camera, an image (zoomed in) processed by zooming to a predetermined value between 23 mm and 26 mm in terms of 35 mm equivalent focal length is displayed on the display unit 2, and the image is operated with a zoom magnification of 1 times.

[0029] (4. Default of the Camera 10 in the Mobile Terminal 1) FIG. 4 is a diagram showing the imaging area of the mobile terminal 1 and the imaging area of a conventional mobile terminal equipped with three cameras, an ultra-wide-angle camera, a wide-angle camera, and a telephoto camera. Reference numeral 1003 indicates the imaging area of the mobile terminal 1, and reference numeral 1004 indicates the imaging area of the conventional mobile terminal.

[0030] As shown by reference numeral 1004, in a conventional mobile terminal equipped with three cameras, the default angle of view is the full angle of view of the wide-angle camera. The full angle of view of the wide-angle camera varies depending on the model, but is generally from 23 mm to 26 mm in terms of 35 mm equivalent focal length. In the figure, the left ends of the bands of the ultra-wide-angle camera, the wide-angle camera, and the telephoto camera are their respective full angles of view, and the angle of view (zoomed angle of view) obtained by zoom processing is on the right side from the full angle of view.

[0031] As shown by reference numeral 1003, in the mobile terminal 1 of the present embodiment, the default angle of view is 24 mm in terms of 35 mm equivalent focal length obtained by zooming an image captured at 19 mm in terms of 35 mm equivalent focal length, which corresponds to the ultra-wide-angle camera and is 20 mm or less in terms of 35 mm equivalent focal length.

[0032] FIG. 5 is a diagram showing the full angle of view and the default angle of view of the camera 10 in the mobile terminal 1. As shown in FIG. 5, the default angle of view R2 of the camera 10 is smaller than the full angle of view R1 of the camera 10. In the mobile terminal 1, an image (image data) of the default angle of view R2 is zoomed and displayed on the display unit 2, and the operation unit 4 accepts a zoom-in operation and a zoom-out operation based on the image of the default angle of view R2. That is, the state where the image of the angle of view R2 is enlarged and displayed on the display unit 2 is the magnification "1.0" on the user interface (UI).

[0033] In the present embodiment, the 35 mm equivalent focal length corresponding to the full angle of view R1 of the camera 10 is 19 mm (angle of view 98 degrees) (an example). And the 35 mm equivalent focal length corresponding to the default angle of view R2 is set to 24 mm (angle of view 82 degrees) in the present embodiment (an example).

[0034] That is, in the present embodiment, the magnification "about 1.3 times (24 mm ÷ 19 mm)" of the image processing unit 14 of the camera 10 is set as the magnification "1.0" on the UI that serves as a reference for the user's operation. Hereinafter, the magnification of the image processing unit 14 is also referred to as the internal zoom magnification, and the magnification on the UI is also referred to as the UI display zoom magnification.

[0035] FIG. 6 is a diagram of a table T showing the relationship between the internal zoom magnification and the UI display zoom magnification in the camera 10 of the mobile terminal 1. The table T is stored in, for example, the storage unit 6 and read by the control unit 5 of the mobile terminal 1. When the camera 10 is activated, the control unit 5 reads the table T and displays on the display unit 2 an image enlarged at an internal zoom magnification of “1.3” with a UI display zoom magnification of “1.0”. When a zoom-in operation is performed by the user and, for example, a UI display zoom magnification of “1.1” is instructed, the control unit 5 displays on the display unit 2 an image enlarged at an internal zoom magnification of “1.4” and enlarged more than the default (internal zoom magnification “1.3”). Also, when a zoom-out operation is performed by the user and, for example, a UI display zoom magnification of “0.7” is instructed, the control unit 5 displays on the display unit 2 an image at the same magnification as the internal zoom magnification of “1.0” and reduced more than the default (internal zoom magnification “1.3”). An image reduced more than the default is a wider-angle image including an area wider than the default.

[0036] By relating the internal zoom magnification, which is the actual zoom magnification, and the UI display zoom magnification, which is the zoom magnification seen by the user, in this way, the operation unit 4 accepts an input of the processing amount with the default angle of view as 1 times the zoom magnification. Thereby, even if the default angle of view is the zoomed angle of view, the user can perform imaging with the camera 10 in the same manner as a conventional product without feeling discomfort.

[0037] In the present embodiment, as described above, the control unit 5 of the mobile terminal 1 has the function of a zoom processing unit and performs an enlargement process on an image (image data) captured by the camera 10. Therefore, in default shooting, the control unit 5 displays on the display unit 2 an image enlarged at an internal zoom magnification of “1.3” from the full-angle image sent from the camera 10. When a zoom-in or zoom-out operation is performed and a change from the UI display zoom magnification of “1.0” is instructed, the control unit 5 enlarges or reduces according to the instructed amount based on the image enlarged at an internal zoom magnification of “1.3” and displays the enlarged or reduced image on the display unit 2.

[0038] Note that the zoom processing of the image captured by the camera 10 may be performed by the image processing unit 14 of the camera 10. In that case, the table T may be configured to be included in the image processing unit 14 of the camera 10. Alternatively, the control unit 5 may be configured to send the table T read from the storage unit 6 to the image processing unit 14 of the camera 10. In the configuration where the image processing unit 14 of the camera 10 performs the zoom processing, an image enlarged at the internal zoom ratio corresponding to the UI display zoom ratio is sent from the image processing unit 14 to the control unit 5.

[0039] (5. Imaging operation in the mobile terminal 1) FIG. 7 is a diagram for explaining the flow of the imaging process of the mobile terminal 1. The control unit 5 repeatedly determines whether the activation of the camera 10 has been instructed (S1). For example, when the user operates an icon or the like of the imaging application displayed on the display unit 2, the control unit 5 determines that the activation of the camera 10 has been instructed. When the control unit 5 determines that the activation of the camera 10 has been instructed (S1: YES), it activates the camera 10 (S2). The camera 10 starts imaging when it is activated.

[0040] The control unit 5 displays, on the display unit 2, as a default, an image (image data) captured by the camera 10 and enlarged at a predetermined magnification, here 1.3 times. Even if the orientation of the mobile terminal 1 changes and the subject imaged by the camera 10 changes, as long as no zoom-in (enlargement) operation or zoom-out (reduction) operation is performed, an image enlarged 1.3 times of the captured image is displayed on the display unit 2.

[0041] After activating the camera 10, the control unit 5 repeatedly determines whether a zoom-in operation or a zoom-out operation has been performed (S4). When the control unit 5 determines that a zoom-in operation or a zoom-out operation has been performed (S4: YES), it displays, on the display unit 2, an image zoomed in or out according to the operation amount. Then, it proceeds to S6. On the other hand, when the control unit 5 determines that no zoom-in operation or zoom-out operation has been performed (S4: NO), it proceeds to S6 without performing the process of S5.

[0042] In S6, the control unit 5 determines whether imaging has been instructed. For example, when the user operates the imaging switch 8 displayed on the display unit 2, the control unit 5 determines that imaging has been instructed. When the control unit 5 determines that imaging has been instructed (S6: YES), it stores the image being displayed on the display unit 2 at that time in the storage unit 6 (S7). Then, it proceeds to S8. On the other hand, when the control unit 5 determines that imaging has not been instructed (S6: NO), it proceeds to S8 without performing the process of S7.

[0043] In S8, the control unit 5 determines whether an instruction to end the camera 10 has been given. When the control unit 5 determines that an instruction to end the camera 10 has been given (S8: YES), it ends the imaging application and stops the function of the camera 10 (S9). On the other hand, when the control unit 5 determines that an instruction to end the camera 10 has not been given (S8: NO), it returns the process to S4. The processes of S4, S6, and S8 are repeatedly executed until it is determined as YES in S8.

[0044] (6. Advantages of the mobile terminal 1) The camera 10 of the mobile terminal 1 is an ultra-wide-angle camera. If an image with the full angle of view taken by such a camera 10 is directly displayed on the display unit 2 as the default, it will give the user a sense of discomfort such as the imaging area being too wide and the subject to be photographed being small. In the above configuration, at the time of default shooting, instead of the full angle of view of the camera 10 which is an ultra-wide-angle camera, zoom processing is performed up to a predetermined angle of view smaller than the full angle of view, and the angle of view after the zoom processing is set as the default angle of view. Thereby, the camera 10 can be operated without the above-mentioned sense of discomfort, and the usability is good.

[0045] Also, since the imaging area of a wide-angle camera is covered by a single ultra-wide-angle camera 10, the cost can be reduced compared to a mobile terminal configuration equipped with both an ultra-wide-angle camera and a wide-angle camera. Moreover, by setting the angle of view after the zoom processing as the default angle of view, a zoom-out operation to widen the angle of view more than the default is possible, and an operation feeling as if both a wide-angle camera and an ultra-wide-angle camera are mounted can be obtained.

[0046] Furthermore, in the mobile terminal 1, a single camera 10 covers the imaging area of the telephoto camera. Therefore, compared with a mobile terminal configuration equipped with three cameras, namely an ultra-wide-angle camera, a wide-angle camera, and a telephoto camera, the cost can be reduced more effectively.

[0047] In addition, a configuration with a separate telephoto camera in addition to the camera 10 may be adopted. That is, when the camera 10 is used as the first camera (first imaging unit), a configuration may be adopted in which a second camera (second imaging unit) with a 35mm equivalent focal length of 50mm or more is further provided. In that case, when the zoom magnification displayed on the UI of the mobile terminal exceeds 2 times, for example, the control unit of the mobile terminal switches the camera to be used from the first camera (camera 10) to the telephoto second camera.

[0048] 〔Example of Realization by Software〕 The functions of the mobile terminal 1 can be realized by a program for causing a computer to function as the device, and by programs for causing a computer to function as each control block of the device (especially each part included in the control unit 5 and the image processing unit 14).

[0049] In this case, the above device includes a computer having at least one control device (for example, a processor) and at least one storage device (for example, a memory) as hardware for executing the above program. By executing the above program with this control device and storage device, each function described in each of the above embodiments is realized.

[0050] The above program may be recorded on one or more computer-readable recording media, not temporarily. This recording medium may or may not be provided in the above device. In the latter case, the above program may be supplied to the above device via any wired or wireless transmission medium.

[0051] Also, part or all of the functions of each of the above control blocks can also be realized by a logic circuit. For example, an integrated circuit in which a logic circuit functioning as each of the above control blocks is formed is also included in the scope of the present invention. In addition to this, for example, it is also possible to realize the functions of each of the above control blocks by a quantum computer.

[0052] 〔Summary〕 The imaging device (portable terminal 1) according to Embodiment 1 of the present invention includes an imaging unit (camera 10) with a 35 mm equivalent focal length of 20 mm or less, a display unit 2 that displays an image captured by the imaging unit, a zoom processing unit (image processing unit 14) that performs zoom processing on the image captured by the imaging unit, and a reception unit (operation unit 4) that receives an input of the processing amount by the zoom processing unit. The zoom processing unit performs zoom processing so as to obtain a predetermined value between 23 mm and 26 mm in terms of 35 mm equivalent focal length during default shooting by the imaging unit, and sets the zoomed field of view as the default field of view.

[0053] The imaging device according to Embodiment 2 of the present invention may be configured such that, in the above Embodiment 1, the zoom processing unit performs zoom processing up to a field of view corresponding to a 35 mm equivalent focal length of 50 mm or more according to the input processing amount.

[0054] The imaging device according to Embodiment 3 of the present invention may be configured such that, in the above Embodiment 1, when the imaging unit is a first imaging unit, it further includes a second imaging unit with a 35 mm equivalent focal length of 50 mm or more.

[0055] The imaging device according to Embodiment 4 of the present invention may be configured such that, in any one of the above Embodiments 1 to 3, the reception unit receives an input of the processing amount by setting the default field of view as a zoom magnification of 1 times.

[0056] The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope shown in the claims. Embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of the present invention. Furthermore, by combining the technical means disclosed in each embodiment, new technical features can be formed.

Explanation of Reference Numerals

[0057] 1 Mobile terminal (imaging device) 1A Housing 2 Display unit 4 Operation unit (reception unit) 5 Control unit 6 Storage unit 8 Imaging switch 10 Camera (imaging unit) 11 Lens 12 Sensor 13 A / D conversion unit 14 Image processing unit (zoom processing unit) 18 Actuator

Claims

1. a first imaging unit having a 35 mm equivalent focal length of 20 mm or less; a display unit that displays an image captured by the first imaging unit; a zoom processing unit that performs zoom processing on the image captured by the first imaging unit; a reception unit that receives an input of the processing amount by the zoom processing unit, and comprising: the zoom processing unit performs zoom processing so as to obtain a predetermined value between 23 mm and 26 mm in terms of 35 mm equivalent focal length during default shooting by the first imaging unit, and is preset so that the zoomed angle of view is the default angle of view; An imaging apparatus, further comprising a second imaging unit having a 35 mm equivalent focal length of 50 mm or more.

2. The imaging apparatus according to claim 1, wherein the reception unit receives an input of the processing amount with the default angle of view set as a zoom magnification of 1×.

Citation Information

Patent Citations

  • Digital camera

    JP2003319234A

  • Electronic apparatus, method for controlling the same, program, and recording medium

    JP2018109794A

  • Imaging device

    JP2022172979A

  • Apparatus for processing digital image and method for controlling thereof

    KR1020090085986A

  • Image capture apparatus and setting window thereof

    WO2017200049A1