Electronic apparatus, display method, and program

The electronic device enhances user convenience by using a control unit to mark and display an enlarged image portion of a subject based on touch operations, addressing the lack of convenience in existing image display techniques.

JP2024167704AActive Publication Date: 2024-12-04KYOCERA CORP
View PDF 13 Cites 0 Cited by

Patent Information

Application Number
JP2023083956
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-22
Publication Date
2024-12-04
Estimated Expiration
2043-05-22

Smart Images

  • Figure 2024167704000001_ABST
    Figure 2024167704000001_ABST
Patent Text Reader

Abstract

To improve a technique to display two images and related to convenience for a user.SOLUTION: An electronic apparatus comprises: at least one camera that can photograph a subject to create a first image, and can enlarge and photograph a part of the subject to create a second image; a display that can receive a touch operation; and a control unit. The control unit puts a mark on a portion in the first image corresponding to the second image on the basis of the touch operation to the display displaying the first image, and displays the second image on the display.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to an electronic device, a display method, and a program. [Background technology]

[0002] Conventionally, there is known a technique for generating two images and displaying the two generated images. For example, Patent Document 1 describes displaying an image of a subject and an image of a photographer on a liquid crystal panel. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2011-55251 A Summary of the Invention [Problem to be solved by the invention]

[0004] The technology for displaying two images leaves room for improvement in terms of user convenience.

[0005] In view of the above, an object of the present disclosure is to improve the technology for displaying two images with respect to user convenience. [Means for solving the problem]

[0006] An electronic device according to an embodiment of the present disclosure includes: At least one camera capable of capturing an image of a subject to generate a first image and capturing a magnified image of a portion of the subject to generate a second image; A display unit capable of receiving a touch operation; a control unit that marks a portion of the first image that corresponds to the second image and displays the second image on the display unit based on a touch operation on the display unit while the first image is being displayed; and Equipped with.

[0007] A display method according to an embodiment of the present disclosure includes: based on a touch operation on a display unit displaying a first image, marking a portion of the first image corresponding to a second image and displaying the second image on the display unit; the first image is an image generated by photographing a subject, The second image is an image generated by taking a magnified image of a part of the subject.

[0008] A program according to an embodiment of the present disclosure includes: On the computer, Executing an operation including marking a portion of the first image corresponding to the second image and displaying the second image on the display unit based on a touch operation on the display unit while displaying the first image; the first image is an image generated by photographing a subject, The second image is an image generated by taking a magnified image of a part of the subject. Effect of the Invention

[0009] According to an embodiment of the present disclosure, the technique of displaying two images can be improved in terms of user convenience. [Brief description of the drawings]

[0010] [Figure 1] 1A and 1B are diagrams illustrating examples of use of an electronic device according to an embodiment of the present disclosure. [Diagram 2] FIG. 2 is a block diagram of the electronic device shown in FIG. [Diagram 3] 10 is a flowchart illustrating an example procedure of a display process according to an embodiment of the present disclosure. [Figure 4] 2 is a diagram showing an example of a display mode of a display unit shown in FIG. 1. [Diagram 5] 2 is a diagram showing an example of a display mode of a display unit shown in FIG. 1. [Figure 6] 2 is a diagram showing an example of a display mode of a display unit shown in FIG. 1. [Figure 7] 2 is a diagram showing an example of a display mode of a display unit shown in FIG. 1. [Figure 8] 13A and 13B are diagrams illustrating an example of a display mode of a display unit according to another embodiment of the present disclosure. [Figure 9] FIG. 13 is a block diagram of an electronic device according to yet another embodiment of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings.

[0012] As shown in Fig. 1, an electronic device 1 according to this embodiment is used by a user. The user uses the electronic device 1 to capture an image of a subject. The electronic device 1 is, for example, a smartphone. However, the electronic device 1 may be any device as long as it is capable of capturing an image of a subject.

[0013] 2, electronic device 1 includes first camera 10, second camera 11, display unit 12, positioning unit 13, storage unit 14, and control unit 15. In this embodiment, electronic device 1 includes first camera 10 and second camera 11, that is, two cameras. However, electronic device 1 only needs to include at least one camera.

[0014] The first camera 10 is capable of generating a first image of a subject by photographing the subject. The first camera 10 is, for example, a wide-angle camera. However, the first camera 10 is not limited to a wide-angle camera. The first camera 10 may be any camera, such as an ultra-wide-angle camera or a telephoto camera. The first camera 10 is configured to include an imaging element and a lens unit. The lens unit includes at least one lens. The lens is a multifocal lens. However, the lens may be a single-focus lens. The first camera 10 has an autofocus function.

[0015] The second camera 11 is capable of capturing an image of a subject at a larger magnification than the first camera 10. The second camera 11 is capable of generating a second image of the subject by capturing an image of the subject at a larger magnification. The second camera 11 is, for example, a macro camera. However, the second camera 11 is not limited to a macro camera. The second camera 11 may be any camera as long as it is capable of capturing an image of a subject at a larger magnification than the first camera 10. The second camera 11 is configured to include an imaging element and a lens unit. The lens unit includes at least one lens. The lens is a single-focus lens. However, the lens may be a multi-focus lens.

[0016] The minimum shooting distance of the second camera 11 is smaller than the minimum shooting distance of the first camera 10. The minimum shooting distance is the shortest distance from a subject to the camera that can be photographed by the camera.

[0017] The display unit 12 can display various types of information. The display unit 12 can also accept a touch operation. The display unit 12 may be a touch screen display in which a display and a touch screen are integrated. The display is, for example, an LCD (Liquid Crystal Display) or an organic EL (Electro Luminescence) display. The touch screen can detect the position where the user touches the touch screen with a finger or the like. The display unit 12 accepts the touch operation by detecting the position where the user touches.

[0018] The positioning unit 13 can acquire position information of the electronic device 1. The positioning unit 13 includes at least one receiving module compatible with a satellite positioning system. The receiving module is, for example, a receiving module compatible with GPS (Global Positioning System).

[0019] The storage unit 14 includes at least one semiconductor memory, at least one magnetic memory, at least one optical memory, or a combination of at least two of these. The semiconductor memory is, for example, a random access memory (RAM) or a read only memory (ROM). The RAM is, for example, a static random access memory (SRAM) or a dynamic random access memory (DRAM). The ROM is, for example, an electrically erasable programmable read only memory (EEPROM). The storage unit 14 may function as a main storage device, an auxiliary storage device, or a cache memory. The storage unit 14 stores data used in the operation of the electronic device 1 and data obtained by the operation of the electronic device 1.

[0020] The control unit 15 includes at least one processor, at least one dedicated circuit, or a combination of these. The processor is, for example, a general-purpose processor such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit), or a dedicated processor specialized for a specific process. The dedicated circuit is, for example, an FPGA (Field-Programmable Gate Array) or an ASIC (Application Specific Integrated Circuit). The control unit 15 executes processes related to the operation of the electronic device 1 while controlling each part of the electronic device 1.

[0021] Based on a touch operation on display unit 12 displaying the first image, control unit 15 marks a portion of the first image that corresponds to the second image and causes display unit 12 to display the second image. An example of this process will be described with reference to FIG.

[0022] 3 is a flowchart showing an example of a procedure of a display process according to an embodiment of the present disclosure. When the control unit 15 activates the first camera 10 based on a user operation, the control unit 15 starts the process of step S1.

[0023] In the process of step S1, after starting the first camera 10, the control unit 15 moves the focus of the first camera 10 so that it is aligned with the subject. After moving the focus of the first camera 10, the control unit 15 causes the first camera 10 to capture an image of the subject and generate a first image. The control unit 15 may perform capture at an arbitrary frame rate to generate the first image. When the first image is generated, the control unit 15 causes the display unit 12 to display the first image in live view. The live view display is a display in real time of an image captured and generated by a camera. For example, as shown in FIG. 4, the control unit 15 causes the display unit 12 to display the first image 20 in live view. The first image 20 shows a rose as the subject.

[0024] In the process of step S1, the control unit 15 may obtain the location information of the electronic device 1 by the positioning unit 13. The control unit 15 may display the location information of the electronic device 1 on the display unit 12 together with the first image. The control unit 15 may superimpose the location information of the electronic device 1 on the first image. For example, in FIG. 4, the control unit 15 displays the location information of the electronic device 1, "DDD Town, CCC Ward, BBB City, AAA Prefecture," together with the first image 20. By displaying the location information of the electronic device 1, the user can easily understand the location where the subject is being photographed. The control unit 15 may increase the transparency of the characters of the location information of the electronic device 1 displayed on the display unit 12. In this case, the control unit 15 may increase the transparency of the characters of the location information of the electronic device 1 displayed on the display unit 12 more than the transparency of the characters of the location information of the electronic device 1 attached to the third image described later. Alternatively, as increasing the transparency of the characters of the location information of the electronic device 1 displayed on the display unit 12, the control unit 15 may set the transparency of the characters of the location information of the electronic device 1 displayed on the display unit 12 to a first predetermined value. The first predetermined value may be set in consideration of the visibility of the first image when the text of the position information of the electronic device 1 is superimposed on the first image. The first predetermined value is, for example, 50%. By increasing the transparency of the text of the position information of the electronic device 1 in this manner, when the position information of the electronic device 1 is displayed superimposed on the first image, it is possible to prevent the first image from becoming difficult to view due to the position information of the electronic device 1.

[0025] In the process of step S1, the control unit 15 may display information on the current time on the display unit 12 together with the first image. The control unit 15 may superimpose information on the current time on the first image. For example, in FIG. 4, the control unit 15 displays the current time in the format of "yy / mm / dd / hh / mm" together with the first image 20. By displaying the current time, the user can easily grasp the time at which the subject is being photographed. The control unit 15 may increase the transparency of the characters of the current time displayed on the display unit 12. In this case, the control unit 15 may increase the transparency of the characters of the current time displayed on the display unit 12 to a level higher than the transparency of the characters of the current time added to a third image described later. Alternatively, as the increase in the transparency of the characters of the current time displayed on the display unit 12, the control unit 15 may set the transparency of the characters of the current time displayed on the display unit 12 to a second predetermined value. The second predetermined value may be set in consideration of the visibility of the first image when the characters of the current time are superimposed on the first image. The second predetermined value may be the same as or different from the first predetermined value. In this way, by increasing the transparency of the characters of the current time, when the information of the current time is displayed superimposed on the first image, it is possible to prevent the first image from being difficult to see due to the information of the current time. The control unit 15 may update the current time displayed on the display unit 12 as appropriate.

[0026] In the process of step S1, the control unit 15 may display an image of a shooting execution button of the second camera 11 on the display unit 12 displaying the first image in live view. The image of the shooting execution button of the second camera 11 is an image for accepting an execution instruction for generating the second image as a still image as a touch operation. For example, in FIG. 4, the control unit 15 displays an image 30 of the shooting execution button of the second camera 11. However, the control unit 15 makes it impossible to accept a touch operation from the image of the shooting execution button of the second camera 11 at this time. Therefore, as shown in FIG. 4, the luminance or brightness of the image 30 of the shooting execution button may be lower than other images of the display unit 12. The low luminance or brightness of the image 30 of the shooting execution button allows the user to easily understand that a touch operation from the image 30 is impossible to accept.

[0027] In the process of step S1, when the control unit 15 displays the first image on the display unit 12, the control unit 15 may display a first notification on the display unit 12. The first notification is a notification that prompts the user to touch a portion of the first image to be enlarged and photographed. For example, in FIG. 4, the control unit 15 displays the first notification 21. The first notification 21 includes the text "Please touch the portion to be enlarged and photographed." When the user sees the first notification, the user touches a portion of the first image displayed on the display unit 12 that the user wants to enlarge and photograph with the second camera 11. For example, when the user wants to enlarge and photograph the center of a rose shown in the first image 20 as shown in FIG. 4, the user touches the portion 22 that is the center of the rose.

[0028] In the process of step S2, the control unit 15 accepts a touch operation on the display unit 12 displaying the first image in live view. For example, the control unit 15 accepts a touch operation on the portion 22 in FIG.

[0029] In the process of step S3, the control unit 15 generates a first image as a still image by the first camera 10, triggered by the receipt of the touch operation in the process of step S2. The control unit 15 causes the display unit 12 to display the first image generated as a still image. The control unit 15 marks the portion of the first image displayed on the display unit 12 where the touch operation was received in the process of step S2. For example, as shown in FIG. 5, the control unit 15 causes the display unit 12 to display the first image 23 with a frame 24 added. The first image 23 is a still image. The frame 24 corresponds to the portion 22 shown in FIG. 4.

[0030] The first image generated as a still image in the process of step S3 is set as the background of the third image in the process of step S7 described later. Therefore, the control unit 15 may display a second notification on the display unit 12 to notify the user that the background has been set. Furthermore, in the process of step S4 described later, the control unit 15 starts the second camera 11. Therefore, the second notification may notify the user that the background has been set and that the second camera 11 will be started. For example, in FIG. 5, the control unit 15 displays the second notification 25 on the display unit 12. The second notification 25 includes the text "The background has been set. The micro camera will be started." By looking at the second notification, the user can know that the first image displayed as a still image on the display unit 12 has been set as the background of the third image described later. Furthermore, by looking at the second notification, the user can know that the second camera 11 will be started.

[0031] In the process of step S4, the control unit 15 stops the first camera 10 and starts the second camera 11. After starting the second camera 11, the control unit 15 generates a second image by the second camera 11. The control unit 15 causes the display unit 12 to display the generated second image in a live view. The control unit 15 may cause the display unit 12 to display the second image superimposed on the first image. For example, as shown in FIG. 6, the control unit 15 causes the display unit 12 to display the second image 26 in a live view. The control unit 15 also causes the display unit 12 to display the second image 26 superimposed on the first image 23. In FIG. 6, the control unit 15 causes the second image 26 to be displayed at the bottom on the left side when facing the display unit 12. The control unit 15 may cause the size of the second image 26 to be smaller than the size of the first image 23.

[0032] In the process of step S4, the control unit 15 may adjust at least one of the position and size of the second image on the display unit 12 based on a touch operation on the display unit 12 while the second image is being displayed in live view. Therefore, when the control unit 15 causes the display unit 12 to display the second image, the control unit 15 may cause the display unit 12 to display a third notification that notifies the user that at least one of the position and size of the second image can be adjusted. The control unit 15 may cause the display unit 12 to display a third notification that notifies the user that at least one of the position and size of the second image can be adjusted and that the second image is being displayed on the display unit 12. For example, in FIG. 6, both the position and size of the second image can be adjusted. Therefore, the control unit 15 causes the display unit 12 to display a third notification 27. The third notification includes the text "An image is being projected in a small window. You can adjust the position and size by touching the small window." The user can know that at least one of the position and size of the second image can be adjusted by looking at the third notification. The user touches display unit 12 when wanting to adjust the position of the second image or the like.

[0033] In the process of step S4, after starting up second camera 11, control unit 15 may set the image 30 of the shooting execution button of second camera 11 in a state in which it is possible to accept a touch operation. For example, as shown in Fig. 6, control unit 15 may increase the brightness of image 30 of the shooting execution button higher than the brightness of image 30 shown in Fig. 4. By increasing the brightness of image 30 of the shooting execution button, the user can easily grasp that it is possible to accept a touch operation from image 30.

[0034] In the process of step S4, when the control unit 15 causes the display unit 12 to display the first image, which is the generated still image, the control unit 15 may cause the display unit 12 to display an image of a back button. The image of the back button is an image for accepting a touch operation to return to the process of displaying the first image in live view, i.e., the process of step S1. By returning to the process of displaying the first image in live view, the user can regenerate the first image, which is a still image to be set as the background of the third image. For example, in FIG. 6, the control unit 15 causes the display unit 12 to display an image 31 of a back button. When the control unit 15 accepts a touch operation on the image 31 of the back button, the control unit 15 may return to the process of step S1.

[0035] After the process of step S4, the user brings electronic device 1 closer to the rose in order to capture an image of the center of the rose with second camera 11. The user brings electronic device 1 closer to the rose until second camera 11 focuses on the center of the rose. When second camera 11 focuses on the center of the rose, the user touches image 30 of a capture execution button of second camera 11 as shown in FIG.

[0036] In the process of step S5, control unit 15 accepts a touch operation on the image of the shooting execution button of second camera 11. The acceptance of this touch operation triggers control unit 15 to generate a second image as a still image by second camera 11 (step S6). For example, control unit 15 generates, by second camera 11, second image 29, which is a still image as shown in Fig. 7 described later.

[0037] In the process of step S7, the control unit 15 generates a third image by superimposing the second image on the first image. The control unit 15 generates a third image by superimposing the second image generated as a still image in the process of step S6 on the first image generated as a still image in the process of step S3. The control unit 15 may make the first image the background of the third image by superimposing the second image on the first image. The control unit 15 may display the generated third image on the display unit 12. For example, as shown in FIG. 7, the control unit 15 displays the generated third image 28 on the display unit 12. In the third image 28, the second image 29, which is a still image, is superimposed on the first image 23, which is a still image.

[0038] In the process of step S7, the control unit 15 marks the portion of the first image that corresponds to the second image in the third image. For example, in FIG.

[0039] In the process of step S7, the control unit 15 may attach the location information of the electronic device 1 acquired in the process of step S1 to the third image. The control unit 15 may attach information of the current time to the third image. For example, in FIG. 7, the control unit 15 attaches the location information of the electronic device 1, "DDD town, CCC ward, BBB city, AAA prefecture," and the current time, "yy / mm / dd / hh / mm," to the third image 28. The control unit 15 may lower the transparency of each character of the location information of the electronic device 1 and the current time attached to the third image to be lower than the transparency of each character of the location information of the electronic device 1 and the current time displayed on the display unit 12 in the process of step S1. Alternatively, the control unit 15 may set the transparency of each character of the location information of the electronic device 1 and the current time attached to the third image to a third predetermined value. The third predetermined value may be set in consideration of the visibility of each character of the location information of the electronic device 1 and the current time when the characters of the location information of the electronic device 1 and the current time are superimposed on the third image. The control unit 15 may make the text of the location information of the electronic device 1 and the current time added to the third image opaque. When the text is opaque, the transparency of the text may be 0%.

[0040] After the process of step S7, that is, after the third image is generated, the control unit 15 stores the third image in the storage unit .

[0041] In the process of steps S1 to S7, the control unit 15 may cause the display unit 12 to display an image 32 for accepting a user operation, as shown in Fig. 4 to Fig. 6. The control unit 15 may cause the display unit 12 not to display the first notification to the third notification in response to the user operation accepted from the image 32. When the user becomes accustomed to operating the electronic device 1, the user may find the first notification and the like annoying. In this case, by not displaying the first notification to the third notification in response to the user operation, the possibility that the user will feel annoyed can be reduced.

[0042] In this manner, in the electronic device 1 according to the present embodiment, the control unit 15 marks a portion of the first image corresponding to the second image and causes the display unit 12 to display the second image based on a touch operation on the display unit 12 while the first image is being displayed. By marking a portion of the first image corresponding to the second image, the user can quickly ascertain which portion of the subject included in the first image is an enlarged image of the second image. For example, the user can quickly ascertain whether the second image 29 shown in FIG. 7 is an enlarged image of the frame 24 of the subject included in the first image 23. Thus, according to the present embodiment, the technology for displaying two images can be improved in terms of user convenience.

[0043] Furthermore, in this embodiment, when the control unit 15 causes the display unit 12 to display the first image, the control unit 15 may cause the display unit 12 to display a first notification. By displaying such a first notification on the display unit 12, even if the user is not familiar with using the electronic device 1, the user can quickly touch a portion of the first image displayed on the display unit 12 that the user wishes to take an enlarged photograph of.

[0044] Furthermore, in this embodiment, the control unit 15 may cause the display unit 12 to display location information of the electronic device 1 together with the first image. By displaying the location information of the electronic device 1, the user can easily grasp the location where the subject is being photographed, as described above. Furthermore, the control unit 15 may increase the transparency of the characters of the location information of the electronic device 1 displayed on the display unit 12. By increasing the transparency of the characters of the location information of the electronic device 1, it is possible to prevent the location information of the electronic device 1 from making the first image difficult to see, as described above.

[0045] In the present embodiment, control unit 15 may also cause display unit 12 to display information on the current time together with the first image. By displaying the current time, the user can easily grasp the time at which the subject is being photographed, as described above. Control unit 15 may also increase the transparency of the characters indicating the current time displayed on display unit 12. By increasing the transparency of the characters indicating the current time, it is possible to prevent the first image from becoming difficult to see due to the information on the current time, as described above.

[0046] Moreover, the electronic device 1 according to the present embodiment may include a first camera 10 capable of generating a first image and a second camera 11 capable of generating a second image. By including the first camera 10 and the second camera 11 in the electronic device 1, the specifications of the first camera 10 that generates the first image and the specifications of the second camera that generates the second image can be determined separately. With such a configuration, the electronic device 1 can generate a second image in which a part of a subject included in the first image is enlarged. For example, by using the second camera 11 with a smaller minimum shooting distance, a second image in which a part of a subject included in the first image is enlarged can be generated. In addition, by using a zoom function, the first image and the second image can be generated by one camera. However, when the first image and the second image are generated at the same time by one camera, the first image and the second image can only be generated with an angle of view centered on that camera. In this embodiment, by using the second camera 11 separate from the first camera 10, the user can generate the second image at any position (angle of view).

[0047] Furthermore, in this embodiment, control unit 15 may cause display unit 12 to display the first image in live view after starting up first camera 10. By displaying the first image in live view on display unit 12, the user can check the first image in real time via display unit 12. Furthermore, control unit 15 may cause second camera 11 to be started up when a touch operation on display unit 12 while displaying the first image in live view is accepted. Control unit 15 may cause display unit 12 to display the second image in live view after starting up second camera 11. By displaying the second image in live view on display unit 12, the user can check the second image in real time via display unit 12.

[0048] Furthermore, in this embodiment, control unit 15 may cause display unit 12, while displaying the first image in live view, to display an image of a shooting execution button for second camera 11. However, control unit 15 may cause display unit 12 to be in a state in which touch operation from the image of the shooting execution button cannot be accepted at this point. By causing touch operation from the image of the shooting execution button to be in a state in which touch operation cannot be accepted, it is possible to prevent second camera 11 from being started up, for example, by a user accidentally touching the image of the shooting execution button while the first image is being displayed in live view.

[0049] Furthermore, in this embodiment, when control unit 15 receives a touch operation on display unit 12 while displaying the first image in live view, control unit 15 may cause display unit 12 to display a second notification. By viewing the second notification, the user can know that the first image displayed as a still image on display unit 12 has been set as the background of the third image. By viewing the second notification, the user can know that second camera 11 will be started.

[0050] Furthermore, in this embodiment, when the control unit 15 causes the display unit 12 to display the first image generated as a still image, the control unit 15 may cause the display unit 12 to display an image of a back button for receiving a touch operation to return to the process of displaying the first image in live view. When the control unit 15 receives a touch operation on the image of the back button, the control unit 15 may return to the process of displaying the first image in live view. With this configuration, if the user does not want to set the first image displayed as a still image on the display unit 12 as the background of the third image, the user can return to the process of displaying the first image in live view. By returning to the process of displaying the first image in live view, the user can regenerate the first image, which is a still image to be set as the background of the third image.

[0051] Furthermore, in this embodiment, when control unit 15 causes display unit 12 to display the second image, control unit 15 may cause display unit 12 to display a third notification. Control unit 15 may adjust the position or size of the second image on display unit 12 based on a touch operation on display unit 12 while the second image is being displayed in live view. With this configuration, the user can easily adjust the position or size of the second image.

[0052] In this embodiment, the control unit 15 may generate a third image by superimposing the second image on the first image. The control unit 15 may mark the portion of the first image that corresponds to the second image in the generated third image. By generating such a third image, the user can easily check the subject later.

[0053] (Other embodiments) In another embodiment, the control unit 15 executes a correction process to correct the position of the mark added to the first image or the third image. In this correction process, the control unit 15 estimates a portion of the first image corresponding to the second image by executing an image recognition process on the first image and the second image after the second camera 11 is started. The image recognition process may use any algorithm. As an example, the image recognition process may be an image recognition process using machine learning, or may be an image recognition process using pattern matching or the like. The control unit 15 corrects the position of the mark added to the first image or the third image based on the estimated portion corresponding to the second image. As an example, the control unit 15 may correct the position of the mark added to the first image or the third image by moving the position of the mark added to the first image or the third image to the estimated portion corresponding to the second image. The control unit 15 may execute the correction process at any timing after the start of the second camera 11. That is, the control unit 15 may execute the correction process at any timing after the process of step S4.

[0054] For example, the configuration shown in FIG. 8 corresponds to the configuration after the processing of step S4. In the configuration shown in FIG. 8, the control unit 15 causes the display unit 12 to display a first image 40, which is a still image. The control unit 15 also causes the display unit 12 to display a second image 41 in live view. The control unit 15 marks the portion where the touch operation was accepted in the processing of step S2, and attaches a frame 42 to the first image 40. Here, the control unit 15 performs image recognition processing on the first image 40 and the second image 41, thereby estimating that the portion of the first image 40 that corresponds to the second image 41 is the portion 43. The control unit 15 corrects the position of the frame 42 by moving the position of the frame 42 to the position of the portion 43.

[0055] As described above, the user touches a portion of the first image displayed on the display unit 12 that the user wishes to enlarge and photograph using the second camera 11. However, as the user approaches the subject to generate the second image, the portion of the first image that the user touches may differ from the portion that the user actually enlarges and photographs using the second camera 11. Even in such a case, the position of the mark added to the first image or the third image is corrected, so that the user can correctly grasp the portion of the first image or the third image that corresponds to the second image.

[0056] Other configurations and effects of the electronic device 1 according to the other embodiments are the same as or similar to the configurations and effects of the electronic device 1 according to the above-described embodiments.

[0057] (Still another embodiment) In still another embodiment, control unit 15 generates an assumed image assumed as the second image based on a portion of display unit 12 displaying the first image where a touch operation has been received. For example, control unit 15 detects a portion of the first image where a touch operation has been received in the processing of step S2. Control unit 15 generates the assumed image by enlarging the image of the portion where the touch operation has been received using a zoom function of first camera 10. Control unit 15 may generate the assumed image in the processing of step S3.

[0058] After starting up the second camera 11, the control unit 15 compares the generated assumed image with the second image captured by the second camera 11. Based on the comparison result between the assumed image and the second image, the control unit 15 determines whether or not the shooting location of the second image is shifted. Here, the shooting location of the second image is shifted means that the shooting location of the second image is shifted from the shooting location where the subject is photographed by the second camera 11 in order to generate the second image that is an enlarged portion of the first image that has received the touch operation in the processing of step S2. When the control unit 15 determines that the shooting location of the second image is shifted, it causes the display unit 12 to display a fourth notification that notifies the user that the shooting location of the second image is shifted.

[0059] There are cases where the user wishes to generate a second image by enlarging the touched portion of the first image. When the control unit 15 determines that the shooting location of the second image is shifted, the control unit 15 causes the display unit 12 to display a fourth notification notifying the user that the shooting location of the second image is shifted. Such a fourth notification allows the user to easily understand whether the shooting location of the second image is shifted or not. As a result, the user can generate a second image by enlarging the touched portion of the first image.

[0060] After starting up second camera 11, control unit 15 may display the assumed image together with the second image on display unit 12. With this configuration, the user can easily check whether the shooting location of the second image is misaligned by comparing the second image with the assumed image.

[0061] Other configurations and effects of the electronic device 1 according to the further embodiment are the same as or similar to those of the electronic device 1 according to the embodiment described above.

[0062] (Still another embodiment) As shown in FIG. 9, an electronic device 101 according to yet another embodiment includes a first camera 10, a second camera 11, a display unit 12, a positioning unit 13, a memory unit 14, a control unit 15, a first sensor unit 16, and a second sensor unit 17.

[0063] The first sensor unit 16 is capable of measuring the distance from the electronic device 1 to a subject. The first sensor unit 16 includes, for example, at least one of an infrared sensor, a millimeter wave radar, and a LiDAR (Light Detection and Ranging).

[0064] The second sensor unit 17 is capable of detecting the attitude of the electronic device 1. The second sensor unit 17 includes at least one of, for example, a three-axis acceleration sensor, a three-axis gyro sensor, a three-axis angular velocity sensor, and an inertial measurement unit (IMU).

[0065] In still another embodiment, the control unit 15 executes a correction process to correct the position of the mark added to the first image or the third image. After starting the second camera 11, the control unit 15 measures the distance from the electronic device 1 to the subject by the first sensor unit 16, and detects the attitude of the electronic device 1 by the second sensor unit 17. The control unit 15 corrects the position of the mark added to the first image or the third image based on the measured distance from the electronic device 1 to the subject and the detected attitude of the electronic device 1. The control unit 15 may execute the correction process at any timing after starting the second camera 11. That is, the control unit 15 may execute the correction process at any timing after the process of step S4. By correcting the position of the mark added to the first image or the third image, the user can correctly grasp the part of the first image or the third image that corresponds to the second image in the same or similar manner as in the other embodiments described above.

[0066] In still another embodiment, the control unit 15 may generate guide information. The guide information is guide information for generating a second image by enlarging a portion of the first image where a touch operation was accepted in the process of step S2. After starting the second camera 11, the control unit 15 measures the distance from the electronic device 1 to the subject by the first sensor unit 16, and detects the attitude of the electronic device 1 by the second sensor unit 17. The control unit 15 generates the guide information based on a portion where a touch operation was accepted on the display unit 12 displaying the first image in the process of step S2, the measured distance to the subject, and the detected attitude of the electronic device 1. The guide information includes information on the distance to the subject and information on the direction in which the second camera 11 is moved relative to the subject. The control unit 15 causes the display unit 12 to display the generated guide information during the live view display of the second image. The control unit 15 may update the guide information as appropriate during the live view display of the second image, and cause the display unit 12 to display the updated guide information. Such guide information enables the user to quickly generate a second image by enlarging the touched portion of the first image.

[0067] The configuration and effects of the electronic device 101 according to the further embodiment are the same as or similar to the configuration and effects of the electronic device 1 according to the embodiment described above.

[0068] Although the present disclosure has been described based on the drawings and examples, it should be noted that a person skilled in the art can easily make various modifications or corrections based on the present disclosure. Therefore, it should be noted that these modifications or corrections are included in the scope of the present disclosure. For example, the functions, etc. included in each functional unit can be rearranged so as not to be logically inconsistent. Multiple functional units, etc. may be combined into one or divided. Each embodiment according to the present disclosure described above is not limited to being implemented faithfully to each of the embodiments described respectively, and may be implemented by combining each feature as appropriate or omitting a part. In other words, the contents of the present disclosure can be modified and corrected in various ways by a person skilled in the art based on the present disclosure. Therefore, these modifications and corrections are included in the scope of the present disclosure. For example, in each embodiment, each functional unit, each means, each step, etc. can be added to other embodiments so as not to be logically inconsistent, or replaced with each functional unit, each means, each step, etc. of other embodiments. In addition, in each embodiment, multiple functional units, each means, each step, etc. can be combined into one or divided. Furthermore, each of the above-described embodiments of the present disclosure is not limited to being implemented faithfully according to each of the described embodiments, but may be implemented by combining each feature or omitting some features as appropriate.

[0069] For example, an embodiment is also possible in which a general-purpose computer functions as the electronic device 1, 101 according to the above-described embodiment. Specifically, a program describing the processing contents for realizing each function of the electronic device 1, 101 according to the above-described embodiment is stored in the memory of the general-purpose computer, and the program is read and executed by a processor. Therefore, the present disclosure can also be realized as a program executable by a processor, or a non-transitory computer-readable medium that stores the program.

[0070] In one embodiment, (1) an electronic device includes: At least one camera capable of capturing an image of a subject to generate a first image and capturing a magnified image of a portion of the subject to generate a second image; A display unit capable of receiving a touch operation; a control unit that marks a portion of the first image that corresponds to the second image and displays the second image on the display unit based on a touch operation on the display unit while the first image is being displayed; and Equipped with.

[0071] (2) In the electronic device according to (1), When the control unit causes the first image to be displayed on the display unit, the control unit may cause the display unit to display a first notification that prompts a user to touch a portion of the first image to be zoomed in and photographed.

[0072] (3) In the electronic device according to (1) or (2), The control unit may cause the display unit to display position information of the electronic device together with the first image.

[0073] (4) In the electronic device according to any one of (1) to (3), The control unit may increase transparency of characters of the position information of the electronic device displayed on the display unit.

[0074] (5) In the electronic device according to any one of (1) to (4), The control unit may cause a display unit to display information about a current time together with the first image.

[0075] (6) In the electronic device according to any one of (1) to (5), The control unit may increase transparency of characters indicating the current time displayed on the display unit.

[0076] (7) In the electronic device according to any one of (1) to (6), the at least one camera includes a first camera capable of capturing an image of the subject to generate a first image, and a second camera capable of capturing an enlarged image of a portion of the subject to generate a second image, The minimum shooting distance of the second camera may be smaller than the minimum shooting distance of the first camera.

[0077] (8) In the electronic device according to (7), The control unit is After the first camera is started, the first image is displayed on the display unit as a live view; When a touch operation is received on the display unit while the first image is being displayed in live view, the first camera generates the first image as a still image and starts the second camera; The first image, which is the still image, may be displayed on the display unit, and a portion of the first image, which is the still image, that corresponds to the second image may be marked, and the second image may be displayed in live view on the display unit.

[0078] (9) The electronic device according to (7) or (8), The control unit may cause the display unit, while displaying the first image in live view, to display an image of a shooting execution button of the second camera for accepting an execution instruction to generate the second image as a still image as a touch operation, and may currently make it impossible to accept touch operations from the image of the shooting execution button.

[0079] (10) In the electronic device according to (9), The control unit may be configured to, after starting up the second camera, place the second camera in a state in which a touch operation from an image of the shooting execution button can be accepted.

[0080] (11) In the electronic device according to any one of (7) to (10), When the control unit receives a touch operation on the display unit while the first image is being displayed in live view, the control unit may cause the display unit to display a second notification notifying the user that a background has been set and that the second camera will be launched.

[0081] (12) In the electronic device according to any one of (7) to (11), When the control unit causes the display unit to display the first image, which is the generated still image, the control unit may also cause the display unit to display an image of a back button for accepting a touch operation to return to the process of displaying the first image in live view.

[0082] (13) In the electronic device according to any one of (7) to (12), The control unit may, when receiving a touch operation on an image of a shooting execution button of the second camera, generate a second image as a still image by the second camera.

[0083] (14) In the electronic device according to any one of (7) to (13), The control unit is A third image may be generated by superimposing the second image, which is generated as a still image, on the first image, which is generated as a still image, and the mark may be added to the generated third image.

[0084] (15) In the electronic device according to any one of (7) to (14), The control unit is displaying, on the display unit, a third notification that notifies a user that at least one of a position and a size of the second image can be adjusted, when the second image is displayed on the display unit; At least one of a position and a size of the second image on the display unit may be adjusted based on a touch operation on the display unit while the second image is being displayed in live view.

[0085] (16) In the electronic device according to any one of (1) to (6), The control unit may generate a third image by superimposing the second image on the first image, and may add the mark to the generated third image.

[0086] (17) In the electronic device according to any one of (7) to (15), The control unit may add the mark to a portion of the display unit displaying the first image in live view, where a touch operation has been accepted.

[0087] (18) In the electronic device according to (17), After starting up the second camera, the control unit may estimate a portion of the first image that corresponds to the second image by performing image recognition processing on the first image and the second image, and correct the position of the mark based on the estimated portion that corresponds to the second image.

[0088] (19) The electronic device according to (17), the control unit generates an assumed image that is assumed as the second image based on a portion where a touch operation is accepted on a display unit displaying the first image in live view; After the second camera is started, a fourth notification may be displayed on the display unit to notify the user that the location where the second image was taken is different, based on a comparison result between the expected image and the second image.

[0089] (20) In the electronic device according to (19), The control unit may cause the display unit to display the assumed image together with the second image.

[0090] (21) In the electronic device according to (17) above, a first sensor unit capable of measuring a distance from the electronic device to the subject; a second sensor unit capable of detecting the attitude of the electronic device; Further equipped with The control unit is After the second camera is started, a distance from the electronic device to the subject is measured by the first sensor unit, and an attitude of the electronic device is detected by the second sensor unit; The position of the mark may be corrected based on the measured distance from the electronic device to the subject and the attitude of the electronic device.

[0091] (22) In the electronic device according to (17) above, a first sensor unit capable of measuring a distance from the electronic device to the subject; a second sensor unit capable of detecting the attitude of the electronic device; Further equipped with After the second camera is started, the control unit measuring a distance from the electronic device to the subject with the first sensor unit, and detecting an attitude of the electronic device with the second sensor unit; Guide information for capturing the second image may be displayed on the display unit based on a portion of the display unit that accepts a touch operation while the first image is being displayed in live view, the measured distance to the subject, and the detected attitude of the electronic device.

[0092] In one embodiment, the display method (23) comprises: based on a touch operation on a display unit displaying a first image, marking a portion of the first image corresponding to a second image and displaying the second image on the display unit; the first image is an image generated by photographing a subject, The second image is an image generated by taking a magnified image of a part of the subject.

[0093] In one embodiment, the (24) program comprises: On the computer, Executing an operation including marking a portion of the first image corresponding to the second image and displaying the second image on the display unit based on a touch operation on the display unit while displaying the first image; the first image is an image generated by photographing a subject, The second image is an image generated by taking a magnified image of a part of the subject.

[0094] In this disclosure, descriptions such as "first" and "second" are identifiers for distinguishing the configuration. Configurations distinguished by descriptions such as "first" and "second" in this disclosure may exchange numbers in the configuration. For example, a first camera may exchange identifiers "first" and "second" with a second camera. The exchange of identifiers is performed simultaneously. The configurations remain distinguished even after the exchange of identifiers. Identifiers may be deleted. A configuration from which an identifier has been deleted is distinguished by a code. Descriptions of identifiers such as "first" and "second" in this disclosure alone should not be used to interpret the order of the configuration or to justify the existence of an identifier with a smaller number. [Explanation of symbols]

[0095] 1,101 Electronic equipment 10 First Camera 11 Second Camera 12 Display section 13 Positioning unit 14 Storage section 15 Control section 16 First sensor section 17 Second sensor section 20,23,40 1st image 21 First notice 22 parts 24 slots 25 Second Notice 26,29,41 2nd image 27 Third Notice 28 3rd image 30,31 Images 42 slots 43 parts

Claims

1. At least one camera capable of capturing an image of a subject to generate a first image and capturing an enlarged image of a portion of the subject to generate a second image; A display unit capable of receiving a touch operation; a control unit that marks a portion of the first image corresponding to the second image and displays the second image on the display unit based on a touch operation on the display unit while the first image is being displayed; An electronic device comprising:

2. The electronic device of claim 1 , wherein when the control unit causes the first image to be displayed on the display unit, the control unit causes the display unit to display a first notification that prompts a user to touch a portion of the first image to be enlarged and photographed.

3. The electronic device according to claim 1 , wherein the control unit causes the display unit to display position information of the electronic device together with the first image.

4. The electronic device according to claim 3 , wherein the control unit increases transparency of characters of the position information of the electronic device displayed on the display unit.

5. The electronic device according to claim 1 , wherein the control unit causes a display unit to display information about a current time together with the first image.

6. The electronic device according to claim 5 , wherein the control unit increases a transparency of characters indicating the current time displayed on the display unit.

7. the at least one camera includes a first camera capable of capturing an image of the subject to generate a first image, and a second camera capable of capturing an enlarged image of a portion of the subject to generate a second image, The electronic device according to claim 1 , wherein a minimum shooting distance of the second camera is smaller than a minimum shooting distance of the first camera.

8. The control unit is After the first camera is started, the first image is displayed on the display unit as a live view; When a touch operation is received on the display unit while the first image is being displayed in live view, the first camera generates the first image as a still image and starts the second camera; The electronic device according to claim 7, wherein the first image, which is the still image, is displayed on the display unit, a portion of the first image, which is the still image, that corresponds to the second image is marked, and the second image is displayed in live view on the display unit.

9. 9. The electronic device of claim 8, wherein the control unit causes the display unit, while displaying the first image in live view, to display an image of a shooting execution button of the second camera for accepting an execution instruction to generate the second image as a still image as a touch operation, and currently makes it impossible to accept touch operations from the image of the shooting execution button.

10. The electronic device according to claim 9 , wherein the control unit, after starting up the second camera, makes the second camera ready to receive a touch operation from an image of the shooting execution button.

11. 9. The electronic device of claim 8, wherein when the control unit receives a touch operation on the display unit while the first image is being displayed in live view, the control unit causes the display unit to display a second notification notifying the user that a background has been set and that the second camera will be activated.

12. The electronic device of claim 8, wherein the control unit, when displaying the first image, which is the generated still image, on the display unit, causes the display unit to display an image of a back button for accepting a touch operation to return to the process of displaying the first image in live view.

13. The electronic device according to claim 12 , wherein the control unit, when receiving a touch operation on an image of a shooting execution button of the second camera, generates the second image as a still image by the second camera.

14. The control unit is The electronic device according to claim 13 , further comprising: a third image generating unit that generates a third image by superimposing the second image, which is generated as a still image, on the first image, which is generated as a still image; and a marking unit that applies the mark to the generated third image.

15. The control unit is when the second image is displayed on the display unit, a third notification is displayed on the display unit to notify a user that at least one of a position and a size of the second image can be adjusted; The electronic device according to claim 8 , wherein at least one of a position and a size of the second image on the display unit is adjusted based on a touch operation on the display unit while the second image is being displayed as a live view.

16. The electronic device according to claim 1 , wherein the control unit generates a third image by superimposing the second image on the first image, and applies the mark to the generated third image.

17. The electronic device according to claim 8 , wherein the control unit places the mark on a portion of the display unit displaying the first image in a live view, the portion having received a touch operation.

18. 18. The electronic device of claim 17, wherein after starting the second camera, the control unit estimates a portion of the first image that corresponds to the second image by performing image recognition processing on the first image and the second image, and corrects the position of the mark based on the estimated portion that corresponds to the second image.

19. the control unit generates an assumed image that is assumed as the second image based on a portion where a touch operation is accepted on a display unit displaying the first image in live view; 18. The electronic device of claim 17, further comprising: a display unit that displays a fourth notification on the display unit, the fourth notification notifying a user that the location where the second image was taken is shifted, based on a comparison result between the assumed image and the second image, after the second camera is started.

20. The electronic device according to claim 19 , wherein the control unit causes the display unit to display the assumed image together with the second image.

21. a first sensor unit capable of measuring a distance from the electronic device to the subject; a second sensor unit capable of detecting the attitude of the electronic device; Further equipped with The control unit is After the second camera is started, a distance from the electronic device to the subject is measured by the first sensor unit, and an attitude of the electronic device is detected by the second sensor unit; The electronic device according to claim 17 , wherein the position of the mark is corrected based on the measured distance from the electronic device to the subject and the attitude of the electronic device.

22. a first sensor unit capable of measuring a distance from the electronic device to the subject; a second sensor unit capable of detecting the attitude of the electronic device; Further equipped with After the second camera is started, the control unit measuring a distance from the electronic device to the subject with the first sensor unit, and detecting an attitude of the electronic device with the second sensor unit; 18. The electronic device of claim 17, wherein guide information for capturing the second image is displayed on the display unit based on a portion of the display unit that accepts a touch operation while displaying the first image in live view, the measured distance to the subject, and the detected attitude of the electronic device.

23. and displaying the second image on the display unit while marking a portion of the first image corresponding to the second image based on a touch operation on the display unit while the first image is being displayed. the first image is an image generated by photographing a subject, The second image is an image generated by taking an enlarged image of a part of the subject. Display method.

24. On the computer, Executing an operation including marking a portion of the first image corresponding to the second image and displaying the second image on the display unit based on a touch operation on the display unit while the first image is being displayed; the first image is an image generated by photographing a subject, The second image is an image generated by taking an enlarged image of a part of the subject. program.

Citation Information

Patent Citations

  • Digital photographing device and operation method therefor

    CN107690649A

  • Terminal camera switching method and terminal

    CN110506416A

  • Split screen features for macro photography

    CN114641805A

  • Imaging device, imaging method, and program

    JP2010232962A

  • Image pickup apparatus and program

    JP2010268323A