Electronic device, display method and program

The electronic device enhances user convenience by allowing touch-based interaction to overlay and adjust enlarged image portions, addressing the limitations of existing image display technologies.

JP7785720B2Active Publication Date: 2025-12-15KYOCERA CORP
View PDF 13 Cites 0 Cited by

Patent Information

Application Number
JP2023083956
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2023-05-22
Publication Date
2025-12-15
Estimated Expiration
2043-05-22

AI Technical Summary

Technical Problem

Existing technologies for displaying two images leave room for improvement in terms of user convenience.

Method used

An electronic device equipped with at least one camera capable of capturing a subject image and a magnified portion, a display unit that accepts touch operations, and a control unit that marks and displays a corresponding portion of the first image to overlay the second image based on touch input, allowing for enhanced user interaction and image manipulation.

Benefits of technology

Improves user convenience by enabling quick and intuitive selection and display of enlarged image portions, enhancing the user's ability to determine which parts of the subject are enlarged, and providing real-time image checking and adjustment capabilities.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007785720000001
    Figure 0007785720000001
  • Figure 0007785720000002
    Figure 0007785720000002
  • Figure 0007785720000003
    Figure 0007785720000003
Patent Text Reader

Abstract

To improve a technique to display two images and related to convenience for a user.SOLUTION: An electronic apparatus comprises: at least one camera that can photograph a subject to create a first image, and can enlarge and photograph a part of the subject to create a second image; a display that can receive a touch operation; and a control unit. The control unit puts a mark on a portion in the first image corresponding to the second image on the basis of the touch operation to the display displaying the first image, and displays the second image on the display.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present disclosure relates to an electronic device, a display method, and a program. [Background technology]

[0002] Conventionally, there is known a technique for generating two images and displaying the two generated images. For example, Patent Document 1 describes displaying an image of a subject and an image of a photographer on a liquid crystal panel. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2011-55251 Summary of the Invention [Problem to be solved by the invention]

[0004] The technology for displaying two images leaves room for improvement in terms of user convenience.

[0005] In view of the above, an object of the present disclosure is to improve the technology for displaying two images in terms of user convenience. [Means for solving the problem]

[0006] An electronic device according to an embodiment of the present disclosure includes: at least one camera capable of capturing an image of a subject to generate a first image and capturing a magnified image of a portion of the subject to generate a second image; a display unit capable of receiving touch operations; a control unit that marks a portion of the first image corresponding to the second image and displays the second image on the display unit based on a touch operation on the display unit while the first image is being displayed; Equipped with.

[0007] A display method according to an embodiment of the present disclosure includes: and displaying the second image on the display unit while marking a portion of the first image corresponding to the second image based on a touch operation on the display unit while the first image is being displayed, the first image is an image generated by photographing a subject, The second image is an image generated by taking an enlarged image of a part of the subject.

[0008] A program according to an embodiment of the present disclosure includes: On the computer, executing an operation including marking a portion of the first image corresponding to the second image and displaying the second image on the display unit based on a touch operation on the display unit while the first image is being displayed; the first image is an image generated by photographing a subject, The second image is an image generated by taking an enlarged image of a part of the subject. [Effects of the Invention]

[0009] According to an embodiment of the present disclosure, the technique for displaying two images can be improved in terms of user convenience. [Brief explanation of the drawings]

[0010] [Figure 1] 1A and 1B are diagrams illustrating an example of use of an electronic device according to an embodiment of the present disclosure. [Figure 2] FIG. 2 is a block diagram of the electronic device shown in FIG. [Figure 3] 10 is a flowchart illustrating an example procedure of a display process according to an embodiment of the present disclosure. [Figure 4] 2 is a diagram showing an example of a display mode of the display unit shown in FIG. 1. FIG. [Figure 5] 2 is a diagram showing an example of a display mode of the display unit shown in FIG. 1. FIG. [Figure 6] 2 is a diagram showing an example of a display mode of the display unit shown in FIG. 1. FIG. [Figure 7] 2 is a diagram showing an example of a display mode of the display unit shown in FIG. 1. FIG. [Figure 8] FIG. 10 is a diagram illustrating an example of a display mode of a display unit according to another embodiment of the present disclosure. [Figure 9] FIG. 10 is a block diagram of an electronic device according to yet another embodiment of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings.

[0012] As shown in Fig. 1, an electronic device 1 according to this embodiment is used by a user. The user uses the electronic device 1 to capture an image of a subject. The electronic device 1 is, for example, a smartphone. However, the electronic device 1 may be any device that can capture an image of a subject.

[0013] 2, electronic device 1 includes first camera 10, second camera 11, display unit 12, positioning unit 13, storage unit 14, and control unit 15. In this embodiment, electronic device 1 includes two cameras, namely first camera 10 and second camera 11. However, electronic device 1 only needs to include at least one camera.

[0014] The first camera 10 is capable of generating a first image of a subject by capturing an image of the subject. The first camera 10 is, for example, a wide-angle camera. However, the first camera 10 is not limited to a wide-angle camera. The first camera 10 may be any camera, such as an ultra-wide-angle camera or a telephoto camera. The first camera 10 is configured to include an imaging element and a lens unit. The lens unit includes at least one lens. The lens is a multifocal lens. However, the lens may also be a single-focal lens. The first camera 10 has an autofocus function.

[0015] The second camera 11 is capable of capturing an image of a subject at a larger magnification than the first camera 10. The second camera 11 is capable of generating a second image of the subject by capturing an image of the subject at a larger magnification than the first camera 10. The second camera 11 is, for example, a macro camera. However, the second camera 11 is not limited to a macro camera. The second camera 11 may be any camera as long as it is capable of capturing an image of a subject at a larger magnification than the first camera 10. The second camera 11 is configured to include an imaging element and a lens unit. The lens unit includes at least one lens. The lens is a single-focus lens. However, the lens may be a multi-focus lens.

[0016] The shortest shooting distance of second camera 11 is shorter than the shortest shooting distance of first camera 10. The shortest shooting distance is the shortest distance from a subject to a camera that can be photographed by the camera.

[0017] The display unit 12 can display various types of information. The display unit 12 can also accept touch operations. The display unit 12 may be a touch screen display in which a display and a touch screen are integrated. The display is, for example, an LCD (Liquid Crystal Display) or an organic EL (Electro Luminescence) display. The touch screen can detect the position where the user touches the touch screen with a finger or the like. The display unit 12 accepts the touch operation by detecting the position where the user touched.

[0018] The positioning unit 13 can acquire position information of the electronic device 1. The positioning unit 13 includes at least one receiving module compatible with a satellite positioning system. The receiving module is, for example, a receiving module compatible with the GPS (Global Positioning System).

[0019] The storage unit 14 includes at least one semiconductor memory, at least one magnetic memory, at least one optical memory, or a combination of at least two of these. The semiconductor memory is, for example, a random access memory (RAM) or a read-only memory (ROM). The RAM is, for example, a static random access memory (SRAM) or a dynamic random access memory (DRAM). The ROM is, for example, an electrically erasable programmable read-only memory (EEPROM). The storage unit 14 may function as a main storage device, an auxiliary storage device, or a cache memory. The storage unit 14 stores data used in the operation of the electronic device 1 and data obtained by the operation of the electronic device 1.

[0020] The control unit 15 is configured to include at least one processor, at least one dedicated circuit, or a combination of these. The processor is, for example, a general-purpose processor such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit), or a dedicated processor specialized for a specific process. The dedicated circuit is, for example, an FPGA (Field-Programmable Gate Array) or an ASIC (Application Specific Integrated Circuit). The control unit 15 controls each unit of the electronic device 1 and executes processes related to the operation of the electronic device 1.

[0021] Based on a touch operation on display unit 12 while the first image is being displayed, control unit 15 marks a portion of the first image that corresponds to the second image and causes display unit 12 to display the second image. An example of this processing will be described with reference to FIG. 3.

[0022] 3 is a flowchart showing an example of a procedure of a display process according to an embodiment of the present disclosure. When control unit 15 activates first camera 10 based on a user operation, control unit 15 starts the process of step S1.

[0023] In the processing of step S1, after starting up first camera 10, control unit 15 moves the focus of first camera 10 so that it is aligned with the subject. After moving the focus of first camera 10, control unit 15 causes first camera 10 to capture an image of the subject and generate a first image. Control unit 15 may perform capture at any frame rate to generate the first image. Once the first image is generated, control unit 15 causes display unit 12 to display the first image in live view. Live view display refers to the display of an image captured and generated by a camera in real time. For example, as shown in FIG. 4, control unit 15 causes display unit 12 to display first image 20 in live view. A rose is captured as the subject in first image 20.

[0024] In the processing of step S1, the control unit 15 may acquire location information of the electronic device 1 using the positioning unit 13. The control unit 15 may display the location information of the electronic device 1 on the display unit 12 together with the first image. The control unit 15 may superimpose the location information of the electronic device 1 on the first image. For example, in FIG. 4, the control unit 15 displays the location information of the electronic device 1, "DDD Town, CCC Ward, BBB City, AAA Prefecture," together with the first image 20. By displaying the location information of the electronic device 1, the user can easily understand the location where the subject is being photographed. The control unit 15 may increase the transparency of the text of the location information of the electronic device 1 displayed on the display unit 12. In this case, the control unit 15 may increase the transparency of the text of the location information of the electronic device 1 displayed on the display unit 12 more than the transparency of the text of the location information of the electronic device 1 added to the third image described below. Alternatively, to increase the transparency of the text of the location information of the electronic device 1 displayed on the display unit 12, the control unit 15 may set the transparency of the text of the location information of the electronic device 1 displayed on the display unit 12 to a first predetermined value. The first predetermined value may be set taking into consideration the visibility of the first image when the text of the location information of the electronic device 1 is superimposed on the first image. The first predetermined value is, for example, 50%. By increasing the transparency of the text of the location information of the electronic device 1 in this way, when the location information of the electronic device 1 is displayed superimposed on the first image, it is possible to prevent the location information of the electronic device 1 from making the first image difficult to view.

[0025] In the process of step S1, control unit 15 may cause display unit 12 to display information about the current time along with the first image. Control unit 15 may superimpose the information about the current time on the first image. For example, in FIG. 4, control unit 15 causes first image 20 to display the current time in "yy / mm / dd / hh / mm" format. Displaying the current time allows the user to easily understand the time at which the subject is being photographed. Control unit 15 may increase the transparency of the text indicating the current time displayed on display unit 12. In this case, control unit 15 may increase the transparency of the text indicating the current time displayed on display unit 12 to be higher than the transparency of the text indicating the current time added to a third image (described below). Alternatively, to increase the transparency of the text indicating the current time displayed on display unit 12, control unit 15 may set the transparency of the text indicating the current time displayed on display unit 12 to a second predetermined value. The second predetermined value may be set taking into consideration the ease of viewing the first image when the text indicating the current time is superimposed on the first image. The second predetermined value may be the same as or different from the first predetermined value. Increasing the transparency of the current time characters in this manner prevents the current time information from making the first image difficult to see when the current time information is displayed superimposed on the first image. Control unit 15 may update the current time displayed on display unit 12 as appropriate.

[0026] In the processing of step S1, control unit 15 may display an image of a shooting execution button for second camera 11 on display unit 12 while displaying the first image in live view. The image of the shooting execution button for second camera 11 is an image for accepting an execution instruction to generate the second image as a still image as a touch operation. For example, in FIG. 4, control unit 15 displays image 30 of the shooting execution button for second camera 11. However, control unit 15 currently makes it impossible to accept a touch operation from the image of the shooting execution button for second camera 11. Therefore, as shown in FIG. 4, the brightness or luminosity of image 30 of the shooting execution button may be lower than that of other images on display unit 12. The low brightness or luminosity of image 30 of the shooting execution button allows the user to easily understand that a touch operation from image 30 is impossible to accept.

[0027] In the process of step S1, when the control unit 15 displays the first image on the display unit 12, the control unit 15 may display a first notification on the display unit 12. The first notification is a notification that prompts the user to touch a portion of the first image that the user wants to enlarge and photograph. For example, in FIG. 4, the control unit 15 displays the first notification 21. The first notification 21 includes text that reads, "Please touch the portion you want to enlarge and photograph." When the user sees the first notification, the user touches a portion of the first image displayed on the display unit 12 that the user wants to enlarge and photograph using the second camera 11. For example, if the user wants to enlarge and photograph the center of a rose in the first image 20 shown in FIG. 4, the user touches the portion 22 that is the center of the rose.

[0028] In the process of step S2, the control unit 15 accepts a touch operation on the display unit 12 while the first image is being displayed in live view. For example, in FIG.

[0029] In the process of step S3, control unit 15 generates a first image as a still image using first camera 10, triggered by the receipt of a touch operation in the process of step S2. Control unit 15 causes display unit 12 to display the first image generated as a still image. Control unit 15 marks the portion of the first image displayed on display unit 12 where the touch operation was received in the process of step S2. For example, as shown in FIG. 5, control unit 15 causes display unit 12 to display first image 23 with a frame 24 added. First image 23 is a still image. Frame 24 corresponds to portion 22 shown in FIG. 4.

[0030] The first image generated as a still image in the process of step S3 is set as the background of the third image in the process of step S7 described below. Therefore, control unit 15 may display a second notification on display unit 12 to notify the user that the background has been set. Furthermore, in the process of step S4 described below, control unit 15 activates second camera 11. Therefore, the second notification may notify the user that the background has been set and that second camera 11 will be activated. For example, in FIG. 5 , control unit 15 displays second notification 25 on display unit 12. Second notification 25 includes the text "Background set. Micro camera will be activated." By viewing the second notification, the user can know that the first image displayed as a still image on display unit 12 has been set as the background of the third image described below. Furthermore, by viewing the second notification, the user can know that second camera 11 will be activated.

[0031] In the processing of step S4, control unit 15 stops first camera 10 and starts second camera 11. After starting second camera 11, control unit 15 causes second camera 11 to generate a second image. Control unit 15 causes display unit 12 to display the generated second image in live view. Control unit 15 may cause display unit 12 to display the second image superimposed on the first image. For example, as shown in FIG. 6, control unit 15 causes display unit 12 to display second image 26 in live view. Control unit 15 also causes display unit 12 to display the second image 26 superimposed on the first image 23. In FIG. 6, control unit 15 causes second image 26 to be displayed at the bottom left as viewed from the front of display unit 12. Control unit 15 may cause the size of second image 26 to be smaller than the size of first image 23.

[0032] In the processing of step S4, the control unit 15 may adjust at least one of the position and size of the second image on the display unit 12 based on a touch operation on the display unit 12 while the second image is being displayed in live view. Therefore, when the control unit 15 displays the second image on the display unit 12, the control unit 15 may cause the display unit 12 to display a third notification informing the user that at least one of the position and size of the second image can be adjusted. The control unit 15 may also cause the display unit 12 to display a third notification informing the user that at least one of the position and size of the second image can be adjusted and that the second image is being displayed on the display unit 12. For example, in FIG. 6 , both the position and size of the second image can be adjusted. Therefore, the control unit 15 displays a third notification 27 on the display unit 12. The third notification includes text stating, "An image is being displayed in a small window. You can adjust the position and size by touching the small window." The user can learn by viewing the third notification that at least one of the position and size of the second image can be adjusted. The user touches the display unit 12 when he or she wants to adjust the position of the second image or the like.

[0033] In the process of step S4, after starting up second camera 11, control unit 15 may make second camera 11 ready to accept a touch operation from image 30 of the shooting execution button. For example, as shown in Fig. 6, control unit 15 may increase the brightness of image 30 of the shooting execution button more than the brightness of image 30 shown in Fig. 4. By increasing the brightness of image 30 of the shooting execution button, the user can easily understand that the image 30 is ready to accept a touch operation.

[0034] In the processing of step S4, when control unit 15 causes display unit 12 to display the first image, which is the generated still image, it may cause display unit 12 to display the image of a back button. The image of the back button is an image for accepting a touch operation to return to the processing of displaying the first image in live view, i.e., the processing of step S1. By returning to the processing of displaying the first image in live view, the user can regenerate the first image, which is a still image to be set as the background of the third image. For example, in FIG. 6, control unit 15 causes display unit 12 to display image 31 of a back button. When control unit 15 accepts a touch operation on image 31 of the back button, it may return to the processing of step S1.

[0035] After the process of step S4, the user brings electronic device 1 closer to the rose in order to photograph the center of the rose with second camera 11. The user brings electronic device 1 closer to the rose until the focus of second camera 11 is set on the center of the rose. When the focus of second camera 11 is set on the center of the rose, the user touches image 30 of the photographing execution button of second camera 11 as shown in FIG.

[0036] In the processing of step S5, control unit 15 accepts a touch operation on the image of the shooting execution button of second camera 11. Receipt of this touch operation triggers control unit 15 to generate a second image as a still image by second camera 11 (step S6). For example, control unit 15 uses second camera 11 to generate second image 29, which is a still image as shown in Fig. 7 described below.

[0037] In the process of step S7, control unit 15 generates a third image by superimposing the second image on the first image. Control unit 15 generates a third image by superimposing the second image generated as a still image in the process of step S6 on the first image generated as a still image in the process of step S3. Control unit 15 may use the first image as the background of the third image by superimposing the second image on the first image. Control unit 15 may display the generated third image on display unit 12. For example, as shown in FIG. 7, control unit 15 displays the generated third image 28 on display unit 12. In third image 28, second image 29, which is a still image, is superimposed on first image 23, which is a still image.

[0038] In the process of step S7, the control unit 15 marks the portion of the first image that corresponds to the second image in the third image. For example, in Fig. 7, the control unit 15 marks the third image 28 with a frame 24.

[0039] In the process of step S7, the control unit 15 may add the location information of the electronic device 1 acquired in the process of step S1 to the third image. The control unit 15 may also add information about the current time to the third image. For example, in FIG. 7, the control unit 15 adds the location information of the electronic device 1, "DDD Town, CCC Ward, BBB City, AAA Prefecture," and the current time in "yy / mm / dd / hh / mm," to the third image 28. The control unit 15 may lower the transparency of the text indicating the location information of the electronic device 1 and the current time added to the third image below the transparency of the text indicating the location information of the electronic device 1 and the current time displayed on the display unit 12 in the process of step S1. Alternatively, the control unit 15 may set the transparency of the text indicating the location information of the electronic device 1 and the current time added to the third image to a third predetermined value. The third predetermined value may be set taking into consideration the visibility of the text indicating the location information of the electronic device 1 and the current time when the text indicating the location information of the electronic device 1 and the current time is superimposed on the third image. The control unit 15 may make the characters of the location information and the current time of the electronic device 1 that are added to the third image opaque. When the characters are opaque, the transparency of the characters may be 0%.

[0040] After the process of step S7, that is, after the third image is generated, the control unit 15 stores the third image in the storage unit .

[0041] In the processing of steps S1 to S7, the control unit 15 may cause the display unit 12 to display an image 32 for accepting a user operation, as shown in FIGS. 4 to 6. The control unit 15 may prevent the display unit 12 from displaying the first to third notifications in response to the user operation accepted from the image 32. As the user becomes accustomed to operating the electronic device 1, the user may find the first notification and the like annoying. In this case, by preventing the display unit 12 from displaying the first to third notifications in response to the user operation, the possibility that the user will feel annoyed can be reduced.

[0042] As described above, in the electronic device 1 according to the present embodiment, based on a touch operation on the display unit 12 while the first image is being displayed, the control unit 15 marks a portion of the first image corresponding to the second image and causes the display unit 12 to display the second image. By marking a portion of the first image corresponding to the second image, the user can quickly determine which portion of the subject included in the first image is an enlarged image of the second image. For example, the user can quickly determine whether the second image 29 shown in FIG. 7 is an enlarged image of the frame 24 of the subject included in the first image 23. Therefore, according to the present embodiment, the technology for displaying two images can be improved in terms of user convenience.

[0043] Furthermore, in this embodiment, when the first image is displayed on the display unit 12, the control unit 15 may also display a first notification on the display unit 12. By displaying such a first notification on the display unit 12, the user can quickly touch the part of the first image displayed on the display unit 12 that the user wishes to zoom in on, even if the user is not familiar with using the electronic device 1.

[0044] Furthermore, in this embodiment, control unit 15 may cause display unit 12 to display location information of electronic device 1 together with the first image. By displaying the location information of electronic device 1, the user can easily understand the location where the subject is being photographed, as described above. Furthermore, control unit 15 may increase the transparency of the text of the location information of electronic device 1 displayed on display unit 12. By increasing the transparency of the text of the location information of electronic device 1, it is possible to prevent the location information of electronic device 1 from making the first image difficult to see, as described above.

[0045] In the present embodiment, control unit 15 may also cause display unit 12 to display information about the current time together with the first image. By displaying the current time, the user can easily grasp the time at which the subject is being photographed, as described above. Control unit 15 may also increase the transparency of the characters indicating the current time displayed on display unit 12. By increasing the transparency of the characters indicating the current time, it is possible to prevent the information about the current time from making the first image difficult to see, as described above.

[0046] Furthermore, the electronic device 1 according to the present embodiment may include a first camera 10 capable of generating a first image and a second camera 11 capable of generating a second image. By including the first camera 10 and the second camera 11 in the electronic device 1, the specifications of the first camera 10 that generates the first image and the specifications of the second camera that generates the second image can be determined separately. This configuration allows the electronic device 1 to generate a second image in which a portion of a subject included in the first image is more enlarged. For example, by using the second camera 11 with a shorter minimum shooting distance, a second image in which a portion of a subject included in the first image is more enlarged can be generated. Furthermore, by using a zoom function, the first image and the second image can also be generated using a single camera. However, when the first image and the second image are generated simultaneously using a single camera, the first image and the second image can only be generated with an angle of view centered on that camera. In the present embodiment, by using the second camera 11 separate from the first camera 10, the user can generate the second image at any position (angle of view).

[0047] Furthermore, in this embodiment, after starting up the first camera 10, the control unit 15 may cause the display unit 12 to display the first image in live view. By displaying the first image in live view on the display unit 12, the user can check the first image in real time via the display unit 12. Furthermore, the control unit 15 may cause the second camera 11 to be started up when the control unit 15 receives a touch operation on the display unit 12 while the first image is being displayed in live view. After starting up the second camera 11, the control unit 15 may cause the display unit 12 to display the second image in live view. By displaying the second image in live view on the display unit 12, the user can check the second image in real time via the display unit 12.

[0048] Furthermore, in this embodiment, control unit 15 may cause display unit 12, while displaying the first image in live view, to display an image of a shooting execution button for second camera 11. However, control unit 15 may cause display unit 12 to be in a state where touch operations from the image of the shooting execution button cannot be accepted at this point. By causing touch operations from the image of the shooting execution button to be in a state where they cannot be accepted, it is possible to prevent second camera 11 from being started up, for example, by the user accidentally touching the image of the shooting execution button while the first image is being displayed in live view.

[0049] Furthermore, in this embodiment, when control unit 15 receives a touch operation on display unit 12 while the first image is being displayed in live view, control unit 15 may cause display unit 12 to display a second notification. By viewing the second notification, the user can know that the first image displayed as a still image on display unit 12 has been set as the background of the third image. Furthermore, by viewing the second notification, the user can know that second camera 11 will be activated.

[0050] Furthermore, in this embodiment, when control unit 15 causes display unit 12 to display the first image generated as a still image, control unit 15 may cause display unit 12 to display an image of a back button for accepting a touch operation to return to the process of displaying the first image in live view. When control unit 15 accepts a touch operation on the image of the back button, control unit 15 may return to the process of displaying the first image in live view. With this configuration, if the user does not want to set the first image displayed as a still image on display unit 12 as the background of the third image, the user can return to the process of displaying the first image in live view. By returning to the process of displaying the first image in live view, the user can regenerate the first image as a still image to be set as the background of the third image.

[0051] Furthermore, in this embodiment, when the second image is displayed on the display unit 12, the control unit 15 may cause a third notification to be displayed on the display unit 12. The control unit 15 may adjust the position or size of the second image on the display unit 12 based on a touch operation on the display unit 12 while the second image is being displayed in live view. With this configuration, the user can easily adjust the position or size of the second image.

[0052] In this embodiment, the control unit 15 may generate a third image by superimposing the second image on the first image. The control unit 15 may mark the portion of the first image that corresponds to the second image in the generated third image. By generating such a third image, the user can easily check the subject later.

[0053] (Other embodiments) In another embodiment, the control unit 15 executes a correction process to correct the position of a mark added to the first image or the third image. In this correction process, after the second camera 11 is started, the control unit 15 executes an image recognition process on the first image and the second image to estimate a portion of the first image that corresponds to the second image. The image recognition process may use any algorithm. For example, the image recognition process may be an image recognition process using machine learning or an image recognition process using pattern matching, etc. The control unit 15 corrects the position of the mark added to the first image or the third image based on the estimated portion that corresponds to the second image. For example, the control unit 15 may correct the position of the mark added to the first image or the third image by moving the position of the mark added to the first image or the third image to the estimated portion that corresponds to the second image. The control unit 15 may execute the correction process at any timing after the start of the second camera 11. In other words, the control unit 15 may execute the correction process at any timing after the processing of step S4.

[0054] For example, the configuration shown in FIG. 8 corresponds to the configuration after the processing of step S4. In the configuration shown in FIG. 8, control unit 15 causes display unit 12 to display first image 40, which is a still image. Control unit 15 also causes display unit 12 to display second image 41 in live view. Control unit 15 marks the portion where the touch operation was accepted in the processing of step S2, and adds a frame 42 to first image 40. Here, control unit 15 performs image recognition processing on first image 40 and second image 41, and thereby estimates that the portion of first image 40 that corresponds to second image 41 is portion 43. Control unit 15 corrects the position of frame 42 by moving the position of frame 42 to the position of portion 43.

[0055] As described above, the user touches a portion of the first image displayed on display unit 12 that the user wishes to enlarge and photograph using second camera 11. However, as the user approaches the subject to generate the second image, the portion of the first image that the user touched may differ from the portion that the user actually enlarges and photographs using second camera 11. Even in such a case, the position of the mark added to the first image or the third image is corrected, so that the user can correctly identify the portion of the first image or the third image that corresponds to the second image.

[0056] Other configurations and effects of the electronic device 1 according to the other embodiments are the same as or similar to the configurations and effects of the electronic device 1 according to the above-described embodiments.

[0057] (Still another embodiment) In yet another embodiment, control unit 15 generates an assumed image to be used as the second image based on a portion of display unit 12 displaying the first image where a touch operation has been received. For example, control unit 15 detects a portion of the first image where a touch operation has been received in the processing of step S2. Control unit 15 generates the assumed image by enlarging the image of the portion where the touch operation has been received using the zoom function of first camera 10. Control unit 15 may generate the assumed image in the processing of step S3.

[0058] After second camera 11 is started, control unit 15 compares the generated assumed image with the second image captured by second camera 11. Based on the comparison result between the assumed image and the second image, control unit 15 determines whether the shooting location of the second image is shifted. Here, "the shooting location of the second image is shifted" means that the shooting location is shifted from the shooting location where the subject is captured by second camera 11 in order to generate the second image, which is an enlarged version of the portion of the first image for which the touch operation was accepted in the processing of step S2. If control unit 15 determines that the shooting location of the second image is shifted, it causes display unit 12 to display a fourth notification notifying the user that the shooting location of the second image is shifted.

[0059] The user may wish to generate a second image by enlarging the touched portion of the first image. When the control unit 15 determines that the shooting location of the second image is misaligned, the control unit 15 causes the display unit 12 to display a fourth notification notifying the user that the shooting location of the second image is misaligned. This fourth notification allows the user to easily determine whether the shooting location of the second image is misaligned. As a result, the user can generate a second image by enlarging the touched portion of the first image.

[0060] After starting up second camera 11, control unit 15 may display the second image and the assumed image on display unit 12. With this configuration, the user can easily check whether the shooting location of the second image is misaligned by comparing the second image with the assumed image.

[0061] Other configurations and effects of the electronic device 1 according to the other embodiments are the same as or similar to the configurations and effects of the electronic device 1 according to the above-described embodiments.

[0062] (Still another embodiment) As shown in FIG. 9, an electronic device 101 according to yet another embodiment includes a first camera 10, a second camera 11, a display unit 12, a positioning unit 13, a memory unit 14, a control unit 15, a first sensor unit 16, and a second sensor unit 17.

[0063] The first sensor unit 16 can measure the distance from the electronic device 1 to a subject. The first sensor unit 16 includes, for example, at least one of an infrared sensor, a millimeter wave radar, and a LiDAR (Light Detection and Ranging).

[0064] The second sensor unit 17 is capable of detecting the attitude of the electronic device 1. The second sensor unit 17 includes, for example, at least one of a three-axis acceleration sensor, a three-axis gyro sensor, a three-axis angular velocity sensor, an inertial measurement unit (IMU), and the like.

[0065] In yet another embodiment, the control unit 15 executes a correction process to correct the position of the mark added to the first image or the third image. After starting the second camera 11, the control unit 15 measures the distance from the electronic device 1 to the subject using the first sensor unit 16 and detects the attitude of the electronic device 1 using the second sensor unit 17. The control unit 15 corrects the position of the mark added to the first image or the third image based on the measured distance from the electronic device 1 to the subject and the detected attitude of the electronic device 1. The control unit 15 may execute the correction process at any timing after starting the second camera 11. In other words, the control unit 15 may execute the correction process at any timing after the processing of step S4. By correcting the position of the mark added to the first image or the third image, the user can correctly identify the portion of the first image or the third image that corresponds to the second image, in the same or similar manner as in the other embodiments described above.

[0066] In still another embodiment, control unit 15 may generate guide information. The guide information is guide information for generating a second image by enlarging a portion of the first image where a touch operation was accepted in the processing of step S2. After starting second camera 11, control unit 15 measures the distance from electronic device 1 to the subject using first sensor unit 16 and detects the attitude of electronic device 1 using second sensor unit 17. Control unit 15 generates the guide information based on the portion where a touch operation was accepted on display unit 12 displaying the first image in the processing of step S2, the measured distance to the subject, and the detected attitude of electronic device 1. The guide information includes information on the distance to the subject and information on the direction in which second camera 11 should be moved relative to the subject. Control unit 15 displays the generated guide information on display unit 12 during live view display of the second image. Control unit 15 may update the guide information as appropriate during live view display of the second image and display the updated guide information on display unit 12. Such guide information allows the user to quickly generate a second image that is an enlarged version of the touched portion of the first image.

[0067] The configuration and effects of the electronic device 101 according to the further embodiment are the same as or similar to the configuration and effects of the electronic device 1 according to the embodiment described above.

[0068] While the present disclosure has been described based on various drawings and examples, it should be noted that those skilled in the art would easily be able to make various modifications and alterations based on the present disclosure. Therefore, it should be noted that these modifications and alterations are within the scope of the present disclosure. For example, the functions included in each functional unit can be rearranged so as not to cause logical inconsistencies. Multiple functional units can be combined into one or separated. The above-described embodiments of the present disclosure are not limited to faithful implementation of each of the described embodiments, but can be implemented by combining features or omitting some features as appropriate. In other words, those skilled in the art can make various modifications and alterations based on the present disclosure. Therefore, these modifications and alterations are within the scope of the present disclosure. For example, in each embodiment, each functional unit, means, or step can be added to other embodiments so as not to cause logical inconsistencies, or can be replaced with each functional unit, means, or step of other embodiments. Furthermore, in each embodiment, multiple functional units, means, or steps can be combined into one or separated. Furthermore, each of the above-described embodiments of the present disclosure is not limited to being implemented faithfully according to each of the described embodiments, but can also be implemented by combining each feature or omitting some of them as appropriate.

[0069] For example, an embodiment is also possible in which a general-purpose computer functions as the electronic device 1, 101 according to the above-described embodiment. Specifically, a program describing the processing content for realizing each function of the electronic device 1, 101 according to the above-described embodiment is stored in the memory of the general-purpose computer, and the program is read and executed by a processor. Therefore, the present disclosure can also be realized as a program executable by a processor, or a non-transitory computer-readable medium storing the program.

[0070] In one embodiment, (1) the electronic device comprises: at least one camera capable of capturing an image of a subject to generate a first image and capturing a magnified image of a portion of the subject to generate a second image; a display unit capable of receiving touch operations; a control unit that marks a portion of the first image corresponding to the second image and displays the second image on the display unit based on a touch operation on the display unit while the first image is being displayed; Equipped with.

[0071] (2) In the electronic device described in (1), When the control unit causes the first image to be displayed on the display unit, the control unit may cause the display unit to display a first notification that prompts the user to touch a portion of the first image to be enlarged and photographed.

[0072] (3) In the electronic device described in (1) or (2), The control unit may cause the display unit to display location information of the electronic device together with the first image.

[0073] (4) In the electronic device according to any one of (1) to (3), The control unit may increase the transparency of characters of the position information of the electronic device displayed on the display unit.

[0074] (5) In the electronic device according to any one of (1) to (4), The control unit may cause a display unit to display information about a current time together with the first image.

[0075] (6) In the electronic device according to any one of (1) to (5), The control unit may increase the transparency of characters indicating the current time displayed on the display unit.

[0076] (7) In the electronic device according to any one of (1) to (6), the at least one camera includes a first camera capable of capturing an image of the subject and generating a first image, and a second camera capable of capturing an enlarged image of a portion of the subject and generating a second image, The minimum object distance of the second camera may be smaller than the minimum object distance of the first camera.

[0077] (8) In the electronic device described in (7), The control unit After the first camera is started, the first image is displayed on the display unit as a live view; When a touch operation is received on the display unit while the first image is being displayed in live view, the first camera generates the first image as a still image and starts the second camera; The first image, which is the still image, may be displayed on the display unit, and a mark may be added to a portion of the first image, which is the still image, that corresponds to the second image, and the second image may be displayed in live view on the display unit.

[0078] (9) In the electronic device according to (7) or (8), The control unit may cause the display unit, while displaying the first image in live view, to display an image of a shooting execution button of the second camera for accepting an execution instruction to generate the second image as a still image as a touch operation, and may currently be in a state where it is not possible to accept touch operations from the image of the shooting execution button.

[0079] (10) In the electronic device described in (9), The control unit may be configured to, after starting up the second camera, make the second camera ready to accept a touch operation from the image of the shooting execution button.

[0080] (11) In the electronic device according to any one of (7) to (10), When the control unit receives a touch operation on the display unit while the first image is being displayed in live view, the control unit may cause the display unit to display a second notification notifying the user that a background has been set and that the second camera will be activated.

[0081] (12) In the electronic device according to any one of (7) to (11), When the control unit causes the display unit to display the first image, which is the generated still image, the control unit may also cause the display unit to display an image of a back button for accepting a touch operation to return to the process of displaying the first image in live view.

[0082] (13) In the electronic device according to any one of (7) to (12), When the control unit receives a touch operation on an image of a shooting execution button of the second camera, the control unit may generate a second image as a still image by the second camera.

[0083] (14) In the electronic device according to any one of (7) to (13), The control unit A third image may be generated by superimposing the second image, which has been generated as a still image, on the first image, which has been generated as a still image, and the mark may be added to the generated third image.

[0084] (15) In the electronic device according to any one of (7) to (14), The control unit when the second image is displayed on the display unit, displaying a third notification on the display unit that notifies the user that at least one of a position and a size of the second image can be adjusted; At least one of a position and a size of the second image on the display unit may be adjusted based on a touch operation on the display unit while the second image is being displayed in live view.

[0085] (16) In the electronic device according to any one of (1) to (6), The control unit may generate a third image by superimposing the second image on the first image, and may add the mark to the generated third image.

[0086] (17) In the electronic device according to any one of (7) to (15), The control unit may add the mark to a portion of the display unit displaying the first image in live view, where a touch operation has been received.

[0087] (18) In the electronic device described in (17), After starting the second camera, the control unit may estimate a portion of the first image that corresponds to the second image by performing image recognition processing on the first image and the second image, and correct the position of the mark based on the estimated portion that corresponds to the second image.

[0088] (19) In the electronic device described in (17), the control unit generates an assumed image that is assumed as the second image based on a portion where a touch operation is accepted on a display unit that is displaying the first image in live view; After the second camera is started, a fourth notification may be displayed on the display unit to notify the user that the location where the second image was taken is different, based on the comparison result between the assumed image and the second image.

[0089] (20) In the electronic device described in (19), The control unit may cause the display unit to display the assumed image together with the second image.

[0090] (21) In the electronic device described in (17) above, a first sensor unit capable of measuring a distance from the electronic device to the subject; a second sensor unit capable of detecting the attitude of the electronic device; Furthermore, The control unit After the second camera is activated, the first sensor measures a distance from the electronic device to the subject, and the second sensor detects an attitude of the electronic device; The position of the mark may be corrected based on the measured distance from the electronic device to the subject and the attitude of the electronic device.

[0091] (22) In the electronic device described in (17) above, a first sensor unit capable of measuring a distance from the electronic device to the subject; a second sensor unit capable of detecting the attitude of the electronic device; Furthermore, After the second camera is started, the control unit measuring a distance from the electronic device to the subject with the first sensor unit, and detecting an attitude of the electronic device with the second sensor unit; Guide information for capturing the second image may be displayed on the display unit based on a portion of the display unit that receives a touch operation while the first image is being displayed in live view, the measured distance to the subject, and the detected attitude of the electronic device.

[0092] In one embodiment, (23) the display method includes: and displaying the second image on the display unit while marking a portion of the first image corresponding to the second image based on a touch operation on the display unit while the first image is being displayed, the first image is an image generated by photographing a subject, The second image is an image generated by taking an enlarged image of a part of the subject.

[0093] In one embodiment, the program (24) On the computer, executing an operation including marking a portion of the first image corresponding to the second image and displaying the second image on the display unit based on a touch operation on the display unit while the first image is being displayed; the first image is an image generated by photographing a subject, The second image is an image generated by taking an enlarged image of a part of the subject.

[0094] In this disclosure, descriptions such as "first" and "second" are identifiers for distinguishing the configuration. In this disclosure, the configurations distinguished by descriptions such as "first" and "second" can have their numbers exchanged. For example, the first camera can exchange the identifiers "first" and "second" with the second camera. The exchange of identifiers is performed simultaneously. The configurations remain distinguished even after the identifier exchange. Identifiers may be deleted. A configuration from which an identifier has been deleted is distinguished by a symbol. The descriptions of identifiers such as "first" and "second" in this disclosure should not be used solely to interpret the order of the configurations or to justify the existence of an identifier with a smaller number. [Explanation of symbols]

[0095] 1,101 Electronic equipment 10 Camera 1 11 Second Camera 12 Display section 13 Positioning unit 14 Storage section 15 Control Unit 16 First sensor section 17 Second sensor section 20,23,40 1st image 21 First notice 22 parts 24 slots 25 Second Notice 26,29,41 2nd image 27 Third Notice 28 Third image 30,31 images 42 slots 43 parts

Claims

1. a first camera capable of capturing an image of a subject and generating a first image; a second camera capable of taking an enlarged image of a portion of the subject to generate a second image; a display unit capable of receiving touch operations; Control unit and Equipped with The control unit When a touch operation on the display unit is received while the first image is being displayed in live view, the first camera generates the first image as a still image and starts the second camera; An electronic device that displays the first image, which is the still image, on the display unit, marks a portion of the first image, which is the still image, that corresponds to the second image, and displays the second image on the display unit.

2. 2. The electronic device of claim 1, wherein when the control unit causes the first image to be displayed on the display unit, the control unit causes the display unit to display a first notification prompting the user to touch a portion of the first image to be enlarged.

3. The electronic device according to claim 1 , wherein the control unit causes the display unit to display location information of the electronic device together with the first image.

4. The electronic device according to claim 3 , wherein the control unit increases transparency of characters of the position information of the electronic device displayed on the display unit.

5. The electronic device according to claim 1 , wherein the control unit causes a display unit to display information about a current time together with the first image.

6. The electronic device according to claim 5 , wherein the control unit increases transparency of the characters indicating the current time displayed on the display unit.

7. The electronic device described in claim 1, wherein the minimum shooting distance of the second camera is smaller than the minimum shooting distance of the first camera.

8. The control unit The electronic device according to claim 1 , wherein after the first camera is activated, the first image is displayed on the display unit as a live view.

9. 2. The electronic device of claim 1, wherein the control unit causes the display unit, while displaying the first image in live view, to display an image of a shooting execution button of the second camera for accepting an execution instruction to generate the second image as a still image as a touch operation, and currently makes it impossible to accept touch operations from the image of the shooting execution button.

10. The electronic device according to claim 9 , wherein the control unit, after starting the second camera, makes the second camera ready to accept a touch operation from the image of the shooting execution button.

11. 2. The electronic device of claim 1, wherein when the control unit receives a touch operation on the display unit while the first image is being displayed in live view, the control unit causes the display unit to display a second notification notifying the user that a background has been set and that the second camera will be activated.

12. 2. The electronic device of claim 1, wherein the control unit, when displaying the first image, which is the generated still image, on the display unit, causes the display unit to display an image of a back button for accepting a touch operation to return to the process of displaying the first image in live view.

13. The electronic device according to claim 12 , wherein the control unit, upon receiving a touch operation on an image of a shooting execution button of the second camera, generates a second image as a still image by the second camera.

14. The control unit The electronic device according to claim 13 , wherein a third image is generated by superimposing the second image, which is generated as a still image, on the first image, which is generated as a still image, and the mark is added to the generated third image.

15. The control unit when the second image is displayed on the display unit, displaying a third notification on the display unit that notifies the user that at least one of a position and a size of the second image can be adjusted; The electronic device according to claim 1 , wherein at least one of a position and a size of the second image on the display unit is adjusted based on a touch operation on the display unit while the second image is being displayed in live view.

16. The electronic device according to claim 1 , wherein the control unit generates a third image by superimposing the second image on the first image, and applies the mark to the generated third image.

17. The electronic device of claim 1 , wherein the control unit applies the mark to a portion of the display unit displaying the first image in live view, where a touch operation has been accepted.

18. 18. The electronic device of claim 17, wherein after starting the second camera, the control unit estimates a portion of the first image that corresponds to the second image by performing image recognition processing on the first image and the second image, and corrects the position of the mark based on the estimated portion that corresponds to the second image.

19. the control unit generates an assumed image that is assumed as the second image based on a portion where a touch operation is accepted on a display unit that is displaying the first image in live view; 18. The electronic device of claim 17, wherein after the second camera is started, a fourth notification is displayed on the display unit to notify the user that the location where the second image was taken is different, based on a comparison result between the assumed image and the second image.

20. The electronic device according to claim 19 , wherein the control unit causes the display unit to display the assumed image together with the second image.

21. a first sensor unit capable of measuring a distance from the electronic device to the subject; a second sensor unit capable of detecting the attitude of the electronic device; Furthermore, The control unit After the second camera is activated, the first sensor measures a distance from the electronic device to the subject, and the second sensor detects an attitude of the electronic device; The electronic device according to claim 17 , wherein the position of the mark is corrected based on the measured distance from the electronic device to the subject and the attitude of the electronic device.

22. a first sensor unit capable of measuring a distance from the electronic device to the subject; a second sensor unit capable of detecting the attitude of the electronic device; Furthermore, After the second camera is started, the control unit measuring a distance from the electronic device to the subject with the first sensor unit, and detecting an attitude of the electronic device with the second sensor unit; 18. The electronic device according to claim 17, wherein guide information for capturing the second image is displayed on the display unit based on a portion of the display unit that has accepted a touch operation while the first image is being displayed in live view, the measured distance to the subject, and the detected attitude of the electronic device.

23. When a touch operation is received on a display unit while a first image is being displayed in live view, a first camera generates the first image as a still image and a second camera is activated; displaying the first image, which is the still image, on the display unit, marking a portion of the first image, which is the still image, that corresponds to the second image, and displaying the second image on the display unit; the first image is an image generated by the first camera capturing an image of a subject, The second image is an image generated by the second camera taking a magnified image of a part of the subject. Display method.

24. On the computer, When a touch operation is received on a display unit while a first image is being displayed in live view, a first camera generates the first image as a still image and a second camera is activated; displaying the first image, which is the still image, on the display unit, marking a portion of the first image, which is the still image, that corresponds to the second image, and displaying the second image on the display unit; the first image is an image generated by the first camera capturing an image of a subject, The second image is an image generated by the second camera taking a magnified image of a part of the subject. program.

Citation Information

Patent Citations

  • Digital photographing device and operation method therefor

    CN107690649A

  • Terminal camera switching method and terminal

    CN110506416A

  • Split screen features for macro photography

    CN114641805A

  • Imaging device, imaging method, and program

    JP2010232962A

  • Image pickup apparatus and program

    JP2010268323A