Camera device, camera device control method, and computer-readable storage medium

Abstract

The present invention provides an imaging device, a method for controlling an imaging device, and a computer-readable storage medium. The imaging device, which is used for performing imaging while displaying a real-time image, includes: a display component for displaying the real-time image on a display unit; a selection component for selecting a plurality of captured images; a generation component for generating support information for changing the capturing conditions of the real-time image based on information related to the selected captured images, and displaying the generated support information on the display unit; a change component for changing the capturing conditions of the real-time image based on a user operation; and a capture component for capturing the real-time image according to the changed capturing conditions.

Description

Technical Field

[0001] The present invention relates to an imaging device and a method for controlling the imaging device. Background Art

[0002] In recent years, it has become possible to view a plurality of images posted on social networking services (SNS) etc. in a list format. Displaying a list of images with similar subjects, compositions, brightness and color sense creates a sense of unity, thereby giving a good impression of appearance.

[0003] As a technology for capturing multiple images, Japanese Patent Laid-Open No. 2017-116872 discloses a technology that displays an image of a subject to be re-captured and a live view image as a moving image being captured side by side, and enables a user to make gestures or facial expressions during shooting while confirming the image of the subject to be re-captured.

[0004] However, even when a live view image (i.e., a moving image being captured) is displayed alongside an already captured image, it may require considerable effort to adjust the shooting conditions to achieve similar composition, brightness, and color. Furthermore, it is difficult to perform processing for adjusting composition, brightness, and color after shooting, which may require reshooting the same subject. Summary of the Invention

[0005] The present invention provides an image pickup apparatus capable of easily adjusting shooting conditions such as composition, brightness, and color sense according to a shot image while a real-time image is being viewed.

[0006] The camera device according to the present invention is a camera device for shooting while displaying a real-time image, and the camera device includes: a display component for displaying the real-time image on a display unit; a selection component for selecting a plurality of captured images; a generation component for generating support information for changing the shooting conditions of the real-time image based on information related to the selected captured images, and displaying the generated support information on the display unit; a changing component for changing the shooting conditions of the real-time image based on user operations; and a shooting component for shooting the real-time image according to the changed shooting conditions.

[0007] A method for controlling an imaging device, the imaging device being used to perform imaging while displaying a real-time image, the method comprising the following steps: displaying the real-time image on a display unit; selecting a plurality of captured images; generating support information for changing the imaging conditions of the real-time image based on information related to the selected captured images, and displaying the generated support information on the display unit; changing the imaging conditions of the real-time image based on a user operation; and capturing the real-time image according to the changed imaging conditions.

[0008] A computer-readable storage medium stores a program for causing a computer to function as each component of the above-mentioned imaging apparatus.

[0009] Further features of the present invention will become apparent from the following description of exemplary embodiments with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] Figure 1 is a block diagram illustrating a configuration example of an imaging apparatus;

[0011] Figure 2A and Figure 2B is a diagram illustrating the appearance of an imaging apparatus;

[0012] Figure 3 is a flowchart indicating photographing according to Embodiment 1;

[0013] Figures 4A to 4C is an explanatory diagram illustrating the layout of a real-time image and a captured image;

[0014] Figures 5A to 5H is an explanatory diagram illustrating adjustment of a real-time image;

[0015] Figure 6 is a flowchart indicating photographing according to Embodiment 2; and

[0016] 7A to 7C It is an explanatory diagram illustrating an example of a photographed screen according to the second embodiment. DETAILED DESCRIPTION

[0017] Example 1

[0018] The following describes preferred embodiments of the present invention with reference to the accompanying drawings. In Embodiment 1, a list of captured images and real-time images is displayed on a live view display screen during shooting. The imaging device generates support information based on information about the captured images. This support information includes information related to the composition, brightness, and color of the captured images, and provides support for users to adjust the composition, brightness, and color of the real-time images based on the captured images. Based on this support information, users can adjust the composition, brightness, and color of the real-time images based on the captured images before shooting.

[0019] The imaging device according to Embodiment 1 is a smartphone with a camera function (hereinafter referred to as a smartphone). The present invention is not limited thereto. The imaging device may be another device with an imaging function, such as a digital camera, a digital video camera, a cellular phone, or other mobile electronic device.

[0020] Device configuration:

[0021] Figure 1: is a block diagram illustrating a configuration example of an imaging device. Figure 1 , the configuration of a smartphone 100 serving as an imaging apparatus according to Embodiment 1 will be described below.

[0022] The control unit 101 is a processor such as a CPU or a DSP, for example. A control program for the blocks provided in the smartphone 100 is read from the ROM 102, expanded in the RAM 103, and executed. This enables the control unit 101 to control the operation of the blocks provided in the smartphone 100.

[0023] The ROM 102 is a nonvolatile memory capable of electrical erasure and recording. In addition to the operation programs of the blocks provided in the smartphone 100, the ROM 102 stores parameters for the operation of the blocks, for example.

[0024] The RAM 103 is a rewritable volatile memory and is used to, for example, expand a program to be executed by the control unit 101 or the like and temporarily store data generated by the operation of blocks provided in the smartphone 100 .

[0025] The optical system 104 includes lenses such as a zoom lens and a focus lens, and forms a subject image on an imaging surface of the imaging unit 105. The imaging unit 105 is, for example, an imaging device such as a CCD or CMOS sensor. The imaging unit 105 performs photoelectric conversion on the subject image formed on the imaging surface of the imaging unit 105 by the optical system 104, and then outputs the obtained analog image signal to the A / D conversion unit 106.

[0026] The A / D conversion unit 106 converts the input analog image signal into digital image data. The digital image data output from the A / D conversion unit 106 is temporarily stored in the RAM 103.

[0027] The image processing unit 107 applies various image processing for developing and displaying or recording digital image data to the image data stored in the RAM 103. The image processing applied to the digital image data includes, for example, correction of pixel defects caused by the optical system 104 or the imaging device, demosaicing, white balance correction, color interpolation, and gamma processing.

[0028] The recording unit 108 records data including image data in a recording medium accommodated in the recording unit. The display unit 109 includes a display device such as an LCD (Liquid Crystal Display) and displays images stored in the RAM 103 and images recorded in the recording unit 108 on the display device. In addition, the display unit 109 displays an operation user interface for receiving user instructions and the like.

[0029] The input unit 110 is an input interface including various physical operating members such as a touch panel and a shutter release, and receives input of user commands. The communication unit 111 is connected to an external server via radio, and transmits and receives data including image data and layout information. For example, the external server is a server for controlling a service such as a social network service (hereinafter referred to as SNS), in which users transmit captured images and publish these images to SNS users.

[0030] The smartphone 100 provides a live view display for sequentially displaying analog image signals output from the imaging unit 105 on a display device via the A / D conversion unit 106, RAM 103, image processing unit 107, and display unit 109 under the control of the control unit 101. During the live view display, the user can adjust the composition in preparation for the main shot, assuming that the image data is recorded on the recording medium. Furthermore, during the live view display, the user can change exposure conditions such as aperture and shutter speed, as well as image processing conditions for changing image quality such as brightness, gradation, and color perception, in preparation for the main shot.

[0031] Figure 2A and Figure 2B : is a diagram illustrating the appearance of an imaging device. Figure 2A and Figure 2B , the appearance of the smartphone 100 serving as an imaging device will be described below. Figure 2A is a front view of the smartphone 100, and Figure 2B is a rear view of the smartphone 100 .

[0032] The smartphone 100 includes a display unit 109 and a camera unit 201. The camera unit 201 includes Figure 1 An optical system 104, an imaging unit 105, and an A / D conversion unit 106 are shown.

[0033] According to the shooting of Example 1: Figure 3 This is a flowchart indicating the shooting according to Example 1. Figure 3 The photographing of the smartphone 100 according to the present embodiment will be described in detail. The photographing step is performed by the control unit 101 or a block of the smartphone 100 that has received an instruction from the control unit 101.

[0034] The user switches the smartphone 100 to a shooting mode in which the camera can shoot. Figure 3 For example, the user activates a camera application on the smartphone 100, thereby switching the smartphone 100 to a shooting mode.

[0035] In step S301 , the control unit 101 starts live view display by controlling the optical system 104 , the imaging unit 105 , the A / D conversion unit 106 , the RAM 103 , the image processing unit 107 , and the display unit 109 .

[0036] During the live view display period, smartphone 100 sequentially captures live images. The captured live images are displayed on the display device of display unit 109. The user can adjust the composition and change the exposure and image processing conditions while viewing the sequentially displayed live images. The processing in steps S302, S303, S304, S305, and S306, described later, is performed during the live view display period.

[0037] In step S302, the control unit 101 displays a pattern of display positions of the placed image on the display unit 109. The pattern includes a plurality of separate areas. The control unit 101 displays a predetermined pattern or a pattern selected by the user.

[0038] Reference Figure 4A The following describes the pattern of the image display position. The pattern of the display position includes a plurality of frames (areas) for placing images. For example, after selecting an image from the images not laid out on the display unit 109, the user can select the display position of the image by dragging the image into a specific area of ​​the pattern.

[0039] Figure 4A This example illustrates a live view display screen displaying a pattern 401 showing display positions on display unit 109. Pattern 401 includes nine rectangular areas arranged in three rows and three columns. These rectangular areas indicate locations for placing live images and captured images. Each of these images is placed in a respective rectangular area. Pattern 401 is a pattern that can display nine images in a list format.

[0040] The display position style is not limited to Figure 4A For example, a display position pattern may include four areas for placing four images. Furthermore, the individual areas are not limited to rectangles. These areas can be formed in various shapes, such as circles and polygons. A display position pattern may include areas of different sizes. Alternatively, the display position of an image may be determined by the user freely arranging the images in a predetermined area without using a pattern.

[0041] In step S303, the control unit 101 determines the display position of the real-time image of the subject to be captured from the rectangular area of ​​the pattern 401 displayed on the live view display screen. For example, the control unit 101 may determine the display position of the real-time image to be captured as an area selected by the user from the areas included in the pattern 401.

[0042] Reference Figure 4B , the following will describe the determination of the display position of the real-time image. Figure 4A When the display is displayed as shown, the user selects a rectangular area for displaying the real-time image in the rectangular area by touching. The control unit 101 sets the rectangular area selected by the user as the display position of the real-time image and displays the real-time image in the rectangular area.

[0043] Figure 4B The live view display screen in FIG. 4 indicates an example in which the user selects the central rectangular area 402 from 9 rectangular areas as the display position of the real-time image. The control unit 101 determines the rectangular area 402 as the display position of the real-time image and displays the real-time image in the rectangular area 402. Figure 4B In the example of FIG, rectangular area 402 shows a slice of bread with a fried egg with the sunny side up on a plate. The display position of the real-time image is not always selected and determined by the user. For example, the display position of the real-time image can be pre-set for each style.

[0044] In step S304, the control unit 101 (selection unit) selects a captured image and determines the display position of the captured image in the pattern 401 based on the user operation. The user operation is, for example, an operation of dragging and dropping an image selected from captured images that are not laid out on the display unit 109 to a desired position (area) in the pattern 401. The control unit 101 places the captured image in the area where the user has dragged and dropped the image selected from captured images that are not laid out.

[0045] Reference Figure 4C , the selection and layout of the captured images will be described below. Figure 4C The live view display screen in indicates an example in which five captured images are placed around the rectangular area 402 which is the display position of the live image by the process of step S304.

[0046] In step S303, when the display position of the real-time image is determined, the control unit 101 displays the list 403 of captured images that are not laid out at a position different from the pattern 401. Figure 4C In the example shown in FIG4 , the list 403 of captured images not laid out indicates five captured images not laid out. The images indicated in the list 403 of captured images not laid out on the live view display screen are acquired from the recording unit 108. While checking the list 403 of captured images not laid out on the live view display screen, the user selects a desired image from among these captured images, and then drags and drops the image to a desired position in the pattern 401, thereby placing the captured images one by one.

[0047] Assume that in order to display a list of subjects, compositions, brightness and color senses that are unified, the user selects and places captured images that have similar subjects, compositions, brightness and color senses. Figure 4C In the example shown in FIG. 4 , in list 403 of unlaid captured images, images of chickens and flowers are different subjects from the bread slices in the real-time image displayed in rectangular area 402. Therefore, the user selects the image of the bread slices that is the same as the real-time image from list 403 of unlaid captured images, rather than the images of chickens or flowers. As described above, control unit 101 places captured images in pattern 401 based on a user operation to place the desired image at the desired location.

[0048] The layout of the captured images is not always determined based on user operations. The control unit 101 can analyze the images in the list 403 of unlaid captured images and place images similar to the real-time image in terms of subject, composition, brightness, and color sense in the pattern 401.

[0049] In step S305, the control unit 101 (generation unit) generates and displays support information for changing the shooting conditions of the real-time image based on the information related to the captured images laid out in step S304. The support information indicates the average shooting conditions of the captured images laid out in step S304. The shooting conditions indicate image processing conditions for changing the composition, exposure conditions (brightness), color, and grayscale.

[0050] Specifically, supporting information related to composition includes, for example, composition lines indicating the average position and size of subjects in captured images. Supporting information related to brightness includes, for example, the average brightness of captured images. This average brightness is indicated as a target value on a slider. Supporting information related to color perception includes, for example, the average color temperature of captured images. This average color temperature is indicated as a target value on a slider.

[0051] Reference Figures 5A to 5G , a method for adjusting composition will be described as an example of adjusting shooting conditions based on support information. Figure 5A and Figure 5B This is an explanatory diagram illustrating the generation of support information.

[0052] Figure 5A and Figure 5B This illustrates an example of a live view display screen in which eight captured images are placed around a real-time image (rectangular area 402) in step S304. Slide bar 500 is a user interface (UI) for rescaling the real-time image to adjust the composition. Shutter button 503 is a UI for shooting by pressing or touching it.

[0053] exist Figure 5AIn the live view display screen, the size of the bread slice as the subject of the real-time image in rectangular area 402 is smaller than the size of the subjects of the captured images placed around rectangular area 402. In this state, the real-time image and the captured images have different subject sizes, so that the captured subject images and the list of captured images may be displayed in a less uniform manner, resulting in poor display.

[0054] The user can zoom in on the live image by moving the pointer 501 of the slide bar 500 in the positive direction. However, the user cannot recognize the extent of sliding for obtaining the same size as the surrounding captured images. Therefore, the control unit 101 displays the target position 502 as a guide for moving the pointer 501. Figure 5B As shown, the user moves the pointer 501 toward the target position 502 to the position of the pointer 504 , thereby adjusting the subject of the real-time image to the same size as the subject of the surrounding captured images.

[0055] Support information indicating target position 502 is generated based on information related to the captured image selected in step S304. Target position 502 is generated, for example, at a magnification that allows the subject of the live image to have substantially the same size as the subject of the captured image. The information related to the captured image used to generate the support information indicates the composition, brightness, color sense, etc. of the captured image. For example, the support information can be calculated using Expression 1.

[0056] [Mathematics.1]

[0057]

[0058] Among them, S is the support information, I k is information related to the captured images, and N is the total number of captured images. In other words, the support information S can be calculated as the average value of information related to the captured images (for example, information including magnification, focal length, and shooting distance during shooting).

[0059] The support information is not always calculated according to the method of Expression 1. For example, the information I related to the captured image may be weighted according to the distance between the captured image and the real-time image or whether the captured image is adjacent to the real-time image. k In other words, the control unit 101 can calculate the support information by comparing the information I related to the captured image with the positional relationship with the real-time image. k Weighting is performed to calculate support information.

[0060] Figure 5A An example of adjusting the magnification is shown. Therefore, S and I kIndicates a value of magnification, focal length, or shooting distance. For example, the control unit 101 can calculate the support information S by substituting the magnification of the placed captured image during shooting into Expression 1, and display the target position 502 at a position corresponding to the average value of the calculated magnification. It is assumed that the shooting conditions (such as the magnification during shooting of the captured image) are recorded in the image as metadata related to the captured image.

[0061] Alternatively, the control unit 101 can generate the ratio of the object (subject) in the image as support information for adjusting the magnification by using image processing such as object recognition. In other words, the control unit 101 detects the subject from each of the captured images and calculates the ratio of the subject in the image. The control unit 101 can substitute the ratio calculated for each captured image into Expression 1 and calculate support information S (target value) related to the ratio of the subject in the real-time image.

[0062] In addition, I in Expression 1 k It is not limited to information related to the adjustment of the magnification. For example, I in Expression 1 k It may be information on the color temperature when adjusting the white balance, or information on the average brightness or Bv (brightness value) of the screen when adjusting the brightness.

[0063] like Figure 5A As shown, the support information S calculated by Expression 1 is displayed as a target position 502 on the slide bar 500 . Figure 5A The example of FIG. 5 illustrates a single slider 500 for adjusting magnification. The present invention is not limited to this example. In addition to magnification, the live view display may also display multiple sliders for adjusting other shooting conditions (such as white balance or brightness). Support information related to white balance or brightness is generated so that the white balance or brightness of the live image is substantially equal to that of the captured image. The support information is displayed as a target value on the corresponding slider.

[0064] Figure 5C and Figure 5D It is an explanatory diagram illustrating a change in support information when a captured image on a live view display screen is changed to another captured image. Figure 5C The captured image on the live view display changes to Figure 5B is an example of an image having a smaller subject than the captured image placed in . When the captured image is changed, the control unit 101 substitutes information about the changed captured image into Expression 1 and recalculates the support information S. The control unit 101 moves the target position 502 on the slide bar 500 to the target value 505 based on the calculated support information S.

[0065] Figure 5D An example of generating support information by specifying a layout is shown. The layout is a predetermined layout pattern for classifying areas in the pattern 401 into a plurality of groups and placing images uniformly in each group. Figure 5D In the layout 507, the nine rectangular areas of three rows and three columns are classified into a first group including rectangular areas located in the center and four corners and a second group including other rectangular areas. In other words, the captured images of the first group are captured images diagonally opposite to the real-time image.

[0066] The predefined layout styles are not limited to Figure 5D Layout 507 is shown. The layout pattern can be, for example, a grid-like layout pattern, wherein the first group includes rectangular areas in the same row as the real-time image, and the second group includes rectangular areas in other rows. The layout can be preset by the user or changed by the user on the live view display screen.

[0067] exist Figure 5D , the subjects of the captured images at the four corners in the first group of the layout 507 are smaller than the subjects of the captured images in the second group. The real-time image of the rectangular area 402 is included in the first group, but it has a larger subject than the subjects of the captured images at the four corners. In this case, the control unit 101 calculates the support information S according to Expression 1 by using information related to the captured images included in the first group of the layout 507. The real-time image of the rectangular area 402 has a larger subject than the subjects of the captured images at the four corners, so that the target value 506 is displayed on the negative direction side of the current position of the indicator. As described above, support information can be generated based on information related to some captured images, where the some captured images are selected from the captured images placed on the live view display screen based on the position in the layout 507.

[0068] Figure 5E and Figure 5F 4 is an explanatory diagram illustrating support information in a case where a pattern 401 includes regions of different sizes. Figure 5E and Figure 5F This illustrates an example where rectangular area 402 for displaying a real-time image is larger than other areas including captured images. Regardless of the size of the area in pattern 401, control unit 101 can generate support information based on information related to the placed captured image and display target value 508 on slide bar 500.

[0069] like Figure 5FAs shown, in addition to displaying the support information (target value 508) on the slide bar 500, the control unit 101 can also display the support information as a composition line 509 for positioning the subject. The support information indicated by the composition line 509 is generated so that the ratio of the subject in the image is substantially equal to the ratio of the subject in the captured image. The control unit 101 can calculate the target value of the subject size in the live image based on the support information S calculated by Expression 1 and display the composition line 509.

[0070] exist Figure 5F In the example shown in FIG, the display area of ​​the real-time image is divided into rectangles by composition lines 509, which are two pairs of intersecting parallel lines. The central rectangle indicates the size of the subject as a guide. The present invention is not limited to this example. The composition lines as supporting information can be frame lines including circles, ellipses, squares, and triangles that indicate the size and position of the subject. The composition lines can include vertical lines, horizontal lines, and diagonal lines that divide the display area of ​​the real-time image into multiple areas and indicate the composition. The user can change the magnification using the slider 500 according to the composition lines and position the subject by reorienting the smartphone 100.

[0071] The control unit 101 may generate composition lines as supporting information by detecting the subject of the captured image on the live view display screen and analyzing the composition. Alternatively, the control unit 101 may select composition lines as supporting information from a prepared composition line template based on the detection result of the subject of the captured image.

[0072] Figure 5G This is an explanatory diagram of a display example in which a user changes a shooting condition according to support information and notifies the user that the shooting condition has been changed to be close to the support information. Figure 5G In the example shown in FIG, the control unit 101 notifies the user that the shooting condition has changed to approach the support information by changing the colors of the composition line 510, the indicator 511 of the slide bar 500, and the shutter button 512. Alternatively, the control unit 101 may emit a sound without changing the color of the support information or the operation button, or may vibrate the smartphone 100 to provide the notification.

[0073] The indicator 504 of the slide bar 500 may be moved relative to the Figure 5B The position within the predetermined distance of the target position 502 in the image is determined to determine whether the shooting condition has changed to the proximity support information. Figure 5GWhether the shooting conditions have changed to approach the supporting information is determined by measuring a position within a predetermined distance of the composition line 510 in FIG. Furthermore, if the supporting information is a composition line including two intersecting diagonal lines, whether the shooting conditions have changed to approach the supporting information can be determined based on whether the distance between the intersection of the diagonal lines and the center of the subject has decreased to a predetermined threshold or less.

[0074] By adjusting the shooting conditions based on the support information, the user can capture a real-time image that is consistent with the captured image placed in step S304. Even if the display area of ​​the real-time image is small and difficult to identify due to the display of the captured image, the user can easily adjust the shooting conditions through simple operations that match the support information.

[0075] exist Figure 3 In step S306, the control unit 101 determines whether the user's adjustment of the shooting conditions has been completed. The control unit 101 can determine whether the adjustment of the shooting conditions has been completed based on, for example, whether the user has adjusted the shooting conditions and pressed the shutter button 503. In the case where the adjustment of the shooting conditions has been completed (step S306: yes), the processing enters step S307. In the case where the adjustment of the shooting conditions has not been completed (step S306: no), the processing returns to step S302, and then repeats the processing of steps S302, S303, S304 and S305 until the adjustment of the shooting conditions is completed. In this way, the control unit 101 (changing unit) adjusts the layout, composition, brightness and color sense of the real-time image based on the user operation according to the support information, thereby capturing an image that is consistent with the captured image.

[0076] In step S307, after the real-time image adjustment is completed in step S306 and the user presses the shutter button 503, the control unit 101 performs the main shooting. Since the shooting conditions are adjusted based on the support information, the image captured in the main shooting is substantially the same as the captured image displayed on the live view display screen in terms of composition, brightness, and color.

[0077] The control unit 101 associates the captured image of the real-time image in the main shooting with the captured image placed on the live view display screen as an image group. In addition, the control unit 101 associates the image data indicating the captured image of the real-time image and the captured image with the layout information including the display position of the real-time image and the display position of the captured image, and records the image data in the recording unit 108.

[0078] In step S308 , the control unit 101 acquires the image data and layout information of the image group recorded in the recording unit 108 , and displays the image data of the image group on the display unit based on the acquired layout information.

[0079] Reference Figure 5H , the image group display screen for displaying image data in an image group will be described below. Figure 5H The image group display screen of 510 indicates an example in which a captured image of a subject captured by main shooting is displayed in a rectangular area 513, and captured images associated with the subject image are displayed around the captured subject image. The control unit 101 places the image data in the image group on the display screen of the display unit 109 based on the layout information of the image group.

[0080] In the first embodiment, referring to the support information generated based on the information about the captured image on the live view display screen, the user can adjust the shooting conditions including the composition, brightness, and color sense of the live image according to the captured image.

[0081] In this way, the user can adjust the shooting conditions and shoot the subject based on the displayed support information, thereby easily generating a uniform image group. In addition, even if the area for displaying the real-time image is reduced by displaying the captured image, making adjustment difficult, the user can easily adjust the shooting conditions based on the support information.

[0082] Example 1 describes adjusting the composition of a real-time image relative to a captured image displayed on a live view display. Adjustment of a real-time image is not limited to this. For example, adjustments to the real-time image may include adjusting exposure conditions or image processing conditions to alter image quality, such as brightness, grayscale, or color.

[0083] Specifically, when adjusting exposure conditions, the exposure correction amount can be adjusted to adjust the brightness of the live image. Alternatively, when adjusting image processing conditions, the chroma enhancement can be adjusted to adjust the vivid colors of the live image. Furthermore, in Example 1, the live view display screen displays the captured image along with the live image. During shooting, the live image and supporting information can be displayed without the captured image.

[0084] Example 2

[0085] In embodiment 2, the captured image on the live view display screen is acquired from an external server, such as a service for providing SNS. The real-time image is displayed on the live view display screen during shooting together with the captured image from the external server. Support information is generated based on the captured image from the external server. Based on the generated support information, the user can adjust the composition, brightness, and color sense of the real-time image based on the captured image before shooting. The configuration of the camera device (smartphone) according to embodiment 2 is the same as that according to Figure 1 The configuration of the smartphone 100 of Embodiment 1 is the same as that of the embodiment 1, and therefore its description is omitted.

[0086] The external server receives image groups and corresponding layout information of captured images from multiple camera devices (smartphones 100) and records the image groups and the layout information in a recording unit of the external server. When accessed from a web browser or the like, the external server can display a list of captured images in the image group on the smartphone 100 that has accessed the external server based on the layout information recorded in the recording unit.

[0087] According to the shooting of Example 2: Figure 6 : is a flowchart illustrating the photographing process according to Example 2. Figure 6 , the following will specifically describe the shooting of the smartphone 100 according to this embodiment. The shooting step is performed by the control unit 101 or a block of the smartphone 100 that has received an instruction from the control unit 101. Figure 3 The same steps as those in the photographing step of Example 1 are denoted by the same reference numerals, and detailed description thereof is omitted.

[0088] In step S301, the control unit 101 starts live view display. In step S601, the control unit 101 (acquisition unit) acquires captured images and corresponding layout information stored in an external server via the communication unit 111 (transmission unit). Embodiment 2 will be described based on an example of acquiring seven captured images and corresponding layout information. It is assumed that the layout information acquired from the external server includes information related to the display position of the images described in Embodiment 1.

[0089] In step S602, the control unit 101 places the seven captured images acquired in step S601 on the live view display screen based on the corresponding layout information. Specifically, the control unit 101 places the captured images at corresponding positions in the display position pattern included in the layout information.

[0090] Reference Figure 7A , the layout of the captured images will be described below. Figure 7A An example is shown in which seven captured images acquired from an external server are laid out on a live view display screen based on corresponding layout information.

[0091] Figure 7A The following is a display example in which seven captured images are displayed at seven points in a pattern including nine rectangular areas. The captured images are not placed in the lower center and lower right rectangular areas of the nine rectangular areas.

[0092] As described above, the smartphone 100 can retrieve captured images and corresponding layout information stored in an external server and, based on the corresponding layout information, position the captured images on the live view display screen. In other words, the smartphone 100 can reproduce the display of a list of captured images in the same layout as when viewing the accessed external server.

[0093] The user can change the display position of a captured image on the live view display. The user selects the captured image to be repositioned and drags and drops it to the desired location to change the position of the captured image. If a captured image is already at the desired location, the image to be repositioned can be dragged and dropped to the desired location to change the position along with the captured image at that location.

[0094] In step S603, the control unit 101 determines a position for displaying a real-time image on the live view display screen. For example, the control unit 101 may determine an area selected by the user from a rectangular area without a captured image as the display position of the real-time image.

[0095] Reference Figure 7B , the following will describe the determination of the display position of the real-time image. For example, the user touches the screen from Figure 7A From the nine rectangular areas, select the lower center or lower right rectangular area where no captured image is placed as the display position for the live image. Figure 7B The example in which the user selects the lower middle rectangular area 701 from the nine rectangular areas is illustrated. The control unit 101 displays the real-time image in the rectangular area 701 selected by the user.

[0096] In step S305, as in Embodiment 1, the control unit 101 generates support information based on the captured image and presents the information to the user. Figure 7B As shown, when determining the position of the real-time image, the control unit 101 generates support information based on the captured image and displays the target value 703 as support information on the slide bar 702. The user can refer to the support information to change the capture conditions. The control unit 101 changes the capture conditions of the real-time image based on the user's instructions.

[0097] In step S306, the control unit 101 determines whether the user has completed adjustment of the shooting conditions. If the adjustment of the shooting conditions has not yet been completed (step S306: No), the process returns to step S601, and then repeats the processes of steps S601, S602, S603, and S305 until the adjustment of the shooting conditions is completed. If the adjustment of the shooting conditions has been completed (step S306: Yes), the process proceeds to step S307.

[0098] In steps S307 and S308, the control unit 101 associates the captured image of the real-time image in the main shooting with the captured image in the pattern as in Example 1 as an image group, and records the image group in the storage unit. In addition, the control unit 101 records the pattern used, the position of the captured image in the pattern, and the position of the captured image as layout information in the storage unit.

[0099] In step S604 , the control unit 101 determines whether to transmit the image data and layout information about the image group to the external server via the communication unit 111 based on a user instruction.

[0100] Reference Figure 7C , the reception of an instruction to send image data and layout information related to an image group will be described below. Figure 7C Example instructions in Figure 6 The image group displayed in step S308 and an example of a UI screen for receiving a transmission instruction from the user are shown. The user can confirm the composition, brightness, and color consistency of the displayed image and decide whether to transmit the image data and layout information related to the image group to an external server.

[0101] If the image data and layout information related to the image group are to be transmitted to the external server, the user presses (touches) the "Yes" button. In response to the operation of the "Yes" button, the control unit 101 determines that the image data and layout information related to the image group are to be transmitted to the external server (step S604: Yes), and the process proceeds to step S605.

[0102] In the case of not transmitting the image data and layout information related to the image group to the external server, the user presses (touches) the "No" button. In response to the operation of the "No" button, the control unit 101 determines that the image data and layout information related to the image group are not to be transmitted to the external server (step S604: No). Figure 6 The shooting is completed.

[0103] In step S605, the control unit 101 transmits the image data related to the image group and the corresponding layout information to the external server via the communication unit 111 so that Figure 6 The shooting is completed.

[0104] In Embodiment 2, the external server can display the images in the image group in the same layout as when the image was taken, based on the image data and corresponding layout information related to the image group received from the smartphone 100. This enables a user who accesses the external server from a web browser or the like and views the image group to view the images in the same layout as when the image was taken by the smartphone 100.

[0105] The present invention can easily adjust shooting conditions such as composition, brightness, and color sense according to a shot image while viewing a real-time image.

[0106] Other embodiments

[0107] The embodiments of the present invention can also be implemented by the following method, that is, providing software (program) that performs the functions of the above-mentioned embodiments to a system or device through a network or various storage media, and the computer or central processing unit (CPU) or microprocessing unit (MPU) of the system or device reads and executes the program.

[0108] While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. The scope of the following claims is to be accorded the broadest interpretation so as to encompass all such modifications and equivalent structures and functions.

Claims

1. A camera device for shooting while displaying a real-time image, the camera device comprising: a display component, configured to display the real-time image on a display unit and display a slide bar with an indicator; A selection component for selecting multiple captured images; a generating means for generating support information for changing a photographing condition of the real-time image based on information related to the selected photographed image, and displaying the generated support information on the display unit; a changing component for changing a capturing condition of the real-time image based on a user operation for changing a position of the indicator on the slide bar displayed by the display component; as well as a shooting component, configured to shoot the real-time image according to the changed shooting conditions, The generated support information is displayed as a target position on the slide bar.

2. The imaging device according to claim 1, wherein The generated support information is information indicating the average shooting condition of the selected captured images.

3. The imaging device according to claim 1 or 2, wherein: The generated support information is information for adjusting at least any one of brightness, color sense, and composition of the real-time image.

4. The imaging device according to claim 3, wherein The support information related to brightness is information related to average brightness or BV value, ie, brightness value, the support information related to color sense is information related to color temperature, and the support information related to composition is information related to composition lines.

5. The imaging apparatus according to claim 1 or 2, further comprising a recording unit for recording image data, wherein The selection section places a captured image selected from the image data recorded in the recording unit on the display unit based on a user operation. The imaging device according to claim 5 , wherein: The recording unit further records layout information related to the image data, and The selection section places the selected captured image on the display unit based on layout information associated with the selected captured image.

7. The imaging device according to claim 1 or 2, wherein: The shooting condition includes at least one of a condition related to composition, a condition related to exposure, and a condition related to image quality.

8. The imaging apparatus according to claim 1 or 2, further comprising an acquisition unit configured to acquire the plurality of captured images and layout information associated with the plurality of captured images from an external server, wherein: The selection section places the plurality of captured images acquired from the external server on the display unit based on layout information associated with the plurality of captured images.

9. The imaging device according to claim 1 or 2 further includes a sending component for sending the captured image of the real-time image, the captured image selected during the shooting, and layout information associated with the captured image of the real-time image and the captured image selected during the shooting to an external server.

10. The imaging device according to claim 1 or 2, wherein The changing section notifies a user that the shooting condition is changing to approach the support information displayed on the display unit.

11. The imaging device according to claim 1 or 2, wherein: The generating means generates support information for changing a capturing condition of the real-time image based on information about a portion of the selected captured images.

12. The imaging device according to claim 11, wherein The generating section determines the portion of the captured images based on a layout indicating a predetermined layout pattern.

13. The imaging device according to claim 1 or 2, wherein: The generating means generates support information for changing a capturing condition of the real-time image by weighting information related to the selected captured image based on a positional relationship with the real-time image.

14. The imaging device according to claim 1, wherein In a case where the captured image selected by the selection section on the display unit is changed, the generation section changes the support information displayed on the display unit to support information generated based on information related to the changed captured image.

15. A method for controlling a camera device, wherein the camera device is configured to capture images while displaying a real-time image, the method comprising the following steps: Displaying the real-time image on a display unit and displaying a slide bar with an indicator; Select multiple captured images; generating support information for changing a photographing condition of the real-time image based on information related to the selected photographed image, and displaying the generated support information on the display unit; changing a capturing condition of the real-time image based on a user operation to change a position of the indicator on the displayed slide bar; as well as capturing the real-time image according to the changed capturing conditions, The generated support information is displayed as a target position on the slide bar.

16. The control method of the imaging apparatus according to claim 15, wherein: In the generating step, when the captured image selected on the display unit is changed, the support information displayed on the display unit is changed to support information generated based on information related to the changed captured image. 17 . A computer-readable storage medium storing a program for realizing the steps of the control method according to claim 15 or 16 when executed by a computer.

18. A computer program product comprising a program for implementing the steps of the control method according to claim 15 or 16 when being executed by a computer.

Images