Information processing apparatus and imaging apparatus

Abstract

The present invention provides an information processing apparatus and an image capturing apparatus that generate a set of image data as an image that a user can view without a feeling of strangeness regardless of whether two pieces of image data, i.e., first image data and second image data, have the same or different standards.SOLUTION: The pair image-data generating unit 51 generates a pair image-data item of a pair image PP, which is a set of image-data items, from at least the first image-data item of the first image P1 and the second image-data item of the second image P2. The image pair standard generation unit 52 generates an image pair standard of the image pair data based on the first standard of the first image data and the second standard of the second image data.SELECTED DRAWING: Figure 9

Description

[Technical Field]

[0001] The present invention relates to an information processing device and an imaging device. [Background technology]

[0002] Patent document 1 describes that when two scenes whose shooting times differ by less than a threshold are combined into a scene, and both of the two scenes are classified as main scenes, they are displayed side by side at the same size. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] International Publication No. 2015 / 125815 Summary of the Invention [Problem to be solved by the invention]

[0004] The present invention aims to provide an information processing device and an imaging device that generate a set of image data that can be viewed without any sense of discomfort by a user, regardless of whether the standards of the first image data and the second image data are the same or different. [Means for solving the problem]

[0005] The present invention is an information processing device having a processor, which generates third image data, which is a set of image data, from at least first image data and second image data, and generates a third standard of the third image data based on a first standard of the first image data and a second standard of the second image data.

[0006] The set of image data is preferably one image data. The set of image data is preferably a set of three or more image data including first image data and second image data. The third image data is preferably image data in which the first image data and the second image data are displayed in parallel on the display screen.

[0007] If the first standard and the second standard are different, the processor preferably conforms the third standard to either the first standard or the second standard, or changes the third standard to a standard different from the first standard and the second standard. The first standard, the second standard, and the third standard preferably include at least one of an image format or an image file format. When the processor conforms the third standard to either the first standard or the second standard, it is preferable that one of the first standard or the second standard is a still image and the other is a video. When the processor converts the third standard into a video, it is preferable that the processor duplicates the still image a specific number of times and stitches the duplicated still images together to form the video.

[0008] If the first characteristic of the first image data and the second characteristic of the second image data differ, the processor preferably matches the third characteristic of the third image data to either the first characteristic or the second characteristic, or changes the third characteristic to a third characteristic different from the first characteristic and the second characteristic. The first characteristic, the second characteristic, and the third characteristic are specifications of the image data, and preferably include at least one of the aspect ratio, the image size, the resolution, the frame rate, the bit rate, and the recording time.

[0009] The processor preferably performs at least one of changing the aspect ratio, changing the bit rate, changing the recording time, or changing the frame rate for at least one of the first characteristic or the second characteristic.The processor preferably performs at least one of adding a background, cropping, and scaling for at least one of the first image data or the second image data based on the first characteristic and the second characteristic.

[0010] When changing the bit rate, the processor preferably sets the bit rate determined by the third characteristic to be equal to or less than the bit rate determined by the first characteristic or the second characteristic.When changing the recording time, the processor preferably sets the recording time determined by the third characteristic to be equal to or less than the recording time determined by the first characteristic or the second characteristic.When changing the frame rate, the processor preferably matches at least one of the frame rates determined by the first characteristic or the second characteristic to the third characteristic.

[0011] Preferably, when generating the third image data, the processor maintains the image orientation defined by the first image data and the image orientation defined by the second image data.

[0012] When generating the third image data, the processor preferably outputs information regarding the processing time for generation. Preferably, the processor does not generate the third image data if the first image data or the second image data does not exist or if the first image data or the second image data is a set of image data.

[0013] When outputting the third image data to the display screen, the processor preferably switches between displaying the first image of the first image data and the second image of the second image data on the display screen. Preferably, the processor slides in one of the first image or the second image and slides out the other image on the display screen while switching between displaying the first image and the second image.

[0014] When the processor is set to the second mode, it is preferable that the processor connects multiple still image data to generate video data, which is a set of video, and the video data is image data that scrolls the multiple still image data in a specific direction on the display screen within a specific time period.

[0015] An imaging device of the present invention includes the information processing device of the present invention described above. The imaging device preferably has a first mode, and the processor preferably generates third image data when the imaging device switches to the first mode. The first mode is preferably a mode for generating one set of image data from multiple image data.

[0016] When generating the third image data, the processor preferably acquires both the first image data and the second image data by capturing images using an imaging device. When generating the third image data, the processor preferably acquires either the first image data or the second image data by capturing images using an imaging device. When generating the third image data, the processor preferably acquires either the first image data or the second image data by capturing images.

[0017] The present invention is an imaging device having a processor, which generates third image data of a third aspect ratio from first image data of a first aspect ratio and second image data of a second aspect ratio, wherein the horizontal ratios of the first aspect ratio, the second aspect ratio, and the third aspect ratio are the same, and the third image data is a still image if both the first image data and the second image data are still images, or is a moving image if at least one of the second image data and the second image data is a moving image.

[0018] Preferably, the first and second aspect ratios are 3:4, and the third aspect ratio is 3:2. [Effects of the Invention]

[0019] According to the present invention, even if the standards of the first image data and the second image data are the same or different, it is possible to generate a set of image data that the user can view without feeling uncomfortable. [Brief explanation of the drawings]

[0020] [Figure 1] FIG. 2 is a front perspective view of the imaging device. [Figure 2] FIG. 2 is a rear perspective view of the imaging device. [Figure 3](A) is an explanatory diagram showing the lever in the normal position, (B) is a diagram showing the lever in the pushed-in state, and (C) is a diagram showing the lever in the pulled state. [Figure 4] FIG. 1 is a block diagram showing a schematic configuration of an imaging device. [Figure 5] FIG. 2 is a block diagram showing the functions of an image data processing unit. [Figure 6] FIG. 2 is a block diagram showing the functions of a control unit. [Figure 7] 3 is an explanatory diagram showing a method of acquiring first image data and second image data by imaging. FIG. [Figure 8] 10 is an explanatory diagram showing a method of acquiring first image data from a playback screen and acquiring second image data by capturing an image. FIG. [Figure 9] FIG. 10 is an explanatory diagram showing a method for generating paired image data. [Figure 10] 10 is an explanatory diagram showing a method for generating paired image data when the paired image standard is a moving image; FIG. [Figure 11] 10A and 10B are explanatory diagrams showing a method of generating paired image data when changing the bit rate. [Figure 12] 10 is an explanatory diagram showing a method for generating paired image data when changing the recording time. FIG. [Figure 13] 10A and 10B are explanatory diagrams showing a method for generating paired image data when changing the frame rate and the recording time. [Figure 14] 10 is an explanatory diagram showing a method for generating paired image data when the image orientations of the first and second images are maintained. FIG. [Figure 15] 10A is an explanatory diagram showing the case where the image is oriented in the normal direction, FIG. 10B is an explanatory diagram showing the case where the image is oriented in the direction rotated 90 degrees to the right, and FIG. 10C is an explanatory diagram showing the case where the image is oriented in the direction rotated 90 degrees to the left. [Figure 16] (A) is an explanatory diagram showing adding a background, (B) is a diagram showing cropping, and (C) is a diagram showing reducing the image size. [Figure 17] 10 is an explanatory diagram showing guidance GDX that indicates the time during generation of paired image data and the time until generation of paired image data is completed. FIG. [Figure 18] FIG. 10 is an image diagram showing a non-transferable icon. [Figure 19] FIG. 10 is an explanatory diagram showing a method for reproducing a pair of images. [Figure 20] FIG. 10 is an explanatory diagram showing a method for generating a loading video. [Figure 21] FIG. 2 is an explanatory diagram showing a first aspect ratio, a second aspect ratio, and an aspect ratio for paired images. [Figure 22] FIG. 10 is an explanatory diagram showing a method for generating multi-image data. DETAILED DESCRIPTION OF THE INVENTION

[0021] 1, imaging device 10 includes camera body 11 and lens barrel 12. Camera body 11 has a horizontally elongated box shape in which the left-right dimension is longer than the up-down dimension when viewed from the front. It is preferable that imaging device 10 is a digital camera or the like.

[0022] Camera body 11 is provided with grip 11A at the left end when viewed from the front. Grip 11A is semi-cylindrical and connects to the front and back of camera body 11, making it easy for the user to hold. Lens barrel 12 is disposed on the front of camera body 11, and is provided with imaging optical system 13. Imaging optical system 13 forms an image of subject light on imaging element 21, which is disposed on optical axis OA.

[0023] The top surface of the camera body 11 is provided with a mode dial 14, a release switch 15, a power switch 16, a lever 17, and the like. The imaging device 10 has a full-size mode, a two-in-one mode (first mode), a roll video mode (second mode), a still image capture mode, a video capture mode, an image playback mode, and the like. In this embodiment, modes other than the two-in-one mode can be switched using the mode dial 14, for example. Note that the two-in-one mode may also be switched using the mode dial 14.

[0024] In addition to the lens barrel 12, a flash unit 18 and an illumination unit 19 are provided on the front of the camera body 11. The flash unit 18 irradiates illumination light onto the subject in conjunction with a shutter release when the exposure value of the subject is below a certain level or when the flash unit 18 is forcibly activated while the image capture device 10 is in still image capture mode. On the other hand, the illumination unit 19 constantly irradiates illumination light onto the subject when the image capture device 10 is in video capture mode.

[0025] 2, the lever 17 is provided above the grip 11A. The lever 17 is provided stacked with the mode dial 14 and the release switch 15. The lever 17 is attached to the mode dial 14 so as to be rotatable around the central axis CL.

[0026] As shown in FIG. 3(A), by turning on the power switch 16, the lever 17 is set to the normal position, rotated slightly counterclockwise from the rear of the camera body 11. The lever 17 can be operated in two ways: by pulling it counterclockwise from the normal position, as shown in FIG. 3(B), or by pushing it clockwise from the normal position, as shown in FIG. 3(C). Pulling the lever 17 not only switches to the two-in-one mode described below, but also changes the recorded images displayed on the display 22 in image playback mode, sequentially going back from the most recent recorded image to a previous recorded image. On the other hand, pushing the lever 17 not only checks paired image data, but also sequentially going back from the most recently captured recorded image to a newer recorded image, as described below.

[0027] The power switch 16 is a push-button switch, and is located near the mode dial 14 and the lever 17. When the power switch 16 is pressed, the power of the imaging device 10 is alternately switched between on and off states.

[0028] The camera body 11 has a built-in imaging element 21 (see FIG. 3 ). The imaging element 21 is held in a holder (not shown) and fixed to the image plane side of the lens barrel 12. The imaging element 21 has a function of capturing still images and moving images, and is, for example, a complementary metal oxide semiconductor (CMOS) image sensor, a charge coupled device (CCD) image sensor, or an organic thin-film imaging element. The imaging element 21 is an imaging element that is placed horizontally, i.e., when the top surface of the camera body 11 faces vertically upward, its vertical length is shorter than its horizontal length. However, the imaging element 21 is not limited to this, and may also be an imaging element that is placed horizontally, i.e., when the top surface of the camera body 11 faces vertically upward, its vertical length is longer than its horizontal length.

[0029] The rear surface of the camera body 11 is provided with a display 22 and an electronic viewfinder 23. The display 22 is an LCD (Liquid Crystal Display) or an OLED (Organic Electroluminescent Display), etc. The display 22 is used for live view display, recorded image display, setting menu display, etc. In live view display, a recorded image of a subject captured by the imaging element 21 is displayed on the display 22 in real time.

[0030] The electronic viewfinder 23 is provided on the top of the camera body 11. The electronic viewfinder 23 displays a live view, and displays in real time a recorded image of a subject captured by the image sensor 21. The electronic viewfinder 23 can be turned on or off as needed, and can be switched to display on the display 22.

[0031] 4, the control unit 31 is made up of a microcomputer including a CPU, a ROM (Read Only Memory) that stores programs and parameters used by the CPU, and a RAM (Random Access Memory) (none of which are shown) that is used as a work memory for the CPU, and controls each part of the imaging device 10. The control unit 31 also performs control related to the two-in-one mode, which will be described in detail later.

[0032] The information processing device of the present invention is a device that includes the information processing components of the imaging device 10, and preferably includes at least the liquid crystal display 22, the control unit 31, the image data processing unit 37, and the display driver 38. The information processing device of the present invention is applicable to various information devices such as tablet terminals and personal computers, in addition to imaging devices 10 such as digital cameras.

[0033] When the lever 17 is rotated, a signal detecting the amount of rotation is sent to the control unit 31. The control unit 31 also receives a mode switching signal from the mode dial 14, a release signal from the release switch 15, and a power on / off signal from the power switch 16.

[0034] The shutter unit 32 is, for example, a focal plane shutter and is disposed between the imaging optical system 13 and the imaging element 21. The shutter unit 32 is capable of blocking the optical path between the imaging optical system 13 and the imaging element 21 and is variable between an open state and a closed state. The shutter unit 32 is in the open state when capturing live view images and moving images. When capturing still images, the shutter unit 32 is variable from the open state to the closed state unless the release switch 15 is operated, whereas the shutter unit 32 is variable from the closed state to the open state unless the release switch 15 is operated. When capturing a preview image in moving image capture mode, the shutter unit 32 operates in the same manner as when capturing a preview image in still image capture mode, and in the same manner as when capturing a still image. The shutter unit 32 is driven by a shutter motor 33. A motor driver 34 controls the driving of the shutter motor 33.

[0035] The imaging element 21 is driven and controlled by the control unit 31. The imaging element 21 has a light receiving surface made up of a plurality of pixels (not shown) arranged in a two-dimensional matrix. Each pixel includes a photoelectric conversion element, and photoelectrically converts the subject image formed on the light receiving surface by the imaging optical system 13 to generate an imaging signal.

[0036] The image sensor 21 also includes signal processing circuits (none of which are shown), such as a noise reduction circuit, an auto-gain controller, and an A / D conversion circuit. The noise reduction circuit performs noise reduction processing on the image signal. The auto-gain controller amplifies the level of the image signal to an optimum value. The A / D conversion circuit converts the image signal into a digital signal and outputs it from the image sensor 21 to the bus line 36. The output signal of the image sensor 21 is image data (so-called RAW data) having one color signal for each pixel.

[0037] The image memory 35 stores one frame of image data output to the bus line 36. The image data processing unit 37 reads one frame of image data from the image memory 35 and performs known image processing such as matrix calculation, demosaic processing, gamma correction, luminance / color difference conversion, resizing, etc. The image data processing unit 37 also performs processing related to the two-in-one mode, which will be described in detail later.

[0038] The display driver 38 sequentially inputs one frame of image data that has been image-processed by the image data processing unit 37 to the display 22 or the electronic viewfinder 23. The display 22, for example, sequentially displays live view images at regular intervals. The display 22 is touch-operable, and by touching an operation icon (not shown) or the like displayed on the display 22, an operation or selection corresponding to the operation icon is performed.

[0039] The card I / F (Interface) 41 is incorporated in a card slot (not shown) provided in the camera body 11, and is electrically connected to a memory card 42 inserted into the card slot. Specifically, the card I / F 41 stores image data that has been image-processed by the image data processing unit 37 in the memory card 42. When playing back and displaying image data stored in the memory card 42, the card I / F 41 reads the image data from the memory card 42. Note that the image recording unit is not limited to a configuration in which data is recorded on a recording medium such as a memory card, and may be a recording device such as an SSD (Solid State Drive).

[0040] The two-in-one mode and processes related to the two-in-one mode will be described in detail below. As shown in Fig. 5, control unit 31 is a processor that executes programs in a program memory (not shown) to cause image data processing unit 37 to realize the functions of image data acquisition unit 50, paired image data generation unit 51, paired image standard generation unit 52, paired image characteristic generation unit 53, and roll video generation unit 54. Also, as shown in Fig. 6, control unit 31 executes programs in the program memory to cause control unit 31 to realize the function of two-in-one mode control unit 55.

[0041] The image data acquisition unit 50 acquires both the first image data and the second image data used to generate the paired image data by capturing images using the imaging device 10. Specifically, as shown in FIG. 7(A), the first image data of the first image P1 is acquired in accordance with the operation of the release switch 15. In this state, as shown in FIG. 7(B), a transition icon ICX indicating that transition to the two-in-one mode is possible is displayed on the display 22. Then, when the transition icon is displayed, the lever 17 is pulled from the normal position (see FIG. 3(B)) to transition to the two-in-one mode. Then, as shown in FIG. 7(C), the release switch 15 is operated during the two-in-one mode to acquire the second image data of the second image. In this manner, the first image data and the second image data are obtained. As will be described later, the paired image data is generated based on the first image data and the second image data.

[0042] Furthermore, the image data acquisition unit 50 may acquire one of the two sets of first image data and second image data used to generate the paired image data as image data arbitrarily selected from captured image data. Specifically, as shown in FIG. 8(A), the display 22 is switched to a playback screen, and images of the captured image data are displayed on the playback screen. The user selects the first image data to be used to generate the paired image data from the image data of the captured images displayed on the playback screen. The selection of the first image data is preferably performed by touching the display 22, for example.

[0043] As shown in Fig. 8(B), when the first image data is selected, the transition icon ICX is displayed on the display 22 together with the first image P1 of the selected first image data. When the transition icon is displayed, the lever 17 is pulled to switch to the two-in-one mode. Then, as shown in Fig. 8(C), when in the two-in-one mode, the release switch 15 is operated to acquire the second image data of the second image P2. In this way, the first image data and the second image data are acquired.

[0044] The paired image data generating unit 51 generates paired image data (third image data) that is a set of image data from at least the first image data and the second image data. The paired image data is image data in which the first image data and the second image data are displayed in parallel on the display 22. Specifically, as shown in Fig. 9, paired image data of a paired image PP is generated by combining the first image P1 and the second image P2 from the first image data of the first image P1 and the second image data of the second image P2 obtained by the image data obtaining unit 50.

[0045] The generated paired image data may have different standards or characteristics between the first image data and the second image data, which may cause a user to feel uncomfortable when viewing the image of the paired image data. Therefore, the paired image standard generation unit 52 or the paired image characteristic generation unit 53 generates paired image standards or paired image characteristics that allow the user to view the image without feeling uncomfortable. Then, the standard or characteristic of the paired image data is set based on the paired image standard or paired image characteristic.

[0046] The paired image standard generating unit 52 generates a paired image standard (third standard) based on the first standard of the first image data and the second standard of the second image data. In the paired image data, the first image data and the second image data are each a single piece of image data defined by the paired image standard. The first standard, the second standard, and the paired image standard preferably include at least one of an image format or an image file format.

[0047] Specifically, when the first standard and the second standard are different, the paired image standard generation unit 52 adjusts the paired image standard to either the first standard or the second standard, or changes it to a standard different from the first standard and the second standard. For example, when adjusting the paired image standard to either the first standard or the second standard, it is preferable that one of the first standard or the second standard is a still image and the other is a moving image. When the paired image standard is a moving image, it is preferable to duplicate a first image P1, which is a still image of the first standard, a specific number of times and stitch the duplicated first images P1 together to form a moving image MP1. In this case, as shown in FIG. 10 , the paired image data PP is set as a moving image of the third standard and is composed of data of the stitched moving image MP1 and second image data, which is a second image P2 of the moving image of the second standard. On the other hand, when the paired image standard is a still image, it is preferable that an arbitrary frame image selected from the moving image of the first standard is used as the still image. In this case, the paired image is displayed on the display 22 in parallel with the selected arbitrary frame image and a still image of the second standard.

[0048] When the paired image standard is set to either the first standard or the second standard, the image file format is preferably set to MOV of the second standard when the still image of the first standard is JPEG and the video of the second standard is MOV, or when the video of the first standard is MOV and the still image of the second standard is JPEG, the paired image standard is preferably set to JPEG of the second standard. When the paired image standard is changed to a standard different from the first and second standards, the paired image standard is preferably set to PING when the still image of the first standard and the still image of the second standard are both JPEG, or when the video of the first standard is MOV and the still image of the second standard is JPEG, the paired image standard is preferably AVI. When the paired image standard is set to the same as the first and second standards, the image file format is preferably set to JPEG for the first standard, the second standard, and the paired image standard.

[0049] The paired image characteristic generating unit 53 generates paired image characteristics (third characteristics) of the paired image data based on the first characteristics of the first image data and the second characteristics of the second image data. The first characteristics, second characteristics, and paired image characteristics are specifications of the image data, and preferably include at least any of the aspect ratio, image size, resolution, frame rate, bit rate, and recording time.

[0050] Specifically, when the first characteristic of the first image data and the second characteristic of the second image data differ, the paired image characteristic generation unit 53 matches the paired image characteristic of the paired image data to either the first characteristic or the second characteristic, or changes the paired image characteristic of the paired image data to a characteristic different from the first characteristic and the second characteristic. In this case, it is preferable to change at least one of the aspect ratio, bit rate, recording time, and frame rate for at least one of the first characteristic and the second characteristic.

[0051] For example, when changing the bit rate, the paired image characteristic generation unit 53 preferably sets the bit rate determined by the paired image characteristics to be equal to or lower than the bit rate determined by the first or second characteristics. As shown in FIG. 11, if the bit rate of the moving image of the first image P1 determined by the first characteristics is 200 Mbps (Megabits per second) and the bit rate of the moving image of the second image P1 determined by the second characteristics is 100 Mbps, it is preferable to set the bit rate of the moving image of the paired image P2 determined by the paired image characteristics to 50 Mbps. By lowering the bit rate in this manner, the file size of the paired image data can be compressed. On the other hand, even with the paired image characteristics, if the bit rate of the first or second characteristics is maintained, the image quality of the paired image data can be maintained.

[0052] Furthermore, when changing the recording time, the paired image characteristic generation unit 53 preferably sets the recording time determined by the paired image characteristics to be equal to or shorter than the recording time determined by the first characteristic or the second characteristic. As shown in FIG. 12, if the recording time of the moving image P1 of the first image determined by the first characteristic is 30 seconds and the recording time of the moving image P2 of the second image determined by the second characteristic is 20 seconds, it is preferable to set the recording time of the moving image P2 of the paired image characteristics to 20 seconds. In this case, a portion of the moving image of the first standard is cut out and edited to a recording time of 20 seconds. This allows moving images of different recording times to be combined, and also allows the file size of the combined paired image data to be compressed.

[0053] Furthermore, when changing the frame rate, the paired image characteristic generation unit 53 preferably matches at least one of the frame rates determined by the first characteristic or the second characteristic to the paired image characteristic. As shown in Fig. 13, if the frame rate of the moving image of the first image P1 determined by the first characteristic is 20 fps (frames per second) and the recording time is 60 seconds, and the frame rate of the moving image of the second image P2 determined by the second characteristic is 20 fps and the recording time is 30 seconds, it is preferable to set the frame rate of the moving image of the paired image PP determined by the paired image characteristic to 40 fps and the recording time to 30 seconds.

[0054] In this case, the frame rate of the video with the first characteristic (first image data) is changed from 20 fps to 40 fps, thereby editing the video from 60 seconds to 30 seconds, and the recording time is reduced to 30 seconds. Meanwhile, the frame rate of the video with the second characteristic (second image data) is edited from 20 fps to 40 fps by repeating two identical frames within the same 30-second recording time. By combining the first characteristic video and the second characteristic video edited in this way, a video with 40 fps and a recording time of 30 seconds (video with paired image characteristics) is obtained. When changing the frame rate in this way, unlike when shortening the recording time, there is no need to thin out the video frames, and therefore a video with smoother movement is obtained.

[0055] When generating paired image data, the paired image characteristic generation unit 53 preferably maintains the image orientations determined by the first image data and the second image data. Specifically, as shown in Fig. 14(A), if the image orientation of the first image P1 in the first image data is normal and the image orientation of the second image P2 in the second image data is also normal, the orientations of the first image P1 and the second image P2 are also maintained normal in paired image PP of the paired image data. Furthermore, as shown in Fig. 14(B), if the image orientation of the first image P1 in the first image data is normal and the image orientation of the second image P2 in the second image data is rotated 90 degrees clockwise, the orientation of the first image P1 is maintained normal and the orientation of the second image P2 is maintained rotated 90 degrees clockwise in paired image PP of the paired image data.

[0056] 14(C), if the orientation of the first image P1 in the first image data is normal and the orientation of the second image P2 in the second image data is rotated 90 degrees left, the orientation of the first image P1 is maintained in the normal direction and the orientation of the second image P2 is maintained in the rotated 90 degrees left in paired images PP of the paired image data. Also, as shown in FIG. 14(D), if the orientation of the first image P1 in the first image data is right and the orientation of the second image P2 in the second image data is rotated 90 degrees left, the orientation of the first image P1 is maintained in the rotated 90 degrees right and the orientation of the second image P2 is maintained in the rotated 90 degrees left in paired images PP of the paired image data.

[0057] The normal image orientation refers to the orientation of image P obtained when the horizontally oriented imaging device 10 is used to capture an image in a horizontally oriented state, as shown in Fig. 15(A). The image orientation rotated 90 degrees to the right refers to the orientation of an image obtained when the horizontally oriented imaging device 10 is rotated 90 degrees clockwise to capture an image in a vertically oriented state, as shown in Fig. 15(B). The image orientation rotated 90 degrees to the left refers to the orientation of an image obtained when the horizontally oriented imaging device 10 is rotated 90 degrees counterclockwise to capture an image in a vertically oriented state, as shown in Fig. 15(C).

[0058] The paired image characteristic generation unit 53 preferably performs at least one of background addition, cropping, and scaling on at least one of the first image data and the second image data based on the first characteristic and the second characteristic. These processes are used to adjust the image size of the still image or video of the first image P1 or the second image P2 to the image size of the first image P1 or P2 in the paired images.

[0059] Specifically, as shown in Figure 16(A), when generating pair image data of a pair image PP from the first image data of a first image P1 and the second image data of a second image P2, each of which has a different image size, background processing involves adding a background image BP to the blank space that occurs when the image size of the second image P2 is adjusted to the image size of the first image P1.

[0060] As shown in FIG. 16(B), in the cropping process, in order to match the image size of the first image P1 to the image size of the second image P2, when acquiring the first image data, a process is performed in which the first image data is cropped to the image size of the second image P2 and then acquired. The area CP represents the area to be cropped. In this case, the image size can be reduced while maintaining the image size of the subject in the first image P1. As shown in FIG. 16(C), in the downscaling process, in order to match the image size of the first image P1 to the image size of the second image P2, a process is performed to downscaling the image size of the first image data. In this case, the image size of the subject in the first image P1 is reduced in accordance with the reduction in the image size.

[0061] The control performed when generating paired image data will be described below. When generating paired image data, the two-in-one mode control unit 55 outputs information regarding the processing time required for generation. Specifically, when the release switch 15 is operated in two-in-one mode, the second image data is obtained and generation of the paired image data begins. As the generation of this paired image data begins, as shown in FIG. 17, guidance GDX is displayed on the display 22 indicating that the paired image data is being generated and indicating the time remaining until generation of the paired image data is completed.

[0062] Furthermore, the two-in-one mode control unit 55 does not generate paired image data if either the first image data or the second image data does not exist, or if the first image data or the second image data is paired image data. The absence of either the first image data or the second image data includes not only the case where the data is not stored on the memory card 42, but also the case where the data is not stored in the partial storage memory within the imaging device 10. Specifically, if either the first image data or the second image data does not exist, or if the first image data or the second image data is paired image data, the transition-impossible icon ICY, indicating that transition to the two-in-one mode is not possible, is displayed on the display 22, as shown in FIG. 18 . In this case, even if the lever 17 is pulled, transition to the two-in-one mode is not performed. However, if either the first image data or the second image data exists, generation of paired image data is permitted.

[0063] The playback of paired image data will be described below. When the two-in-one mode control unit 55 outputs paired image data to the display 22 (display screen), it switches between displaying the first image of the first image data and the second image of the second image data on the display 22. In addition, while switching between displaying the first image and displaying the second image, one of the first image and the second image slides in and the other slides out and is displayed on the display screen.

[0064] Specifically, as shown in FIG. 19(A), when the second image P2 is displayed on the display 22, the user presses the lever 17 from the normal position (see FIG. 3(C)). Accordingly, as shown in FIG. 19(B), the first image P1 slides in on the display 22, and the second image P2 slides out from the display 22. As shown in FIG. 19(C), by continuing to press the lever 17, the image displayed on the display 22 switches to the first image P1. Then, when the pressing of the lever 17 is released, the first image P1 slides out from the display 22, and the second image P2 slides in on the display 22, as shown in FIG. 19(D). Then, when the lever 17 returns to the normal position (see FIG. 3(A)), the image displayed on the display 22 switches to the second image, as shown in FIG. 19(E).

[0065] The generation of a roll video will be described below. The roll video generator 54 connects multiple still image data together to generate video data, which is a set of videos. The video data is preferably image data that scrolls multiple still image data in a specific direction on the display 22 within a specific time period.

[0066] Specifically, when the mode dial 14 is operated to set the roll video mode, an image selection screen is displayed on the display 22 as shown in FIG. 20(A). A plurality of still images are displayed on the image selection screen. Then, as shown in FIG. 20(B), a still image to be used in the roll video is selected from the still images on the image selection screen by tapping the display 22 or the like. A number is displayed on the selected still image in the order of selection. Once selection is complete, generation of the roll video begins. Once generation of the roll video is complete, a guidance message GDY is displayed as shown in FIG. 20(C), indicating that generation of the roll video is complete. When the generated roll video is played back, for example, three still images are displayed on the display 22, scrolling in order from left to right, over a period of 30 seconds.

[0067] In the above embodiment, the paired image data generation unit 51 and the paired image characteristic generation unit 53 may generate paired image data with an aspect ratio for paired images (third aspect ratio) from first image data with a first aspect ratio and second image data with a second aspect ratio. In this case, the horizontal ratios of the first aspect ratio, the second aspect ratio, and the aspect ratio for paired images are the same, and the paired image data is preferably a still image if both the first image data and the second image data are still images, and preferably a moving image if at least one of the first image data and the second image data is a moving image. Note that the horizontal ratios of the first aspect ratio, the second aspect ratio, and the aspect ratio for paired images being the same includes cases where the horizontal ratios are completely the same as well as cases where there is a slight difference in the horizontal ratios.

[0068] Specifically, as shown in FIG. 21, if the first aspect ratio of the first image P1 is 3:4 (width:height) and the second aspect ratio of the second image P2 is 3:4 (width:height), it is preferable that the aspect ratio for the paired images of the paired images PP be 3:2, with the horizontal ratio of the first aspect ratio and the second aspect ratio being the same at 3.

[0069] In the above embodiment, paired image data is generated from two pieces of image data, the first image data and the second image data, but three or more pieces of image data including the first image data and the second image data may be used as a set of image data to generate multi-image data (third image data). Specifically, as shown in Fig. 22, multi-image data is generated based on the first image data of the first image P1 and the second image data of the second image P2, as well as the third image data of the third image P3 and the fourth image data of the fourth image P4. In this case, the multi-image data is saved as a single piece of image data.

[0070] In this embodiment, each process is executed by a computer. The computer may execute these processes by a processor, a program, or a combination thereof. The computer may be a general-purpose computer, a computer for specific applications, a system such as a workstation, or other hardware element capable of executing a program.

[0071] The processor may be composed of one or more pieces of hardware, and the type of hardware is not limited. For example, the processor may be composed of hardware such as a programmable logic device such as a CPU (Central Processing Unit), an MPU (Micro Processing Unit), or an FPGA (Field Programmable Gate Array), a dedicated circuit for executing specific processes such as an ASIC (Application Specific Integrated Circuit), a GPU (Graphic Processing Unit), or an NPU (Neural Processing Unit). The processor also has various units or means for executing various processes in the present embodiment. The type of hardware may also be a combination of different types of hardware. When multiple pieces of hardware are configured to execute one or more processes of a certain processor, the multiple pieces of hardware may exist in devices physically separated from each other or in the same device. In any of the embodiments, the order of the processes performed by the processor is not limited to the order described above and may be changed as appropriate. The hardware may be composed of an electric circuit or the like, which is a combination of circuit elements such as semiconductor devices.

[0072] Furthermore, the present embodiment may be implemented by hardware, software, firmware, microcode, or a combination thereof. Software, firmware, and microcode may be configured by a program. A program may also be, for example, a group of program modules, each function of which may be implemented by a processor configured to perform the respective function. The program may be program code or multiple code segments stored in one or more non-transitory computer-readable media (e.g., storage media or other storages). The program may be stored in multiple non-transitory computer-readable media that reside in physically separate devices. A program code or a code segment may represent a procedure, a function, a subprogram, a routine, a subroutine, a module, a software package, a class, or any combination of instructions, data structures, or program statements. A program code or a code segment may be connected to another code segment or a hardware circuit by sending or receiving information, data, arguments, parameters, or memory contents.

[0073] In the above embodiment, each process or function is realized by an image data acquisition unit 50, a paired image data generation unit 51, a paired image standard generation unit 52, a paired image characteristic generation unit 53, a roll video generation unit 54, and a two-in-one mode control unit 55.

[0074] In the above-described embodiments, a digital camera in which the imaging optical system 13 is fixed to the camera body 11 is exemplified, but the present invention is not limited to this and may be applied to a lens-interchangeable digital camera in which the imaging optical system is interchangeable with respect to the camera body. Note that in the above-described embodiments, a lens barrel 12 without a zoom lens is exemplified, but the present invention is not limited to this and the imaging optical system 13 may include a zoom lens. Furthermore, the present invention is applicable to cameras other than the above-described digital cameras, such as smartphones and video cameras. [Explanation of symbols]

[0075] 10. Digital Camera 11 Camera body 11A Grip 12 Lens barrel 13 Imaging optical system 14 Mode dial 15 Release switch 16 Power switch 17 Lever 18 Flash equipment 19 Lighting equipment 21 Image sensor 22 Display 23 Electronic viewfinder 31 Control Unit 32 shutter unit 33 Shutter motor 34 Motor driver 35 Image Memory 36 Bus Line 37 Image data processing section 38 Display Driver 41 Card I / F (Interface) 42 Memory Card 50 Image data acquisition unit 51 Pair image data generation unit 52 Pair Image Standards Generation Unit 53 Pair image characteristic generation unit 54 Roll video generation unit 55 Two-in-one mode control unit CL center axis OA optical axis P1 1st image P2 2nd image PP Pair Image MP1 video P Image ICX Migrable Icons ICY non-transferable icon BP background image CP area GDX, GDY Guidance

Claims

1. An information processing device having a processor, The processor: generating third image data, which is a set of image data, from at least the first image data and the second image data; an information processing apparatus that generates a third standard of the third image data based on a first standard of the first image data and a second standard of the second image data;

2. 2. The information processing apparatus according to claim 1, wherein the set of image data is one image data.

3. The information processing apparatus according to claim 1 , wherein the set of image data is a set of three or more image data including the first image data and the second image data.

4. The information processing apparatus according to claim 1 , wherein the third image data is image data in which the first image data and the second image data are displayed in parallel on a display screen.

5. If the first standard and the second standard are different, The processor: The information processing apparatus according to claim 1 , wherein the third standard is adapted to either the first standard or the second standard, or is changed to a standard different from the first standard and the second standard.

6. The information processing apparatus according to claim 1 , wherein the first standard, the second standard, and the third standard include at least one of an image format and an image file format.

7. The processor: When the third standard is adjusted to either the first standard or the second standard, 7. The information processing apparatus according to claim 6, wherein one of the first standard and the second standard is for still images, and the other is for moving images.

8. The processor: When converting the third standard into a video, The information processing apparatus according to claim 7 , wherein the still image is duplicated a specific number of times, and the duplicated still images are joined together to fit the moving image.

9. When the first characteristic of the first image data and the second characteristic of the second image data are different, The processor: The information processing apparatus according to claim 1 , wherein the third characteristic of the third image data is matched to either the first characteristic or the second characteristic, or is changed to a third characteristic different from the first characteristic and the second characteristic.

10. the first characteristic, the second characteristic, and the third characteristic are specifications of image data; 10. The information processing apparatus according to claim 9, wherein the information includes at least one of an aspect ratio, an image size, a resolution, a frame rate, a bit rate, and a recording time.

11. The processor: The information processing apparatus according to claim 9 , wherein at least one of an aspect ratio change, a bit rate change, a recording time change, and a frame rate change is performed for at least one of the first characteristic and the second characteristic.

12. The processor: The information processing apparatus according to claim 9 , wherein at least one of background addition, cropping, and scaling is performed on at least one of the first image data and the second image data based on the first characteristic and the second characteristic.

13. The processor: The information processing apparatus according to claim 11 , wherein, when the bit rate is changed, the bit rate determined by the third characteristic is set to be equal to or lower than the bit rate determined by the first characteristic or the second characteristic.

14. The processor:

12. The information processing apparatus according to claim 11, wherein when the recording time is changed, the recording time determined by the third characteristic is set to be equal to or shorter than the recording time determined by the first characteristic or the second characteristic.

15. The processor: The information processing apparatus according to claim 11 , wherein, when the frame rate is changed, at least one of the frame rates determined by the first characteristic and the second characteristic is adjusted to match the third characteristic.

16. The processor: The information processing apparatus according to claim 1 , wherein, when the third image data is generated, the image orientation determined by the first image data and the image orientation determined by the second image data are maintained.

17. The processor: When generating the third image data, The information processing apparatus according to claim 1 , wherein information relating to a processing time for the generation is output.

18. The processor: If the first image data or the second image data does not exist, or if the first image data or the second image data is the set of image data, The information processing apparatus according to claim 1 , wherein the third image data is not generated.

19. The processor: The information processing apparatus according to claim 1 , wherein, when the third image data is output to a display screen, a first image of the first image data and a second image of the second image data are displayed on the display screen in a switching manner.

20. The processor: The information processing device according to claim 19 , wherein, during switching between display of the first image and display of the second image, one of the first image and the second image is slid in and the other is slid out and displayed on the display screen.

21. The processor: When the second mode is set, a plurality of still image data are joined together to generate a set of moving image data, 2. The information processing apparatus according to claim 1, wherein the moving image data is image data for scrolling the plurality of still image data in a specific direction on a display screen within a specific time period.

22. An imaging device comprising the information processing device according to any one of claims 1 to 21.

23. the imaging device has a first mode; The processor: The imaging device according to claim 22 , wherein the third image data is generated when the imaging device is switched to the first mode.

24. 24. The imaging device according to claim 23, wherein the first mode is a mode in which the set of image data is generated from a plurality of image data.

25. The processor: When generating the third image data, The imaging device according to claim 22 , wherein both the first image data and the second image data are acquired by capturing an image with the imaging device.

26. The processor: When generating the third image data, 23. The imaging device according to claim 22, wherein one of the first image data and the second image data is an image arbitrarily selected from image data that has already been captured.

27. 1. An imaging device having a processor, The processor: generating third image data having a third aspect ratio from the first image data having the first aspect ratio and the second image data having the second aspect ratio; the first aspect ratio, the second aspect ratio, and the third aspect ratio have the same horizontal ratio; The third image data is When the first image data and the second image data are both still images, they are still images; When at least one of the first image data and the second image data is a moving image, the imaging device.

28. the first aspect ratio and the second aspect ratio are 3:4; 28. The imaging device of claim 27, wherein the third aspect ratio is 3:2.

Images