Information processing device, information processing method, and program
The device addresses usability issues by using an image search unit to find images with the earliest or closest capture times within grouped images, improving the efficiency of image retrieval without repeated user input.
Patent Information
- Application Number
- JP2023536605
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2021-07-21
- Filing Date
- 2022-03-10
- Publication Date
- 2025-11-18
- Estimated Expiration
- 2042-03-10
AI Technical Summary
Conventional information processing devices with image capturing capabilities require users to re-enter date and time periods when no images are found, leading to usability issues during image retrieval.
The device includes an image search unit that identifies images corresponding to specified date and time information, determining the image with the earliest or closest capture time within grouped images, and a display control unit that displays these images on a display unit.
Enhances usability by automatically displaying the most relevant images without requiring users to repeatedly input date and time information, facilitating efficient image retrieval.
Smart Images

Figure 0007772069000001 
Figure 0007772069000002 
Figure 0007772069000003
Abstract
Description
[Technical Field]
[0001] The present technology relates to an information processing device, an information processing method, and a program, and in particular to a technology for searching for images. [Background technology]
[0002] Conventionally, information processing devices equipped with an image capturing function, such as a camera, have been configured to associate the image capturing time with the image and store it, and such information processing devices can, for example, display images in order of capture based on the image capturing time.
[0003] Further, an information processing device has been proposed that displays a list of images captured on a date and in a time period designated by a user. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2007-312310 Summary of the Invention [Problem to be solved by the invention]
[0005] However, with the above-mentioned information processing device, if there are no images taken on the date and time period selected by the user, the image cannot be displayed, which may result in the user having to re-enter the date and time period, which may actually be a burden to the user.
[0006] Therefore, the present technology aims to improve usability when searching for images. [Means for solving the problem]
[0007] The information processing device according to the present technology includes an image search unit that searches for an image corresponding to specified date and time information from among a plurality of images stored in association with image capture times, and a display control unit that displays an image based on the search results by the image search unit on a display unit. The plurality of images include grouped images, and when the images corresponding to the specified date and time information are grouped images, the image search unit determines as search results the image with the earliest image capture time and the image with the closest image capture time to the specified date and time information from among the images in the group that includes the image corresponding to the specified date and time information. This allows the information processing device to compare the specified date and time information with the image capture time associated with the image, and determine, as a search result, an image whose image capture time is close to the specified date and time information. [Brief explanation of the drawings]
[0008] [Figure 1] FIG. 1 is a diagram illustrating the appearance of an imaging device. [Figure 2] FIG. 1 is a diagram illustrating the appearance of an imaging device. [Figure 3] FIG. 2 is a diagram illustrating the internal configuration of the imaging device. [Figure 4] FIG. 10 is a diagram illustrating a playback mode. [Figure 5] 10A and 10B are diagrams illustrating an image search and display process in the first specific example. [Figure 6] 10A and 10B are diagrams illustrating an image search and display process in the first specific example. [Figure 7] 10 is a flowchart showing the flow of an image search and display process in the first specific example. [Figure 8] 10A and 10B are diagrams illustrating an image search and display process in the second specific example. [Figure 9] 10 is a flowchart showing the flow of an image search and display process in the second specific example. [Figure 10] 13A to 13C are diagrams illustrating an image search and display process in a specific example 3. [Figure 11] 13 is a flowchart showing the flow of an image search and display process in the third specific example. [Figure 12] 13 is a diagram illustrating an image search and display process in a fourth specific example. FIG. [Figure 13] 13 is a flowchart showing the flow of an image search and display process in the fourth specific example. [Figure 14]FIG. 13 is a diagram illustrating an image search and display process in a fifth specific example. [Figure 15] 13 is a flowchart showing the flow of an image search and display process in the fifth specific example. [Figure 16] FIG. 20 is a diagram illustrating an image search and display process in a seventh specific example. [Figure 17] 13 is a flowchart showing the flow of an image search and display process in Example 7. [Figure 18] FIG. 20 is a diagram illustrating an image search and display process in the eighth specific example. [Figure 19] FIG. 13 is a diagram illustrating an image search and display process in a ninth specific example. [Figure 20] 13 is a flowchart showing the flow of an image search and display process in a ninth specific example. [Figure 21] 13 is a diagram illustrating an image search and display process in a tenth example. FIG. [Figure 22] 20 is a flowchart showing the flow of image search and display processing in Example 10. [Figure 23] FIG. 10 is a diagram illustrating a date and time input image. DETAILED DESCRIPTION OF THE INVENTION
[0009] The embodiments will be described below in the following order. <1. Configuration of imaging device> <2. Playback mode> <3. Image search display processing> <4. Modifications> <5. Summary> <6. This technology>
[0010] <1. Configuration of imaging device> 1 and 2 are diagrams showing the appearance of an imaging device 1 as an example of an information processing device according to an embodiment of the present technology. FIG. 2 shows a camera housing 2 from which a lens barrel 3 has been removed. Note that the following description will be given with the subject side as the front and the photographer (user) side as the rear. The information processing device shown in FIGS. 1 and 2 is an example of the present technology, and a part of it may be included in an external device connected to the information processing device wirelessly or by wire, or it may include processing units other than the units shown below.
[0011] As shown in Figures 1 and 2, the imaging device 1 comprises a camera housing 2 in which the necessary parts are arranged inside and outside, and a lens barrel 3 that is detachable from the camera housing 2 and attached to the front part 2a. It should be noted that the lens barrel 3 being detachable as a so-called interchangeable lens is just one example, and the lens barrel may be one that cannot be removed from the camera body 2.
[0012] A rear monitor 4 is disposed on the rear surface 2b of the camera housing 2. The rear monitor 4 displays live view images, playback images of recorded images, and the like. The rear monitor 4 is configured by a display device such as a liquid crystal display (LCD) or an organic electroluminescence (EL) display. The rear monitor 4 is rotatable relative to the camera housing 2. For example, the rear monitor 4 is rotatable around the upper end of the rear monitor 4 as a rotation axis, so that the lower end of the rear monitor 4 moves rearward. The right or left end of the rear monitor 4 may be the rotation axis. Furthermore, the rear monitor 4 may be rotatable around multiple axes.
[0013] An EVF (Electric Viewfinder) 5 is disposed on the top surface 2c of the camera housing 2. The EVF 5 includes an EVF monitor 5a and a frame-shaped enclosure 5b that protrudes rearward so as to surround the upper and left and right sides of the EVF monitor 5a. The EVF monitor 5a is formed using an LCD, an organic EL display, etc. Note that an optical viewfinder (OVF) may be provided instead of the EVF monitor 5a.
[0014] The rear surface 2b and the top surface 2c are provided with various controls 6. The controls 6 include, for example, a shutter button (release button), a playback menu start button, a decision button, a cross key, a cancel button, a zoom key, and a slide key. These controls 6 include various types of controls, such as buttons, dials, and composite controls that can be pressed and rotated. The various types of controls 6 enable, for example, shutter operation, menu operation, playback operation, mode selection operation, focus operation, zoom operation, and parameter change operation. Note that parameters include, for example, shutter speed, aperture value (F-number), ISO sensitivity, etc. The controls 6 also include a touch panel provided on the front surface of the rear monitor 4.
[0015] FIG. 3 is a diagram showing the internal configuration of the imaging device 1. As shown in FIG. In the imaging device 1, light from a subject is incident on the imaging element unit 12 via the imaging optical system 11.
[0016] The imaging optical system 11 is provided with various lenses such as a zoom lens, a focus lens, a condenser lens, an aperture mechanism, a zoom lens drive mechanism, and a focus lens drive mechanism. The imaging optical system 11 may also be provided with a mechanical shutter (for example, a focal plane shutter).
[0017] The imaging element unit 12 is configured to have an image sensor such as a CMOS (Complementary Metal Oxide Semiconductor) type or a CCD (Charge Coupled Device) type. The image sensor unit 12 performs processes such as CDS (Correlated Double Sampling) and AGC (Automatic Gain Control) on the electrical signal obtained by photoelectrically converting the light received by the image sensor, and then performs A / D (Analog / Digital) conversion on the electrical signal. The image sensor unit 12 then outputs the imaging signal as digital data to the signal processor 13.
[0018] The signal processing unit 13 is configured as an image processor, for example, a DSP (Digital Signal Processor), etc. The signal processing unit 13 performs various signal processing on the input imaging signal. For example, the signal processing unit 13 performs pre-processing, synchronization processing, YC generation processing, resolution conversion processing, file formation processing, etc.
[0019] In the pre-processing, the imaging signal from the imaging element unit 12 is subjected to clamping processing for clamping the black levels of R, G, and B to predetermined levels, correction processing between the R, G, and B color channels, and the like. In the image processing, a color separation process is performed to generate image data for each pixel so that it contains all the color components of R, G, and B. For example, in the case of an image sensor that uses a Bayer array color filter, a demosaic process is performed as the color separation process. In the YC generation process, a luminance (Y) signal and a color (C) signal are generated (separated) from R, G, and B image data. In the resolution conversion process, the image data that has been subjected to various signal processes is subjected to the resolution conversion process.
[0020] In the file creation process, for example, the image data that has been subjected to the various processes described above is subjected to compression encoding for recording or communication, formatting, generation and addition of metadata, etc., to generate a file for recording or communication. For example, still image files can be generated in formats such as JPEG (Joint Photographic Experts Group), TIFF (Tagged Image File Format), GIF (Graphics Interchange Format), etc. It is also possible to generate image files in the MP4 format used for recording moving images and audio in accordance with MPEG-4. It is also possible to generate an image file as raw (RAW) image data.
[0021] The signal processing unit 13 generates metadata that includes information on processing parameters within the signal processing unit 13, various control parameters obtained from the control unit 17, information indicating the operating status of the imaging optical system 11 and the imaging element unit 12, mode setting information, and information such as date, time, and location. For example, the metadata includes camera information such as the time the image data was captured, the model, manufacturer, and serial number of the imaging device 1, the data format, the frame rate (for moving images), the data size, the angle of view, and parameter information used during imaging.
[0022] The storage unit 14 is, for example, a nonvolatile memory, and stores the image file processed by the signal processing unit 13. Note that, hereinafter, image data and image files may be simply referred to as images.
[0023] The display unit 15 displays various information to the photographer, and is, for example, the rear monitor 4 or EVF monitor 5a disposed on the camera housing 2 of the imaging device 1 as shown in FIG. The display unit 15 executes various displays on the display screen based on instructions from the control unit 17 . For example, the display unit 15 displays an image based on an image file stored in the storage unit 14. Furthermore, the display unit 15 displays various operation menus, icons, messages, etc., i.e., a GUI (Graphical User Interface), based on instructions from the control unit 17. Note that, although the imaging device 1 includes the display unit 15 in this embodiment, an external device (not shown) connected to the imaging device 1 by wire or wirelessly may also include the display unit 15. That is, the display unit 15 of the external device may display the GUI based on instructions from the control unit 17 of the imaging device 1.
[0024] The communication unit 16 performs data communication and network communication with external devices via wire or wirelessly. For example, the communication unit 16 transmits and outputs image files to an external information processing device, display device, recording device, playback device, or the like. Furthermore, the communication unit 16 serves as a network communication unit and performs various network communications such as the Internet, a home network, and a LAN (Local Area Network), and can transmit and receive various data to and from servers, terminals, and the like on the network.
[0025] The control unit 17 is configured by a microcomputer (arithmetic processing device) including a CPU (Central Processing Unit), a ROM (Read Only Memory), and a RAM (Random Access Memory). The control unit 17 is an information processing device that controls the operation of the imaging device 1.
[0026] RAM is used as a working area for the CPU to process various data, and to temporarily store data, programs, etc. The ROM is used to store the OS (Operating System) that the CPU uses to control each part, application programs for various operations, firmware, various setting information, and the like. The various setting information includes communication setting information, setting information related to imaging operations, setting information related to image processing, etc. Setting information related to imaging operations includes shutter speed, F-number, ISO sensitivity, curtain speed setting of mechanical shutter or electronic shutter, frame rate, etc.
[0027] The control unit 17 is provided with functions as an imaging control unit 31, a display control unit 32, and an image search unit 33. The imaging control unit 31 performs various controls when capturing an image. For example, the imaging control unit 31 instructs the signal processing unit 13 to perform various signal processing, and controls imaging operations and recording operations in response to user operations. In addition, the imaging control unit 31 controls the operation of the aperture mechanism, controls the shutter speed of the imaging element unit 12, controls autofocus, manual focus, and zoom operations, drives the focus lens and zoom lens in response to zoom operations, and controls exposure timing.
[0028] The display control unit 32 controls the display of the display unit 15 (rear monitor 4, EVF monitor 5a). For example, the display control unit 32 causes the rear monitor 4 to display captured images and causes the rear monitor 4 to display GUIs for changing various settings. The display control unit 32 also displays images based on the search results of the image search unit 33 on the rear monitor 4.
[0029] As will be described in detail later, the image search unit 33 searches for an image corresponding to the date and time information specified via the operation unit 6 from among a plurality of images stored in the storage unit 14 with their image capture times associated with each other. In this specification, the image capture time is related to the date and time when the image was captured, and indicates, for example, the year, month, day, hour, and minute when the image was captured. The processing (image search and display processing) executed by the display control unit 32 and the image search unit 33 will be described later. In this embodiment, the imaging device 1 is provided with the operator 6, but an external device (not shown) connected to the imaging device 1 by wire or wirelessly may be provided with the operator 6. In other words, the image search unit 33 of the imaging device 1 may search for an image corresponding to date and time information specified via the operator 6 of the external device.
[0030] Furthermore, the control unit 17 is connected to a driver unit 18 and an audio output device 19 .
[0031] The driver unit 18 includes, for example, a motor driver for a zoom lens drive motor, a motor driver for a focus lens drive motor, a motor driver for a diaphragm mechanism motor, and the like. These motor drivers apply drive currents to the corresponding drivers in response to instructions from the imaging control unit 31, and cause the focus lens and zoom lens to move, and the diaphragm blades of the diaphragm mechanism to open and close.
[0032] The audio output device 19 is a device that outputs audio, such as a speaker or a piezoelectric element.
[0033] <2. Playback mode> 4 is a diagram showing playback modes. The imaging device 1 has a single-image playback mode and a list playback mode as methods for displaying images stored in the storage unit 14 on the rear monitor 4. The imaging device 1 can switch between the single-image playback mode and the list playback mode by a predetermined operation on the control 6.
[0034] 4, in single-image playback mode, the display control unit 32 displays one image out of the multiple images stored in the storage unit 14 on the rear monitor 4. When an operation to switch the image to be displayed is performed via the operator 6, the display control unit 32 switches the image to be displayed in accordance with the operation on the operator 6 and displays it on the rear monitor 4.
[0035] 4, in the list playback mode, the display control unit 32 displays a list of multiple images (9 images in the example in the lower part of FIG. 4) stored in the storage unit 14 on the rear monitor 4, arranging them in order of earliest capture time (oldest capture order). The display control unit 32 also points the cursor CS so that one of the images displayed in the list is highlighted. When an operation to switch the cursor CS is performed via the operator 6, the display control unit 32 moves the cursor CS in accordance with the operation on the operator 6, thereby switching the image to be highlighted. When an operation to point the cursor CS at an image outside the screen is performed via the operator 6, the display control unit 32 switches the images currently displayed in the list from the images currently displayed in the list to another image stored in the storage unit 14 and displays the images on the rear monitor 4.
[0036] Furthermore, when an operation is performed on the operator 6 to enlarge and display the image on which the cursor CS is placed, the display control unit 32 switches to single image playback mode and displays the image on which the cursor CS is placed on the rear monitor 4.
[0037] <3. Image search display processing> Next, the image search and display process will be described using specific examples. Note that the imaging device 1 may be able to execute all of the specific examples described below, or may be able to execute only some of them. Furthermore, the images given in the specific examples are just examples, and any type of image may be used, and the number of images stored does not matter.
[0038] <3.1 Example 1> 5 and 6 are diagrams illustrating the image search and display process in specific example 1. In specific example 1, as shown in the upper part of FIG. 5 and the upper part of FIG. 6, it is assumed that nine still images 1 to 9 are stored in the storage unit 14. It is assumed that still images 1 to 4 were captured between 15:20:00 and 15:15 on July 1, 2021. It is assumed that still images 5 to 7 were captured between 15:39:50 and 15:40 on July 1, 2021. It is assumed that still images 8 and 9 were captured between 15:50:15 and 15:20 on July 1, 2021.
[0039] In specific example 1, when an operation to start the image search display process is performed on the operator 6, the display control unit 32 displays a date and time input image 41 for specifying date and time information in the center of the rear monitor 4, as shown in the lower left part of Figure 5.
[0040] The date and time input image 41 includes a character string prompting the user to input date and time information for searching for an image, and also includes an input field 42 for inputting the year, month, day, hour, and minute. Hereinafter, the year, month, day, hour, and minute provided in the input field 42 may be referred to as input items. The input field 42 may also include seconds. The input field 42 may display the current date and time as a default, or the capture time of the image displayed immediately before the image search and display process. Alternatively, the input field 42 may display neither date and time, or another date and time. When the input field 42 displays the current date and time or the capture time of the image displayed immediately before the image search and display process as a default, the user can more easily input a date and time than when no default display is present.
[0041] Triangle marks are displayed above and below any one of the multiple input items in the input field 42, indicating that the value can be changed by operating the controller 6 up and down (for example, operating the up and down buttons on the cross key, or sliding up and down on the touch panel, etc.) In the example on the left side of the lower row of Fig. 5, triangle marks are displayed above and below the input item for "year."
[0042] When the operator 6 is operated up or down while the date and time input image 41 is displayed on the rear monitor 4, the display control unit 32 changes and displays the input item in response to the up or down operation. For example, when a down operation is performed, the display control unit 32 changes the value of the input item to the next value.
[0043] Furthermore, when the operator 6 is operated left or right (for example, by operating the left or right button on the cross key, or by sliding left or right on the touch panel), the display control unit 32 changes the changeable input item in accordance with the left or right operation. For example, when a right operation is performed, the display control unit 32 changes the changeable input item by one to the right, and displays triangle marks above and below the changed input item.
[0044] In this way, after the input item displayed in the input field 42 is changed in response to the user's operation of the operator 6, if no operation is performed on the operator 6 for a predetermined period of time (e.g., 5 seconds), the image search unit 33 searches for an image corresponding to the input item displayed in the input field 42, i.e., the date and time information specified by the user.
[0045] Here, the image search unit 33 searches for an image corresponding to the date and time information specified by the user by comparing the date and time information specified by the user with the shooting time in the metadata associated with each of the multiple images stored in the memory unit 14.
[0046] In specific example 1, the image search unit 33 searches for images captured at, for example, "July 1, 2021, 3:40 PM," which is date and time information specified by the user, and extracts still images 6 to 7 whose capture times match the date and time information. In this way, when multiple images are extracted, the image search unit 33 determines the image (still image 6) captured earliest among the extracted images as the detection result.
[0047] Then, as shown in the lower center of Figure 5, the display control unit 32 sets the mode to single-image playback mode and displays the image determined as the detection result by the image search unit 33, i.e., the image (still image 6) finally searched by the image search unit 33, on the entire surface of the rear monitor 4. At this time, the display control unit 32 continues to display the date and time input image 41, and displays the date and time input image 41 superimposed on the front of the searched image. Note that here, the date and time input image 41 may be displayed with a predetermined transparency, such as semi-transparency, so that the searched image can be seen through it.
[0048] In this way, the user can check the retrieved image, and if the retrieved image is different from the intended image, the user can immediately input date and time information into the date and time input image 41.
[0049] Then, after the searched image is displayed on the rear monitor 4, when an operation to hide the date and time input image 41 is performed on the operator 6, the display control unit 32 hides the date and time input image 41, as shown in the lower right part of Figure 5.
[0050] 6, the image search unit 33 searches for images captured at "15:44, July 1, 2021," which is the date and time information specified by the user. If no image whose capture time matches the date and time information specified by the user is stored in the storage unit 14, the image search unit 33 determines the image whose capture time is closest to the date and time information specified by the user (an image with a small difference between the date and time information and the capture time, i.e., a still image 7) as the detection result.
[0051] 6, the display control unit 32 sets the mode to single-image playback mode and displays the image (still image 7) searched for by the image search unit 33 on the entire surface of the rear monitor 4. At this time, the display control unit 32 continues to display the date and time input image 41, and also displays the date and time input image 41 superimposed on the front of the searched image.
[0052] Then, after the searched image is displayed on the rear monitor 4, when an operation to hide the date and time input image 41 is performed on the operator 6, the display control unit 32 hides the date and time input image 41, as shown in the lower right part of Figure 6.
[0053] As described above, in specific example 1, the image search unit 33 searches for images corresponding to the date and time information specified by the user via the date and time input image 41, and the display control unit 32 displays the searched images on the rear monitor 4. Note that the images corresponding to the date and time information specified by the user include the image captured the earliest among the images whose capture times match the specified date and time information, and the image whose capture time is closest to the specified date and time information, and the same applies to the following explanation.
[0054] Specific Example 1 is particularly useful when the user knows the date and time information he or she wants to search for. For example, this is useful when, during a break at an event such as a wedding, the user wants to view the program and display a specific image from the images he or she has taken so far on the rear monitor 4.
[0055] 7 is a flowchart showing the flow of the image search and display process in Example 1. When the image search and display process in Example 1 is started, the display control unit 32 displays the date and time input image 41 in the center of the rear monitor 4 in step S1.
[0056] Then, when the input item (date and time information) of input field 42 is changed via operator 6, display control unit 32 changes and displays the input item in input field 42 in step S2. After that, in step S3, image search unit 33 determines whether a predetermined time has passed since the date and time information was last changed, and if the predetermined time has not passed (No in step S3), returns the process to step S2.
[0057] On the other hand, if a predetermined time has passed since the date and time information was changed (step S3), in step S4, the image search unit 33 searches for an image corresponding to the specified date and time information from among the multiple images stored in the memory unit 14.
[0058] Then, in step S5, the display control unit 32 sets the mode to single-image playback mode and displays the image searched by the image search unit 33 on the entire surface of the rear monitor 4. At this time, the display control unit 32 continues to display the date and time input image 41, and also displays the date and time input image 41 superimposed on the front of the searched image.
[0059] Next, in step S6, the display control unit 32 determines whether an operation to hide the date and time input image 41 has been performed on the control unit 6, and if an operation to hide the date and time input image 41 has not been performed (No in step S6), the process returns to step S2. On the other hand, if an operation to hide the date and time input image 41 has been performed (Yes in step S6), the display control unit 32 hides the date and time input image 41 and ends the image search and display process.
[0060] <3.2 Example 2> 8 is a diagram illustrating the image search and display process in Example 2. In Example 2, it is assumed that the same images as those in Example 1 are stored in the storage unit 14, as shown in the upper part of FIG.
[0061] In specific example 2, the single-image playback mode is set, and as shown in the lower left of Figure 8, the display control unit 32 displays one of the multiple images stored in the memory unit 14 (here, still image 1) on the rear monitor 4.
[0062] Then, when an operation to start the image search and display process is performed on the operator 6, the display control unit 32 superimposes the date and time input image 41 on the still image 1 and displays it in the center of the rear monitor 4, as shown in the center of the bottom row of Figure 8.
[0063] At this time, the display control unit 32 displays the date and time input image 41 with the capture time of the still image 1 entered in the input field 42 based on the metadata of the still image 1 displayed on the rear monitor 4.
[0064] Then, after the input item in the input field 42 is changed in response to the user's operation of the operator 6, if no operation is performed on the operator 6 for a predetermined time (e.g., 5 seconds), the image search unit 33 searches for an image corresponding to the input item displayed in the input field 42, i.e., the date and time information specified by the user. The search method is the same as in the first specific example.
[0065] 8, in the single-image playback mode, the display control unit 32 switches to the image (still image 6) searched for by the image search unit 33 and displays it on the entire surface of the rear monitor 4. At this time, the display control unit 32 continues to display the date and time input image 41.
[0066] Then, after the searched image is displayed on the rear monitor 4, when an operation to hide the date and time input image 41 is performed on the operator 6, the display control unit 32 hides the date and time input image 41.
[0067] 9 is a flowchart showing the flow of the image search and display process in Example 2. Note that the same processes as those in Example 1 are given the same reference numerals and the description thereof will be omitted.
[0068] When the image search and display process in specific example 2 is started, in step S11 the display control unit 32 displays the date and time input image 41 with the capture time of the image displayed on the rear monitor 4 in single-image playback mode entered in the input field 42.
[0069] Thereafter, the processes of steps S2 to S4 are performed, and in step S12 the display control unit 32 switches the image that was displayed on the rear monitor 4 to the image found by the image search unit 33. At this time, the display control unit 32 continues to display the date and time input image 41, and also displays the date and time input image 41 superimposed on the front of the found image. Thereafter, the process of step S6 is performed.
[0070] Concrete example 2 is particularly useful when the user knows how many minutes after the image displayed on the rear monitor 4 that the image he or she wants to see is an image of a scene that occurred. For example, this is useful when the interval between scoring scenes in a sporting event is known, or when the time schedule for a specific event is known.
[0071] <3.3 Example 3> 10 is a diagram illustrating the image search and display process in Specific Example 3. In Specific Example 3, it is assumed that the same images as those in Specific Example 1 are stored in the storage unit 14, as shown in the upper part of FIG.
[0072] In specific example 3, the list playback mode is set, and as shown in the lower left of Fig. 10, the display control unit 32 displays a list of nine images stored in the storage unit 14 on the rear monitor 4. The display control unit 32 also points the cursor CS at, for example, a still image 1.
[0073] Then, when an operation to start the image search and display process is performed on the operator 6, the display control unit 32 displays a date and time input image 41 for specifying date and time information superimposed on the still image 1 in the center of the rear monitor 4, as shown in the lower center of Figure 10.
[0074] At this time, the display control unit 32 displays a date and time input image 41 with the capture time of the still image 1 entered in the input field 42 based on the metadata of the still image 1 on which the cursor CS is placed, among the multiple images displayed on the rear monitor 4.
[0075] Then, after the input item displayed in the input field 42 is changed in response to the user's operation of the operator 6, if no operation is performed on the operator 6 for a predetermined time (e.g., 5 seconds), the image search unit 33 searches for an image corresponding to the input item displayed in the input field 42, i.e., the date and time information specified by the user. The search method is the same as in the first specific example.
[0076] 10, the display control unit 32 switches the cursor CS to point at the image (here, the still image 8) found by the image search unit 33. At this time, the display control unit 32 continues to display the date and time input image 41.
[0077] Then, after the searched image is displayed on the rear monitor 4, when an operation to hide the date and time input image 41 is performed on the operator 6, the display control unit 32 hides the date and time input image 41.
[0078] 11 is a flowchart showing the flow of the image search and display process in Example 3. Note that the same processes as those in Example 1 are given the same reference numerals and the description thereof will be omitted.
[0079] When the image search and display process in specific example 2 is started, in step S21, the display control unit 32 displays the date and time input image 41 with the capture time of the image on which the cursor CS is placed, among the multiple images displayed on the rear monitor 4 in the list playback mode, entered in the input field 42.
[0080] Thereafter, the processes of steps S2 to S4 are performed, and in step S22 the display control unit 32 displays the image found by the image search unit 33 so that the cursor CS can be placed on it. At this time, the display control unit 32 continues to display the date and time input image 41, and also displays the date and time input image 41 superimposed on the front of the found image. Thereafter, the process of step S6 is performed.
[0081] Like Example 2, Example 3 is particularly useful when the user knows that the image he or she wants to see is an image of a scene that occurred a certain number of minutes after the image displayed on the rear monitor 4.
[0082] In the third specific example, in step S22, the image on which the cursor CS is placed may be moved to the upper left corner of the rear monitor 4 and displayed.
[0083] <3.4 Specific example 4> Fig. 12 is a diagram illustrating the image search and display process in Specific Example 4. In Specific Example 4, as shown in the upper part of Fig. 12, it is assumed that images similar to those in Specific Example 2 are stored in the storage unit 14. In Specific Example 4, it is assumed that still images 1 to 4 are grouped. It is also assumed that still images 5 to 7 are grouped. It is also assumed that still images 8 to 9 are grouped. Here, grouping refers to associating multiple images captured by one continuous image capture or interval image capture. Group information for identifying grouped images is associated with the image data of the grouped images and stored in storage unit 14. In other words, the group information stored in storage unit 14 makes it possible to identify whether the image data stored in storage unit 14 belongs to a group.
[0084] Note that continuous imaging refers to capturing still images continuously at predetermined intervals while the shutter button as the control 6 is being pressed, and interval imaging refers to capturing still images continuously at predetermined intervals.
[0085] In the following, the processing different from that of the second specific example, specifically the processing for searching for an image, will be described in detail, and the description of the processing that is the same as that of the second specific example will be omitted.
[0086] In Example 4, as in Example 2, the single-image playback mode is set, and as shown in the lower left of Figure 12 and the center of Figure 12, the display control unit 32 superimposes a date and time input image 41 for specifying date and time information on the still image 1 and displays it in the center of the rear monitor 4.
[0087] Then, after the input item displayed in the input field 42 is changed in response to the user's operation of the operator 6, if no operation is performed on the operator 6 for a predetermined period of time (e.g., 5 seconds), the image search unit 33 searches for an image (here, a still image 6) that corresponds to the input item displayed in the input field 42, i.e., the date and time information specified by the user.
[0088] At this time, if group information is stored for an image corresponding to the date and time information specified by the user, the image search unit 33 determines one of the images in the group that includes that image as the search result. For example, the image search unit 33 determines the image captured earliest (still image 5) from among the images in the group including still image 6 (still images 5 to 7) as the search result.
[0089] 12, the display control unit 32 switches the image finally found by the image search unit 33 (here, the still image 5) to be displayed on the entire surface of the rear monitor 4. At this time, the display control unit 32 continues to display the date and time input image 41.
[0090] Then, after the searched image is displayed on the rear monitor 4, when an operation to hide the date and time input image 41 is performed on the operator 6, the display control unit 32 hides the date and time input image 41.
[0091] 13 is a flowchart showing the flow of the image search and display process in Example 4. Note that the same processes as those in Example 2 are given the same reference numerals and the description thereof will be omitted.
[0092] When the image search and display process in Specific Example 4 starts, the processes of step S11 and steps S2 to S4 are performed. In step S31, the display control unit 32 determines whether the searched images are grouped based on the group information. As a result, if the images are not grouped (No in step S31), the process proceeds to step S12. That is, if the images are not grouped, in step S12 the display control unit 32 displays the images searched in step S4 that correspond to the date and time information specified by the user (the image captured the earliest among the images whose capture times match the specified date and time information, or the image captured the closest to the specified date and time information). On the other hand, if the images are grouped (Yes in step S31), in step S32 the image search unit 33 determines the image captured the earliest from the group to which the image searched in step S4 that corresponds to the date and time information specified by the user belongs as the search result. Thereafter, the processes of steps S12 and S6 are performed.
[0093] <3.5 Example 5> 14 is a diagram illustrating the image search and display process in Specific Example 5. In Specific Example 5, as shown in the upper part of FIG. 14, it is assumed that the same images and group information as those in Specific Example 4 are stored in the storage unit 14.
[0094] In Example 5, similar to Example 4, if group information is stored for an image corresponding to the date and time information specified by the user, the image search unit 33 determines one of the images in the group that includes that image as the search result. At this time, in specific example 5, the image search unit 33 determines as the search result the image (here, still image 6) whose capture time is closest to the specified date and time information from among the images of the group including still image 6 (still images 5 to 7).
[0095] 14, the display control unit 32 switches the image found by the image search unit 33 (here, the still image 6) to be displayed on the entire surface of the rear monitor 4. At this time, the display control unit 32 continues to display the date and time input image 41.
[0096] Then, after the searched image is displayed on the rear monitor 4, when an operation to hide the date and time input image 41 is performed on the operator 6, the display control unit 32 hides the date and time input image 41.
[0097] 15 is a flowchart showing the flow of the image search and display process in Example 5. Note that the same processes as those in Example 4 are given the same reference numerals and the description thereof will be omitted.
[0098] When the image search and display process in the specific example 5 is started, the processes of step S11, step S2 to step S4, and step S31 are performed, and if the searched images are grouped (Yes in step S31), the image search unit 33 determines, from the group, the image whose image capture time is closest to the specified date and time information as the search result in step S41. Thereafter, the processes of step S12 and step S6 are performed.
[0099] The image search unit 33 may search for an image corresponding to the specified date and time information, and from a group containing the searched images, determine the image captured earliest and the image captured closest to the date and time information as the search result. In this case, the display control unit 32 may display, for example, the image captured earliest as the main image on the front of the rear monitor 4, and the image captured closest to the date and time information as the sub-image on the edge of the rear monitor 4.
[0100] <3.6 Specific Example 6> In specific examples 4 and 5, an image corresponding to specified date and time information is searched for, and if group information is stored for the searched image, the image with the earliest capture time or the image with the capture time closest to the date and time information is determined as the search result from among the images in the group that includes the searched image.
[0101] In the specific example 6, the image search unit 33 searches for an image corresponding to the specified date and time information, and if there is an image captured under the same imaging conditions as the searched image, determines the image captured the earliest or the image captured the closest to the date and time information from among the images captured under the same imaging conditions as the searched image as the searched image. Note that other processing is the same as in the specific examples 4 and 5.
[0102] Here, the term "same shooting conditions" refers to at least one shooting-related condition, such as shutter speed, F-number, ISO sensitivity, or zoom magnification, in the metadata associated with the image. Images captured consecutively under the same shooting conditions are likely to contain a common subject or to have been captured in the same scene. Therefore, the image search unit 33 searches for images corresponding to the specified date and time information. If there are other images captured consecutively with the same ISO sensitivity, for example, as the searched image, the image with the earliest capture time or the image with the closest capture time to the date and time information is determined as the search result. Note that "same" here refers not only to cases where the values are completely identical, but also to cases where the values are within a range considered to be identical.
[0103] <3.7 Example 7> 16 is a diagram illustrating the image search and display process in Specific Example 7. In Specific Examples 1 to 6, the cases where still images are stored in the storage unit 14 are described. In Specific Example 7, the case where still images and moving images are stored in the storage unit 14 is described.
[0104] In Specific Example 7, as shown in the upper part of Fig. 16, it is assumed that six still images 1 to 4 and still images 8 to 9, and one moving image 1 are stored in the storage unit 14. Note that still images 1 to 4 and still images 8 to 9 are the same as those in Specific Examples 1 to 6. It is assumed that moving image 1 was captured between 15:39:50 and 15:40:50 on July 1, 2021.
[0105] Then, as in specific example 2, when an operation to start the image search and display process is performed on the operator 6, the display control unit 32 displays a date and time input image 41 for specifying date and time information superimposed on the still image 1 in the center of the rear monitor 4, as shown in the lower center of Figure 16.
[0106] Then, after the input item displayed in the input field 42 is changed in response to the user's operation of the operator 6, if no operation is performed on the operator 6 for a predetermined period of time (e.g., 5 seconds), the image search unit 33 searches for an image corresponding to the input item displayed in the input field 42, i.e., the date and time information specified by the user.
[0107] At this time, if the image corresponding to the date and time information specified by the user is a moving image, the image search unit 33 searches for a frame that matches the date and time information specified by the user from among the multiple frames that make up the moving image. Specifically, the image search unit 33 reads the capture time and frame rate from the metafile associated with the video. Then, the image search unit 33 subtracts the capture time from the specified date and time information, and determines, based on the subtraction result and the frame rate, which frame from the start of capture corresponds to the time specified by the user. The image search unit 33 then determines, as the search result, the frame corresponding to the determined number of frames. Whether or not an image corresponding to the date and time information specified by the user is a moving image can be determined by whether the date and time information is later than the capture time of the moving image (the start time of capture) and earlier than the time obtained by adding the capture time to the capture time of the moving image.
[0108] 16, the display control unit 32 switches to the image (frame) searched for by the image search unit 33 and displays it on the entire surface of the rear monitor 4. At this time, the display control unit 32 continues to display the date and time input image 41.
[0109] Then, after the searched image is displayed on the rear monitor 4, when an operation to hide the date and time input image 41 is performed on the operator 6, the display control unit 32 hides the date and time input image 41.
[0110] 17 is a flowchart showing the flow of the image search and display process in Example 7. Note that the same processes as those in Example 2 are given the same reference numerals and the description thereof will be omitted.
[0111] When the image search and display process in Concrete Example 7 starts, the processes of step S11 and steps S2 to S4 are performed, and in step S51, the image search unit 33 determines whether the image corresponding to the date and time information specified by the user is a video. As a result, if it is not a video (No in step S51), the process proceeds to step S12. On the other hand, if it is a video (Yes in step S51), in step S52, the image search unit 33 determines, as the detection result, from among the multiple frames constituting the searched video, a frame that matches the specified date and time information. Thereafter, the processes of step S12 and step S6 are performed.
[0112] In addition, when the image corresponding to the date and time information specified by the user is a moving image, the frame that matches the date and time information specified by the user among the multiple frames that make up the moving image is determined as the search result, but it is also possible to determine the first frame among the multiple frames that make up the moving image as the detection result.
[0113] <3.8 Example 8> 18 is a diagram illustrating the image search and display process in Specific Example 8. In Specific Examples 1 to 6, the case where a still image is stored in the storage unit 14 as the image has been described. In Specific Example 8, the case where a dual recording function is provided that can capture a still image when, for example, the shutter button is pressed while a moving image is being captured will be described. Therefore, in Specific Example 8, still images and moving images are stored in the storage unit 14.
[0114] 18, in Example 8, as in Example 7, it is assumed that six still images 1 to 4 and still images 8 to 9, and one moving image 1 are stored in storage unit 14. It is also assumed that still images 5 to 7 are captured and stored in storage unit 14 while moving image 1 is being captured.
[0115] Then, as in specific example 2, when an operation to start the image search and display process is performed on the operator 6, the display control unit 32 displays a date and time input image 41 for specifying date and time information, for example, superimposed on the still image 1, in the center of the rear monitor 4, as shown in the center of the lower part of Figure 18.
[0116] Then, after the input item displayed in the input field 42 is changed in response to the user's operation of the operator 6, if no operation is performed on the operator 6 for a predetermined period of time (e.g., 5 seconds), the image search unit 33 searches for an image corresponding to the input item displayed in the input field 42, i.e., the date and time information specified by the user.
[0117] At this time, if a moving image is stored in the memory unit 14, the image search unit 33 searches for an image (still image or moving image) corresponding to the date and time information specified by the user, using the image capture time (image capture start time) for moving images and the image capture time for still images as a comparison target. Specifically, the comparison target for video 1 is the image capture time, "July 1, 2021, 15:39:50." Therefore, in this case, as the image corresponding to the date and time information specified by the user, a still image 6 having a capture time closest to the specified date and time information is searched for. Note that other processing is omitted as it is the same as in specific examples 1 to 6.
[0118] <3.9 Specific Example 9> 19 is a diagram illustrating the image search and display process in specific example 9. In specific example 9, as shown in the lower part of FIG. 19, it is assumed that a plurality of images (still images) captured at different times on the same date are stored in the storage unit 14.
[0119] Then, when an operation to start the image search and display process is performed on the operator 6, the display control unit 32 displays a date and time input image 43 for specifying date and time information superimposed on the still image 1 in the center of the rear monitor 4, as shown in the upper left of Figure 19. Here, the date and time input image 43 has an input field 44 in which only the "year", "month", and "day" are input, and no input fields for the "hour" and "minute" are provided.
[0120] Then, after the input item displayed in the input field 44 is changed in response to the user's operation of the control 6, if no operation is performed on the control 6 for a predetermined time (for example, 5 seconds), a search is performed for the input item displayed in the input field 44, i.e., the image corresponding to the date and time information specified by the user (here, only the date). Compared to specific examples 1 to 8, the search here is performed only by date, resulting in a rough search with low accuracy.
[0121] The image search unit 33 then searches for images of the date and time information specified by the user, i.e., the date input by the user, based on the image capture time in the metadata. If there are multiple images corresponding to the date input by the user, the image captured most densely on that date is selected as the search result.
[0122] 19, the image search unit 33 counts the number of images per unit time (every hour) for images corresponding to the date input by the user. Then, the image search unit 33 obtains image groups separated by a time period (e.g., 3:00 p.m.) in which the counted number is 0. In the example in the lower part of FIG. 19, two image groups surrounded by dashed lines can be obtained.
[0123] Furthermore, the image search unit 33 counts the number of images in each image group and extracts the image group with the largest number of images as the image group that was taken most concentratedly. For example, the image group that was taken between 4 PM and 6 PM is extracted as the image group that was taken most concentratedly.
[0124] 19, the display control unit 32 displays the image finally found by the image search unit 33 and the date and time input image 41 superimposed on the rear monitor 4. Here, the date and time input image 43 is switched to the date and time input image 41, and the capture time of the image displayed on the rear monitor 4 is entered in the input field 42 of the date and time input image 41.
[0125] Thereafter, when the input item displayed in the input field 42 is changed in response to the user's operation of the control 6 and no operation is performed on the control 6 for a predetermined time (for example, 5 seconds), the image search unit 33 searches for an image corresponding to the input item displayed in the input field 42, i.e., the date and time information (including the hour and minute in this case) specified by the user. Here, the image search is more accurate (more detailed) than when searching by date alone.
[0126] 19, the display control unit 32 switches to the image found by the image search unit 33 and displays it on the entire surface of the rear monitor 4. At this time, the display control unit 32 continues to display the date and time input image 41.
[0127] Then, after the searched image is displayed on the rear monitor 4, when an operation to hide the date and time input image 41 is performed on the operator 6, the display control unit 32 hides the date and time input image 41.
[0128] 20 is a flowchart showing the flow of the image search and display process in Example 9. Note that the same processes as those in Example 1 are given the same reference numerals and the description thereof will be omitted.
[0129] When the image search and display process in the ninth specific example is started, the display control unit 32 displays the date and time input image 43 including the input field 44 in step S61.
[0130] Then, when the input item (date) of input field 44 is changed via operator 6, in step S62 display control unit 32 changes and displays the input item in input field 44. After that, in step S63 image search unit 33 determines whether a predetermined time has passed since the date and time information (date) was last changed, and if the predetermined time has not passed (No in step S63), returns the process to step S62.
[0131] On the other hand, if a predetermined time has passed since the date and time information was changed (step S63), in step S64, image search unit 33 searches for an image corresponding to the specified date and time information (date) from among the multiple images stored in storage unit 14. Then, if there are multiple images corresponding to the specified date and time information, image search unit 33 counts the number of images per unit time.
[0132] In step S65, the image search unit 33 finds image groups separated by a time period in which the counted number of images is 0 (for example, 3 p.m.). In step S66, the image search unit 33 counts the number of images in each image group and extracts the image group with the largest number of images as the image group that was captured most concentratedly. The image search unit 33 then determines the image captured earliest among the images that were captured most concentratedly as the search result.
[0133] Then, in step S67, the display control unit 32 displays the image finally found by the image search unit 33 and the date and time input image 41 superimposed on the rear monitor 4. Thereafter, as in specific example 1, the processes of steps S2 to S6 are executed. Note that in specific example 9, the image groups were obtained by dividing the time slots where the count number was 0, but it is also possible to obtain image groups by dividing each time period (by one hour, such as between 1 PM, 2 PM, and 3 PM). When dividing the time period by one, the image group taken between 5 PM has the largest number of images in the example at the bottom of FIG. 19, so in step S67 of FIG. 20, the image taken at the earliest time among the images taken between 5 PM is displayed on the rear monitor 4.
[0134] <3.10 Example 10> Fig. 21 is a diagram for explaining the image search and display process in Specific Example 10. Fig. 22 is a flowchart showing the flow of the image search and display process in Specific Example 10. Specific Example 10 differs from Specific Example 9 in that the processes of steps S71 to S73 are executed instead of the processes of steps S66 and S67 in Specific Example 9.
[0135] In Specific Example 10, similarly to Specific Example 9, in step S65 the image search unit 33 finds a group of images separated by a time period in which the count number is 0 (for example, 3 p.m.). Thereafter, in step S71 the display control unit 32 displays a list of the images of the image group that were captured at the earliest time on the rear monitor 4, as shown in Fig. 21. For example, as shown in the lower part of Fig. 19, if a plurality of images (still images) captured at different times on the same date are stored in the storage unit 14, the image captured at the earliest time among the image group captured between 1 p.m. and 2 p.m. and the image captured at the earliest time among the images captured between 4 p.m. and 6 p.m. are displayed side by side on the rear monitor 4 in Fig. 21. Note that the arrangement of the image captured at the earliest time among each image group is not limited to vertical arrangement, and it may be arranged horizontally or displayed as thumbnails above, below, left, or right.
[0136] Then, in step S72, when one of the images displayed in the list is selected via the operation device 6, the display control unit 32 displays the selected image on the rear monitor 4 in step S73, and also displays the date and time input image 41 superimposed thereon with the image capture time of the selected image entered in the input field 42. Thereafter, similarly to specific example 1, the processes of steps S2 to S6 are executed.
[0137] <3.11 Example 11> In Example 11, a predetermined image analysis process is performed on the image searched for by the image search unit 33 and corresponding to the date and time information specified by the user, and the scene in which the searched image was captured is identified. Note that various known image analysis methods can be applied to the image analysis process, and detailed explanations will be omitted here.
[0138] When displaying the images searched by the image search unit 33, the display control unit 32 selects and displays the images in single-image playback mode or list display mode based on the scene identified by the image analysis process. For example, if the scene is a sport, list display mode is selected because it is highly likely that images have been captured continuously. On the other hand, if the scene is in portrait mode, single-image playback mode is selected to allow the image to be viewed in detail.
[0139] <3.12 Example 12> In specific example 12, the imaging device 1 is connected to an external device. The external device may be a computer having a CPU, such as a smartphone or a personal computer. When the external device is a smartphone, a date and time input image 45 as shown in Fig. 23 is displayed on the display unit of the external device. The date and time input image 45 displays "month, day," "hour," and "minute" scrolling up and down, and accepts a swipe operation (touch operation) by the user.
[0140] Then, when the imaging device 1 receives the date and time information input in the external device via the date and time input image 45, it searches for an image as in Examples 1 to 10 and transmits the searched image to the external device. This allows the imaging device 1 to transmit to the external device an image corresponding to the date and time information specified by the user.
[0141] <3.13 Example 13> In specific example 13, a plurality of imaging devices 1 are interconnected via a network. When date and time information is input to one of the imaging devices 1, for example, via a date and time input image 41, the date and time information is transmitted to the other imaging devices 1. Then, all imaging devices 1 search for an image corresponding to the date and time information specified by the user, and transmit the searched image to the imaging device 1 to which the date and time information was input.
[0142] This allows, in cases where one event is being photographed by a plurality of imaging devices 1, images photographed by the other imaging devices 1 to be checked.
[0143] <4. Modifications> The embodiment is not limited to the example described above, and various modified configurations can be adopted. For example, although the imaging device 1 has been described as an example of an information processing device, the information processing device may be various devices such as a computer, a game machine, or a television receiver.
[0144] Also, for example, in Specific Example 2, date and time information is input to the date and time input image 41. However, a difference date and time input image for inputting a difference (for example, 15 minutes later) from the capture time of the image displayed on the rear monitor 4 may be displayed on the rear monitor 4, and the difference date and time input image may also be displayed when the image searched by the image search unit 33 is displayed.
[0145] <5. Summary> As described above, the information processing device (imaging device 1) according to the embodiment includes an image search unit 33 that searches for an image corresponding to specified date and time information from among a plurality of images stored in association with the image capture time, and a display control unit 32 that displays an image based on the search result by the image search unit 33 on the display unit 15 (rear monitor 4). This allows the information processing device to compare the specified date and time information with the image capture time associated with the image, and determine, as a search result, an image whose image capture time is close to the specified date and time information. Therefore, the information processing device can improve usability when searching for images.
[0146] In addition, if there are multiple images associated with a capture time that matches the specified date and time information, the image search unit 33 may determine the image with the earliest capture time among the multiple associated images as the search result. This makes it possible to display an image that is most suitable for the date and time information specified by the user.
[0147] Furthermore, if there is no image associated with a capture time that matches the specified date and time information, the image search unit 33 may determine, as the search result, an image whose capture time is closest to the specified date and time information. As a result, even if there is no image associated with an image capturing time that matches the date and time information specified by the user, an image close to that date and time information can be displayed, making it possible to display an image that is likely to be the image desired by the user.
[0148] In addition, the display control unit 32 may display a date and time input image on the display unit 15 to allow the user to input date and time information, and may also display the date and time input image when displaying images searched by the image search unit 33. This allows the user to immediately input date and time information when an image that the user does not want is displayed.
[0149] In addition, the display control unit 32 may display a date and time input image on the display unit 15 to allow the user to input date and time information, and may display the capture time associated with the image displayed on the display unit 15 on the date and time input image. This makes it possible to provide a user interface that makes it easy for the user to input date and time information when the user knows how many minutes after the image displayed on the display unit the image of the scene that occurred was displayed.
[0150] In addition, the display control unit 32 may display a date and time input image on the display unit 15 to allow the user to input the difference from the imaging time associated with the image displayed on the display unit 15, and may also display the difference date and time input image when displaying an image searched by the image search unit. This allows the user to easily input the difference if the user knows how many minutes after the image displayed on the display unit the image of the scene that occurred was displayed.
[0151] The multiple images include still images and moving images, and if the image corresponding to the specified date and time information is a moving image, the display control unit 32 may display the first frame of the moving image on the display unit 15. This allows the user to view the first frame of the video corresponding to the specified date and time information.
[0152] The multiple images include still images and moving images, and if the image corresponding to the specified date and time information is a moving image, the display control unit 32 may display on the display unit 15 a frame at a time that matches the specified date and time information in the moving image. This allows the user to see the image (still image) corresponding to the date and time information designated by the user, even if the image corresponding to the designated date and time information is a moving image.
[0153] Multiple images are grouped, and when the images corresponding to the specified date and time information are grouped images, the image search unit 33 may determine the image with the earliest capture time as the search result from among the images in the group that includes the image corresponding to the specified date and time information. This allows for cueing of an image from among a series of images captured continuously.
[0154] The multiple images include one or more grouped images, and when the images corresponding to the specified date and time information are grouped images, the image search unit 33 may determine as the search result the image whose capture time is closest to the specified date and time information from among the images in the group that includes the image corresponding to the specified date and time information. This makes it possible to display the image that the user is most likely to desire from among a series of images captured in succession.
[0155] The multiple images include one or more grouped images, and when the images corresponding to the specified date and time information are grouped images, the image search unit 33 may determine as the search result the image with the earliest capture time and the image with the closest capture time to the specified date and time information from among the images in the group that includes the image corresponding to the specified date and time information. This makes it possible to display the cue-selected image and the image that the user is most likely to desire side by side from among a series of images captured in succession.
[0156] The display control unit 32 may display the image captured closest to the specified date and time information as the main image, and the image captured earliest as the sub-image, and simultaneously display both images. This makes it possible to display the cue-selected image and the image that the user is most likely to desire from among a series of images that have been captured in a more easily viewable manner.
[0157] The image search unit 33 may search for an image corresponding to date and time information specified by an external device. This allows images stored in the imaging device 1 to be transmitted to an external device by operating the external device.
[0158] The images are stored in association with information indicating the imaging conditions, and the image search unit 33 may determine as the search result any image with imaging conditions that are the same as the imaging conditions associated with the image corresponding to the specified date and time information. This makes it possible to search for any image from among a series of images captured continuously.
[0159] The image search unit 33 may determine, as a search result, the image captured at the earliest time from among images captured under the same imaging conditions as those associated with the image corresponding to the specified date and time information. This allows for cueing of an image from among a series of images captured continuously.
[0160] The image search unit 33 can search for images in different ways depending on the input accuracy of the specified date and time information. This makes it possible to perform a rough search at first and then a detailed search, thereby providing a user interface that is more user-friendly to the user.
[0161] The image search unit 33 may search for images using date and time information with a relatively low input accuracy, and then, based on the search results, search for images using date and time information with a relatively high input accuracy. This makes it possible to perform a rough search at first and then a detailed search, thereby providing a user interface that is more user-friendly to the user.
[0162] The display control unit 32 may display a date and time input image on the display unit to allow the user to input date and time information by touch operation. This makes it possible to provide a user interface that allows the user to intuitively input date and time information.
[0163] In addition, the information processing method includes an information processing device that searches for an image corresponding to specified date and time information from among a plurality of images stored in association with the image capture time, and displays the searched image on a display unit. The program also causes the computer to function as an image search unit that searches for an image corresponding to specified date and time information from among multiple images stored with their image capture times associated with each other, and a display control unit that displays the image searched by the image search unit on a display unit. Such an information processing method and program can also provide the same effects as those of the information processing device.
[0164] Such a program can be pre-recorded in a HDD as a recording medium built into a device such as a personal computer, or in a ROM or flash memory in a microcomputer having a CPU. Alternatively, the software may be temporarily or permanently stored (recorded) on a removable recording medium such as a flexible disk, a CD-ROM (Compact Disc Read Only Memory), an MO (Magnet Optical) disk, a DVD, a Blu-ray disk, a magnetic disk, a semiconductor memory, a memory card, etc. Such removable recording media may be provided as a so-called package software. The program can be installed onto a personal computer or the like from a removable recording medium, or can be downloaded from a download site via a network such as a LAN (Local Area Network) or the Internet.
[0165] Furthermore, the effects described in this specification are merely examples and are not limiting, and other effects may also be present.
[0166] <6. This technology> The present technology can also be configured as follows. (1) an image search unit that searches for an image corresponding to designated date and time information from among a plurality of images stored in association with their image capture times; a display control unit that displays, on a display unit, an image based on the search results by the image search unit; An information processing device comprising: (2) The image search unit If there are multiple images associated with a capture time that matches the specified date and time information, the image with the earliest capture time among the multiple associated images is determined as the search result. The information processing device described in (1). (3) The image search unit If there is no image associated with a capture time that matches the specified date and time information, the image whose capture time is closest to the specified date and time information is determined as the search result. An information processing device according to (1) or (2). (4) The display control unit displaying a date and time input image on the display unit to allow a user to input the date and time information; When displaying the images searched by the image search unit, the date and time input image is also displayed. An information processing device according to any one of (1) to (3). (5) The display control unit displaying a date and time input image on the display unit to allow a user to input the date and time information; The image capturing time associated with the image displayed on the display unit is displayed on the date and time input image. An information processing device according to any one of (1) to (4). (6) The display control unit displaying, on the display unit, a difference date and time input image for inputting a difference from an image capturing time associated with the image displayed on the display unit; When displaying the image searched by the image search unit, the differential date and time input image is also displayed. An information processing device according to any one of (1) to (5). (7) The plurality of images includes still images and moving images, The display control unit If the image corresponding to the specified date and time information is a moving image, the first frame of the moving image is displayed on the display unit. An information processing device according to any one of (1) to (6). (8) The plurality of images includes still images and moving images, The display control unit If the image corresponding to the specified date and time information is a moving image, a frame at a time that matches the specified date and time information in the moving image is displayed on the display unit. An information processing device according to any one of (1) to (7). (9) the plurality of images are grouped; The image search unit If the images corresponding to the specified date and time information are grouped images, the image captured the earliest among the images in the group that includes the image corresponding to the specified date and time information is determined as the search result. An information processing device according to any one of (1) to (8). (10) the plurality of images includes one or more grouped images; The image search unit If the image corresponding to the specified date and time information is a grouped image, the image whose capture time is closest to the specified date and time information is determined as the search result from among the images in the group that includes the image corresponding to the specified date and time information. An information processing device according to any one of (1) to (9). (11) the plurality of images includes one or more grouped images; The image search unit If the image corresponding to the specified date and time information is a group of images, the image captured the earliest and the image captured the closest to the specified date and time information are determined as search results from among the images in the group that includes the image corresponding to the specified date and time information. An information processing device according to any one of (1) to (10). (12) The display control unit The image captured closest to the specified date and time is displayed as the main image, and the image captured earliest is displayed as the sub-image. (11) An information processing device according to (11). (13) The image search unit Searching for images that match the date and time information specified by an external device An information processing device according to any one of (1) to (12). (14) The image is stored in association with information indicating imaging conditions, The image search unit Determine, as a search result, any of the images associated with the image corresponding to the specified date and time information and having the same imaging conditions as the imaging conditions. An information processing device according to any one of (1) to (13). (15) The image search unit The image captured under the same imaging conditions as the image corresponding to the specified date and time information is selected as the search result. (14) An information processing device according to (14). (16) The image search unit Search for images in different ways depending on the accuracy of the specified date and time information An information processing device according to any one of (1) to (15). (17) The image search unit Search for images using date and time information with relatively low input accuracy, and then search for images using date and time information with relatively high input accuracy based on the search results. (16) An information processing device according to (16). (18) The display control unit a date and time input image for allowing a user to input the date and time information by a touch operation is displayed on the display unit; An information processing device according to any one of (1) to (17). (19) The information processing device Searching for an image corresponding to the specified date and time information from among a plurality of images stored in association with their image capture times; Display the searched image on the display. Information processing methods. (20) an image search unit that searches for an image corresponding to designated date and time information from among a plurality of images stored in association with their image capture times; a display control unit that displays the images searched by the image search unit on a display unit; programs that make a computer function. [Explanation of symbols]
[0167] 1. Imaging device 4 Rear monitor 6 Controls 15 Display section 17 Control Unit 32 Display control unit 33 Image Search Section
Claims
1. an image search unit that searches for an image corresponding to designated date and time information from among a plurality of images stored in association with their image capture times; a display control unit that displays, on a display unit, an image based on the search results by the image search unit; Equipped with the plurality of images includes grouped images; The image search unit If the image corresponding to the specified date and time information is a group of images, the image captured the earliest and the image captured the closest to the specified date and time information are determined as search results from among the images in the group that includes the image corresponding to the specified date and time information. Information processing device.
2. The image search unit If there are multiple images associated with a capture time that matches the specified date and time information, the image with the earliest capture time among the multiple associated images is determined as the search result. The information processing device according to claim 1 .
3. The image search unit If there is no image associated with a capture time that matches the specified date and time information, the image whose capture time is closest to the specified date and time information is determined as the search result. The information processing device according to claim 1 .
4. The display control unit displaying a date and time input image on the display unit to allow a user to input the date and time information; When displaying the images searched by the image search unit, the date and time input image is also displayed. The information processing device according to claim 1 .
5. The display control unit displaying a date and time input image on the display unit to allow a user to input the date and time information; The image capturing time associated with the image displayed on the display unit is displayed on the date and time input image. The information processing device according to claim 1 .
6. The display control unit displaying, on the display unit, a difference date and time input image for inputting a difference from an image capturing time associated with the image displayed on the display unit; When displaying the image searched by the image search unit, the differential date and time input image is also displayed. The information processing device according to claim 1 .
7. The plurality of images includes still images and moving images, The display control unit If the image corresponding to the specified date and time information is a moving image, the first frame of the moving image is displayed on the display unit. The information processing device according to claim 1 .
8. The plurality of images includes still images and moving images, The display control unit If the image corresponding to the specified date and time information is a moving image, a frame at a time that matches the specified date and time information in the moving image is displayed on the display unit. The information processing device according to claim 1 .
9. The display control unit The image captured closest to the specified date and time is displayed as the main image, and the image captured earliest is displayed as the sub-image. The information processing device according to claim 1 .
10. The image search unit Searching for images that match the date and time information specified by an external device The information processing device according to claim 1 .
11. The image is stored in association with information indicating imaging conditions, The image search unit Determine, as a search result, any of the images associated with the image corresponding to the specified date and time information and having the same imaging conditions as the imaging conditions. The information processing device according to claim 1 .
12. The image search unit The image captured under the same imaging conditions as the image corresponding to the specified date and time information is selected as the search result. The information processing device according to claim 11.
13. The image search unit Search for images in different ways depending on the accuracy of the specified date and time information The information processing device according to claim 1 .
14. The image search unit Search for images using date and time information with relatively low input accuracy, and then search for images using date and time information with relatively high input accuracy based on the search results. The information processing device according to claim 13.
15. The display control unit a date and time input image for allowing a user to input the date and time information by a touch operation is displayed on the display unit; The information processing device according to claim 1 .
16. The information processing device an image corresponding to the specified date and time information is searched for from among a plurality of images that include grouped images and are stored with their image capture times associated therewith, and if the image corresponding to the specified date and time information is a grouped image, from among the images in the group that includes the image that corresponds to the specified date and time information, the image that was captured the earliest and the image that was captured the closest to the specified date and time information are determined as search results; Displaying images based on search results on the display Information processing methods.
17. an image search unit that searches for an image corresponding to designated date and time information from among a plurality of images stored in association with their image capture times; a display control unit that displays the images searched by the image search unit on a display unit; to make the computer function, the plurality of images includes grouped images; The image search unit If the image corresponding to the specified date and time information is a group of images, the image captured the earliest and the image captured the closest to the specified date and time information are determined as search results from among the images in the group that includes the image corresponding to the specified date and time information. program.
18. An image search unit that searches for an image corresponding to specified date and time information from among a plurality of images stored in association with their image capture times; a display control unit that displays, on a display unit, an image based on the search results by the image search unit; Equipped with The image search unit searches for images in different ways depending on the input accuracy of the specified date and time information. Information processing device.
19. An information processing device comprising: Searching for an image corresponding to the specified date and time information from among a plurality of images stored in association with their image capture times using different methods depending on the input accuracy of the specified date and time information; Displaying images based on search results on the display Information processing methods.
20. An image search unit that searches for an image corresponding to specified date and time information from among a plurality of images stored in association with their image capture times; a display control unit that displays the images searched by the image search unit on a display unit; to make the computer function, The image search unit searches for images in different ways depending on the input accuracy of the specified date and time information. program.
Citation Information
Patent Citations
Information processor, information processing method, program and recording medium
JP2002300521A
Image retrieval method and device and program
JP2004220420A
Electronic camera
JP2006166193A
Image display apparatus, display control program, and photographic equipment
JP2007312310A
Image printing device and order reception terminal
JP2016004379A