Imaging device, information processing method, and program

Abstract

To provide an environment capable of suitably linking a voice memo to a series of image groups captured in a continuous imaging mode.SOLUTION: An imaging apparatus comprises a user interface control unit which performs processes of: displaying a state in which a plurality of images are brought together as a first display mode of an image group composed of the images; individually displaying each of the images as a second display mode of the image group; and detecting an operation to record a voice memo corresponding to an image selected in the second display mode.SELECTED DRAWING: Figure 5

Description

[Technical field]

[0001] The present technology relates to an imaging device, an information processing method, and a program, and in particular to a technology regarding a voice memo associated with a captured image. [Background technology]

[0002] Users who use imaging devices (also called "cameras") for work, such as professional photographers and journalists, often upload images captured with the imaging device to a server (a File Transfer Protocol (FTP) server) of a newspaper company or the like, on-site, using the communication function of the imaging device (see, for example, Patent Document 1). Furthermore, in the case of newspaper companies and the like, image data is uploaded from multiple users, so the amount of image data they receive can be enormous. In such cases, it becomes necessary for newspaper companies and the like to efficiently search for the desired image data and to understand what the image data sent depicts and under what circumstances. To meet such demands, users may add voice memos to image data in an imaging device (for example, Patent Document 2). At newspaper companies and the like, by checking the voice memo linked to the image data, it becomes possible to understand the image data that has been sent and to efficiently proceed with subsequent editing and selection work. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2017-138777 A [Patent Document 2] JP 2005-293339 A Summary of the Invention [Problem to be solved by the invention]

[0004] Incidentally, imaging devices are provided with a single shooting mode in which one still image is captured by a release operation, and a continuous shooting mode in which multiple still images are captured by a release operation. Furthermore, when a series of images captured in the continuous shooting mode are organized into an image group, it may not be clear which of the images the voice memo should be associated with.

[0005] Therefore, an object of the present technology is to provide an environment in which voice memos can be appropriately associated with a series of images captured in continuous shooting mode. [Means for solving the problem]

[0006] The imaging device according to the present technology includes a user interface control unit that performs the processes of displaying a state in which a plurality of images are grouped together as a first display mode of an image group consisting of the plurality of images, displaying each of the plurality of images individually as a second display mode of the image group, and detecting an operation of recording a voice memo corresponding to a selected image selected in the second display mode. This allows the user to visually recognize that a plurality of images are grouped together as an image group, and also makes it possible to view the images included in the image group individually.

[0007] The imaging device described above may further include a file management section that generates a file of the voice memo as a separate file from an image file. That is, the audio data is not stored as metadata for the image file.

[0008] In the imaging device described above, the plurality of images may be a series of images captured using a continuous shooting function. By displaying the continuous-shot image group in the first display manner, it is possible to clearly recognize that the images are a series of images.

[0009] In the above-described imaging device, in the display process for the image group in the first display mode, one of the images belonging to the image group may be displayed as a representative image. This makes it possible to display a distinctive image that identifies the contents of the image group as a representative image.

[0010] In the above-described imaging device, a representative image in the series of images captured using a continuous shooting function may be the first image captured in the series of images. Since a continuous-shot image group is made up of images captured continuously within a relatively short period of time, there are often no significant differences between the images in terms of composition, subject appearance, etc. With this configuration, the first image captured is automatically selected as the representative image of the continuous-shot image group.

[0011] The user interface control unit in the above-described imaging device may perform control to display, in the first display mode, an icon image indicating that a voice memo has been recorded in the image group. This makes it possible to recognize from the icon image that a voice memo is recorded in the image group.

[0012] The user interface control unit in the above-mentioned imaging device may display an icon image indicating that a voice memo has been recorded in the image group when a voice memo has been recorded for the representative image among the images belonging to the image group. That is, even if a voice memo is recorded on an image other than the representative image, the icon image is not displayed.

[0013] The user interface control unit in the above-described imaging device may display the icon image when at least one image having a voice memo recorded thereon is present among the images belonging to the image group. This makes it possible to determine whether an image group includes an image with a voice memo recorded thereon without having to check each individual image in the image group.

[0014] The user interface control unit in the above-described imaging device may select, as the representative image, an image on which a voice memo has been recorded, from among the images belonging to the image group. As a result, an icon image is not displayed in an image group in which no voice memo is recorded in any of the images, and an icon image is displayed in an image group in which a voice memo is recorded in at least one image.

[0015] The user interface control unit in the above-described imaging device may not generate a file of the voice memo based on the operation in the first display mode. For example, when a group of images is displayed, the operation to record a voice memo is not detected, or even if the operation to record a voice memo is detected, the process to record the voice memo is not executed.

[0016] The user interface control unit in the imaging device described above may detect the operation in the first display mode. For example, when an operation to record a voice memo is detected in the first display mode, a process to link the voice memo to the entire image group is executed. Alternatively, when an operation to record a voice memo is detected in the first display mode, a process to link the voice memo to the displayed representative image is executed. Furthermore, a display process to allow the user to select an object to link the voice memo may be executed.

[0017] The file management section in the imaging device may give a file name to the voice memo such that the portion excluding the extension is the same character string as the file name of the image to be linked. This makes it possible to identify the image file to which the voice memo is linked from the file name.

[0018] When the user interface control unit in the above-mentioned imaging device detects a delete operation for an image on which the voice memo is recorded, the user may be presented with a first option for deleting both the image and the voice memo, a second option for deleting only the voice memo, and a third option for canceling the delete operation. By simultaneously displaying an option for canceling and an option for deleting, the number of operations required to delete can be reduced, thereby reducing the operational burden on the user.

[0019] The information processing method of the present technology is performed by an information processing device, which performs the following processes: displaying a state in which a plurality of images are grouped together as a first display mode of an image group consisting of the plurality of images; displaying each of the plurality of images individually as a second display mode of the image group; detecting an operation of selecting an image in the second display mode; and detecting an operation of recording a voice memo corresponding to the selected image.

[0020] The program of the present technology is a program that causes an information processing device to execute a process of displaying a state in which a plurality of images are grouped together as a first display mode of an image group consisting of the plurality of images, a process of displaying each of the plurality of images individually as a second display mode of the image group, a process of detecting an operation of selecting an image in the second display mode, and a process of detecting an operation of recording a voice memo corresponding to the selected image. This allows the user to visually recognize that a plurality of images are grouped together as an image group, and also makes it possible to individually view the images included in the image group in the imaging device. [Brief description of the drawings]

[0021] [Figure 1] 1 is an explanatory diagram of transfer and upload of image files and audio files according to an embodiment of the present technology; [Diagram 2] 1 is a perspective view of an imaging device according to an embodiment; [Diagram 3]FIG. 2 is a rear view of the imaging device according to the embodiment. [Figure 4] FIG. 2 is a block diagram of an imaging device that performs communication according to an embodiment. [Diagram 5] FIG. 2 is an explanatory diagram of a functional configuration of a camera control unit according to the embodiment. [Figure 6] FIG. 4 is an explanatory diagram of an image list screen according to the embodiment; [Figure 7] FIG. 13 is an explanatory diagram of a display screen before image group expansion according to the embodiment. [Figure 8] FIG. 13 is an explanatory diagram of a display screen after image group expansion according to the embodiment. [Figure 9] FIG. 13 is an explanatory diagram of a display screen after image group expansion according to the embodiment. [Figure 10] FIG. 13 is an explanatory diagram of a voice memo recording screen according to the embodiment. [Figure 11] FIG. 13 is an explanatory diagram of a display screen after image group expansion according to the embodiment. [Figure 12] FIG. 13 is an explanatory diagram of a display screen before image group expansion according to the embodiment. [Figure 13] FIG. 13 is an explanatory diagram of a display screen before image group expansion according to the embodiment. [Figure 14] FIG. 13 is an explanatory diagram of a voice memo playback screen according to the embodiment. [Figure 15] FIG. 10 is an explanatory diagram of a modified example of the voice memo playback screen according to the embodiment. [Figure 16] FIG. 13 is an explanatory diagram of a deletion target selection screen according to the embodiment. [Figure 17] FIG. 13 is an explanatory diagram of a deletion screen according to an embodiment. [Figure 18] FIG. 13 is an explanatory diagram of a deletion completion screen according to the embodiment. [Figure 19] FIG. 13 is an explanatory diagram of a deletion selection screen according to the embodiment. [Figure 20] FIG. 13 is an explanatory diagram of a deletion selection screen according to the embodiment. [Figure 21] 11 is a flowchart of an image playback operation detection process according to an embodiment. [Figure 22] 11 is a flowchart of an image playback operation detection process according to an embodiment. [Figure 23]11 is a flowchart of an image playback operation detection process according to an embodiment. [Figure 24] 11 is a flowchart of an assignable button operation detection process according to an embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0022] The embodiments will be described below in the following order. <1. Uploading images using an imaging device> 2. Configuration of the imaging device <3. Functional configuration of the imaging device> <4. User interface screen> <5. Processing flow> <5-1. Image playback operation detection process> <5-2. Assignable button operation detection process> <6. Variations> <7. Summary> <8. This Technology>

[0023] <1. Uploading images using an imaging device> The imaging device 1 according to the embodiment can upload captured images to an external server. First, image uploading will be described. FIG. 1 shows an image capture device 1, an FTP server 4, and a network 6.

[0024] The imaging device 1 may be of various types, such as a video camera or a still camera. The imaging device 1 shown in the figure is assumed to be a camera used by a cameraman or a reporter at a sports or event venue or on-site. For example, one cameraman may use one imaging device 1, or may use multiple imaging devices 1. In the following description, the imaging device 1 may be referred to as a "camera."

[0025] The network 6 may be, for example, the Internet, a home network, a LAN (Local Area Network), a satellite communication network, or any other type of network. The FTP server 4 may be, for example, a server operated by a newspaper company, a broadcasting station, a news agency, etc. Of course, the FTP server 4 is not limited to such servers. The FTP server 4 may take the form of a cloud server, a home server, a personal computer, or the like.

[0026] The imaging device 1 can upload captured image data and the like to the FTP server 4 via the network 6. For example, when the user of the imaging device 1 is a professional cameraman working for a newspaper company, it is assumed that the user will use the system in such a manner that images captured at an event venue are instantly uploaded from the imaging device 1 to the FTP server 4. Alternatively, the FTP server 4 may be a portable terminal device such as a smartphone carried by the user, and image data and the like may be uploaded to the portable terminal device serving as the FTP server 4 via a network 6 such as short-range wireless communication.

[0027] For this purpose, FTP setting information for uploading to the FTP server 4 is registered in the imaging device 1. The FTP setting information includes the host name of the FTP server 4, the save path, the user name, the password, the connection type, and the like. A user can input the contents of such FTP setting information by performing an input operation on the imaging device 1, thereby registering the FTP setting information in the imaging device 1. Alternatively, the FTP setting information may be registered in the imaging device 1 by transferring the contents of the FTP setting information from an external device.

[0028] In the case of this embodiment, a situation is assumed in which an image file PF and an audio file AF are uploaded and transmitted from the imaging device 1 to the FTP server 4.

[0029] The imaging device 1 generates image data as still images or moving images through imaging operations, and also generates metadata as additional information. The image file PF shown in FIG. 1 is assumed to be a data file that includes image data and associated metadata.

[0030] In the present embodiment, the imaging device 1 has a voice memo function. The voice memo function is a function that can add annotations, explanations, etc. to a captured image by voice. For example, a user may speak while performing a predetermined operation with a specific image designated, or a cameraman may speak to explain the contents of a still image while performing a predetermined operation, and the voice is recorded and a voice memo associated with the image data is generated. 1 is a data file that includes the voice data as the voice memo. That is, the voice file AF is generated as a separate file from the image file PF. When shooting video, ambient sound is also recorded as sound track data, but this sound track data is sound data included in the image file PF and is separate from the sound file AF. In this explanation, the sound file AF refers only to a file that contains sound data as a sound memo. In the following description, it is assumed that a still image is captured, and an example will be described in which the image file PF contains still image data and metadata, and the audio file AF contains audio memo data generated in association with the capture of the still image.

[0031] Note that not all image files PF are necessarily associated with an audio file AF; only when a cameraman or the like inputs audio using the voice memo function is an audio file AF generated in the imaging device 1 and associated with the image file PF. Therefore, when uploading from the imaging device 1 to the FTP server 4, the image file PF and the audio file AF may be sent as a pair, or only the image file PF may be sent.

[0032] 2. Configuration of the imaging device Fig. 2 shows a front perspective view of the imaging device 1 of the embodiment, and Fig. 3 shows a rear view. Here, the imaging device 1 is a so-called digital still camera, and can capture both still images and videos by switching the imaging mode. In still image shooting, there are provided a "single shooting mode" in which one still image is captured with each release operation, and a "continuous shooting mode" in which multiple still images are captured continuously with each release operation. In this embodiment, the imaging device 1 is not limited to a digital still camera, but may be a video camera that is mainly used for capturing moving images and can also capture still images.

[0033] In the imaging device 1, a lens barrel 2 is disposed on the front side of a main body housing 100 constituting a camera body, or is detachable. On the rear side (photographer side) of the imaging device 1, a display panel 101 is provided, which is a display device such as a liquid crystal display (LCD) or an organic EL (Electro-Luminescence) display. A display unit formed using an LCD, an organic EL display, or the like is also provided as the viewfinder 102. The viewfinder 102 is not limited to an electronic viewfinder (EVF), and may be an optical viewfinder (OVF).

[0034] A user can view images and various information through the display panel 101 and the viewfinder 102 . In this example, the imaging device 1 is provided with both a display panel 101 and a viewfinder 102, but this is not limited to this, and the imaging device 1 may be configured to have only one of the display panel 101 and the viewfinder 102, or both or either of the display panel 101 and the viewfinder 102 may be detachable.

[0035] On a main body housing 100 of the imaging device 1, various controls 110 are provided. For example, various types of operators 110, such as keys, dials, and combined operators for pressing / rotating, are provided to realize various operation functions. For example, menu operation, playback operation, mode selection operation, focus operation, zoom operation, parameter selection operation such as shutter speed and F-number (F-number), etc. are possible. Although detailed description of each operator 110 will be avoided, in the case of this embodiment, among the operators 110, the shutter button 110S and the assignable button 110C are particularly shown. The shutter button 110S is used for shutter operation (release operation) and also for AF operation when pressed halfway.

[0036] The assignable button 110C is an operator also called a custom button, and is a button to which a user can assign any operation function. In this embodiment, the assignable button 110C is assigned operation functions such as recording and playing back a voice memo. That is, by operating the assignable button 110C under a specific situation, it is possible to record and play back a voice memo. For example, by pressing and holding the assignable button 110C under a specific situation, it is possible to record a voice memo while the button is being pressed. By releasing the long press of the assignable button 110C, the voice memo recording is stopped. Also, by pressing the assignable button 110C for a short time, the recorded voice memo is played back.

[0037] Shutter button 110S is arranged on the upper right side of main body housing 100, and can be pressed with the index finger of the user's right hand, for example, when holding grip portion 103 with the user's right hand. Also, the assignable button 110C is arranged on the upper part of the rear side of the main body housing 100 as shown in FIG. 2, for example, and can be operated by the user by pressing it with the thumb of the right hand.

[0038] Instead of the assignable button 110C, a dedicated operation button for executing functions related to voice memos may be provided.

[0039] Furthermore, when a display unit such as the display panel 101 has a touch panel function, the display panel 101 may be one of the operators 110.

[0040] Microphone holes 104 are formed on both sides of the viewfinder 102. The microphone hole 104 on the left side as viewed by the photographer is designated as microphone hole 104L, and the microphone hole 104 on the right side is designated as microphone hole 104R. By forming the microphone holes 104L and 104R, environmental sounds and the voice of the photographer can be acquired as stereo sounds. A microphone (not shown) is disposed inside each of the microphone holes 104.

[0041] FIG. 4 shows the internal configuration of the imaging device 1 including the lens barrel 2. The imaging device 1 has, for example, a lens system 11, an imaging unit 12, a camera signal processing unit 13, a recording control unit 14, a display unit 15, a communication unit 16, an operation unit 17, a camera control unit 18, a memory unit 19, a driver unit 22, a sensor unit 23, an audio input unit 25, an audio processing unit 26, and an audio playback unit 27.

[0042] The lens system 11 includes lenses such as a zoom lens and a focus lens, an aperture mechanism, etc. The lens system 11 guides light (incident light) from a subject and collects the light on the imaging unit 12.

[0043] The imaging unit 12 includes an image sensor 12a (imaging element) such as a complementary metal oxide semiconductor (CMOS) type or a charge coupled device (CCD) type. In the imaging unit 12, the light received by the image sensor 12a is photoelectrically converted into an electric signal, and then, for example, CDS (Correlated Double Sampling) processing, AGC (Automatic Gain Control) processing, etc. are performed on the electric signal, and A / D (Analog / Digital) conversion processing is also performed on the electric signal. Then, the imaging signal as digital data is output to the downstream camera signal processing unit 13 and camera control unit 18.

[0044] The camera signal processing unit 13 is configured as an image processor, for example, using a DSP (Digital Signal Processor) etc. The camera signal processing unit 13 performs various types of signal processing on the digital signal (captured image signal) from the imaging unit 12. For example, as camera processes, the camera signal processing unit 13 performs pre-processing, synchronization processing, YC generation processing, resolution conversion processing, file formation processing, etc.

[0045] In the pre-processing, the captured image signal from the imaging unit 12 is subjected to a clamping process for clamping the R, G, and B black levels to a predetermined level, a correction process between the R, G, and B color channels, and the like. In the synchronization process, a color separation process is performed so that the image data for each pixel has all the color components R, G, and B. For example, in the case of an image sensor that uses a Bayer array color filter, a demosaic process is performed as the color separation process. In the YC generation process, a luminance (Y) signal and a color (C) signal are generated (separated) from R, G, B image data. In the resolution conversion process, the image data that has been subjected to various types of signal processing is subjected to the resolution conversion process.

[0046] In the file creation process, for example, image data that has been subjected to the various processes described above is subjected to compression encoding for recording or communication, formatting, generation and addition of metadata, etc., to generate a file for recording or communication. For example, image files PF in formats such as JPEG (Joint Photographic Experts Group), TIFF (Tagged Image File Format), GIF (Graphics Interchange Format), etc. may be generated as still image files. It is also possible to generate image files PF in the MP4 format used for recording video and audio conforming to MPEG-4. It is also possible to generate an image file PF as raw (RAW) image data.

[0047] The camera signal processing unit 13 generates metadata that includes information on processing parameters within the camera signal processing unit 13, various control parameters obtained from the camera control unit 18, information indicating the operating status of the lens system 11 and the imaging unit 12, mode setting information, and imaging environment information (date, time, location, etc.).

[0048] The recording control unit 14 performs recording and reproduction on a recording medium such as a non-volatile memory, for example. The recording control unit 14 performs processing for recording image files such as moving image data and still image data, thumbnail images, and the like on the recording medium, for example. The actual form of the recording control unit 14 may be various. For example, the recording control unit 14 may be configured as a flash memory built into the imaging device 1 and a write / read circuit for the memory. The recording control unit 14 may also be in the form of a card recording / playback unit that performs recording / playback access to a recording medium that can be detached from the imaging device 1, such as a memory card (such as a portable flash memory). The recording control unit 14 may also be realized as an HDD (Hard Disk Drive) built into the imaging device 1.

[0049] The display unit 15 is a display unit that displays various information to the person taking the image, and is, for example, a display panel 101 or a viewfinder 102 using a display device such as a liquid crystal panel (LCD: Liquid Crystal Display) or an organic EL (Electro-Luminescence) display arranged on the housing of the imaging device 1. The display unit 15 executes various displays on the display screen based on instructions from the camera control unit 18 . For example, the display unit 15 displays a reproduced image of image data read from a recording medium by the recording control unit 14. Further, image data of the captured image that has been resolution-converted for display by the camera signal processing unit 13 is supplied to the display unit 15, and the display unit 15 may perform display based on the image data of the captured image in response to an instruction from the camera control unit 18. This causes a so-called through image (monitoring image of the subject), which is an image captured while checking the composition or recording a video, to be displayed. Further, based on instructions from the camera control unit 18, the display unit 15 executes display of various operation menus, icons, messages, etc., that is, GUI (Graphical User Interface) on the screen.

[0050] The communication unit 16 performs data communication and network communication with external devices in a wired or wireless manner. For example, the captured image data (still image files or video files) is transmitted to an external display device, recording device, playback device, or the like. Furthermore, the communication unit 16 serves as a network communication unit and performs communication via various networks 6, such as the Internet, a home network, and a LAN (Local Area Network), and can transmit and receive various data between a server, a terminal, and the like on the network. For example, in the case of this embodiment, the communication unit 16 performs communication processing for uploading captured image data (such as the above-mentioned image file) to the FTP server 4. In this embodiment, the communication unit 16 communicates with the information processing device 2 and transfers the image file PF and the audio file AF.

[0051] The operation unit 17 collectively refers to input devices for a user to input various operations. Specifically, the operation unit 17 refers to various operators (keys, dials, touch panel, touch pad, etc.) provided on the housing of the imaging device 1. An operation performed by the user is detected by the operation unit 17, and a signal corresponding to the input operation is sent to the camera control unit . The operation unit 17 includes the shutter button 110S and the assignable button 110C described above.

[0052] The camera control unit 18 is composed of a microcomputer (arithmetic processing device) equipped with a CPU (Central Processing Unit). The memory unit 19 stores information and the like used for processing by the camera control unit 18. The illustrated memory unit 19 collectively represents, for example, a Read Only Memory (ROM), a Random Access Memory (RAM), a flash memory, and the like. The memory unit 19 may be a memory area built into the microcomputer chip serving as the camera control unit 18, or may be configured by a separate memory chip. The camera control unit 18 executes a program stored in the ROM, flash memory, or the like of the memory unit 19 to control the entire imaging device 1 . For example, the camera control unit 18 controls the operation of each necessary part regarding the control of the shutter speed of the imaging unit 12, instructions for various signal processing in the camera signal processing unit 13, imaging operations and recording operations in response to user operations, playback operations of recorded image files, operations of the lens system 11 such as zoom, focus, and aperture adjustment in the lens barrel, user interface operations, etc.

[0053] The RAM in the memory unit 19 is used as a working area for various data processing by the CPU of the camera control unit 18, for temporarily storing data, programs, and the like. The ROM and flash memory (non-volatile memory) in memory unit 19 are used to store the OS (Operating System) that the CPU uses to control each part, content files such as image files, application programs for various operations, firmware, various setting information, etc. The various types of setting information include the above-mentioned FTP setting information, exposure settings, shutter speed settings, and mode settings as setting information related to imaging operations, white balance settings, color settings, and settings related to image effects as setting information related to image processing, and custom key settings and display settings as setting information related to operability.

[0054] The driver unit 22 includes, for example, a motor driver for a zoom lens drive motor, a motor driver for a focus lens drive motor, a motor driver for a diaphragm mechanism motor, and the like. These motor drivers apply drive currents to the corresponding drivers in response to instructions from the camera control unit 18, moving the focus lens and zoom lens, opening and closing the aperture blades of the aperture mechanism, and so on.

[0055] The sensor unit 23 collectively represents various sensors mounted on the imaging device. The sensor unit 23 is equipped with, for example, an IMU (inertial measurement unit), and can detect angular velocity using a three-axis angular velocity (gyro) sensor of pitch, yaw, and roll, and can detect acceleration using an acceleration sensor. Furthermore, the sensor unit 23 may be equipped with, for example, a position information sensor, an illuminance sensor, or the like.

[0056] The audio input unit 25 has, for example, a microphone and a microphone amplifier, and outputs an audio signal by collecting surrounding sounds. In the present embodiment, the microphones provided are a microphone 25L corresponding to the microphone hole 104L and a microphone 25R corresponding to the microphone hole 104R.

[0057] The audio processing unit 26 performs processing such as converting the audio signal obtained by the audio input unit 25 into a digital audio signal, AGC processing, sound quality processing, noise reduction processing, etc. The audio data that has undergone these processes is output to the camera signal processing unit 13 and the camera control unit 18. For example, when a moving image is captured, the audio data is processed in the camera control unit 18 as audio data accompanying the moving image.

[0058] Furthermore, voice data input as a voice memo by the photographer during playback or image capture is converted into a file as a voice file AF in the camera signal processing unit 13 or the camera control unit 18 . The audio file AF can be associated with the image file PF and recorded on a recording medium by the recording control unit 14, or can be transmitted and output from the communication unit 16 together with the image file PF.

[0059] The audio playback unit 27 includes an audio signal processing circuit, a power amplifier, a speaker, etc., and plays back the audio file AF recorded on the recording medium by the recording control unit 14. For example, when playing back the audio file AF, the recording control unit 14 reads out the audio data of the audio file AF under the control of the camera control unit 18, and transfers it to the audio playback unit 27. The audio playback unit 27 performs the necessary signal processing and conversion to an analog signal for the audio data, and outputs the audio from the speaker via the power amplifier. This allows the user to listen to the audio recorded as a voice memo. When playing back a video, the audio accompanying the video is played back by the audio playback unit 27.

[0060] <3. Functional configuration of the imaging device> In the imaging device 1, a program stored in a ROM or RAM serving as the memory unit 19 is executed, thereby establishing a functional configuration as shown in FIG. The imaging device 1 includes a UI (user interface) control unit 31, a file management unit 32, and a communication control unit 33.

[0061] The UI control unit 31 performs a process of detecting operations on various operators 110 provided in the imaging device 1, a display process using the display unit 15, a process of outputting audio, a process of providing an input operation environment to the user, and the like. Specifically, the UI control unit 31 performs a process of providing an environment in which the user can perform input operations by display output and audio output, and also performs display output and audio output for presenting various types of information to the user. Furthermore, when the user operates the operation device 110, the operation is detected and a process corresponding to the operation is executed.

[0062] Particularly in this embodiment, the UI control unit 31 detects that the assignable button 110C has been pressed under specific conditions, and performs a process of recording a voice memo and linking it to an image as a corresponding process. Furthermore, the UI control unit 31 performs processing for providing a UI environment for playing back a voice memo, a UI environment for deleting a voice memo, and the like.

[0063] The file management unit 32 performs a process of storing an image captured by a user as an image file PF, a process of storing a voice memo input by a user as an audio file AF, and the like. When storing the image file PF or the audio file AF, a process of giving a file name to each file is performed. The file name of the image file PF is, for example, a counter value indicating the number of images (still images and moving images) captured since resetting, to which an extension for images is added. Also, the file name of the audio file AF as an audio memo is a counter value the same as that of the image file to which the audio memo corresponds, to which an extension for the audio file AF is added. In this way, the audio file AF and the image file PF are associated with each other.

[0064] Furthermore, the file management unit 32 performs a process of deleting the image file PF and the audio file AF designated by the user. Furthermore, the file management unit 32 performs a process of acquiring from the memory unit 19 the image file PF and the audio file AF designated for playback.

[0065] In this embodiment, the file management unit 32 generates a management file for organizing a series of images captured in continuous shooting mode into one image group. The management file stores information for identifying the image files PF that belong to one image group.

[0066] The communication control unit 33 has a function of controlling the communication operation by the communication unit 16 . The communication control unit 33 performs a process of causing the communication unit 16 to communicate with the FTP server 4 . Specifically, the communication control unit 33 performs an upload process to the FTP server 4 via the communication unit 16 . The communication control unit 33 performs a process of uploading the image file PF and the audio file AF generated by the file management unit 32 as a pair to the FTP server 4 .

[0067] <4. User interface screen> The following describes UI screens on the display panel 101 of the imaging device 1. In particular, display examples relating to continuous shot images and voice memos will be mainly described. Note that each screen described below is an example of a screen displayed on the display panel 101 as the display unit 15 by the camera control unit 18 of the imaging device 1 executing the function as the UI control unit 31.

[0068] FIG. 6 shows an image list screen 50 on which images (still images and moving images) captured by the imaging device 1 can be viewed in a list. The image list screen 50 is, for example, a screen that is displayed on the display panel 101 in a playback mode.

[0069] The image list screen 50 displays a status bar 121 that displays time information, an indicator showing the battery charge state, and the like, and thumbnail images 122 for each of a plurality of captured images.

[0070] The thumbnail image 122 displayed is either a thumbnail image 122A for a single image captured in single shot mode, or a thumbnail image 122B for an image group that represents a group of multiple images captured in continuous shot mode.

[0071] For the thumbnail image 122B of an image group, one image out of a plurality of images included in the image group is selected as a representative image. The captured image used for the thumbnail image 122B may be selected by the user or automatically. For example, of a plurality of images captured in continuous shooting mode, the first image captured is automatically selected as a representative image and used as thumbnail image 122B.

[0072] An image group icon 123 indicating that it is an image group is superimposed on the thumbnail image 122B for the image group.

[0073] A plurality of images taken in continuous shooting mode may be automatically grouped together and generated as an image group, or a plurality of images selected by a user may be generated as an image group.

[0074] When any of the thumbnail images 122 is selected on the image list screen 50, the display on the display panel 101 is switched to the next screen. For example, when thumbnail image 122A for an image captured in single shot mode is selected, the screen switches to one in which the selected image is displayed large. Furthermore, when a thumbnail image 122B for an image group is selected, the screen switches to one displaying the selected image group (see FIG. 7).

[0075] The screen shown in FIG. 7 is a screen dedicated to an image group on which a plurality of images are displayed without being expanded, and is set as an image group pre-expansion display screen 51. On the pre-image group development display screen 51, a representative image 124 is displayed, along with a frame image 125 indicating that the image group contains a plurality of images.

[0076] When an operation is performed on the representative image 124 or the like on the pre-image-group-development display screen 51, the post-image-group-development display screen 52 shown in FIG. One of the images belonging to an image group is selected and displayed on post-image group expansion display screen 52. In Fig. 8, the first image captured in a series of images captured in continuous shooting mode is displayed as display image 126. Furthermore, a number display 127 indicating the total number of images belonging to the image group and their display positions is displayed on the post-expansion display screen 52. The number display 127 in Fig. 8 indicates that the first image in the image group consisting of 14 images is being displayed.

[0077] On the post-image group expansion display screen 52, image forwarding operations can be performed by swiping operations or button operations. An image forwarding operation is an operation for changing the displayed image 126 to another image, and Fig. 9 shows the post-image group expansion display screen 52 that is displayed after performing an image forwarding operation multiple times. FIG. 9 shows the state in which the fifth image out of 14 images belonging to an image group is displayed.

[0078] 9, pressing and holding the assignable button 110C starts recording of a voice memo. Recording of the voice memo ends when the press and hold state of the assignable button 110C is released or the recording time of the voice memo reaches a predetermined time. Furthermore, the voice memo is stored in association with the display image 126 displayed on the display panel 101 when the assignable button 110C is pressed and held. In this example, because the assignable button 110C is pressed and held from the state shown in Fig. 9, the voice memo is associated with the fifth image in the image group.

[0079] During recording of the voice memo, a voice memo recording screen 53 shown in FIG. The voice memo recording screen 53 displays a recording icon 128 indicating that recording is in progress, a recording level gauge 129 indicating the input levels of the microphones 25L and 25R, and a recording time bar 130 indicating the recording time and remaining recording time. In the example shown in FIG. 10, the maximum recording time is 60 seconds, of which 35 seconds have already been recorded.

[0080] After 60 seconds of recording has finished, or after the long press of assignable button 110C is released before the maximum recording time is reached, a post-image group expansion display screen 52 shown in Fig. 11 is displayed on display panel 101. Like Fig. 9, Fig. 11 shows a state in which the fifth image of the 14 images belonging to the image group is displayed. In addition, a voice memo icon 131, indicating that a voice memo is associated with this image, is displayed superimposed on the image.

[0081] When an operation to cancel the expanded display of the image group is performed from the state shown in Fig. 11, such as by pressing the back button, the image group pre-expansion display screen 51 shown in Fig. 7 is displayed on the display panel 101. The image group shown in Fig. 7 is in a state in which a voice memo corresponding to the fifth image has been recorded, but the representative image 124 displayed on the display panel 101 is the first image belonging to the image group, and as this first image has no corresponding voice memo, the voice memo icon 131 is not displayed. If a voice memo has been recorded on the representative image 124, a voice memo icon 131 is displayed on the image group pre-expansion display screen 51, as shown in FIG.

[0082] A modified example of the image group pre-expansion display screen 51 that is displayed when the expanded display is cancelled after associating a voice memo with the fifth image will be described with reference to Figs. 12 and 13. Figs. In the above, when a voice memo corresponding to the representative image 124 has been recorded, a voice memo icon 131 is displayed on the image group pre-expansion display screen 51, as shown in FIG. 12. However, in a modified example, even if there is no corresponding voice memo for the first image selected as the representative image 124, since a voice memo is associated with at least one of the images belonging to the image group (for example, the fifth image), a voice memo may be associated with the image, and therefore a voice memo icon 131 may be displayed as shown in FIG. 12 to indicate that there is an image containing a voice memo among the images belonging to the image group. This allows the user to recognize from the voice memo icon 131 whether or not there is an image with a corresponding voice memo, without having to expand and display the image group.

[0083] In the modified example shown in FIG. 13, one of the images belonging to the image group that has a corresponding voice memo (for example, the fifth image) is newly selected as the representative image 124. In other words, by simply viewing the pre-image group expansion display screen 51 shown in FIG. 13, the user can recognize that there is a voice memo corresponding to one of the images in the image group, and that at least one of the images with the voice memo has been selected as the representative image 124.

[0084] Meanwhile, for example, in the post-image group expansion display screen 52 shown in FIG. 11, that is, in the post-image group expansion display screen 52 where an image with a voice memo is displayed as the display image 126, when an operation to play back the voice memo is performed, such as a short press of the assignable button 110C, the voice memo playback screen 54 shown in FIG. 14 is displayed on the display panel 101.

[0085] On the voice memo playback screen 54, a voice memo icon 131, a playback icon 132 indicating that the voice memo is being played, and a playback time bar 133 indicating the recording time of the voice memo and the number of seconds already played are displayed on top of the image linked to the voice memo to be played. The play icon 132 is, for example, an icon image having the same shape as the record icon 128 shown in FIG. 10 but a different color. In the example shown in FIG. 14, the recording time length of the voice memo is 48 seconds, and it is shown that the portion currently being played is 27 seconds after the start of playback.

[0086] A modified example of the voice memo playback screen 54 is shown in FIG. In the voice memo playback screen 54 shown in FIG. 15, in addition to a voice memo icon 131, a playback icon 132, and a playback time bar 133, a playback level gauge 134 indicating the playback levels of the left and right channels is displayed.

[0087] On the post-image group expansion display screen 52 shown in FIG. 11, i.e., on the post-image group expansion display screen 52 where an image with a corresponding voice memo is displayed as the display image 126, when an operation is performed to delete a voice memo, etc., a deletion target selection screen 55 shown in FIG. 16 is displayed on the display panel 101.

[0088] Three operable options are presented to the user on deletion target selection screen 55. Specifically, a first option 135 for deleting both the image file PF and the audio file AF as a voice memo, a second option 136 for deleting only the audio file AF as a voice memo and leaving the image file PF recorded, and a third option 137 for canceling the deletion operation are displayed.

[0089] The image file PF and audio file AF that are deleted when either the first option 135 or the second option 136 is operated are files relating to the display image 126 that is being displayed on the display panel 101 when the deletion operation is performed.

[0090] When either the first option 135 or the second option 136 is operated, a deleting screen 56 shown in FIG.

[0091] The deleting screen 56 displays a message 138 indicating that deleting is in progress, a deleting bar 139 indicating the progress of the deleting process, and a cancel button 140 for canceling the deleting process. When the user operates the cancel button 140 while the deleting screen 56 is displayed, the deletion of the file to be deleted is cancelled.

[0092] When the time required for deleting the files has elapsed without the cancel button 140 being operated, a deletion completion screen 57 shown in FIG.

[0093] The deletion completion screen 57 displays a message 141 indicating that the deletion has been completed, and a confirmation button 142 which is operated when it is confirmed that the deletion has been completed.

[0094] When an operation for deleting or the like is performed on the pre-exploded image group display screen 51 shown in FIG. 7, a delete selection screen 58 shown in FIG. The delete selection screen 58 displays a delete all option 143 for deleting all images belonging to an image group at once, and a cancel option 144 for canceling the delete operation.

[0095] It should be noted that when an audio file AF exists as an audio memo linked to one of the images belonging to an image group, operating the delete all option 143 may result in the deletion of not only the image file PF but also the associated audio file AF. Note that an option may be provided for deleting only the audio file AF as a voice memo linked to one of the image groups.

[0096] When a delete operation is performed while an image not associated with a voice memo is displayed as display image 126 (for example, as shown in FIG. 8), delete selection screen 59 shown in FIG. 20 is displayed on display panel 101. The delete selection screen 59 displays a delete option 145 for deleting the image file PF and a cancel option 146 for canceling the delete operation. When the delete option 145 is operated, image deletion starts, and for example, a deleting screen 56 shown in FIG. 17 is displayed. Moreover, when the cancel option 146 is operated, the delete operation is cancelled, and the screen returns to the screen before the cancel operation was performed (for example, the screen shown in FIG. 8).

[0097] <5. Processing flow> <5-1. Image playback operation detection process> 21, 22 and 23 show the processing executed by the camera control unit 18 for detecting operations for transitioning between screens and for performing screen transitions for the image list screen 50 shown in FIG. 6, the display screen 51 before image group expansion shown in FIG. 7, and the display screen 52 after image group expansion shown in FIG. 8.

[0098] The flowcharts shown in the respective drawings show processing that is executed when an operation to play a captured image is detected, and is image playback operation detection processing. When an image playback operation is detected, the camera control unit 18 displays a list of images using the image list screen 50 (see FIG. 6) in step S101 of FIG.

[0099] In step S102, the camera control unit 18 determines whether or not an operation to select one image has been detected on the image list screen 50. If an image selection operation has not been detected, the camera control unit 18 determines in step S103 whether or not an operation to end image playback has been detected. When an operation to end image playback is detected, the camera control unit 18 ends the image playback operation detection process.

[0100] If the operation to end the image playback is not detected, the camera control unit 18 returns to the process of step S102. That is, the camera control unit 18 repeats the processes of steps S102 and S103 until it detects an image selection operation or a playback end operation.

[0101] In step S102, when an operation for selecting one image (or one image group) is performed, the camera control unit 18 determines in step S104 whether or not the selection is an image group. When an image group is selected, the camera control section 18 displays the image group pre-expansion display screen 51 (see FIG. 7) in order to display the image group in a non-expanded state in step S105.

[0102] In a state where the unexpanded image group display screen 51 is displayed, the camera control unit 18 determines in step S106 whether or not an expansion operation has been detected. If an expansion operation has not been detected, the camera control unit 18 determines in step S107 whether or not a return operation for returning to the previous screen has been detected. When a back operation is detected, the camera control unit 18 returns to step S101 and displays the image list screen 50, thereby presenting the previous screen to the user.

[0103] If the return operation is not detected in step S107, the camera control unit 18 returns to the process of step S106. That is, the camera control unit 18 repeats the processes of steps S106 and S107 until the camera control unit 18 detects either the unfolding operation or the return operation.

[0104] If an unfolding operation is detected in step S106, the camera control unit 18 displays the post-unfolding image group display screen 52 (see FIG. 8) in order to display the image group in an unfolded state in step S108 of FIG.

[0105] In step S109, the camera control unit 18 determines whether or not an image forwarding operation such as a swipe operation or pressing of a direction key has been detected on the display screen 52 after the image group has been expanded. If an image forwarding operation is detected, the camera control unit 18 performs processing to display the adjacent image according to the operation in step S110. By appropriately detecting the image forwarding operation, the multiple images belonging to the image group are displayed in order on the display panel 101.

[0106] If an image forwarding operation is not detected in step S109, the camera control unit 18 determines in step S111 whether or not a back operation is detected. If a back operation is detected, the camera control unit 18 returns to step S105 and presents the previous screen to the user by displaying the image group pre-expansion display screen 51. This makes it possible to switch between the display before and after the image group is expanded.

[0107] If a return operation is not detected in step S111, the camera control unit 18 determines in step S112 whether or not an operation on the assignable button 110C is detected. In this example, since a function related to a voice memo is executed by operating the assignable button 110C, an operation on the assignable button 110C is detected in step S112. If a function related to a voice memo is assigned to an operator 110 other than the assignable button 110C, an operation on the assigned operator 110 is detected in step S112. Furthermore, if a function related to a voice memo is executed by another operator 110 in addition to the assignable button 110C, an operation on both the assignable button 110C and the other operator 110 is detected in step S112.

[0108] If an operation on the assignable button 110C is not detected, the camera control unit 18 returns to step S109. That is, the camera control unit 18 repeatedly executes the detection processes of steps S109, S111, and S112 until an image forwarding operation, a back operation, or an operation on the assignable button 110C is detected.

[0109] When an operation on the assignable button 110C is detected, the camera control unit 18 executes an assignable button operation detection process in step S113. This process is a process for executing each function related to the voice memo according to the operation mode, as will be described in detail later.

[0110] Returning to the explanation of step S104, step S104 is a process for judging whether or not the image selected on the image list screen 50 is an image group. In this process, if it is judged that the selected image is not an image group, that is, if one image is selected, the camera control unit 18 performs a process for displaying the selected image in step S114 of FIG.

[0111] In step S115, the camera control unit 18 determines whether or not an image forwarding operation has been detected on a screen displaying one image. If an image forwarding operation has been detected, the camera control unit 18 returns to the process of step S104. That is, it determines whether or not the adjacent image corresponding to the operation is an image group, and if it is an image group, the process proceeds to step S105, and if it is not an image group but a single image, the process proceeds to step S114. As a result, appropriate display processing is performed depending on whether or not the adjacent image is an image group.

[0112] If an image forwarding operation is not detected, the camera control unit 18 determines whether or not a back operation is detected in step S116. If a back operation is detected, the camera control unit 18 returns to step S101 and presents the previous screen by displaying the image list screen 50. This makes it possible to switch between a screen displaying a single image and a screen displaying a list of images.

[0113] If a return operation has not been detected, the camera control unit 18 determines in step S117 whether or not an operation on the assignable button 110C has been detected. As described above, since a function related to a voice memo is assigned to the assignable button 110C, an operation on the assignable button 110C has been detected in step S117.

[0114] When an operation on the assignable button 110C is detected, the camera control unit 18 executes an assignable button operation detection process in step S113. This process is a process for executing each function related to the voice memo according to the operation mode, and will be described in detail later.

[0115] If an operation on the assignable button 110C is not detected, the camera control unit 18 returns to step S115. That is, the camera control unit 18 repeatedly executes the detection processes of steps S115, S116, and S117 until an image forwarding operation, a back operation, or an operation on the assignable button 110C is detected.

[0116] <5-2. Assignable button operation detection process> The process executed when an operation on assignable button 110C, which is an operator to which a voice memo-related function is assigned, is detected is shown in Fig. 24. The process shown in Fig. 24 is executed by each section (such as UI control section 31 and file management section 32) of camera control section 18.

[0117] In step S201, the camera control unit 18 determines whether or not a predetermined time has elapsed since the assignable button 110C began to be pressed. If the predetermined time has not elapsed, the camera control unit 18 determines in step S202 whether or not the assignable button 110C is still being pressed. If the assignable button 110C is being pressed, the camera control unit 18 returns to step S201 and determines whether a predetermined time has elapsed.

[0118] That is, when the assignable button 110C is pressed and held, the camera control unit 18 repeatedly executes steps S201 and S202 until a predetermined time has elapsed, and at the point in time when the predetermined time has elapsed, the process proceeds from step S201 to step S203.

[0119] On the other hand, if the pressed state of the assignable button 110C is released before the predetermined time has elapsed, for example, if the assignable button 110C is pressed for a short period of time, the camera control unit 18 proceeds from step S202 to the process of step S208.

[0120] That is, the process executed when the assignable button 110C is pressed for a long time is the process from step S203 onwards, and the process executed when the assignable button 110C is pressed for a short time is the process from step S208 onwards.

[0121] When the assignable button 110C is pressed and held, the camera control unit 18 executes control to start recording of a voice memo in step S203. For example, the camera control unit 18 starts a series of operations for recording an audio signal input from the audio input unit 25 on a recording medium as an audio file AF through processing by the audio processing unit 26, the camera signal processing unit 13, and the recording control unit 14. For example, at this point, the camera signal processing unit 13 starts processing for buffering audio data based on audio input by the microphones 25L and 25R for a maximum of 60 seconds.

[0122] The camera control unit 18 determines in step S204 whether or not the assignable button 110C is being pressed, and if it is being pressed, determines in step S205 whether or not the maximum recording time has elapsed.

[0123] If it is determined that the maximum recording time has elapsed, that is, if the assignable button 110C continues to be pressed but the maximum recording time has not elapsed, the camera control unit 18 returns to the process of step S204.

[0124] On the other hand, if it is determined in step S204 that assignable button 110C is not being pressed, or if it is determined in step S205 that the maximum recording time has elapsed, camera control unit 18 performs recording stop control in step S206. For example, camera control unit 18 stops the process of buffering the audio signal input from audio input unit 25 in camera signal processing unit 13 via the process of audio processing unit 26.

[0125] Then, in step S207, the camera control unit 18 executes a process of generating an audio file AF as an audio memo and storing it in a storage medium. That is, the camera signal processing unit 13 executes a compression process, a file format generation process, and the like on the buffered audio data, and the recording control unit 14 records the data in a predetermined file data format (for example, a WAV file) on the recording medium. With the above, the camera control unit 18 ends the series of processes for recording a voice memo shown in FIG.

[0126] As a result, if the assignable button 110C is continuously pressed, after a predetermined time has elapsed it is determined to be a long press and voice memo recording processing is initiated, and voice memo recording processing is continued until the pressed state is released or the recording time reaches the maximum recording time. When the recording time reaches the maximum recording time, or when the long press state of the assignable button 110C is released before the recording time reaches the maximum recording time, recording of the voice memo is stopped.

[0127] After executing the recording stop processing, in step S207, the camera control unit 18 generates an audio file AF as an audio memo corresponding to the recording processing and stores it in the memory unit 19. After completing the processing of step S207, the camera control unit 18 ends the series of processing shown in FIG. That is, when the series of processes in FIG. 24 are performed by executing step S113 in FIG. 22, the process returns to step S109 in FIG. 23. Moreover, when the series of processes in FIG. 24 are executed by executing step S113 in FIG. 23, the process returns to step S115 in FIG.

[0128] If it is determined in step S202 that the operation of pressing the assignable button 110C for a short time has been performed, the camera control unit 18 determines in step S208 whether or not there is a voice memo associated with the image displayed on the display panel 101. If there is no associated voice memo, the camera control unit 18 ends the series of processes shown in FIG.

[0129] 24, if it is determined that there is a voice memo associated with the image, the camera control unit 18 executes control to start playing the voice memo in step S209. For example, the camera control unit 18 instructs the recording control unit 14 to start playing a specific voice file AF, and instructs the voice playback unit 27 to perform a playback operation.

[0130] During playback of a voice memo, the camera control unit 18 determines in step S210 whether playback has ended, determines in step S211 whether a playback end operation has been detected, and determines in step S212 whether a volume change operation has been detected.

[0131] If it is determined in step S210 that playback has ended, i.e., if the playback output has reached the end of the audio data, the camera control unit 18 performs playback stop control for the playback operation of the recording control unit 14 and the audio playback unit 27 in step S214, and ends the series of processes shown in Figure 24. Furthermore, if it is determined in step S210 that playback has not ended, the camera control unit 18 determines in step S211 whether or not a playback end operation has been detected, and if a playback end operation has been detected, playback stop control is performed on the playback operation of the recording control unit 14 and the audio playback unit 27 in step S214, and then the series of processes shown in Figure 24 is terminated.

[0132] Furthermore, if the playback end operation is not detected, the camera control unit 18 determines in step S212 whether or not a volume change operation is detected, and if a volume change operation is detected, in step S213, performs playback volume change control on the audio playback unit 27, and returns to the process of step S210. If a volume change operation is not detected, the process returns to step S210 without executing the process of step S213.

[0133] Although not shown in the drawings, when a power-off operation is detected, a process of stopping the display on the display panel 101 is appropriately performed.

[0134] <6. Variations> Various modified examples will be described. In the above example, an example was described in which voice memo-related functions are concentrated in assignable button 110C, but a voice memo-related function may be executed by operating another operator 110. In that case, the process of detecting the operation of assignable button 110C can be interpreted as a process of detecting the operation of the corresponding operator 110 to obtain the same effect. Furthermore, not only when voice memo-related functions are integrated into one operator 110, but also when a plurality of buttons are operated in a predetermined sequence, functions related to voice memos can be executed. For example, various functions can be executed by performing an operation to display a menu screen while one image is displayed on the display panel 101, performing an operation to select an item related to voice memos from the displayed menu, and further selecting a voice memo recording function or a playback function as the function to be executed from the menu. In that case, instead of detecting the operation of the assignable button 110C, a process for detecting that the corresponding menu item has been selected may be executed.

[0135] When a voice memo has already been associated and a recording operation for the voice memo (the operation detected in step S201 in FIG. 24) is detected, several processing examples are conceivable. For example, it may be possible to prevent a new voice memo from being associated with the image unless the voice memo is deleted. In this case, after the process of step S201, a process is executed to determine whether or not a voice memo has already been associated with the target image, and if no voice memo is associated, the process of steps S203 and onward is executed.

[0136] In addition, if the already linked voice memo has not reached the maximum recording time, additional recording of the voice memo may be permitted, and if the voice memo has reached the maximum recording time, the recording operation of the voice memo may be invalidated. In this case, after the recording operation is detected in step S201, it is determined whether an already linked voice memo exists, and if it does, it is determined whether there is any remaining recording time, and if so, a process is performed to perform additional recording.

[0137] Furthermore, even if there is already a linked recorded memo, when a voice memo recording operation is performed, the already linked voice memo may be discarded and a new voice memo may be recorded.

[0138] Furthermore, multiple voice memos may be associated with one image, in which case the file name of the voice file AF as the voice memo not only identifies the associated image file PF, but also names the multiple voice memos differently.

[0139] In each of the above examples, an audio file AF is associated with one image file PF as an audio memo, but recording of an audio file AF associated with an entire image group may also be permitted. In that case, this can be achieved, for example, by recording information that identifies the audio file AF associated with the entire image group in a management file that organizes multiple images into a single image group. In addition to the confirmation processes of steps S106 and S107 in FIG. 21, the camera control unit 18 also executes a process for detecting an operation on the assignable button 110C, and accordingly executes the series of processes shown in FIG. 24, thereby making it possible to record a voice memo linked to the entire image group.

[0140] <7. Summary> As described in each of the above examples, the imaging device 1 is equipped with a user interface control unit (UI control unit 31) that performs the following processes: displaying a state in which a plurality of images are grouped together (display screen 51 before image group expansion) as a first display mode of an image group consisting of a plurality of images; displaying each of the plurality of images individually (displaying display screen 52 after image group expansion) as a second display mode of the image group; and detecting an operation to record a voice memo corresponding to a selected image selected in the second display mode. This allows the user to visually recognize that a plurality of images are grouped together as an image group, and also makes it possible to view the images included in the image group individually. The second display mode makes it easy to associate a voice memo with each image included in an image group, which allows information about the images in the image group to be added by voice memo, and makes it possible to communicate information about the images to users other than the photographer, such as editors.

[0141] Further, a file management section 32 may be provided that generates a file of the voice memo (voice file AF) as a separate file from the image file PF. That is, the audio data is not stored as metadata for the image file PF. Therefore, since the voice memo can be handled as an independent file, it is easy to extract the voice memo and record the same voice memo in multiple image files.

[0142] The multiple images may also be a series of images taken using a continuous shooting function. By displaying the continuous-shot image group in the first display manner, it is possible to clearly recognize that the images are a series of images. It is also possible to record a voice memo for each image in such a continuous shot image group, and it is also possible to transmit information about a series of images to other users.

[0143] As explained with respect to the pre-image group development display screen 51 in FIG. 7 and the like, in the display processing of the group in the first display mode, one of the images belonging to the image group may be displayed as a representative image 124. This makes it possible to display a distinctive image that identifies the contents of the image group as the representative image 124. This makes it easy for the photographer and other users to identify images that belong to an image group, and by obtaining additional information from the voice memo, it becomes even easier to understand what type of image each image in the image group is.

[0144] As described with reference to the image list screen 50 in FIG. 6 and the like, the representative image 124 in a series of images captured using the continuous shooting function may be the first image captured in the series of images. Since a continuous-shot image group is images captured continuously within a relatively short period of time, there are often no significant differences between the images in terms of composition, subject appearance, etc. With this configuration, the first image captured is automatically selected as the representative image 124 of the continuous-shot image group. This eliminates the need for a process or algorithm for selecting the representative image 124, thereby reducing the processing load on the camera control unit 18. Furthermore, by selecting a representative image 124 from a group of continuously shot images, it becomes easier to understand what kind of images the group of continuously shot images contains.

[0145] As explained in the image group pre-expansion display screen 51 of Figure 12, the user interface control unit (UI control unit 31) may perform control to display an icon image (voice memo icon 131) indicating that a voice memo has been recorded in the image group in the first display mode. This makes it possible to recognize from the icon image that a voice memo is recorded in the image group. Therefore, when a user other than the photographer checks an image group, it is difficult for the user to overlook that a voice memo has been recorded, which makes editing work and the like easier.

[0146] As explained in the image group pre-expansion display screen 51 in Figure 12, the user interface control unit (UI control unit 31) may display an icon image (voice memo icon 131) indicating that a voice memo has been recorded in the image group when a voice memo has been recorded for the representative image 124 among the images belonging to the image loop. That is, even if a voice memo is recorded on an image other than the representative image 124, the icon image is not displayed. This makes it possible to determine whether or not an icon image can be displayed simply by determining whether or not a voice memo has been recorded on the representative image 124, thereby reducing the processing load on the camera control unit 18.

[0147] As explained as a modified example in the image group pre-expansion display screen 51 in Figure 12, the user interface control unit (UI control unit 31) may display an icon image (voice memo icon 131) when there is at least one image with a voice memo recorded among the images belonging to the image group. This makes it possible to determine whether an image group includes an image with a voice memo recorded thereon without having to check each individual image in the image group. This eliminates the need for the user to check whether or not a voice memo has been recorded for each image in an image group, making it possible to provide a user interface that is highly convenient for the user.

[0148] As explained as a modified example in the image group pre-expansion display screen 51 in FIG. 13, the user interface control unit (UI control unit 31) may select an image having a voice memo recorded thereon as the representative image 124 from among the images belonging to the image group. As a result, an icon image is not displayed in an image group in which no voice memo is recorded in any of the images, and an icon image is displayed in an image group in which a voice memo is recorded in at least one image. Therefore, it becomes possible to check whether or not a voice memo is included in an image group simply by looking at the image icon, thereby improving convenience.

[0149] As described in the image playback operation detection process in FIG. 21, the user interface control unit (UI control unit 31) does not need to generate a voice memo file based on an operation in the first display mode. For example, when a group of images is displayed, the operation to record a voice memo is not detected, or even if the operation to record a voice memo is detected, the process to record the voice memo is not executed. This makes it possible to prevent operational errors by the photographer, such as a situation in which the photographer intends to record a voice memo for a representative image of an image group but ends up linking the voice memo to the entire image group, or vice versa.

[0150] As described in the modified example, the user interface control unit (UI control unit 31) may detect the operation in the first display mode. For example, when an operation to record a voice memo is detected in the first display mode, a process to link the voice memo to the entire image group is executed. Alternatively, when an operation to record a voice memo is detected in the first display mode, a process to link the voice memo to the displayed representative image is executed. Furthermore, a display process to allow the user to select an object to link the voice memo may be executed. In this way, the photographer is provided with a means for recording voice memos in various display modes, thereby improving convenience.

[0151] As explained in the description of the file management unit 32, the file management unit 32 may give the voice memo a file name such that the portion excluding the extension is the same character string as the file name of the image to be linked. This makes it possible to identify the image file to which the voice memo is linked from the file name. Therefore, a user other than the photographer can easily identify which image file the voice memo is related to even if there is no linking information between the voice memo file and the image file, thereby improving convenience.

[0152] As described in the deletion target selection screen 55 of Figure 16, when a delete operation is detected for an image on which a voice memo is recorded, the user interface control unit (UI control unit 31) may perform processing to present to the user a first option 135 for deleting both the image and the voice memo, a second option 136 for deleting only the voice memo, and a third option 137 for canceling the delete operation. By simultaneously displaying an option for canceling and an option for deleting, the number of operations required to delete can be reduced, thereby reducing the operational burden on the user.

[0153] The program of the embodiment is a program that causes, for example, a CPU, a DSP, or a device including these to execute each of the processes shown in FIGS. That is, the program of the embodiment causes a control unit such as the camera control unit 18 to execute a process of displaying a state in which a plurality of images are grouped together as a first display mode of an image group made up of a plurality of images. The control unit is also caused to execute a process of individually displaying each of the multiple images as a second display format of the image group. Furthermore, the control unit is caused to execute a process of detecting an operation of selecting one image in the second display mode. Furthermore, the control unit is caused to execute a process of detecting an operation for recording a voice memo corresponding to the selected image. The imaging device 1 described above can be realized by such a program.

[0154] A program for realizing such an imaging device 1 can be recorded in advance in a HDD serving as a recording medium built into a device such as a computer device, or in a ROM or the like in a microcomputer having a CPU. Alternatively, the software may be temporarily or permanently stored (recorded) on a removable recording medium such as a flexible disk, a CD-ROM (Compact Disc Read Only Memory), an MO (Magneto Optical) disk, a DVD (Digital Versatile Disc), a Blu-ray Disc (registered trademark), a magnetic disk, a semiconductor memory, a memory card, etc. Such removable recording media may be provided as a so-called package software. Furthermore, such a program can be installed in a personal computer or the like from a removable recording medium, or can be downloaded from a download site via a network such as a LAN (Local Area Network) or the Internet.

[0155] Furthermore, such a program is suitable for widespread provision of the imaging device 1 of the embodiment. For example, by downloading the program to a device equipped with a camera function, such as a mobile terminal device such as a smartphone or tablet, a mobile phone, a personal computer, a game device, a video device, or a PDA (Personal Digital Assistant), the smartphone or the like can function as the imaging device 1 of the present disclosure.

[0156] It should be noted that the effects described in this specification are merely examples and are not limiting, and other effects may also be obtained.

[0157] <8. This Technology>

[0158] The present technology can also be configured as follows. (1) a user interface control unit that performs a process of displaying a state in which a plurality of images are grouped together as a first display mode of an image group consisting of the plurality of images, a process of displaying each of the plurality of images individually as a second display mode of the image group, and a process of detecting an operation of recording a voice memo corresponding to a selected image selected in the second display mode. Imaging device. (2) A file management unit is provided for generating a file of the voice memo as a separate file from the image file. The imaging device according to (1) above. (3) The plurality of images are a series of images taken using a continuous shooting function. The imaging device according to any one of (1) to (2) above. (4) In the display process of the image group in the first display mode, one of the images belonging to the image group is displayed as a representative image. The imaging device according to any one of (1) to (3) above. (5) A representative image in the series of images taken using the continuous shooting function is the first image taken in the series of images. The imaging device according to (3) above. (6) The user interface control unit performs control to display an icon image indicating that a voice memo is recorded in the image group in the first display mode. An imaging device according to any one of (1) to (5) above. (7) The user interface control unit displays an icon image indicating that a voice memo is recorded in the image group when a voice memo is recorded in the representative image of the images belonging to the image group. The imaging device according to (4) above. (8) The user interface control unit displays the icon image when at least one image having a voice memo recorded thereon is present among the images belonging to the image group. The imaging device according to (6) above. (9) The user interface control unit selects an image having a voice memo recorded thereon as the representative image from among the images belonging to the image group. The imaging device according to any one of (4) and (7) above. (10) The user interface control unit does not generate a file of the voice memo based on the operation in the first display mode. The imaging device according to (2) above. (11) The user interface control unit detects the operation in the first display mode. The imaging device according to any one of (1) to (9) above. (12) The file management unit assigns a file name to the voice memo so that the part excluding the extension is the same as the character string of the file name of the image to be linked. The imaging device according to (2) above. (13) When a delete operation for an image on which a voice memo is recorded is detected, the user interface control unit performs a process of presenting to a user a first option for deleting both the image and the voice memo, a second option for deleting only the voice memo, and a third option for canceling the delete operation. The imaging device according to any one of (1) to (12) above. (14) a process of displaying a state in which a plurality of images are grouped together as a first display mode of an image group consisting of the plurality of images; displaying each of the plurality of images individually as a second display mode of the image group; A process of detecting an operation of selecting one image in the second display mode; A process of detecting an operation of recording a voice memo corresponding to the selected image. An information processing method executed by an information processing device. (15) a process of displaying a state in which a plurality of images are grouped together as a first display mode of an image group consisting of the plurality of images; displaying each of the plurality of images individually as a second display mode of the image group; A process of detecting an operation of selecting one image in the second display mode; A process of detecting an operation of recording a voice memo corresponding to the selected image. A program to be executed by an information processing device. [Explanation of symbols]

[0159] 1. Imaging device 18 Camera control section 31 UI control section 32 File Management Section 51 Image group display screen before expansion 52 Image group display screen after expansion 55 Delete target selection screen 110 Controls 110S Shutter button 110C Assignable Button 124 Representative Images 131 Voice Memo Icon 135 First Choice 136 2nd Option 137 Third Option

Claims

1. a user interface control unit that performs a process of displaying a state in which a series of images are captured using a continuous shooting function as a first display mode of an image group, a process of displaying each of the series of images individually as a second display mode of the image group, and a process of detecting an operation of recording a voice memo corresponding to a selected image selected in the second display mode, The user interface control unit performs control to display an icon image indicating that a voice memo is recorded in the image group in the first display mode. Imaging device.

2. A user interface control unit which performs the processes of displaying a state in which a series of images are captured using a continuous shooting function as a first display mode of the image group, displaying each of the series of images individually as a second display mode of the image group, and detecting an operation of recording a voice memo corresponding to a selected image selected in the second display mode; a file management unit that generates a file of the voice memo as a separate file from an image file; The user interface control unit does not generate a file of the voice memo based on the operation in the first display mode. Imaging device.

3. A file management unit is provided for generating a file of the voice memo as a separate file from the image file. The imaging device according to claim 1 .

4. In the display process of the image group in the first display mode, one of the images belonging to the image group is displayed as a representative image. The imaging device according to claim 1 .

5. A representative image in the series of images taken using the continuous shooting function is the first image taken in the series of images. The imaging device according to claim 1 .

6. The user interface control unit displays an icon image indicating that a voice memo is recorded in the image group when a voice memo is recorded in the representative image of the images belonging to the image group. The imaging device according to claim 4.

7. The user interface control unit displays the icon image when at least one image having a voice memo recorded thereon is present among the images belonging to the image group. The imaging device according to claim 1 .

8. The user interface control unit selects an image having a voice memo recorded thereon as the representative image from among the images belonging to the image group. The imaging device according to claim 4.

9. The user interface control unit detects the operation in the first display mode. The imaging device according to claim 1 .

10. The file management unit assigns a file name to the voice memo so that the part excluding the extension is the same as the character string of the file name of the image to be linked. The imaging device according to claim 3 .

11. When a delete operation for an image on which a voice memo is recorded is detected, the user interface control unit performs a process of presenting to a user a first option for deleting both the image and the voice memo, a second option for deleting only the voice memo, and a third option for canceling the delete operation. The imaging device according to claim 1 .

12. a process of displaying a state in which a series of images taken using a continuous shooting function are grouped together as a first display mode of the image group; displaying each of the series of images individually as a second display mode of the image group; A process of detecting an operation of selecting one image in the second display mode; detecting an operation to record a voice memo corresponding to the selected image; a process of displaying an icon image indicating that a voice memo is recorded in the image group in the first display mode; An information processing method executed by an information processing device.

13. a process of displaying a state in which a series of images taken using a continuous shooting function are grouped together as a first display mode of the image group; displaying each of the series of images individually as a second display mode of the image group; A process of detecting an operation of selecting one image in the second display mode; A process of detecting an operation of recording a voice memo corresponding to the selected image. a process of displaying an icon image indicating that a voice memo is recorded in the image group in the first display mode; A program to be executed by an information processing device.

Images