Program and information processing method

Abstract

To provide a program that provides information processing functions that support creation of image collections.SOLUTION: A program disclosed herein causes an information processing device to perform: processing for causing a display unit to display a list screen showing multiple captured images and an individual image screen showing one image selected form the multiple captured images in the list screen; and processing for causing the display unit to display a screen indicating images determined to include a subject person(s) with closed eyes on the list screen or individual image screen.SELECTED DRAWING: Figure 21

Description

[Technical Field]

[0001] This technology is Regarding programs and information processing methods This invention relates to a technology that is particularly suited to creating an image collection of an event. [Background technology]

[0002] For example, there is a service in which a photographer takes photos at wedding events such as weddings, wedding receptions, and after-parties, creates a photo album as a collection of images, and provides the photos to participants. In this case, after the event, the photographer or other person will import the images captured with the imaging device into a personal computer, smartphone, or the like, and edit them using editing software or the like to create an image album. This image album can then be made available via SNS (social networking service), cloud services, email, messaging applications, or the like. The following Patent Document 1 describes a technology for transferring images taken with a camera to a smartphone or the like for sharing. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2016-81173 Summary of the Invention [Problem to be solved by the invention]

[0004] Incidentally, event photo collections are a source of enjoyment for participants, and they often want to view them as soon as possible after the event has ended. For example, if the bride and groom and other guests could view the captured images immediately after the wedding ceremony and reception, while the afterglow of the ceremony was still lingering, it is believed that they would be able to experience even greater emotion. However, for example, when a large number of photographs are taken at a wedding, simply viewing them in order is troublesome for the viewer and is not considered appropriate. Therefore, it is considered to create an edited image collection using selected images from a large number of images and make it available for viewing by related parties. However, even in this case, it is a difficult task for the photographer or other person creating the image collection to decide and select which images from the large number of images to add to the image collection. Therefore, an object of the present disclosure is to provide an information processing function that supports creators when creating such image albums. [Means for solving the problem]

[0005] The program related to the present technology is a program that causes an information processing device to execute the following processes: a process of causing a display unit to execute a list display that displays a plurality of captured images and an individual display that displays one image selected from the plurality of captured images in the list display; and a process of causing the display unit to execute a display showing an image in which the subject person is determined to have their eyes closed in the list display or the individual display.

[0006] The information processing device according to the present technology includes a user interface control unit that performs a process of executing a list display and an individual display as a display that allows an image to be selected from a group of images captured at a specific event, and a process of detecting an archive operation on the displayed image, and an event data management unit that performs a process of storing archive information indicating that an archive setting has been made in correspondence with the image that is the target of the archive operation. For example, imagine a use case where images (photos) are selected from a group of multiple images taken at an event such as a wedding in order to create an image collection. In this case, it would be possible to archive any image from among the many images. The information processing device according to the present technology described above may include a filter processing unit that performs filtering based on the archive information, and the user interface control unit may control the list display so that images extracted by filtering are displayed as a list. For example, filtering can be performed to extract images that have been set as archives or images that have not been set as archives.

[0007] In the information processing device according to the present technology described above, it is conceivable that whether or not filtering based on the archive information is performed, or filtering conditions, can be selected. For example, it is possible to select whether or not to perform filtering, or the filtering conditions, such as extracting images that have been set as archives, extracting images that have not been set as archives, and so on.

[0008] In the information processing device relating to the above-described present technology, the user interface control unit controls the provision of a user interface that allows the setting of selection information for creating an image collection by selectively using image data included in the image group, and the event data management unit is thought to perform processing to store the archive information and the selection information as separate information. The selection information includes information indicating that the image has been selected for use in the image album, etc. This information is associated with the image as information separate from the archive information.

[0009] In the information processing device according to the present technology described above, it is conceivable that the user interface control unit enables an archive operation for the displayed image during the individual display. When a single image is displayed, the user can perform archive operations on that image.

[0010] In the information processing device according to the present technology described above, it is conceivable that the user interface control unit detects a swipe operation in a predetermined direction on a displayed image as an archive operation on the image. For example, touching the image area and swiping up on the screen is detected as an archive operation.

[0011] In the information processing device according to the present technology described above, it is conceivable that the user interface control unit, when detecting an archive operation, performs control to execute a display that allows the archive operation to be canceled for a predetermined time. For example, when performing an archive operation, a toast message can be displayed to allow an undo instruction.

[0012] The information processing device according to the present technology described above may include an image analysis unit that performs image analysis on each image in the image group and determines whether the subject person has closed their eyes, and the event data management unit may perform processing to store information about the person's eyes being closed in association with an image that has been determined to be an image of the person having closed their eyes. For example, an image group consisting of a plurality of image data captured at an event such as a wedding ceremony is analyzed to determine whether the subject has their eyes closed, and the determination result is stored as closed eyes information.

[0013] In the information processing device related to the present technology described above, it is conceivable that the user interface control unit performs control to execute a display showing an image that has been determined to be an image of an eye being closed based on the eye closing information during the list display or the individual display. For example, a closed eye icon may be displayed in association with the image.

[0014] The information processing device according to the present technology described above may include a filter processing unit that performs filtering based on the blink information, and the user interface control unit may perform control so that the list display includes a list of images extracted by filtering. For example, images excluding images with closed eyes are displayed in a list.

[0015] In the information processing device according to the present technology described above, it is possible to select whether or not to perform filtering based on the blink information. To enable a user to select whether or not to filter the closed-eye image, that is, whether or not to display it.

[0016] In the information processing device relating to the present technology described above, the user interface control unit controls the provision of a user interface that allows the setting of selection information for creating an image collection by selectively using image data included in the image group, and the event data management unit is thought to perform processing to store the blink information and the selection information as separate information. For example, like archive information, blink information is managed as information separate from selection information.

[0017] The information processing device according to the present technology described above may include a filter processing unit that performs filtering based on information from the imaging device that captured the image, and the user interface control unit may control the list display so that images extracted by filtering are displayed as a list. For example, images captured by an imaging device of a specific model or with a specific serial number may be displayed in a list.

[0018] The information processing method of the present technology is an information processing method in which an information processing device executes a process of causing a display unit to execute a list display that displays a plurality of captured images and an individual display that displays one image selected from the plurality of captured images in the list display, and a process of causing the display unit to execute a display showing an image in which a subject person is determined to have their eyes closed in the list display or the individual display. Also The information processing method of the present technology involves an information processing device performing the following processes: a process of executing a list display and an individual display as a display that allows an image to be selected from a group of images captured at a specific event; a process of detecting an archive operation on the displayed image; and a process of storing archive information indicating that the image has been archived in correspondence with the image that is the target of the archive operation. These are support processes that make the work of photographers and others creating photo albums more efficient. do. [Brief explanation of the drawings]

[0019] [Figure 1] 1 is an explanatory diagram of a system configuration for providing services according to an embodiment of the present technology; [Figure 2] FIG. 10 is an explanatory diagram of a work procedure for providing a service according to an embodiment. [Figure 3] FIG. 2 is a block diagram illustrating the configuration of a terminal device and a server device according to an embodiment. [Figure 4] FIG. 2 is an explanatory diagram of a functional configuration of a terminal device according to an embodiment. [Figure 5] FIG. 10 is an explanatory diagram of event data on the terminal device side according to the embodiment. [Figure 6] FIG. 2 is an explanatory diagram of a functional configuration of a server device according to an embodiment. [Figure 7] FIG. 10 is an explanatory diagram of event data on the server device side according to the embodiment; [Figure 8] FIG. 10 is an explanatory diagram of web gallery information generated by the server device according to the embodiment. [Figure 9] 10 is a flowchart of a presetting process of a terminal device according to an embodiment. [Figure 10] FIG. 10 is an explanatory diagram of a project list screen according to an embodiment. [Figure 11] 10 is a flowchart of a transfer / editing process of the terminal device according to the embodiment. [Figure 12] 10 is a flowchart of a selection support process of the terminal device according to the embodiment. [Figure 13] 10 is a flowchart of a selection support process of the terminal device according to the embodiment. [Figure 14] 10 is a flowchart of a selection support process of the terminal device according to the embodiment. [Figure 15] 10 is a flowchart of a selection support process of the terminal device according to the embodiment. [Figure 16] 10 is a flowchart of a selection support process of the terminal device according to the embodiment. [Figure 17] 10 is a flowchart of a selection support process of the terminal device according to the embodiment. [Figure 18] 10 is a flowchart of a selection support process of the terminal device according to the embodiment. [Figure 19] FIG. 2 is an explanatory diagram of a time view according to an embodiment. [Figure 20] FIG. 10 is an explanatory diagram of zooming in / out of a time view according to an embodiment. [Figure 21] FIG. 2 is an explanatory diagram of an event view according to an embodiment. [Figure 22] FIG. 2 is an explanatory diagram of an event view according to an embodiment. [Figure 23] FIG. 10 is an explanatory diagram of a time view candidate tab screen according to an embodiment. [Figure 24] FIG. 10 is an explanatory diagram of a single image display screen according to an embodiment. [Figure 25] FIG. 10 is an explanatory diagram of an archive operation according to an embodiment. [Figure 26] 10A and 10B are explanatory diagrams of screen transitions during archiving according to an embodiment. [Figure 27] 10A and 10B are explanatory diagrams of screen transitions during archiving according to an embodiment. [Figure 28]FIG. 2 is an explanatory diagram of a filter function according to an embodiment. [Figure 29] 10A and 10B are diagrams illustrating a display mode of a filter icon according to an embodiment. [Figure 30] 10A and 10B are explanatory diagrams of display modes according to filter conditions according to an embodiment. [Figure 31] 10A and 10B are explanatory diagrams of guidance displays relating to a filter function according to an embodiment. [Figure 32] 10A and 10B are explanatory diagrams of guidance displays relating to a filter function according to an embodiment. [Figure 33] FIG. 10 is an explanatory diagram of a setting state display of a filter function according to an embodiment. [Figure 34] FIG. 10 is an explanatory diagram of a cover / highlight selection screen according to an embodiment. [Figure 35] FIG. 10 is an explanatory diagram of a confirmation screen according to the embodiment. [Figure 36] 10 is a flowchart of a process of a server device according to an embodiment. [Figure 37] 10 is a flowchart of a process after receiving a URL of the terminal device according to the embodiment. [Figure 38] FIG. 10 is an explanatory diagram of a preview screen of a web gallery according to an embodiment. [Figure 39] FIG. 10 is an explanatory diagram of a web gallery delivery screen according to an embodiment. [Figure 40] 10 is a flowchart of a final delivery process of the terminal device according to the embodiment. [Figure 41] FIG. 10 is an explanatory diagram of view switching according to an embodiment. [Figure 42] FIG. 10 is an explanatory diagram of an image layout of an event view according to an embodiment. [Figure 43] FIG. 10 is an explanatory diagram of an image layout when switching views according to an embodiment. [Figure 44] 10A and 10B are explanatory diagrams illustrating display of candidate tabs in an event view according to an embodiment. [Figure 45] 10 is a flowchart of a delimiter determination process according to an embodiment. [Figure 46] 10A to 10C are diagrams illustrating an example of a screen transition when an event view is updated according to an embodiment. [Figure 47]10A to 10C are diagrams illustrating an example of a screen transition when an event view is updated according to an embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0020] The embodiments will be described below in the following order. <1. System configuration and operation procedures for image gallery service> <2. Configuration of information processing device> <3. Pre-setting process> <4. Transfer / Editing Process> <5. Selection process> [5-1 Overall Selection Process] [5-2 Archive and Blink-Based Filtering] [5-3 Cover, Highlight Selection] <6. Server processing> <7. Web Gallery Delivery Processing> <8. Final delivery processing> <9.Event View> <10. Summary and Variations>

[0021] <1. System configuration and operation procedures for image gallery service> In the embodiment, a case will be described in which a photographer takes still images (photographs) at an event such as a wedding, generates content as an image collection from the captured images, and provides the content to a client for a fee or free of charge. It should be noted that the present invention is not limited to still images, and moving images with or without sound may be captured, and an image collection including these moving images or an image collection consisting of multiple moving images may be generated.

[0022] For the purpose of explanation, cameramen and their assistants are collectively referred to as camera staff. The term "client" is not limited to the person placing the order, but also refers to any user who can view the image collection provided to them. For example, the term "client" refers to the bride and groom, their relatives, friends, and other related parties.

[0023] An image collection broadly refers to content that is a collection of images (still images and videos) such as a photo album, and the form in which it is provided does not matter, but in this embodiment, as an example, it is possible to provide an image collection as a web gallery and an image collection for actual delivery.

[0024] The image collection of a web gallery referred to here is an electronic image collection that allows photos of an event, such as a wedding, to be quickly viewed on a website after the event has ended. In the explanation, a website is used as an example, but this is just one example, and the content file as an image collection can also be provided in a form that allows it to be sent to the client's terminal device using, for example, email, electronic messages, SNS, etc.

[0025] The image collection to be delivered is, for example, a collection of images from an event that will later be officially produced as a photo album by a camera staff member and provided to a client. The image data captured at the event may be edited to create an electronic image collection as image album content or slideshow content, or an image collection may be created on paper, for example. The electronic image collection may be provided via download or streaming, or may be stored on portable storage media such as a disk-type storage medium, card-type storage medium, tape-type storage medium, or flash memory medium.

[0026] In this embodiment, a web gallery image collection can be generated that can be quickly viewed by clients before the final image collection is delivered. Furthermore, the web gallery image collection is not simply a large number of captured images lined up, but rather is a selection of images with a quality that can be enjoyed by viewers. On the other hand, the image collection delivered is positioned as something that camera crews can take their time to create by editing with more creativity.

[0027] FIG. 1 shows terminal devices 1A and 1B, an imaging device 2, a personal computer 3, a server device 4, terminal devices 5A and 5B, and a network 6. The terminal devices 1A and 1B are terminal devices used by camera staff, and for ease of explanation, they are collectively referred to as staff terminal 1. The terminal devices 5A and 5B are terminal devices used by users as the above-mentioned clients, and for the sake of explanation, these will be collectively referred to as client terminals 5.

[0028] Here, the staff terminal 1 and the client terminal 5 are exemplified by portable terminal devices such as smartphones and tablet devices. For example, the terminal device 1A is assumed to be a smartphone used by a cameraman, and the terminal device 1B is assumed to be a smartphone used by an assistant. The terminal device 5A is assumed to be a smartphone used by the bride, and the terminal device 5B is assumed to be a tablet device used by a friend at the venue. The staff terminal 1 and client terminal 5 may be any so-called information processing device, and specific examples thereof include a personal computer, a mobile phone, a game device, an audio device, a video device, a communication device, a television device, etc. In other words, any information processing device capable of performing information processing operations, such as a device with a built-in microcomputer, can be used as the staff terminal 1 or client terminal 5 of the present disclosure. However, since it is intended for use at event venues, etc., it is preferable that the device be a portable device such as a smartphone or tablet device.

[0029] Various types of imaging devices such as video cameras and still cameras are assumed as the imaging device 2. The imaging device 2 shown in the figure is assumed to be a camera used by a photographer at a wedding venue.

[0030] Data communication is possible between the imaging device 2 and the staff terminal 1 (for example, terminal device 1A) by, for example, FTP (File Transfer Protocol) communication. Specifically, it is conceivable that the terminal device 1A functions as an FTP server, and image files (including image data and metadata) captured by the imaging device 2 are uploaded sequentially or all at once via FTP communication. For this reason, it is assumed that the imaging device 2 is set up for FTP to transfer data to the terminal device 1A. The FTP setting information includes the host name of the FTP server, the destination path, the user name, the password, the connection type, and so on.

[0031] However, the imaging device 2 and the terminal device 1A may use other protocols than FTP. Any communication method may be used between the imaging device 2 and the terminal device 1A as long as it allows for the transfer of images and metadata. For example, mutual information communication may be possible using short-range wireless communication such as Bluetooth (registered trademark), WI-FI (Wireless Fidelity: registered trademark), or NFC (Near Field Communication: registered trademark), or infrared communication. Furthermore, the imaging device 2 and the terminal device 1A may be able to communicate with each other via a wired connection such as a wired LAN.

[0032] The personal computer 3 is exemplified as an information processing device used by, for example, camera staff to create the image album content for final delivery. This personal computer 3 is used to obtain data relating to images of the event from the server device 4 and to create the image album content for delivery using an image editing application or the like.

[0033] The server device 4 provides and manages various information for the camera staff to create a web gallery or a collection of images for actual delivery. For example, an application program for an image album providing service is installed on the staff terminal 1, and the process described below is performed in accordance with the application program. Correspondingly, the server device 4 manages data related to the event, generates a web gallery, etc.

[0034] The staff terminal 1 and the server device 4 are always connected while the application program is running, for example, and event data is synchronized between them. Examples of event data will be described later, and include image data captured at the event and data used to generate a web gallery.

[0035] In this disclosure, "synchronization" refers to maintaining the event data stored in the staff terminal 1 and the event data stored in the server device 4 so that at least a portion of the data content is the same. In particular, data to be synchronized includes image data, selection information, editing information, archive information, blink information, etc. The content of each will be described later.

[0036] The network 6 may be, for example, the Internet, a home network, a LAN (Local Area Network), a satellite communication network, or any other type of network. The staff terminal 1 can upload image data and the like to the server device 4 via the network 6 and transmit information for synchronization. The client terminal 5 can access the web page provided by the server device 4 via the network 6 and view the web gallery. The personal computer 3 can acquire image files for creating the image album content for actual delivery from the server device 4 via the network 6 .

[0037] The imaging device 2 has a display device such as a display panel on the back of the device or a viewfinder, and is capable of inputting operations using various controls, a touch panel, etc. In other words, it has sufficient functionality as a user interface. The imaging device 2 also has a built-in microcomputer, which enables various types of information processing and communication. For this reason, it is also assumed that the imaging device 2 functions as an information processing device as referred to in the present disclosure, and communicates with the server device 4 without going through the terminal devices 1A and 1B, and executes processing performed by the terminal devices 1A and 1B as described below. In the embodiment, the processing of the staff terminal 1 and the server device 4 will be mainly described, but an example in which the imaging device 2 performs all or part of the processing of the staff terminal 1 described below is also conceivable.

[0038] The outline of the procedure for providing an image album realized by a system such as that shown in Figure 1 will be explained with reference to Figure 2. This is a work procedure at the staff terminal 1 based on the operation of the camera staff as a service provider.

[0039] In step S1, advance settings are made. For example, the camera staff makes communication settings between the staff terminal 1 and the imaging device 2, event settings, image retouching settings, etc. This advance setting is made before the start of the wedding ceremony.

[0040] In step S2, the wedding ceremony is photographed, transferred, and automatically edited. Image files taken by the cameraman using the imaging device 2 are sequentially transferred to the staff terminal 1 (for example, terminal device 1A). The staff terminal 1 takes in the image file, transfers the image file to the server device 4, and automatically edits the image according to the pre-set settings.

[0041] Step S3 shows the tasks that can be performed on the day after the wedding ceremony. The camera crew uses the staff terminal 1 to perform selection operations. Selection includes the selection of images to be posted in the web gallery, the selection of cover images and highlight images, and even image editing. The staff terminal 1 performs update processing of the event data in response to the camera crew's operations. Processing for synchronizing the event data with the server device 4 is also performed sequentially. The selection in step S3 may be performed while the wedding ceremony or the like is in progress.

[0042] In step S4, the web gallery delivery process is performed. The server device 4 creates a web gallery based on the event data. The camera staff member checks the contents of the web gallery on the staff terminal 1 and then makes it available for viewing by the client. This allows the client to view the web gallery, which is a collection of wedding images, for example, on the day after the wedding ceremony.

[0043] Step S5 shows the creation of an image collection for the actual delivery and the processing of the actual delivery. The camera staff will later create the image album content for the actual delivery using, for example, a personal computer 3 and provide it to the client. This allows the client to receive the image collection content as the final delivery.

[0044] <2. Configuration of information processing device> 3 shows an example of the configuration of an information processing device 70 that can be configured as a staff terminal 1, a client terminal 5, or a server device 4 or a personal computer 3. The staff terminal 1, the personal computer 3, or the server device 4 can execute the processes described below by having the following configuration of the information processing device 70. The imaging device 2 can also execute the same processes as the staff terminal 1 described below by having the following configuration of the information processing device 70.

[0045] A CPU (Central Processing Unit) 71 of the information processing device 70 executes various processes in accordance with a program stored in a ROM (Read Only Memory) 72 or a program loaded from a storage unit 79 into a RAM (Random Access Memory) 73. The RAM 73 also stores data necessary for the CPU 71 to execute various processes as appropriate. The CPU 71, ROM 72, and RAM 73 are interconnected via a bus 74. An input / output interface 75 is also connected to this bus 74.

[0046] The input / output interface 75 is connected to an input unit 76 that includes an operator and an operation device. For example, the input unit 76 may be various types of operators or operation devices such as a keyboard, a mouse, keys, a dial, a touch panel, a touch pad, or a remote controller. An operation by the user is detected by the input unit 76, and a signal corresponding to the input operation is interpreted by the CPU 71.

[0047] Furthermore, the input / output interface 75 is connected integrally or separately to a display unit 77 such as a liquid crystal panel (LCD: Liquid Crystal Display) or an organic EL (Electro-Luminescence) display, and an audio output unit 78 such as a speaker.

[0048] The display unit 77 is a display unit that displays various types of information, and is configured by, for example, a display device provided in the housing of the information processing device 70, or a separate display device connected to the information processing device 70, or the like. The display unit 77 displays images for various image processing and images to be processed on the display screen based on instructions from the CPU 71. The display unit 77 also displays various operation menus, icons, messages, etc., i.e., a GUI (Graphical User Interface), based on instructions from the CPU 71.

[0049] The input / output interface 75 may be connected to a storage unit 79 configured from a hard disk or solid-state memory, or a communication unit 80 that performs communication using various communication methods.

[0050] The communication unit 80 performs communication processing via a transmission path such as the Internet, and communication with various devices via wired / wireless communication, bus communication, and the like. When this information processing device 70 is considered as the staff terminal 1, the communication unit 80 has a function for FTP communication with the imaging device 2 and a function for communicating with the server device 4 via the network 6. Alternatively, the communication unit 80 may have a function for communicating via short-range wireless communication such as the above-mentioned Bluetooth, Wi-Fi, and NFC, infrared communication, wired connection communication, etc. The communication unit 80 may also have a function for communicating via a communication line for mobile phones such as LTE (Long Term Evolution). When the information processing device 70 is considered as the server device 4 or the personal computer 3, the communication unit 80 has at least a function of performing communication via the network 6.

[0051] A drive 82 is also connected to the input / output interface 75 as required, and a removable recording medium 81 such as a magnetic disk, optical disk, magneto-optical disk, or semiconductor memory is appropriately mounted thereon. The drive 82 allows data files such as image files and various computer programs to be read from the removable recording medium 81. The read data files are stored in the storage unit 79, and images and sounds contained in the data files are output on the display unit 77 and the audio output unit 78. Furthermore, the computer programs and the like read from the removable recording medium 81 are installed in the storage unit 79 as necessary.

[0052] In this information processing device 70, for example, software for the processing of the present disclosure can be installed via network communication by the communication unit 80 or via a removable recording medium 81. Alternatively, the software may be stored in advance in the ROM 72, the storage unit 79, etc.

[0053] Assuming that the staff terminal 1 is the information processing device 70, the CPU 71 of the information processing device 70 will implement a functional configuration as shown in FIG. 4 by an application program. Figure 4 shows the functions provided in the information processing device 70, which is the staff terminal 1, including an event data management unit 30, a UI (user interface) control unit 31, a communication control unit 32, a filter processing unit 33, an image analysis unit 34, and a segmentation determination unit 35.

[0054] The event data management unit 30 is a processing function that stores, as event data relating to a specific event, image data received through communication with the imaging device 2 and additional information including rating information corresponding to the image data. The event data management unit 30 also updates the event data in response to operational inputs from the camera staff.

[0055] An example of the contents of the event data is shown in FIG. Event data is a data group including images and various details about an event that is registered by a camera staff member operating the staff terminal 1. Figure 5 shows event data 60 about an event with the event name "event2." In this example, the event data 60 includes preset information 61 , an imaging / editing information table 62 , and delimiter information 63 .

[0056] The preset information 61 is information set by the camera staff in advance in step S1 of Fig. 2. For example, it includes editing information such as retouching parameters.

[0057] The imaging / editing information table 62 is a table to which information is successively added and updated in the processing of steps S2 and S3 in FIG. In this imaging / editing information table 62, various information is written in correspondence with the image files transferred from the imaging device 2. Image data and metadata (MT1, MT2, etc.) are included in the image file transferred from the imaging device 2. This image data is managed as original image data, and the added metadata is also managed. Image data can be, for example, RAW data or data compressed using the JPEG format, and the data format does not matter, but here we will use JPEG compressed data such as ``DSC0001.jpg'' as an example. The metadata (MT1, MT2, etc.) includes camera information such as the date and time the image data was captured, the model of the imaging device 2, the manufacturer, and the serial number, as well as data format, data size, angle of view information, focus point information, and other information added by the imaging device 2.

[0058] The imaging and editing information table 62 stores rating information corresponding to image data. The rating information indicates the rating value given to an image by a photographer or other person, and is, for example, the number of stars, which can be one of six levels, such as "no stars," "one star," "two stars," "three stars," "four stars," and "five stars." For example, the more stars there are, the higher the rating. Of course, this type of rating information is just one example. Such rating information serves as a reference for camera staff when selecting images. Therefore, for example, when setting the selection flag (setting the image information to be used), as described below, images with high ratings in the rating information can be said to be images that are likely to be used in a web gallery or for final delivery. This rating information can be assigned by the cameraman after checking the captured image when he or she captures the image. The imaging device 2 is provided with a user interface for inputting rating information. This rating information may be included in metadata corresponding to the image data and transferred to the staff terminal 1 together with the image data. Alternatively, it may be written in the XMP area of ​​Exif in the image file. The staff terminal 1 extracts and manages rating information from the metadata (or Exif data). This rating information can be added or updated in association with image data by operating the staff terminal 1 side.

[0059] The imaging / editing information table 62 stores selection information corresponding to image data. One of the selection information is the "selection flag" (sometimes simply referred to as "flag"), which indicates whether the image will be included in the Web Gallery. When the flag is off, the image will not be used in the Web Gallery, and when the flag is on, the image has been selected for use in the Web Gallery. One of the pieces of selection information is cover image information indicating that the image is selected as a cover image to be placed as a cover at the top of the web gallery. One type of selection information is highlight image information, which indicates that the image has been selected to be highlighted in the web gallery. Highlighting means that the image is displayed larger than other images. Alternatively, normal images may be monochrome images, while highlight images may be displayed in color. Conversely, in terms of emphasis, normal images may be color images, while highlight images may be displayed in monochrome. Furthermore, normal images may be displayed borderless, while highlight images may be displayed with a border. There are a variety of possible ways of highlighting.

[0060] The blinking information is information indicating the blinking state of the subject person, obtained through image analysis processing executed by the function of the image analysis unit 34. For example, the simplest example would be flag information such as "0" or "1" indicating whether the image shows a blinked eye.

[0061] Archive information is information indicating that an image has been archived by the user. Archive operations will be described later. For example, the simplest example would be flag information such as "0" or "1" that indicates whether the image has been archived.

[0062] The editing information includes various image processing parameters such as retouching parameters, tilt correction parameters, etc. The retouching parameters include image quality adjustment parameters such as brightness adjustment values, color adjustment values, contrast adjustment values, and sharpness adjustment values. Retouching parameters can be set in advance, but they can also be set for individual images. Tilt correction parameters must be set individually. For these reasons, editing information corresponding to image data is stored so that parameters set for individual images can be stored.

[0063] As shown in the figure, the imaging / editing information table 62 may store edited image data corresponding to the image data. Edited image data is image data that has been edited based on preset or individually set editing information for original image data. It is not limited to image data that has been retouched using editing information, but can also refer to image data that has had its quality changed. Examples of quality changes include changes in image size, resolution, cropping, and frame rate for video. In the figure, edited image data is distinguished from original image data by adding an "E" to the file name, such as "DSC0001E.jpg." This edited image data is used for display on the user interface of the staff terminal 1. Such edited image data does not necessarily have to be created and stored; for example, editing information may be applied each time an image is displayed. Therefore, it is sufficient for the imaging / editing information table 62 to update and manage the editing information, and it is not necessary to store the edited image data. However, of course, generating and storing edited image data as needed, as shown in the figure, is effective in reducing the processing load during display processing.

[0064] The delimiter information 63 is information about sub-events and scene delimiters that are set as a result of the delimiter determination process described below. The delimiter information 63 is updated every time the delimiter determination process is performed.

[0065] The CPU 71 of the information processing device 70 serving as the staff terminal 1 performs additional storage and updating of information about the event data 60 as described above using the function of the event data management unit 30 shown in FIG. The format of the event data 60 and the format of the imaging / editing information table 62 are merely examples, and any format may be used as long as it allows at least the above content to be managed for each event. For example, the original image data, metadata, rating information, selection information, blink information, archive information, editing information, and edited image data included in the imaging / editing information table 62 do not necessarily have to be stored together as a table, and may be stored in any format or manner as long as the metadata, rating information, selection information, blink information, archive information, editing information, and edited image data are associated with at least one piece of original image data.

[0066] 4 is a function that controls the presentation of images and rating information related to event data 60 of a specific event and also detects operation inputs, that is, a function that performs user interface processing. User interface processing includes presenting various types of information, providing an environment in which operation input is possible, detecting operations by the user, and detecting / estimating the user's intentions. Specifically, the UI control unit 31 performs control processing to provide the user with an operation input environment and present information by, for example, causing the display unit 77 and the audio output unit 78 to perform display output, audio output, etc. to the user. Alternatively, the UI control unit 31 performs a process of detecting an operation by the user, for example. Alternatively, the UI control unit 31 performs both a process of providing an operation input environment to the user and a process of detecting an operation by the user, for example. Of course, the UI control unit 31 may perform other user interface processing.

[0067] The communication control unit 32 has a function of controlling communication for synchronizing the event data 60 with the external server device 4 in response to storage or update of the event data 60. For example, when an image transfer is received from the imaging device 2, the communication control unit 32 controls the process of transferring the image data from the communication unit 80 to the server device 4, and controls the notification of the updated content to the server device 4 in response to an update of the content of the event data 60.

[0068] The filter processing unit 33 is a function that performs processing to filter images from a group of images captured for an event in response to a user operation and extract images to be displayed. Filter conditions are set by a user operation. Specifically, the archive setting state, blinking state, metadata, etc. are set as filter conditions.

[0069] The image analysis unit 34 has the function of setting the above-mentioned blink information. For example, it performs image analysis on image data received through communication with the image capture device 2, detects a person as a subject, and determines whether that person has their eyes closed. If the image shows a person with their eyes closed, it generates blink information. This analysis is performed for each image, and the blink information is managed in the event data 60.

[0070] The division determination unit 35 is a function that performs processing to determine divisions in time series for a group of images that are a series of images captured for an event. For example, it determines the divisions of sub-events in an event such as a wedding, or scenes into which sub-events are subdivided. For example, if a wedding ceremony and reception are considered to be one event, there are various events that can be divided into chronological order, such as the ceremony, reception, greetings, cake cutting, toast, bouquet toss, etc. The content of the divisions is arbitrary, but for example, if a series of weddings is considered to be an event, the events that divide it will be called "sub-events" for the sake of explanation. There may also be cases where a two-stage division is performed to further subdivide a single sub-event. In such cases, each subdivided event will be called a "scene."

[0071] It is up to you to decide what events, occurrences, actions, etc. to consider as "sub-events" or "scenes." When the whole is considered as one "event," each division is considered a "sub-event," and each further division is considered a "scene." For example, in some cases, "cake cutting" could be a "sub-event" or a "scene."

[0072] The above functions in Fig. 4 are merely examples. When the information processing device 70 includes at least the event data management unit 30, the UI control unit 31, and the communication control unit 32, the information processing device 70 performs processing as the staff terminal 1 of the present embodiment. These functions are realized, for example, by installing an application program for creating image album content on the information processing device 70.

[0073] Next, assuming that the server device 4 is the information processing device 70 as shown in FIG. 3, the CPU 71 of the information processing device 70 implements a functional configuration as shown in FIG. 6 by an application program. FIG. 6 shows an event data management unit 40, an image album creation unit 41, an event data provision control unit 42, and a data output unit 43 as functions provided in an information processing device 70 serving as the server device 4.

[0074] The event data management unit 40 is a processing function that manages the storage and updating of event data in the server device 4. The contents of the event data 90 on the server device 4 side are shown in Fig. 7. As in Fig. 5, this is event data 90 for an event with the event name "event2". In this example, the event data 90 includes preset information 91 and an imaging / editing information table 92 .

[0075] The preset information 91 is the same information as the preset information 61 in the staff terminal 1. For example, the contents set in the preset in step S1 in FIG. In the event data 90, the delimiter information 63 in FIG. 5 may be synchronously managed.

[0076] The imaging and editing information table 92 has almost the same information as the imaging and editing information table 62. That is, it is possible to manage original image data, metadata, rating information, selection information, blink information, archive information, and editing information for each image. Note that the imaging / editing information table 92 does not associate edited image data, because edited images are created when the web gallery is generated. Of course, the server device 4 may also generate edited image data sequentially, and associate the edited image data with the original image data in the imaging / editing information table 92. The CPU 71 of the information processing device 70, which is the server device 4, performs additional storage and updating of information about the event data 90 as described above using the function of the event data management unit 40 in FIG.

[0077] 6 is a function that generates image album content as a web gallery of a specific event. In particular, the image album generation unit 41 references the selection information and editing information in the event data 90 to generate image album data, i.e., web page data to be used as a web gallery. An example of the generated web gallery data is shown in FIG. The server device 4 generates page information in HTML (HyperText Markup Language) format or XML (Extensible Markup Language) format as web gallery data, for example, as web page setting information 96, and also generates an image folder 97 that collects images called from the web page setting information 96 and displayed on the page. The image folder 97 contains edited image data for images that have been adopted as web galleries.

[0078] The event data provision control unit 42 in FIG. 6 is a function that controls transmission of the event data 90 to the staff terminal 1 for provision. For example, the staff terminal 1 logs in to the server device 4 and, in response to specifying an event, transmits all or part of the event data 90 for that event to the staff terminal 1. The staff terminal 1 then treats the received content as event data 60 under its own management. This allows an assistant to perform operations using the event data 60 on the terminal device 1B side, for example. Of course, the event data provision control unit 42 may also control the provision of event data to the terminal device 1A and the personal computer 3.

[0079] The data output unit 43 controls the transmission of some or all of the data contained in the event data, such as metadata, rating information, selection information, blink information, archive information, editing information, or image data (e.g., original image data), to a terminal device (e.g., a personal computer 3) as a file in a predetermined format. In other words, it is a processing function that provides the camera staff with the data necessary to create the image collection content for this delivery.

[0080] The above functions in Fig. 6 are merely examples. By providing the information processing device 70 with the event data management unit 40, event data can be synchronized between the staff terminal 1 and the server device 4. Furthermore, by providing the server device 4 with the image album generation unit 41, web galleries can be generated quickly. Each function in FIG. 6 is realized, for example, by installing an application program for creating image album content on the information processing device 70.

[0081] <3. Pre-setting process> A specific processing example will be described below. First, an example of the presetting process at the staff terminal 1 shown as step S1 in FIG. 2 will be described with reference to FIGS. The processing of the staff terminal 1 referred to below refers to processing performed by the CPU 71 of the information processing device 70 having the functions of FIG. In addition, the screen examples described below along with the flowcharts are examples of the contents displayed on a display formed on the housing of an information processing device 70 serving as the staff terminal 1, for example, a smartphone.

[0082] FIG. 9 shows the process of the staff terminal 1. For example, the camera staff member starts an application program using the staff terminal 1 and performs an operation for preparation processing. In response to this operation, the CPU 71 of the staff terminal 1 executes the processing from step S10 onwards.

[0083] In step S10, a project creation process is performed on the staff terminal 1. This is a process for setting an event for which an image album is to be created. For example, on the display unit 77 of the staff terminal 1 on which the application program has been started, a project list screen 110 is displayed as shown in FIG. 10A. The project list screen 110 has a list area 111 where event names that are the subject of each project are displayed in a list, as well as an add icon 112, a communication icon 134, a menu icon 127, and the like.

[0084] The camera staff creates a project for which an image album is to be created on this project list screen 110. For example, the camera staff enters an event name and the like to create one project. For example, by operating the add icon 112, a project setting screen (not shown) is displayed, and the project title (for example, event name), the date and time of the event, the location, whether or not to apply auto-retouch settings, and the like can be set. The camera staff inputs the appropriate items and performs an operation to set the project contents. In response to this, one project is created on the staff terminal 1 and displayed in the list area 111.

[0085] Figure 10B shows an example in which two projects named "event 1" and "event 2" are displayed. For each project, information such as the event name, date and time, and location is displayed. In step S10 of FIG. 9, the staff terminal 1 performs control to provide such a screen user interface by using the function of the UI control section 31, and performs project creation processing in response to operations by the camera staff.

[0086] This project creation process is performed, for example, while the staff terminal 1 and the server device 4 are connected online. In this case, the staff terminal 1 uses the function of the communication control unit 32 to send information for synchronization processing to the server device 4 in accordance with the user's operation. This allows the server device 4 to be in a state where information for one project is entered synchronously.

[0087] 9, the staff terminal 1 performs transfer settings. These transfer settings are settings for FTP transfer between the staff terminal 1 and the imaging device 2, such as the file format to be transferred and the FTP connection server. The staff terminal 1 uses the function of the UI control unit 31 to display a screen for transfer settings to the camera staff, and performs the necessary transfer settings in response to operations by the camera staff.

[0088] In step S12, the staff terminal 1 performs auto-retouching settings, which are processing for setting parameters for image editing processing that is commonly applied to each image. The staff terminal 1 displays a screen for auto-retouching settings to the camera staff using the functions of the UI control unit 31, and performs the necessary auto-retouching settings in response to operations by the camera staff. The parameters for these auto-retouching settings are written as pre-setting information 61 in the event data 60 of the created project. Furthermore, this auto-retouching setting is also performed, for example, while the staff terminal 1 and the server device 4 are connected online, and the staff terminal 1 transmits the parameter information for which auto-retouching has been set to the server device 4 for synchronization processing. This allows the server device 4 to store preset information 91 having the same content as the preset information 61 of the event data 60 as the event data 90 of the project.

[0089] In step S13, the staff terminal 1 sets a watermark. For example, the name of the photographer can be inserted as a watermark (digital watermark) into the images in the web gallery. Watermark setting is a process for setting whether or not to include this watermark and its contents. The staff terminal 1 displays a screen for setting a watermark to the camera staff using the function of the UI control unit 31, and sets the necessary watermark in response to the camera staff's operation. This watermark setting information is also written as pre-setting information 61 in the event data 60 of the created project. This watermark setting is also performed while the staff terminal 1 and the server device 4 are connected online, and the staff terminal 1 transmits the watermark setting information to the server device 4 for synchronization processing. This allows the server device 4 to store preset information 91 synchronized with the preset information 61 in the event data 90 of the project.

[0090] The order of steps S11, S12, and S13 may be different. Furthermore, the processing of each step does not have to be performed as a series of processes, and may be performed each time in response to a user operation during startup, for example. Furthermore, each process may be skipped if not necessary. For example, the transfer settings in step S11 may be performed each time a project is created in step S10, but if the FTP transfer settings have already been configured once and no changes to the settings are required, step S11 may be skipped after the project is created in step S10, and the process may proceed to step S12. Of course, the same applies to the processes in steps S12 and S13, and if no changes are required after the settings have been configured, these may be skipped. In addition, communication with the server device 4 for synchronization may be performed at the timing of each process, but it is also possible to synchronize the pre-setting information 61, 91 by sending the information together when several settings have been made. Furthermore, if there is content that has been set in an environment where online connection with the server device 4 is not possible, it is preferable that the set information be sent when an online connection state is established, and the pre-setting information 61, 91 be synchronized.

[0091] <4. Transfer / Editing Process> Next, a specific example of the processing of the staff terminal 1 in step S2 in Fig. 2 will be described with reference to Fig. 11. That is, this is processing that is executed on the staff terminal 1 while a wedding ceremony is taking place, mainly by the functions of the event data management unit 30, the communication control unit 32, and the image analysis unit 34 in Fig. 4.

[0092] The staff terminal 1 checks whether or not image file transfer has started from the imaging device 2 in step S101 of Fig. 11. While image transfer is not being performed, the process of Fig. 11 is not particularly performed. For example, during a wedding ceremony, a photographer uses the imaging device 2 to capture images of the ceremony and reception. After capturing still images, for example, the imaging device 2 transfers the image files to the staff terminal 1 automatically or in response to the photographer's operation. Note that the transfer timing is an example. The transfer may be performed after each image is captured, or multiple images may be transferred together. In the case of video recording, the data may be transferred during periods when recording is not being started or stopped, or during the recording period after recording has started. All recorded video may be transferred, or only the first specified period may be transferred.

[0093] Furthermore, the cameraman can add rating information to the captured image by operating the imaging device 2. For example, he or she can check the image immediately after capturing it and input the rating information. This rating information is then written in the metadata. The transfer of the image file containing the image data and metadata may be performed, for example, in response to a cameraman checking the captured image and inputting rating information.

[0094] When the staff terminal 1 detects that the transfer of such an image file has started, the process proceeds from step S101 to step S102, and a process of receiving the image data and metadata is performed. In this case, the received image data is managed as original image data in the imaging / editing information table 62 of the event data 60. The received metadata is also managed accordingly.

[0095] The staff terminal 1 performs image compression processing in step S103. For example, the compression processing is performed so as to increase the compression rate of the received image data. This is processing to generate image data to be sent to the server device 4.

[0096] In step S104, the staff terminal 1 performs a closed-eye image analysis process. That is, the received image or the image compressed in step S103 is subjected to image analysis processing to detect the person as the subject, detect the pupils, and determine whether the person has closed their eyes. If it is determined that the image shows the subject with their eyes closed, the staff terminal 1 generates closed-eye information for that image indicating that the person has their eyes closed. The closed-eye information is registered in the imaging / editing information table 62 of the event data 60.

[0097] In step S105, the staff terminal 1 performs rating information management. This is a process of checking the metadata of the received image file, extracting the rating information assigned by the imaging device 2, and managing the information in an updatable manner in the imaging / editing information table 62 of the event data 60.

[0098] In step S106, the staff terminal 1 transmits information to the server device 4 to synchronize the event data 60 and 90. In this case, the staff terminal 1 transmits the image data compressed in step S103, metadata, rating information, and blink information to the server device 4. In response to receiving this, the server device 4 updates the event data 90 and maintains the synchronized state with the event data 60.

[0099] In step S107, the staff terminal 1 performs auto-retouch application processing. That is, image processing is automatically performed on the original image data using preset retouching parameters to generate edited image data, which is managed in the imaging and editing information table 62. This edited image data is generated for use in UI display on the staff terminal 1. In this example, auto-retouching is performed as part of the process when an image file is received, but it may also be performed at other times as needed, such as when a request is made to display a single image. It is also possible to perform image processing on the compressed image data generated in step S103. In this case, for example, the order of the processes in steps S106 and S107 may be reversed, and the compressed image data may be subjected to image processing that applies auto-retouching before being sent to the server.

[0100] 11, the staff terminal 1 captures images captured by the photographer, and information corresponding to the images is managed by the event data 60. For example, when a wedding ceremony is over, all captured images are managed by the event data 60. Furthermore, by carrying out transmission for successive synchronization, the event data 90 on the server device 4 side is synchronized with the event data 60 on the staff terminal 1 side during and at the end of the wedding ceremony.

[0101] Also, during the processing of Figure 11, a list of images transferred from the imaging device 2 and the communication status are displayed on the time view 120 described below, so that the camera staff can check the status of image import into the staff terminal 1, etc.

[0102] <5. Selection process> [5-1 Overall Selection Process] Next, a detailed example of the selection process in step S3 of FIG. 2 will be described with reference to the flowcharts of FIGS. 12 to 18 and the screen examples of FIGS. 19 to 35. 12 to 18 show a series of flowcharts in separate parts, with connections indicated by "c1", "c2", "c3", "c4", "c5", "c6", "c7", and "c8". The processing of these flowcharts is performed by the functions of the event data management unit 30, UI control unit 31, communication control unit 32, filter processing unit 33, and segmentation determination unit 35 in FIG.

[0103] Step S201 in FIG. 12 shows the process of displaying a list of projects (event names, etc.) on the project list screen 110 as shown in FIG. 10B. In step S202, the staff terminal 1 monitors whether or not a project selection operation has been performed on the project list screen 110, and in step S203 monitors whether or not an operation to terminate the application program has been performed. When an operation to terminate the application program is performed, the application program is closed and the process is completed.

[0104] For example, when making a selection during or immediately after a wedding, the camera crew performs an operation to select the target project on the project list screen 110. For example, the camera crew performs an operation such as tapping one of the projects displayed in the list area 111. When such an operation is detected, the staff terminal 1 proceeds from step S202 to step S204 to acquire the latest event data for the selected project. For example, the staff terminal 1 requests the event data 90 for the selected project from the server device 4 and imports the transmitted event data 90. The staff terminal 1 then compares it with the event data 60 it holds and updates it to the latest information. For example, the staff terminal 1 compares some information that can determine whether the information is new or old, such as update date and time information or version control information for the event data 60 and the event data 90, and if they differ, the event data 60 is updated to the latest information.

[0105] For example, if we consider terminal device 1A held by a photographer, during the wedding ceremony an assistant may be entering rating information and selection information on terminal device 1B, and this information may not be reflected in the event data 60 on terminal device 1A. Furthermore, when rating information or selection information is to be input on the side of terminal device 1B held by the assistant, it is appropriate to input the latest information on the side of terminal device 1A as a standard. Therefore, the staff terminal 1 receives the event data 90 of the server device 4, which has the latest information sent from both the terminal devices 1A and 1B, and updates the information of its own event data 60 if it is not the latest.

[0106] It should be noted that there may be only one staff terminal 1, and the information on the staff terminal 1 may always be the latest. In such a case, the processing of step S204 may be unnecessary.

[0107] 13, the staff terminal 1 displays a list of event images, for example, a time view 120 as shown in FIG. The time view 120 is a list display in the image area 128 as a simple time-series display in which images are arranged in the order of their capture times.

[0108] The time view 120 changes its display form as shown in FIG. 20A, FIG. 20B, and FIG. 20C in response to the zoom-in / zoom-out operation. 19 and 20A show four images arranged in a row in image area 128, Fig. 20B shows two images arranged in a row, and Fig. 20C shows one image arranged vertically on the screen. The user can adjust the image size as desired to view the list display.

[0109] 13, the staff terminal 1 may display the event view 200 as shown in FIG. 21 or 22 instead of the time view 120. In the event image list display in step S211 of FIG. The event view 200 also has an image area 128 where images are displayed in a list, but in this case, sub-event and scene divisions are set for each image, and the list is displayed in sub-event and scene units. FIG. 21 shows a state in which the index bar 201 is displayed in the event view 200, and FIG. 22 shows a state in which the index bar 201 is not displayed. The event view 200 will be described in more detail below.

[0110] In the time view 120 and the event view 200, an event title 121 is displayed, and also an all flags icon 123, a next icon 132, a communication icon 134, a menu icon 127, and the like are displayed.

[0111] The menu icon 127 is an operator for displaying various menu items. The communication icon 134 is an icon for displaying the status of FTP communication with the image capture device 2, etc. The all flag icon 123 is an operator for setting on / off the selection flag for all images, which indicates that the images are to be used in the image album. The next icon 132 is an operator for transitioning to the next screen.

[0112] As described above, the time view 120 and the event view 200 have an image area 128 in which images transferred from the imaging device 2 are displayed as a list of thumbnails, and an all tab 125 and a candidate tab 126 are provided for displaying the image area 128. When the all tab 125 is selected, images transferred from the imaging device 2 are displayed in the image area 128 regardless of whether the selection flag is on or off. For example, assume that Fig. 19 shows a list display when the all tab 125 is selected. On the other hand, when the candidate tab 126 is selected, only images for which the selection flag is set to ON are displayed in the image area 128, out of all images transferred from the imaging device 2. For example, Fig. 23 shows an example of the list display when the candidate tab 126 is selected. The selection flag is set to ON / OFF by the camera staff for each image depending on whether or not the image should be used in the web gallery.

[0113] The number of corresponding images is also displayed in the all tab 125 and the candidate tab 126. In FIG. 23, "2065" is the number of images displayed in the all tab 125, and "54" is the number of images displayed in the candidate tab 126.

[0114] A view switching button 202 is displayed in the time view 120 and the event view 200. When "Time" is selected as shown in Fig. 19, the time view 120 is displayed. When "Event" is selected as shown in Fig. 21, the event view 200 is displayed. The user can arbitrarily switch between the list display in the time view 120 and the event view 200. For example, the view switching button 202 alternates between "Time" and "Event" each time it is tapped.

[0115] 20B, 20C, and 21, a closed eyes icon 210 may be displayed for each image in the image area 128 in the time view 120 and the event view 200. This is to present an image in which the subject person has their eyes closed using the icon based on the closed eyes information described above. It may be difficult to determine whether a person has their eyes closed, particularly when a relatively small thumbnail image is displayed as in Figure 20B or Figure 21. The closed eyes icon 210 is useful for confirming the image by indicating the closed eyes state.

[0116] However, in this example, the closed eyes icon 210 is not displayed in Fig. 20A. This is because if the thumbnail images are made extremely small and multiple images are to be viewed at once, displaying the closed eyes icon 210 would clutter the screen. However, even in such cases, examples in which the closed eyes icon 210 is displayed can be considered.

[0117] For each image in the image area 128 in the time view 120 and the event view 200, a rating icon 130 and a flag setting icon 131 are displayed in association with the image, as shown in FIGS. 20B, 20C, and 21.

[0118] The rating icon 130 not only displays rating information set by the number of stars, but also serves as an operator for changing the rating. For example, the number of stars can be changed by tapping or sliding the rating icon 130, which is a rating change operation. The flag setting icon 131 indicates whether the selection flag is on or off by, for example, changing the color or brightness of the icon. The flag setting icon 131 is also used as an operator for switching the selection flag on or off. For example, the selection flag can be switched on or off by a tap operation.

[0119] 20A does not display the rating icon 130 and the flag setting icon 131. This is because the rating icon 130 and the flag setting icon 131 are displayed when the display corresponding to the image is sized to be easy to see or operate, as in FIG. 20B. Of course, even in the state of FIG. 20A, the rating icon 130 and the flag setting icon 131 may be displayed corresponding to the image.

[0120] A filter designation area 129 is also provided in the time view 120 and the event view 200. A rating designation icon 137 in the filter designation area 129 allows images to be narrowed down by rating them, for example, on a six-level scale. For example, an operator is provided as the number of stars, and filtering is performed according to the designated operator, and the extracted images are displayed in a list in the image area 128.

[0121] For example, when a three-star control is operated, images with rating information of "three stars" or higher (i.e., images that fall into any of "three stars," "four stars," and "five stars") are extracted and displayed in a list. Alternatively, in this case, only images with rating information of "three stars" may be extracted and displayed in a list.

[0122] In the filter designation area 129, a rating designation icon 137 expressed by the number of stars is displayed, along with the number of images to which that rating has been set. Furthermore, a filter operation icon 136 is displayed in the filter specification area 129. By operating the filter operation icon 136, it is possible to set filter conditions other than the rating and to filter the displayed image.

[0123] In the state where the staff terminal 1 has displayed the time view 120 or the event view 200 as described above in step S211 of FIG. 13, the staff terminal 1 performs the monitoring loop process from step S212 to step S222 of FIG.

[0124] 13, the staff terminal 1 monitors the operation of the next icon 132. The process when the operation of the next icon 132 is detected will be described later.

[0125] In step S213, the staff terminal 1 monitors a tab switching operation. A tab switching operation is an operation on the candidate tab 126 while the list of all tabs 125 is displayed, or an operation on the all tab 125 while the list of candidate tabs 126 is displayed. When the tab switching operation is detected, the staff terminal 1 performs processing to switch the list display contents in the image area 128 in accordance with the selected tab in step S240.

[0126] In step S214, the staff terminal 1 monitors the operations relating to the screen state performed on the image area 128 by the camera staff. The operations relating to the screen state here include operations such as enlarging / reducing an image, scrolling the screen, and making a displayed item appear / disappear.

[0127] For example, the staff terminal 1 monitors pinch operations. The pinch operations here include pinch out operations for enlarging an image and pinch in operations for reducing an image. When the pinch operation is detected, the staff terminal 1 enlarges or reduces the display state in the image area 128 in step S241.

[0128] 20A, 20B, and 20C show examples of changes in the display of image area 128 in response to pinch-in / pinch-out. Figure 20A shows the smallest displayed thumbnail images. When a pinch-out operation is performed, the images displayed as a list are enlarged as shown in Figure 20B. When a further pinch-out operation is performed, the images are enlarged as shown in Figure 20C. Furthermore, when a pinch-in operation is performed, the screen shrinks from the state of FIG. 20C to the state of FIG. 20B, and further pinch-in operation returns it to the state of FIG. 20A. As described above, the display of the closed eye icon 210, rating icon 130, flag setting icon 131, etc. is also switched depending on whether the image is enlarged or reduced.

[0129] In step S214, the staff terminal 1 also monitors swipe operations. For example, in the time view 120 shown in Fig. 19 or the event view 200 shown in Fig. 21, an up / down swipe operation is recognized as a vertical scroll operation, and the display is scrolled vertically in step S241. Furthermore, a left or right swipe operation on the event view 200 is recognized as a left or right scroll operation, and the staff terminal 1 scrolls the display horizontally in step S241. Furthermore, the staff terminal 1 recognizes, for example, a swipe operation to the right on the index bar 201 in the event view 200 in Fig. 21 as an operation to erase the index bar 201, and recognizes a swipe operation from the right edge of the screen to the left in the state of Fig. 22 as an operation to call up the index bar 201. Then, in step S241, display control is performed to close or reveal the index bar 201.

[0130] 13, the staff terminal 1 monitors whether or not an operation has been performed to select one of the images displayed in the image area 128. For example, this is an operation such as tapping on one of the thumbnail images. The processing performed when this selection operation is detected will be described later.

[0131] In step S216, the staff terminal 1 monitors the filter operation, that is, the operation of the rate designation icon 137 in the filter designation area 129 or the operation of the filter operation icon 136. If an operation of any of the controls in the filter designation area 129 is detected, the staff terminal 1 proceeds to step S242, sets and stores filter conditions according to the operation, performs filtering processing according to the filter conditions, and extracts corresponding images. The extracted images resulting from the filtering are then displayed in a list in the image area 128. In step S243, the end of the filtering process is detected, and the process returns to the monitoring loop. A specific example of the processing in steps S242 and S243 when the filter operation icon 136 is operated will be described later.

[0132] 14, the staff terminal 1 monitors rating operations, such as operations on the rating icons 130 shown in FIGS. 20B, 20C, and 21. If an operation on the rating icon 130 is detected, the staff terminal 1 proceeds to step S230 and updates the event data 60 so that the rating information of the image corresponding to the rating icon 130 has a value according to the operation. Also, in step S231, the staff terminal 1 transmits the updated rating information to the server device 4, so that the event data 90 is updated on the server device 4 side. That is, a synchronized state is maintained.

[0133] In step S218, the staff terminal 1 monitors flag on / off operations, such as operations on the flag setting icon 131 shown in FIGS. 20B, 20C, and 21. If an operation on the flag setting icon 131 is detected, the staff terminal 1 proceeds to step S232 and updates the event data 60 so that the selection flag as selection information for the image corresponding to the flag setting icon 131 is switched on / off. In step S233, the staff terminal 1 transmits the updated flag information to the server device 4, so that the event data 90 is updated on the server device 4 side. That is, the synchronized state is maintained.

[0134] In step S219, the staff terminal 1 monitors the operation of the all flag icon 123. If an operation on the all flag icon 123 is detected, the staff terminal 1 proceeds to step S234, where the process branches depending on whether the selection flags of all images are currently on. If some images have flags on or all have flags off, and not all images have flags on, the staff terminal 1 proceeds to step S236, where it updates the event data 60 so that the flags of all images are on. On the other hand, if the all flags icon 123 is operated when all the images are flagged on, the staff terminal 1 proceeds to step S235 and updates the event data 60 so that the flags for all the images are set to off. In step S237, the staff terminal 1 transmits the updated flag information to the server device 4, so that the event data 90 is updated on the server device 4 side. That is, the synchronized state is maintained.

[0135] 15, the staff terminal 1 monitors the operation of switching to the time view 120. That is, this is the case when, while the event view 200 is being displayed, an instruction to display the time view 120 is given by operating the view switching button 202. In this case, the staff terminal 1 proceeds to step S350 and performs processing to switch to the time view 120 display.

[0136] In step S221, the staff terminal 1 monitors the operation of switching to the event view 200. That is, this is the case when, while the time view 120 is being displayed, an instruction to display the event view 200 is given by operating the view switching button 202. In this case, the staff terminal 1 performs the processes shown in steps S351 to S359. Details of these processes will be described later together with the explanation of the image transition related to the event view 200.

[0137] In step S222, the staff terminal 1 monitors an update operation for the scene setting. The scene setting refers to the setting of sub-events and scene divisions in the event view 200, and the update here refers to recalculation of the division determination process. In response to this update operation, the staff terminal 1 performs the processes of steps S360 to S363, which will also be described later as processing related to the event view 200.

[0138] After the monitoring process up to step S222, the staff terminal 1 returns to step S211 in FIG. 13 and repeats the monitoring process.

[0139] Next, the process when an image selection operation is detected in step S215 of FIG. 13 will be described. That is, this is the case when the user performs an operation to select one image from the list in the time view 120 or the event view 200. In this case, the process of the staff terminal 1 proceeds to step S250 in FIG. 16, and a single image display screen 140 as shown in FIG. 24 is displayed.

[0140] The single image display screen 140 is provided with a single image display area 142 in which a selected image is displayed in a large size. The image displayed in this single image display area 142 is, for example, an image based on edited image data managed by the event data 60. That is, it is edited image data generated by the auto-retouch application process in step S107 of FIG. 11, and is a reproduced image of image data that reflects the retouching parameters in the preset information 61. A focus point mark 148 may also be displayed on the image to indicate the in-focus position within the image.

[0141] The single image display screen 140 also displays a back icon 133, which is an operator for returning the display to the time view 120 or the event view 200, a filter condition icon 138 for displaying the filter conditions, a rating icon 130 for the displayed image, and a flag setting icon 131.

[0142] If the closed eyes information for that image indicates a closed eyes state, a closed eyes icon 210 is displayed.

[0143] Additionally, the single image display screen 140 displays an edit icon 145 for operations relating to the displayed image, a focus point operation icon 146, an export icon 149, an archive icon 135, and an original icon 141.

[0144] With such a single-image display screen 140 displayed, the staff terminal 1 performs a monitoring loop process from step S251 to step S259 in FIGS.

[0145] In step S251, the staff terminal 1 monitors the operation of the edit icon 145. If an operation of the control of the edit icon 145 is detected, the staff terminal 1 proceeds to step S260 and displays an edit screen (not shown). The edit screen provides a user interface that allows, for example, retouching and tilt correction operations, and the camera staff can perform image editing operations using the user interface. In the retouching operation, for example, brightness adjustment values, color adjustment values, contrast adjustment values, sharpness adjustment values, etc. can be set as retouching parameters. As the tilt correction operation, for example, an operator for adjusting the angle of the image is provided. The editing screen may be a screen separate from the single image display screen 140, or may be a screen that is superimposed on the single image display screen 140 and displays various controls.

[0146] If the staff terminal 1 detects a retouching operation, the process proceeds from step S261 to step S262, where the retouching process is performed. This is a process in which the edited image data is further edited using the retouching parameters input by the camera staff. The retouching parameters input in this case are stored in the event data 60 as editing information for each individual image data.

[0147] If the staff terminal 1 detects a tilt correction operation, the process proceeds from step S263 to step S264, where the image tilt correction process is performed. This is a process of editing the edited image data using the tilt correction parameters input by the camera staff's operation. The tilt correction parameters input in this case are stored in the event data 60 as editing information for each individual image data.

[0148] When the end of the editing operation is detected in step S265, the staff terminal 1 transmits the editing information of the event data 60 updated in accordance with the editing process to the server device 4 in step S266, so that the event data 90 is updated on the server device 4 side. In other words, the synchronized state is maintained. In step S267, the staff terminal 1 ends the editing screen and returns to the normal single image display screen 140. The image displayed at this time reflects the editing results. In this way, by operating the edit icon 145, the camera staff can retouch or correct the tilt of any image.

[0149] In the display state of the single image display screen 140, the staff terminal 1 monitors the operation of the focus point operation icon 146 in step S252. If an operation of the focus point operation icon 146 is detected, the staff terminal 1 proceeds to step S270, and branches the processing depending on whether or not the focus point mark 148 is currently displayed on the image in the single image display area 142. If the focus point mark 148 is not currently being displayed, the staff terminal 1 proceeds to step S271 to acquire focus point information for the displayed image. The focus point is information that indicates the position in the image that the imaging device 2 focused on when capturing the image, and is described in the metadata. For example, the focus point is described as the coordinate information of a point in the image.

[0150] The staff terminal 1 acquires focus point information from the metadata of the displayed image and, in accordance with that information, displays a focus point mark 148 on the displayed image, as shown in Fig. 24. For example, the focus point mark 148 may be displayed as an area of ​​a predetermined extent, centered on the coordinate information of a point in the image stored as the focus point. This allows the user to confirm the subject that was in focus when the image was captured.

[0151] 24, the focus point mark 148 is displayed as a mark indicating the four corners (a square in parentheses), but other display forms are also possible, such as a rectangular frame or a circular frame.More than one focus point mark 148 may also be displayed. Also, as shown in Figure 24, the focus point mark 148 is displayed on a single image display screen, but the focus point mark 148 may also be displayed on an image displayed in a list in the image area 128 of the time view 120 or event view 200, for example.

[0152] If an operation of the focus point operation icon 146 is detected in step S252 while the focus point mark 148 is being displayed, the staff terminal 1 proceeds from step S270 to step S273, and ends the display of the focus point mark 148. Therefore, the cameraman can use the focus point operation icon 146 to turn on / off the display of the focus point mark 148 .

[0153] In step S253, the staff terminal 1 monitors the on / off operation of the filter condition display. That is, it monitors the operation on the filter condition icon 138. In that case, the staff terminal 1 proceeds to step S268 and controls the display related to the filter condition setting as will be described later with reference to FIG.

[0154] The staff terminal 1 monitors the operation of the export icon 149 in step S254 of FIG. 17 while the single image display screen 140 is displayed. If an operation on the export icon 149 is detected, the staff terminal 1 proceeds to step S280 to perform export processing, that is, to perform export processing on information relating to the displayed image data.

[0155] In step S255, the staff terminal 1 monitors the image switching operation. In this case, the image switching operation is the operation of the original icon 141. When an operation of the original icon 141 is detected, the staff terminal 1 proceeds to step S281 and switches between an image based on the original image data and an image based on the edited image data. That is, if a playback image based on the edited image data was being displayed at that time, the playback image based on the original image data is displayed. Also, if a playback image based on the original image data was being displayed at that time, the playback image based on the edited image data is displayed. Therefore, by operating the original icon 141, the camera staff can compare the edited image with the original image at will.

[0156] On the single image display screen 140, a rating icon 130 for the image currently being displayed is displayed. In step S256, the staff terminal 1 monitors the rating operation. If an operation on the rating icon 130 is detected, the staff terminal 1 proceeds to step S282 and updates the event data 60 so that the rating information of the displayed image is set to a value according to the operation. In step S283, the staff terminal 1 transmits the updated rating information to the server device 4, so that the event data 90 is updated on the server device 4 side. That is, a synchronized state is maintained.

[0157] On the single image display screen 140, a flag setting icon 131 for the image currently being displayed is displayed. In step S257, the staff terminal 1 monitors the flag on / off operation, that is, the operation of the flag setting icon 131. If an operation on the flag setting icon 131 is detected, the staff terminal 1 proceeds to step S284 and updates the event data 60 so that the flag in the selection information of the displayed image is switched on / off. In step S285, the staff terminal 1 transmits the updated flag information to the server device 4, so that the event data 90 is updated on the server device 4 side. That is, the synchronized state is maintained.

[0158] In step S258, the staff terminal 1 monitors the archive operation for the image. If an archive operation is detected, the staff terminal 1 performs the processes of steps S390 to S395. These processes related to archiving will be described later.

[0159] In step S259, the staff terminal 1 monitors whether the return icon 133 is operated. When the operation of the back icon 133 is detected, the staff terminal 1 proceeds to step S211 in FIG. 13, terminates the single image display screen 140, and returns to a state in which the time view 120 or the event view 200 is displayed.

[0160] Although not shown in the flowchart, for example, on the single image display screen 140, it is also possible to switch between the previous and next images by swiping left and right.

[0161] [5-2 Archive and Blink-Based Filtering] Here, the above-mentioned archive-related processing, processing according to blink information, and filtering processing using these will be described in detail.

[0162] First, the archive operation detected by the staff terminal 1 in step S258 of FIG. 17 will be described. FIG. 25A shows an example of an archive operation on the single image display screen 140. One is the operation of the archive icon 135. The other is a swipe up on the image, as indicated by the UP arrow. The user can archive the image displayed on the single image display screen 140 by, for example, using these two operations. In this embodiment, the archive operation is possible in the single image display screen 140, but is not possible in the list display such as the time view 120 or the event view 200. However, when a single image is displayed large in the time view 120 as shown in Fig. 20C, the archive icon 135 may be displayed, thereby enabling the archive operation.

[0163] When the staff terminal 1 detects an archive operation in step S258 of Fig. 17, it proceeds to step S390 and switches the display according to the display setting at that time. The display setting in this case is a setting for whether or not to display archived images. This can be selected by the filtering setting.

[0164] If the setting is to display archived images, the images will not be switched in response to the archive operation in FIG. 26A, as shown in FIG. 26B. In this case, the display color of the archive icon 135 is changed to indicate that the displayed image has been archived. Therefore, on the single image display screen 140, the archive icon 135 also has the function of indicating whether the displayed image has been archived.

[0165] If the setting is not to display archived images, the image will immediately switch to another image as shown in Figure 27B in response to the archive operation in Figure 27A. The image to switch to will be the next image in chronological order. If there is no next image, the previous image in chronological order will be used. Also, if there are no images that can be displayed, a message will be displayed indicating that there are no images to display, as shown in Figure 27C.

[0166] As in the above example, the staff terminal 1 switches the image according to the display setting in step S390, and displays a toast on the screen for a predetermined time (for example, about 5 seconds) for undo in step S391. An example of the toast display 220 is shown in Figure 25B. This toast display 220 notifies the user that the content has been archived and also allows the user to perform an "undo" operation.

[0167] If the user does not perform an "undo" operation, i.e., an undo operation, the staff terminal 1 proceeds from step S392 to step S393 in Fig. 17 and updates the archive information. That is, the staff terminal 1 updates the archive information of the event data 60 so that the displayed image has been archived. In step S394, the staff terminal 1 transmits the updated archive information to the server device 4, so that the event data 90 is updated on the server device 4 side. That is, a synchronized state is maintained.

[0168] On the other hand, if the user selects "undo" on the toast display 220 in step S391, that is, selects undo, the staff terminal 1 proceeds from step S392 to step S395 in Fig. 17 and returns the display. That is, if the display is switched to that shown in Fig. 27B in step S390, the display will be returned to the state shown in Fig. 27A. Also, if the archive icon 135 is changed as shown in Fig. 26B, the display will be returned to the state shown in Fig. 26A. Then, the process proceeds to step S259. In other words, in this case, the archive setting process in steps S393 and S394 is not performed. As an example of processing, it is also possible to update the archive information in steps S393 and S394 while displaying the toast 220, and if an undo operation is performed, to restore the archive information to its original state.

[0169] By enabling the archiving of images as described above, camera staff can archive images that do not need to be displayed, and in combination with the filtering described next, reduce the number of images to be displayed in a list or individually. This reduces the number of selection tasks and makes selection more efficient. In particular, archiving images that the camera staff can immediately determine not to include in the photo collection is ideal for making selections more efficient. Furthermore, images with the selection flag set to on can be archived and filtered so that they are not displayed, reducing the number of images to select from. Since archive information is treated as separate information from selection information in the event data 60, archiving does not affect the selection flag.

[0170] It is also possible to unarchive images that have been archived. For example, when an archive icon 135, which indicates that an image has been archived by changing its color, is operated, the image is unarchived.

[0171] In terms of processing, the staff terminal 1 will, in regards to the archive operation detected in step S258, if it is an unarchive operation (i.e., an archive operation on an archived image), display an unarchive dialog in step S390, update the unarchive operation in step S393, and then perform processing in step S394 accordingly.

[0172] Blink information is also mentioned. 11, the staff terminal 1 determines whether the subject has closed their eyes for the image received from the imaging device 2 and sets the closed eyes information. Then, as described above, in the time view 120, the event view 200, and the single image display screen 140, the closed eyes icon 210 is displayed for the image in which the subject has their eyes closed, based on the closed eyes information.

[0173] By combining this blink information with filtering, it is possible to reduce the number of images to be displayed in a list or individually, thereby reducing the number of selection tasks and making selection more efficient. Furthermore, the blink information does not affect the selection flag because it is treated as separate information from the selection information in the event data 60. In other words, even if an image is determined to be in a blinked state, it is possible to turn on the selection flag and include it in the image collection.

[0174] The filtering using the above blink information and archive information will now be described. As described above, the filter operation icon 136 is displayed in the time view 120 and the event view 200. 28A shows a state in which the filter operation icon 136 has been operated. By this operation, the processing of the staff terminal 1 proceeds from step S216 to step S242 in FIG. 13, and the filter conditions are set according to the operation, and filtering and corresponding display changes are performed as follows.

[0175] First, a display example for setting filter conditions is shown in Fig. 28B. A filter condition setting section 221 is displayed on the screen and can be operated by the user. This filter condition setting section 221 is provided with a close button 222, a camera condition button 223, an archive condition button 224, a blink condition switch 225, and information buttons 226 and 227.

[0176] The blink condition switch 225 is a switch for selecting whether or not to display a blink image, and the user can arbitrarily select whether or not to display the blink image.

[0177] When the archive condition button 224 is operated, an archive condition setting section 230 is displayed as shown in FIG. 28D, and the user can select the archive conditions. For example, check boxes 232 are provided for "display archived images" and "display non-archived images." It also shows the number of archived images (80) and the number of non-archived images (123).

[0178] This allows the user to - Display only archived images - Display only non-archived images - Display archived and non-archived images You will be able to choose one of the following.

[0179] Instead of displaying the archive condition button 224 (and the corresponding archive condition setting section 230), an archive condition switch may be provided similar to the blink condition switch 225, so that the filter conditions for the archive images can simply be turned on or off. In this case, the selectable conditions are as follows: - Display only non-archived images - Display archived and non-archived images It is conceivable that either of the following would be possible.

[0180] When camera condition button 223 is operated, camera condition setting section 235 is displayed as shown in FIG. 28C, allowing the user to select camera conditions. The camera conditions are conditions that specify the imaging device 2 that captured the image. Model information and serial number of the imaging device 2 are added to each image in the metadata. The camera condition setting section 235 displays imaging device information and check boxes 232 for all images of the event to be processed. For example, in this case, the model name and serial number are displayed. For imaging devices 2 whose serial number is unknown, only the model name is displayed. The number of images is also displayed for each imaging device 2. For example, in this figure, the number of images is displayed as "80," "123," and "333."

[0181] In this example, three imaging devices 2 are displayed, but if there are three or more imaging devices 2, they can be displayed by scrolling. The user can specify the imaging device 2 that captured the image by checking the check box 232, and set the filter condition so that the image of that imaging device 2 is displayed.

[0182] Every time the conditions are changed in the filter condition setting section 221, the camera condition setting section 235, or the archive condition setting section 230, the staff terminal 1 performs filtering under the new conditions and changes the resulting image display and other displays. 13, filtering is performed based on the conditions set at that time in the blink condition switch 225, archive condition setting section 230, and camera condition setting section 235. Then, extracted images resulting from the filtering are displayed in a list in the image area 128.

[0183] When the return icon 228 is operated in the camera condition setting section 235 in FIG. 28C or the archive condition setting section 230 in FIG. 28D, the display returns to the filter condition setting section 221 in FIG. 28B. 28B, 28C, or 28D, the filter condition setting unit 221, the camera condition setting unit 235, or the archive condition setting unit 230 is closed and the state returns to that of FIG. 28A. This is the case when it is determined in step S243 of FIG. 13 that the filter setting change has ended and the process returns to the monitoring loop. Note that this is not limited to the close button 222, and it may also be the case that a tap on the screen other than the filter condition setting unit 221, the camera condition setting unit 235, or the archive condition setting unit 230 is made to end the filter setting change and the process returns to the monitoring loop from step S243.

[0184] Display changes according to filtering include not only the images to be displayed, but also the display mode of the filter operation icon 136 and the display of the number of images. Fig. 29A shows the state before filtering is performed, and Fig. 29B shows the state after filtering is performed. For example, suppose that the display of closed-eye images is turned off with the blink condition switch 225, and images displayed in the image area 128 include images of closed eyes in Fig. 29A, but no images of closed eyes are displayed in Fig. 29B. Furthermore, the color of the filter operation icon 136 changes in the state of Fig. 29B after filtering, thereby indicating that the list display is after filtering. Additionally, the number of images displayed on the All Tab 125 screen changes from 2065 to 2010. This represents a reduction in the number of images due to the fact that closed-eye images are no longer displayed due to filtering.

[0185] The display of the number of images is changed immediately when the filter conditions are changed. In Figure 30A, all three imaging devices 2 are selected in the camera condition setting section 235, and the number of images from each imaging device 2 is "100," "1000," and "1065," and the number of images displayed on all tabs 125, i.e., the total number, is "2165." From this state, the user unchecks the first imaging device 2, as shown in Figure 30B, and as 100 images are hidden by filtering, the number of images displayed on all tabs 125 becomes "2065."

[0186] When the information button 226 is tapped as shown in Fig. 31A, the guidance display shown in Fig. 31B is displayed, which shows a guide to settings in the imaging device 2 for performing filtering for each model. When the information button 227 is tapped as shown in Fig. 32A, the guidance display shown in Fig. 32B is displayed, which indicates that archiving of an image can be performed on the single image display screen 140. The guidance displays in Figures 31B and 32B can be closed by pressing OK.

[0187] The above-mentioned processes such as setting filter conditions, filtering, changing display, and displaying guidance are performed in step S242 of FIG. This filtering can turn on / off the display of archived images, closed-eye images, and images for each model of the imaging device 2. This makes the user's selection more efficient. Note that filter processing only determines whether or not an image is displayed on the screen. Even if an image is hidden by filter processing, it does not affect whether or not it is included in the image gallery. In other words, it does not affect the setting of the selection flag.

[0188] Hiding images through filtering is also effective when displaying the candidate tab 126, meaning that even if the selection flag is turned on, some images may be hidden in the candidate tab 126. This can be used to reduce the number of images displayed in the candidate tab 126 when reconsidering images that have already had their selection flag turned on. For example, by moving from the candidate tab 126 to the single image display screen 140, archiving the images to be used for delivery, and then hiding the archived images in the candidate tab 126, the number of choices can be reduced when selecting images for which the selection flags are to be removed.

[0189] However, when images extracted using the selected filter conditions are displayed, it is desirable to clearly indicate to the user that not all images are being displayed. For this reason, the display mode of the filter operation icon 136 is changed, as shown in FIG. 29B. For example, the color is changed. This allows the user to recognize that not all images are being displayed even if the all tab 125 is selected.

[0190] On the other hand, in the case of the single image display screen 140, it is convenient to be able to know the current filter conditions. Therefore, in the single image display screen 140, as shown in Fig. 33A, by operating the filter condition icon 138, the filtering condition display of Fig. 33B is performed. That is, the setting status of the rating conditions, the imaging device model conditions, the display of archived / non-archived images, and the display of closed-eye images is displayed. This corresponds to the processing of steps S253 and S268 in Fig. 16. By displaying the current filtering conditions, the user can recognize the conditions under which the current image is being displayed.

[0191] Note that performing an OK operation on the filtering condition display in Fig. 33B corresponds to the operation of turning off the filtering condition display in step S253 in Fig. 16. In this case, the filtering condition display in Fig. 33B is ended in step S268.

[0192] [5-3 Cover, Highlight Selection] Next, a process when an operation on the next icon 132 is detected in step S212 of FIG. 13 will be described. In this case, the process of the staff terminal 1 proceeds to step S300 in FIG. 18, and the cover / highlight selection screen 150 shown in FIG. 34 is displayed.

[0193] The cover / highlight selection screen 150 is a screen for the camera staff to perform an operation to select an image to be used as a cover (cover page) or an image to be highlighted (highlighted) in the web gallery. The cover / highlight selection screen 150 displays a back icon 133 and a next icon 132.

[0194] The cover / highlight selection screen 150 also has a list specification area 153, a candidate tab 151, and a selection tab 152. When the candidate tab 151 is selected, a list of flagged-on images (that is, images selected to be used in the web gallery) is displayed in a list specification area 153. Also displayed for each image are a highlight button 155 and a cover button 156. The highlight button 155 is an operator for designating an image as a highlight, and the cover button 156 is an operator for designating an image as a cover. The highlight button 155 may also indicate whether or not a highlight setting is currently set, depending on its display mode, and the cover button 156 may indicate the current cover setting status, depending on its display mode. When the selection tab 152 is selected, a list of images designated as covers or highlights is displayed in a list designation area 153 .

[0195] The camera staff operates the cover / highlight selection screen 150 to select an image to be used as a cover or an image to be highlighted.

[0196] With the cover / highlight selection screen 150 displayed in step S300 of FIG. 18, the staff terminal 1 performs the monitoring loop process from step S301 to step S305.

[0197] In step S301, the staff terminal 1 monitors the operation of the cover button 156. If an operation on the cover button 156 is detected, the staff terminal 1 proceeds to step S310, sets the cover image information in the selection information so that the corresponding image is set as the cover image, and updates the event data 60. In step S311, the staff terminal 1 transmits the updated selection information to the server device 4, so that the event data 90 is updated on the server device 4 side. That is, a synchronized state is maintained.

[0198] In step S302, the staff terminal 1 monitors the operation of the highlight button 155. If an operation on the highlight button 155 is detected, the staff terminal 1 proceeds to step S320, sets the highlighted display image information in the selection information so that the corresponding image is set as the highlighted image, and updates the event data 60. In step S321, the staff terminal 1 transmits the updated selection information to the server device 4, so that the event data 90 is updated on the server device 4 side. That is, a synchronized state is maintained.

[0199] In step S303, the staff terminal 1 monitors a tab switching operation. The tab switching operation in this case is an operation of the selected tab 152 while the list of candidate tabs 151 is displayed, or an operation of the candidate tab 151 while the list of selected tabs 152 is displayed. When the tab switching operation is detected, the staff terminal 1 performs processing to switch the list display contents in the list designation area 153 in accordance with the selected tab in step S330.

[0200] In step S305, the staff terminal 1 monitors the operation of the back icon 133. If the operation of the back icon 133 is detected, the staff terminal 1 proceeds to step S211 in FIG. This allows camera crews to abort cover / highlight selections or restart selections by setting flags.

[0201] When the camera crew has completed the operations on the cover / highlight selection screen 150 , they operate the next icon 132 . 18, the staff terminal 1 monitors the operation of the next icon 132. If the operation of the next icon 132 is detected, the staff terminal 1 proceeds to step S340 and displays a confirmation screen.

[0202] 35 shows an example of a confirmation screen 160. The confirmation screen 160 has a back icon 133, a next icon 132, and a details area 161 in which the final confirmation content is displayed. For example, detailed information such as the number of images flagged for inclusion in the web gallery, the number of images to be highlighted, the title, and the date are displayed.

[0203] The staff terminal 1 monitors the operation of the next icon 132 in step S341 of FIG. 18, and monitors the operation of the back icon 133 in step S342. If the operation of the return icon 133 is detected, the staff terminal 1 returns to step S300 and returns to the display state of the cover / highlight selection screen 150.

[0204] If an operation on the next icon 132 is detected, the staff terminal 1 proceeds to step S343 and transmits a web gallery generation request to the server device 4. 12, and returns to the display state of the project list screen 110. In this case, it is also possible to proceed to step S211 in FIG.

[0205] <6. Server processing> Up to this point, the processing of the staff terminal 1 up to the selection stage in step S3 of FIG. 2 has been explained, but the processing on the server device 4 side will now be explained. Fig. 36 shows the processing of the server device 4 in response to communication from the staff terminal 1. Note that the processing of the server device 4 referred to below refers to processing performed by the CPU 71 of the information processing device 70 having the functions of Fig. 6. In Fig. 36, the processing is mainly performed by the functions of the event data management unit 40 and the image album generation unit 41.

[0206] At step S1 in FIG. 2, pre-setting information is transmitted from the staff terminal 1 to the server device 4. When the server device 4 receives the information about the project setting from the staff terminal 1, the process proceeds from step S500 to step S510, and the server device 4 performs the project setting process.

[0207] The project setting communication from the staff terminal 1 is the communication that the staff terminal 1 makes to the server in the processing from step S10 to step S13 in Fig. 9. For example, information such as the event name, date and time, and location of the created project is transmitted. Based on this information, the server device 4 sets up a new project and sets the event data 90. Furthermore, on the staff terminal 1 side, not only the project itself is set, but also auto-retouch settings, watermark settings, etc. are made, and the setting information is successively transmitted to the server device 4. The server device 4 records this information as pre-setting information 91 of the event data 90, thereby synchronizing the event data 90 with the pre-set event data 60.

[0208] At step S2 in FIG. 2, the staff terminal 1 performs the processing of step S105 in FIG. 11, and transmits the images transferred from the imaging device 2, metadata including rating information, blink information, etc. to the server device 4. When the server device 4 receives the images and metadata from the staff terminal 1, the process proceeds from step S501 to step S520 in Fig. 36, and the images and metadata are imported as information in the event data 90 of the corresponding project. The rating information in the metadata is extracted from the metadata and managed in the event data 90 in a state where it can be updated later.

[0209] At step S3 in FIG. 2, various information for maintaining synchronization with the imaging device 2 is transmitted from the staff terminal 1 to the server device 4 during the process of the staff terminal 1 in FIGS.

[0210] When the server device 4 receives the rating information from the staff terminal 1, the process proceeds from step S502 to step S530 in FIG. 36, and updates the rating information for the corresponding image in the event data 90 of the corresponding project.

[0211] When the server device 4 receives the selection information from the staff terminal 1, the process proceeds from step S503 to step S540, and updates the selection information for the corresponding image in the event data 90 of the corresponding project. That is, the server device 4 also successively updates the image information used by the flag setting, the cover image information as the cover, and the highlighted image information by the highlight setting.

[0212] When the server device 4 receives the editing information from the staff terminal 1, the process proceeds from step S504 to step S550, and updates the editing information for the corresponding image in the event data 90 of the corresponding project.

[0213] When the server device 4 receives the archive information from the staff terminal 1, the process proceeds from step S505 to step S555, and updates the archive information for the corresponding image in the event data 90 of the corresponding project.

[0214] When the server device 4 receives the web gallery editing information from the staff terminal 1, the process proceeds from step S506 to step S560. This is the information sent by the staff terminal 1 in step S343 of FIG. 36, the server device 4 first performs image editing processing using parameters as editing information (including editing information based on the preset information 61) for each image flagged as use image information, and writes out the images as images for the web gallery. That is, it generates each edited image to be stored in the image folder 97 in FIG. 8.

[0215] In step S561 of Fig. 36, the server device 4 performs a web gallery generation process. That is, the server device 4 generates the web page setting information 96 of Fig. 8 as HTML data, for example, and enters it as a web page. This creates a web gallery. 36, the server device 4 transmits the URL (uniform resource locator) of the web gallery to the staff terminal 1. This enables the staff terminal 1 to view the web gallery. At this point, the web gallery is still set to private and can only be viewed on staff terminal 1, the URL destination.

[0216] The above is the processing of the server device 4 corresponding to the processing of the staff terminal 1 up to step S3 in FIG. Although not shown in FIG. 36, a process of providing the event data 90 to the staff terminal 1 that has logged in to the server device 4 is performed as needed (see the description of step S201 in FIG. 12).

[0217] After the web gallery is generated, a share request is sent from the staff terminal 1 to the server device 4 in step S4 of FIG. 2 (described later with reference to FIG. 37). In this case, the staff terminal 1 proceeds from step S507 to step S570 in Fig. 36 and sets the corresponding web gallery to public, so that it can be viewed from the client terminal 5, for example.

[0218] <7. Web Gallery Delivery Processing> The process of the staff terminal 1 at the stage of the web gallery delivery process in step S4 of FIG. 2 will be described with reference to FIG. When a web gallery generation request is sent to the server device 4 as described above, the server device 4 generates a web gallery based on the event data 90, and the URL of the web page is sent. Figure 37 shows the processing of the staff terminal 1 after the URL is acquired.

[0219] The staff terminal 1 accesses the web page using the URL acquired in step S370, thereby allowing the staff terminal 1 to preview the web gallery. This is a preview for the camera staff to check, and the web gallery for this preview will look like a preview screen 180 in FIG. 38, for example. For example, the created web gallery is displayed in a preview area 183, and an edit button 181 and a share button 182 are provided.

[0220] The web gallery content displayed in the preview area 183, i.e., the web gallery created by the server device 4, is configured by arranging images with flags set to "on," for example, in chronological order. An image with cover image information set is displayed at the top as the cover. Images that are highlighted using highlight image information are displayed in a larger size than images that are not highlighted. Note that even images that are not highlighted may be automatically displayed in a larger size. This is done to add balance and emphasis to the gallery as a whole.

[0221] The staff terminal 1 monitors the browsing end operation in step S371 of FIG. 37, monitors the operation of the edit button 181 in step S372, and monitors the operation of the share button 182 in step S373. When an operation to end browsing is detected, web page viewing is terminated. When the operation of the edit button 181 is detected, the staff terminal 1 proceeds to step S380 and performs editing processing.

[0222] The camera staff can check the web gallery contents in the preview area 183 and, if necessary, operate the edit button 181 to perform further editing. In the editing process of step S380, the staff terminal 1 displays an interface image for editing, accepts operations by the camera staff, and edits the preview image accordingly. For example, the background color, title font, title color, title position, slideshow music, etc. can be edited. Then, in response to the edit completion operation, the edit information is transmitted to the server device 4 so that the edit operation is reflected in the web gallery.

[0223] The camera staff member performs editing operations as necessary and then operates the share button 182. In this case, the staff terminal 1 proceeds to step S381 and transmits a share request to the server device 4. As described above, in response to the share request, the server device 4 sets the web gallery to be public in step S570 of FIG.

[0224] In step S382 of FIG. 37, the staff terminal 1 displays a screen indicating the completion of delivery of the web gallery and performs processing corresponding to the operation on the screen. For example, the staff terminal 1 displays a web gallery delivery screen 190 shown in Fig. 39. This web gallery delivery screen 190 displays a notification that the web gallery has been created, a validity period, and a web gallery URL 193. Also displayed are a copy button 191 and a share button 192. The camera staff can operate the copy button 191 to copy the URL, attach it to an email or the like, and send it to the client terminal 5. They can also operate the share button 192 to provide the URL to an SNS or the like, allowing clients to view the web gallery via the SNS. This allows clients to view the web gallery as early as possible, such as after the wedding ceremony is over, or on the day itself. Note that distributing a URL to a client to allow the client to view the image collection as a web gallery is one example. For example, image collection content equivalent to the above-mentioned web gallery may be created and distributed to the client as a content file.

[0225] <8. Final delivery processing> The actual delivery process is carried out at step S5 in FIG. 40 shows the process at the final delivery stage. This process is carried out, for example, on the personal computer 3 or the staff terminal 1. The following description will be given assuming that the process is carried out on the personal computer 3.

[0226] The camera staff operates the personal computer 3, accesses the server device 4 in step S400, and issues a request to read information for the actual delivery. Then, in step S401, the event data 90 is acquired from the server device 4. For example, in this case, the server device 4 may allow rating information and selection information or editing information to be downloaded as an XMP file so that it can be applied to the RAW image file in the personal computer 3. That is, the rating information, used image information indicating that the image has been flagged, cover image information indicating that the image has been used as a cover image, and highlighted image information indicating that the image has been highlighted are transferred to the personal computer 3. All of the event data 90 may be provided to the personal computer 3 .

[0227] The camera crew imports RAW image data captured by the imaging device 2 into the personal computer 3, and uses this RAW image data to create the image collection for delivery. In this case, obtaining an XMP file based on the event data 90 from the server device 4 can make the creation process more efficient.

[0228] In step S402, the personal computer 3 performs the necessary editing processes to complete the image collection for delivery. Thereafter, in step S403, processing for actual delivery is performed, such as generating content data as image album content, transmitting it electronically, recording it on a recording medium, or making it into print data. The created content data, a recording medium on which the content data is recorded, or a printed collection of images on paper is then delivered to the client.

[0229] <9.Event View> The event view 200 shown in FIGS. 21 and 22 will be described. The event view 200 differs from the time view 120 in the way images are arranged in the image area 128 . A series of images from an event such as a wedding ceremony is divided into sub-events and scenes, and images of one scene are arranged horizontally in image area 128. Then, each scene and each sub-event is arranged vertically.

[0230] For each sub-event, an event title section 240 is displayed. The event title section 240 indicates the name of the sub-event, such as "Ceremony" or "Cocktails." However, names such as "event1," "event2," etc. may be used more regularly. The event title section 240 also displays the number of images included in the sub-event, the time when the sub-event took place, and the like.

[0231] Furthermore, sub-events are divided into scenes, and the name of each scene is displayed as a scene title section 241. For example, it is set as "Scene 1", "Scene 2", etc.

[0232] The names of sub-events and scenes may be input by the user or may be selected from preset candidates. If sub-events and scenes can be predicted for each event type, name candidates may be prepared and the user may select one, or the names may be automatically determined from the image content.

[0233] The images of one scene are arranged horizontally, and each image appears when you scroll horizontally. In the example in Figure 21, the sub-event "Ceremony" is divided into "Scene 1," "Scene 2," and "Scene 3," which are then followed by a sub-event called "Cocktails," and these are arranged vertically. By scrolling vertically, the sub-events and scenes appear in chronological order.

[0234] An update button 203 is displayed in the event view 200. This is an operator that instructs updating of the division of sub-events and scenes.

[0235] An index bar 201 can be displayed in the event view 200. The index bar 201 displays, for example, the time and title of each sub-event. This allows the number and types of sub-events to be displayed at a glance. When there are many sub-events, the index bar 201 itself can be scrolled. The index bar 201 also functions as a jump operation section for displaying sub-events. For example, by tapping the "Party Time" portion of the index bar 201, the display jumps in the vertical scroll direction, and images of each scene in the "Party Time" sub-event are displayed. A tap operation on the index bar 201 is detected in step S214 of FIG. 13, and a display jump is performed as the processing of step S241.

[0236] It is also possible to configure the index bar 201 to automatically disappear after being displayed for a predetermined time when the event view 200 is displayed. In this case, the user can call up the index bar 201 by swiping from the right edge of the screen. Also, while the index bar 201 is displayed, the index bar 201 may be closed by swiping to the right from the position of the index bar 201. The processing corresponding to these types of swipes also corresponds to the processing in steps S214 and S241 in FIG.

[0237] For each image, a close eye icon 210, a rating icon 130, and a flag setting icon 131 are displayed, and ratings and selection flags can be set in the same way as in the time view 120.

[0238] In the event view 200, switching between the all tab 125 and the candidate tab 126 is also possible, just like in the time view 120. The event view 200 also has a filter specification area 129, which allows the above-mentioned filtering function to be realized.

[0239] FIG. 41 shows the display switching. 13. When proceeding from the project list screen 110 shown in Fig. 10 to step S211 in Fig. 13, the time view 120 or the event view 200 is displayed. In this case, which view is displayed may be, for example, the view that was last selected the previous time the event was viewed. As described above, the time view 120 and the event view 200 can be switched by the view switching button 202 .

[0240] It is conceivable that the filtering conditions are maintained even when switching from the time view 120 to the event view 200. In other words, if filtering has been performed in the time view 120 and then the view is switched to the event view 200, images according to the filtering conditions are displayed in the event view 200. For example, if filtering conditions are set so that archived images are not displayed, the archived images will not be displayed when switching to the event view 200. Of course, the filter conditions can also be changed in the event view 200 using the filter operation icon 136.

[0241] When an image is selected from the time view 120 or the event view 200, the display shifts to the single image display screen 140. When the return icon 133 on the single image display screen 140 is operated, the display returns to the time view 120 or the event view 200 as the list state before the shift to the single image display screen 140.

[0242] Such screen transitions allow the user to arbitrarily switch between the time view 120 and the event view 200 as list displays. The difference between the time view 120 and the event view 200 is shown in FIG. Fig. 42 shows the arrangement of images in the time view 120. For example, as shown in Fig. 20B, this is the case when two images are displayed horizontally on the screen.

[0243] The images are simply arranged in chronological order based on the time they were taken. The user can scroll vertically to view each image. However, in other words, if you want to view an image from a specific sub-event, you will need to roughly determine the time and scroll vertically for a long time to reach the desired image.

[0244] In contrast, the image layout of the event view 200 is as shown in FIG. 42B. Each scene is arranged vertically, and multiple images of one scene are arranged horizontally. When searching for an image within one scene, horizontal scrolling is used to display each image of that scene within image area 128. Sub-events and scenes are arranged vertically, so if there is a sub-event you want to check the image for, you can reach that sub-event's scene relatively quickly by scrolling vertically. Furthermore, within the scene you want to check, the images are arranged horizontally, making comparison easy. From the above, the event view 200 has the advantage over the time view 120 that it is easier to access each image and easier to compare images of the same scene for selection.

[0245] Note that multiple images from one scene are arranged horizontally in one row, but if the number of images in a scene becomes excessive, horizontal scrolling becomes long and usability may decrease. Therefore, an upper limit is set on the number of images that can be arranged horizontally. For example, the maximum number of images that can be arranged horizontally is 30. If the number of images in a scene exceeds this limit, the next row will be used to arrange them horizontally. Therefore, images from one scene may be displayed across multiple rows.

[0246] Furthermore, when switching from the time view 120 to the event view 200, it is desirable to provide a display that is easy for the user to understand. Therefore, the display state in the event view 200 is set by focusing on the top left image in the image area 128 in the time view 120 immediately before the display is switched.

[0247] Suppose there are six images in a scene, images pct1 to pct6. In the time view 120 immediately before switching, it is assumed that image pct1 was displayed in the upper left corner of the image area 128. In this case, when switching to the event view 200, image pct1 is displayed in the upper left corner of the image area 128, as shown in Fig. 43A. In the figure, the image or part of the image enclosed by a dashed line is an image or part of an image that is not displayed at the time and will be revealed by scrolling.

[0248] Also, assume that in the time view 120 immediately before switching, image pct3 was displayed in the upper left corner of image area 128. In this case, when switching to event view 200, image pct3 is displayed in the upper left corner of image area 128, as shown in FIG.

[0249] Suppose that in the time view 120 immediately before switching, image pct6, which is the end of the scene, was displayed in the upper left corner of the image area 128. In this case, when switching to the event view 200, it is not particularly appropriate to have image pct6 displayed in the upper left corner of the image area 128. Therefore, as shown in Figure 43C, the system is set up so that at least image pct6 is displayed.

[0250] As described above, if the image in the upper left corner of the time view 120 remains in the upper left corner even when switching to the event view 200, the user will not be confused even when the display is changed. Even if it is not possible to display it in the upper left corner after switching, it is desirable to at least keep the same image displayed.

[0251] Next, FIG. 44 shows the display switching between the all tab 125 and the candidate tab 126 in the event view 200. In the all-tab 125 display in FIG. 44A, all images are displayed for each scene. In the display of the candidate tab 126 in FIG. 44B, images with the selection flag set to ON are displayed for each scene.

[0252] In the display of the candidate tab 126, an event title section 240 and a scene title section 241 are displayed, and images of each scene are arranged horizontally. Furthermore, the event title section 240 is displayed even for sub-events and scenes for which no images have been selected in the candidate tab 126. For example, in Fig. 44B, the sub-event "EVENT2" has no images with the selection flag turned on, and the number of images is set to "0." Furthermore, the scene "SCENE1" in the sub-event "EVENT3" does not have an image with the selection flag turned on, but the scene title portion 241 is displayed.

[0253] By viewing such candidate tabs 126, the user can check what images have been selected for use in the image collection (selection flags are on), or how many images have been selected, for each sub-event or scene, which is also useful in considering the balance of image content and number for each sub-event or scene.

[0254] The display of the event view 200 as described above involves the processes of steps S351 to S359 and steps S360 to S363 in Fig. 15. These processes will be described below.

[0255] 15, when a switching operation from the time view 120 to the event view 200 is detected, the staff terminal 1 proceeds to step S351 and branches the processing depending on whether or not the request is for the first display of the event view 200 for the currently targeted event (an event set as one project). The first time can also be said to be a state in which the delimiter information 63 is not stored in the event data 60 in FIG. If it is not the first time, the process proceeds to step S355, but if it is the first time, in step S352 it is determined whether the number of images for the event in question is less than a predetermined number, for example, 100.

[0256] If the number of images is less than the predetermined number, the staff terminal 1 displays a dialog box in step S353 to confirm the event view display, and asks the user to select OK or cancel. For example, a large number of images is preferable for accurately classifying sub-events and scenes and appropriately displaying the event view 200. If the number of images is small, appropriate scene determination may not be possible. Also, if there is only one image per scene, the display of the event view 200 may not be very effective. Transitioning to the event view 200 requires a boundary determination process, which may take a few seconds to a maximum of several tens of seconds.

[0257] Therefore, such an explanation is displayed in a confirmation dialog, and if it is the first time and the number of images is less than a predetermined number, the staff terminal 1 requests confirmation from the user. If the user performs a cancel operation, the process returns to the monitoring loop. If the user performs an OK operation in response to the displayed dialog, the staff terminal 1 proceeds to step S358. The reason for asking the user for confirmation in steps S353 and S354 is to ask the user whether or not it is okay to perform the time-consuming division determination process when the number of images is small as described above and the event view 200 may not be very effective (it is not much different from the time view). The time required for the segmentation determination process varies depending on the device performance, the efficiency of the program, etc., and it is expected that the user will barely notice any waiting time. If the segmentation determination process does not require much time, the user will not have to wait even if the segmentation determination process is performed, and therefore steps S353 and S354 do not need to be performed.

[0258] Furthermore, even if the operation of switching to the event view 200 is the first time, if there are a predetermined number of images or more, the staff terminal 1 proceeds to step S358 without presenting the above-mentioned confirmation dialog. In this case, since the number of images is equal to or greater than a predetermined number, the event view 200 is assumed to be useful as a list, and a break determination process is required for this display.

[0259] Displaying the event view 200 requires that a boundary determination process be performed to determine the boundaries of sub-events and scenes for a series of images in chronological order. Therefore, when the initial switching request is accepted for the project to be processed, a break determination process is performed in step S358.

[0260] Note that a break determination process may be performed in advance prior to the first request to display the event view 200. In that case, it may be possible to proceed to step S355 even for the first time.

[0261] In step S358, a boundary determination process is performed to determine the boundaries of sub-events and scenes for each image in chronological order. Then, in step S359, the event view 200 is displayed using the information resulting from the determination process.

[0262] If the operation of switching to the event view 200 is not the first time, the staff terminal 1 proceeds from step S351 to step S355, and checks whether there is an image for which a scene has not been set. If a division determination process has been performed in the past for images of the target event and sub-event and scene divisions have been set, the event view 200 can be displayed accordingly. However, even if a division determination process has been performed in the past, if new images for the target event have been transferred from the imaging device 2 since then, those images have not been subject to the division determination process, and therefore no scenes have been set.

[0263] If there are no images for which scenes have not been set and scene boundaries have been set for all images at this point, proceed to step S359 and display the event view 200 using the information on the results of past boundary determination processing stored as boundary information 63 in Figure 5.

[0264] If it is determined in step S355 that there is an image for which a scene has not been set, the staff terminal 1 proceeds from step S355 to step S356, and displays a dialog asking whether or not to execute calculation as a segment determination process, and asks the user whether or not to execute segment determination process for updating the scene setting, because the segment determination process takes about several tens of seconds.

[0265] If the user presses OK, the staff terminal 1 performs a division determination process in step S358 to determine the division of sub-events and scenes for each image in chronological order, and then proceeds to step S359, where the event view 200 is displayed using the information resulting from the determination process.

[0266] If the user does not press OK in response to the dialog in step S356, the staff terminal 1 proceeds to step S359 without performing a new segmentation determination process, and uses information on the results of the past segmentation determination process to display the event view 200. In this case, images that are not included in the scene (images waiting to be updated) will also be displayed. Note that steps S356 and S357 ask the user whether they are willing to wait for the segmentation determination process. Therefore, if the segmentation determination process can be performed in a short time (for example, a few seconds), steps S356 and S357 may be omitted. In other words, if there is an image for which a scene has not been set, the process may proceed unconditionally from step S355 to step S358. Alternatively, the estimated time for the segmentation determination process may be determined based on the processing capacity of the staff terminal 1 and the number of images at that time, and permission may be sought from the user in steps S356 and S357 only if the estimated time is long, such as several tens of seconds. 15, when an operation to switch to the event view is detected in step S221, images for which no scene has been set are identified in step S355, and segmentation determination processing is performed in step S358. However, this is not limited to this. For example, the staff terminal 1 may sequentially check for the presence of images for which no scene has been set, and if an image for which no scene has been set is found, automatically perform segmentation determination processing and reset the event and scene. In particular, when the processing time for segmentation determination processing is extremely short or the processing load is light, it is preferable to perform segmentation determination processing as background processing. When sequential segmentation determination processing is performed automatically in this manner, it is also possible to immediately proceed to step S359 in response to detection of an operation in step S221.

[0267] An example of the boundary determination process in step S358 is shown in FIG. First, in step S601, the staff terminal 1 sorts the processing order of all images of the event, which is the project that is the target of the division determination process, by image capture time. For example, sorting is performed by referring to the image capture time in the metadata of each image. In this case, even if images may be transferred from multiple image capture devices 2, all images of the event are sorted in order of image capture time regardless of the image capture device 2.

[0268] In step S602, the staff terminal 1 sets the total number of images to be processed as the total number xmax and sets the variable x to 1. Thereafter, in step S611, the variable x is incremented and the processes from step S603 to step S609 are repeated until the variable x reaches the total number xmax in step S610.

[0269] In step S603, the staff terminal 1 acquires information about the xth image in the sorting order in step S601. For example, the image capture time is acquired from the metadata. If information exists as a result of image analysis, it is also possible to acquire information about the recognized subject, such as people, the number of people, facial recognition information, personal identification information, and item information. It is also possible to acquire various information about the time of image capture contained in the metadata, such as location information, environmental information such as ambient brightness, identification information of the image capture device, angle of view information at the time of image capture, exposure information, white balance information, and whether the image capture device is fixed to a tripod.

[0270] When the variable x=1, that is, when the first image in the time series is the target, the staff terminal 1 proceeds from step S604 to steps S610 and S611, sets x=2, and acquires information on the next image in step S603.

[0271] When information about the second or subsequent image in the sorting order is acquired, the staff terminal 1 proceeds from step S604 to step S605, and compares the acquired information with the image captured at the immediately previous image capture time.

[0272] In step S606, the staff terminal 1 determines whether or not the section between the x-th image and the (x-1)-th image in the order of image capture time satisfies the delimiting condition for the sub-event. For example, when image capture time information is acquired in step S603, if the time difference between the two images is equal to or greater than a first threshold, the sub-event boundary condition is met. For example, the first threshold may be 5 minutes.

[0273] If the sub-event boundary condition is met, the staff terminal 1 determines that the interval between the xth image and the (x-1)th image is the boundary of the sub-event, and sets one sub-event range in step S607. That is, the range of images from the boundary of the previously detected sub-event (the start time in the case of the first sub-event boundary) to the boundary of the current sub-event is set as the range of one sub-event.

[0274] If the sub-event boundary condition is not met, the staff terminal 1 proceeds from step S606 to step S608, and determines whether the scene boundary condition is met between the x-th image and the (x-1)-th image. For example, when the image capture time information is acquired in step S603, if the difference in time between the two images is equal to or greater than a second threshold, the scene separation condition is met. For example, the second threshold is set to a time shorter than the first threshold, e.g., 3 minutes.

[0275] If the scene boundary conditions are met, the staff terminal 1 determines that the section between the xth image and the (x-1)th image is a scene boundary, and sets one scene range in step S609. That is, the images ranging from the previously detected scene boundary or sub-event boundary to the current scene boundary are set as the range of one scene.

[0276] By repeating the above process until the variable x=xmax in step S610, sub-event boundaries and scene boundaries are determined among all images sorted in chronological order. When the variable x=xmax, the staff terminal 1 proceeds from step S610 to step S612, and stores the information on the determined sub-event boundary and scene boundary as boundary information 63 in the event data of FIG.

[0277] By performing such a division determination process in step S358 of FIG. 15, it becomes possible to display the event view 200 shown in FIG. 21 based on the division determination result in step S359. In particular, in the boundary determination process, by determining the boundary between sub-events and scenes based on the time difference between images arranged in order of capture time, it is possible to relatively easily realize the display of each scene in the event view 200. Furthermore, the boundary between scenes is likely to be appropriate for the cameraman.

[0278] In the boundary determination process of FIG. 45, the determination of sub-event boundaries and scene boundaries in steps S606 and S608 is based on the difference in imaging time (for example, 5 minutes and 3 minutes), but other determination conditions may also be used. The following examples are possible:

[0279] Changes in people's behavior (how far they travel) For example, by comparing the location information of each image, it is possible to detect changes in location (such as a ceremony hall, reception hall, or outdoors). Therefore, sub-events and scene divisions can be determined based on changes in location information or the amount of change. Furthermore, by storing the location information of the staff terminal 1 held by the camera staff for each time, it is possible to determine the movement trajectory, and by comparing this with the image capture time of each image, it is possible to determine the position and movement of the camera staff when each image was captured. It is also possible to determine divisions based on this information.

[0280] - Change in zoom magnification (change in angle of view) The angle of view information of each image is compared to determine the zoom state. Changing the zoom magnification is an action that the cameraman takes in response to changes in the subject's condition, and can be used as one of the elements for determining sub-events or scene divisions.

[0281] ·Facial recognition (number of faces in the photo) Changes in the number of subjects or changes in individual subjects can be considered as changes in scenes or sub-events. Sub-events and scene divisions can be determined by comparing the information resulting from image analysis between images. The image analysis information may be stored and used, for example, as image analysis information for determining whether the user has blinked. Also, the number of subjects and identification information of the subjects may be acquired from the server device 4 as the image analysis results of each image.

[0282] ·Object recognition Sub-events and scenes are determined based on the objects in each image. For example, it is possible to determine the time series of images containing a cake or a bouquet, and set the boundaries of scenes and sub-events.

[0283] Tripod detection (whether the camera is attached to a tripod) The information on the fixation state of each image is compared, and the timing when the image capture device 2 is fixed to the tripod and the timing when it is released from the fixation state are determined as the boundary between scenes and sub-events.

[0284] Exposure compensation, white balance If there is a large change in exposure compensation or white balance, it is determined to be a break between scenes or sub-events.

[0285] ·Photometric amount The current brightness is measured inside the imaging device 2, and the scene or sub-event boundary is determined by referring to this value.

[0286] The above are merely examples, but sub-events and scene boundaries can be determined based on a variety of criteria. Of course, boundary determination may be performed by combining multiple determination conditions.

[0287] Next, a process will be described when an update operation for the scene settings is detected in step S222 of Fig. 15. This is when the user operates the update button 203 in the event view 200.

[0288] In step S360, the staff terminal 1 displays a dialog box to ask the user whether it is OK to update the scene settings. This is because the update involves the above-mentioned division determination process, which may take time. If the user performs a cancel operation, the process returns to the monitoring loop from step S361. When the user performs an OK operation, the staff terminal 1 proceeds to step S362 and performs the segmentation determination process described in Fig. 45. Then, the staff terminal 1 updates the display of the event view 200 in step S363 based on the result of the segmentation determination.

[0289] For example, after the event view 200 is displayed, new images may be transferred from the imaging device 2. If the camera staff uses multiple imaging devices 2, after receiving images from one imaging device 2 and displaying the event view 200, images may be received from other imaging devices 2. These new images cannot be reflected in the sub-events or scenes in the event view 200. Therefore, it is preferable to redo the division determination process including the new images so that the display of the event view 200 can be updated. As mentioned above, it is possible that the segmentation determination process may not take much time. In such cases, steps S360 and S361 may be omitted. Alternatively, steps S360 and S361 may be performed when it is expected that the process will take a relatively long time depending on the device performance and the number of images.

[0290] Examples of interfaces for updating the event view 200 include those shown in the following FIGS. 46 and 47. 46A shows an example in which an image awaiting update is displayed in a separate frame from sub-events in the image area 128 of the event view 200. An image awaiting update is an image that has not yet been subjected to segmentation determination processing, that is, an image received after the most recent segmentation determination processing. For example, the waiting-for-update images are displayed together at a position before the first sub-event (upper in the scroll direction) or at a position after the last sub-event (lower in the scroll direction). Additionally, an update-waiting label 204 is superimposed on the update-waiting image to clearly indicate that it is an update-waiting image.

[0291] At this time, an update dialog 205 is displayed to indicate that there are images waiting to be updated, and also to function as an update operator. This display allows the user to recognize that there are images waiting to be updated, and also encourages the user to perform an update operation.

[0292] When the user performs an operation such as tapping on the update dialog 205, the staff terminal 1 starts the division determination process and displays the updating dialog 206 as shown in Fig. 46B. Then, when the division determination process is complete, the completion dialog 207 is displayed as shown in Fig. 46C. When the user taps, the display is updated as shown in Fig. 46D. In other words, all images of the event at that time, including images waiting to be updated, are displayed in a list based on sub-events and scene divisions. 46 is an example in which the user is allowed to perform other operations even during updating, so the display is updated after waiting for a tap operation on the completion dialog 207.

[0293] Other operations may be disabled during updating, as shown in Figure 47. Figure 47A is similar to Figure 46A.

[0294] When the user performs an operation such as tapping on the update dialog 205, the staff terminal 1 starts the division determination process and displays the updating dialog 206 in the center of the screen as shown in Figure 47B. It is recommended that other images be grayed out to make them inoperable. It is also possible to cancel the update. Once the boundary determination process is complete, the display is updated as shown in FIG. 47C.

[0295] <10. Summary and Variations> The above embodiment can provide the following effects. The staff terminal 1, which is an information processing device according to the embodiment, is equipped with a UI control unit 31 that performs the processes of displaying a list and individual images that allow selection of images from a group of images captured at a specific event, and detecting an archive operation for the displayed image, and an event data management unit 30 that stores archive information indicating that the image has been archived in correspondence with the image that is the target of the archive operation. By being able to arbitrarily set archives for images, camera staff can distinguish between images that will not be delivered, images that do not need to be checked, images that have already been confirmed for delivery, etc. This reduces the number of images that need to be considered for selection, promoting the efficiency of selection.

[0296] The staff terminal 1 of the embodiment is provided with a filter processing unit 33 that performs filtering based on archive information, and the UI control unit 31 controls the display so that images extracted by filtering are displayed as a list. This allows you to arbitrarily archive an image and then prevent it from being displayed in a list, etc. For example, if you archive an image that you have decided not to deliver, it will not be displayed as a selection target, reducing the number of choices and promoting the efficiency of selection.

[0297] In the embodiment, an example has been given in which it is possible to select whether or not to perform filtering based on archive information, or to select filtering conditions (see FIG. 28D). This allows the user to select whether images are displayed regardless of whether they are archived or not, to display only images that are not archived, or to display only images that are archived, and allows the user to execute display according to the circumstances at the time.

[0298] In this embodiment, the UI control unit 31 controls the provision of a user interface that allows the user to set selection information for creating an image album by selectively using image data included in the image group of the event, and the event data management unit 30 performs processing to store the archive information and selection information as separate information in the imaging / editing information table 62 of the event data 60 (see Figure 5). This allows users to set archive settings separately from selection settings. For example, users can set archive settings for a certain image without considering whether it will be included in an image collection. In other words, archive settings can be set solely from the perspective of whether it will be displayed or not. This makes it possible to archive not only images that will not be delivered, but also images that have already been confirmed for delivery, thereby reducing the number of selections.

[0299] In the embodiment, an example has been given in which the UI control unit 31 enables an archive operation for a displayed image when the image is individually displayed as the single image display screen 140. Also, in the embodiment, an archive operation for a displayed image is not possible when the image is displayed as a list such as the time view 120 or the event view 200. This allows the user to perform archive operations while viewing a single image and carefully check that image. Displaying an archive operation icon for each image in the list view clutters the screen, and it is difficult to operate the icons on small images. It is also difficult to swipe a specific image on the list view. For these reasons, allowing archive operations on the list view increases the likelihood of cluttering the screen and misoperation. Therefore, by making archive operations possible only when viewing individual images, we have made it possible to prevent misoperation and eliminate screen clutter. It is also possible to consider an example in which an image can be specified and archived when the list is displayed.

[0300] In the embodiment, the UI control unit 31 detects a swipe operation in a predetermined direction on a displayed image as an archive operation on the image (see FIG. 25). This allows users to archive any image with the intuitive operation of swiping the image up on the screen. In addition, images change according to archive operations, and images change with a horizontal swipe, providing efficient operability, such as being able to quickly check images one by one by swiping horizontally, and then archive any image by swiping upwards.

[0301] In the embodiment, when the UI control unit 31 detects an archive operation, it controls to execute a display that allows the archive operation to be canceled for a predetermined time. For example, during the archive operation, a toast message is displayed, allowing an undo instruction (see FIGS. 17 and 25). For example, when archive settings can be made with a simple operation such as swiping, it is possible that the user may archive an image that they do not intend to archive. Therefore, the archive operation can be easily canceled, allowing recovery from unintended operations.

[0302] The staff terminal 1 of the embodiment is equipped with an image analysis unit 34 that performs image analysis on each image in the image group and determines whether the subject person has closed their eyes, and the event data management unit 30 performs processing to store the closed-eye information in correspondence with images that have been determined to have closed eyes. By storing eye closure information for each image, it becomes possible to process images with closed eyes and images with open eyes separately.

[0303] In the embodiment, the UI control unit 31 controls the display of an image determined to be an image of a blink based on the blink information during list display (time view 120 or event view 200) or individual display (single image display screen 140). For example, the UI control unit 31 displays a blink icon 210 corresponding to the image. This allows the camera staff to easily determine whether or not each image shows the subject with their eyes closed. It can be difficult to tell whether or not the subject's eyes are closed, particularly in thumbnail images or so-called "wide shots." By displaying images with closed eyes using the closed-eye icon 210, as in the present embodiment, it becomes possible to efficiently identify images that will not be included in the image album.

[0304] In the embodiment, an example is given in which a filter processing unit 33 is provided that performs filtering based on blink information, and the UI control unit 31 controls the display of images extracted by filtering as a list display using the time view 120 or the event view 200. This allows selection to be made without images of closed eyes. Images of closed eyes are usually not suitable for inclusion in an image gallery, so by excluding such images from the list display and making selections, the number of choices can be reduced, making selection more efficient.

[0305] In the embodiment, it is possible to select whether or not to perform filtering based on blink information (see FIG. 28A). This allows the user to freely choose to view images excluding closed-eye images or images with closed-eye images added. Since closed-eye images may be suitable for an image collection depending on the scene or situation, it is desirable for image collection creators to be able to display closed-eye images as well.

[0306] In the embodiment, the event data management unit 30 performs processing to store the blink information and the selection information in the imaging / editing information table 62 of the event data 60 as separate information. The blinking information based on image analysis is managed separately from the selection information, so the blinking status does not affect the selection of images for the image collection. The camera crew can decide which images to include in the image collection at their own discretion, regardless of whether the eyes are blinking or not.

[0307] In this embodiment, a filter processing unit 33 is provided that performs filtering based on information about the imaging device 2 that captured the image, and the UI control unit 31 controls the display of images extracted by filtering as a list (see Figure 28C). For example, images captured by an imaging device 2 of a specific model or with a specific serial number are displayed in a list. This allows selection to be performed with images extracted for each type of imaging device 2 or each model. This is extremely useful from the perspective of speeding up selection when camera staff need to distinguish between imaging devices 2.

[0308] The staff terminal 1 of the embodiment is equipped with a division determination unit 35 that determines divisions in the time series for a group of images taken at a specific event, and a UI control unit 31 that controls the display of a division-reflecting display, i.e., an event view 200, in which all or part of the images taken within each time period separated by the divisions determined by the division determination unit 35 are arranged in a first direction (e.g., horizontal: left-right direction) and each time period is presented in a second direction (e.g., vertical: up-down direction). This event view 200 allows multiple images to be arranged horizontally (first direction) and vertically (second direction) with different meanings, making it easier to check images than simply displaying them in chronological order. Providing a UI that makes it easy to check images can promote efficient selection. The vertical direction may be the first direction and the horizontal direction may be the second direction. In other words, images from the same time period may be arranged vertically, and sub-events or scenes may be arranged in order horizontally.

[0309] In the embodiment, the UI control unit 31 controls switching between a time view 120, which is a simple chronological display in which images are displayed in order of capture time without being based on divisions, and an event view 200, which is a display that reflects divisions. The time view 120 (simple chronological display) is a simple list display, so it is useful when you want to see the list immediately. On the other hand, the event view 200 (display reflecting divisions) is performed through division determination processing, so it may take some time to display, but by reflecting divisions between sub-events and scenes in the list display, it is easy to see and search. It also makes it easy to understand the balance between scenes and sub-events. Therefore, by switching between the time view 120 and the event view 200, a list display according to the situation is provided.

[0310] In the embodiment, the UI control unit 31 controls the time view 120 and the event view 200 to be alternately switched in response to the operation of the view switching button 202. By alternately switching between the time view 120 and the event view 200, the user can easily select a list display mode that is suitable for the situation.

[0311] In the embodiment, the UI control unit 31 controls the event view 200 so that, in response to a first directional operation such as a left-right swipe, scrolling is performed so that each image of one time period (e.g., a scene) divided by a division moves in the left-right direction (first direction), and in response to a second directional operation such as an up-down swipe, scrolling is performed in the up-down direction (second direction) so that each time period divided by a division is displayed. In the event view 200, the user can scroll horizontally to check the images of a certain scene. Also, by scrolling vertically, the user can quickly search for the scene they want to see. By setting the horizontal and vertical layout in this way, the operability of image viewing can be significantly improved.

[0312] The division determination unit 35 in the embodiment performs division determination for sub-events that are performed within an event. By determining the boundaries of sub-events in the boundary determination process, the camera staff can easily check the images of each sub-event. In the embodiment, images are displayed side by side in units of scenes, but if the number of images is relatively small, images may be displayed side by side in units of sub-events, which is suitable for checking images for each sub-event. In other words, the divisions do not have to be hierarchical, such as sub-events and scenes, but can be a single level of sub-events only.

[0313] The division determination unit 35 in the embodiment performs division determination for sub-events that take place within an event, and division determination for scenes within the sub-events. The division detection process determines the division between sub-events and scenes, allowing for two-level divisions, making it possible to provide a list display by sub-event, scene, etc. In particular, if there are a large number of images per sub-event, dividing them into scenes allows you to view a list of images in smaller divisions. Of course, you can also set three or more levels to further subdivide the scene.

[0314] In the embodiment, the UI control unit 31 controls the display so that the images are arranged in the left-right direction (first direction) with each scene being a single time period. When a large number of images are captured at an event, the number of images per sub-event may be extremely large. In this case, it is preferable to further subdivide the images into scenes and provide a list display. In other words, the images are displayed in a horizontal row by scene. This allows the camera crew to search for images horizontally in units that are easy to see, providing an interface that makes it easier to check and select images.

[0315] The example in which the boundary determination unit 35 in the embodiment determines boundaries based on the time intervals between images in the chronological order of their image capture times in the image group has been given (see FIG. 45). If the time interval between the capture of one image and the next is large, it can be determined that the subject matter has changed significantly, i.e., that this is a division into sub-events or scenes, and this enables division determination with relatively simple processing and high reliability. This makes it relatively easy to realize an appropriate division reflection display.

[0316] In the embodiment, an example has been described in which the boundary determination unit 35 determines boundaries based on the image analysis results of each image in the image group in chronological order of the image capture time. Sub-events and scenes can be separated based on the person in the photo, the number of people, the items in the photo, etc. This allows for appropriate division of the scene to be reflected in the display.

[0317] In the embodiment, the UI control unit 31 prevents the number of images arranged in the left-right direction (first direction) from exceeding the upper limit. If there is no upper limit on the number of images per scene and they are lined up horizontally, it becomes difficult to search for images by scrolling horizontally if the number of images in that scene is extremely large. Therefore, if there are many images in one time period due to divisions, for example, if there are more than 30 images, they are displayed in a different row. This prevents the number of images lined up horizontally and makes it easy to check the images.

[0318] The delimiter determination unit 35 of the embodiment executes the delimiter determination process when a request to display the event view 200 is made by an operation (see FIG. 15). If the boundary determination process is a time-consuming and load-intensive process, it is preferable to perform it only when necessary, thereby avoiding unnecessary processing in situations where a normal list display is required. Of course, this may be done when images are received all at once or sequentially from the imaging device 2. In particular, when there are abundant processing resources or when the segmentation determination process is performed using an algorithm with a relatively light load, by performing this in advance, it is possible to quickly respond to a display that reflects segmentation when the user requests it.

[0319] In the embodiment, an example has been given in which the UI control unit 31 requests confirmation as to whether or not to execute the delimiter determination process when execution of display of the event view 200 is requested by an operation. If the segmentation determination process is a time-consuming and load-intensive process, the user is notified of this and a dialog box is displayed asking whether or not to execute the process (see steps S356, S353, and S360 in FIG. 15). This allows the segmentation determination process to be performed according to the user's convenience. In other words, if the user does not want to perform a time-consuming process, the segmentation determination process can be prevented from being forced to be executed.

[0320] In the embodiment, it is assumed that an operation to instruct the boundary determination unit 35 to execute boundary determination processing is possible. For example, an update button 203 or an update dialog 205 is provided so that the user can execute the relatively time-consuming boundary determination process at a time convenient for the user.

[0321] In the embodiment, the event view 200 displays the title of each sub-event. For example, by displaying sub-event names such as "Ceremony," "Cocktails," and "Party Time," or mechanically assigned sub-event names such as "event1" and "event2," the display reflecting divisions is easy to see, and it is also convenient for camera staff when searching for images. The event view 200 also displays the title of each scene. For example, by displaying names by scene, such as "scene1" and "scene2," the division reflection display is easy to see, especially when arranging images horizontally by scene, and it is also convenient for camera staff when searching for images.

[0322] In the event view 200 of the embodiment, an index bar 201 for a time period based on a division, for example, a sub-event, is displayed (see FIG. 21). For example, by displaying the names of sub-events such as "Ceremony" and "Cocktails," it becomes clear how the list as a whole is divided. The index bar 201 is also used as an operator for image search. By specifying a title in the index bar 201 in the event view 200, it is possible to jump to the display of images for the time period of that sub-event (steps S214 and S241 in FIG. 13). This makes it possible to significantly improve the searchability of the display that reflects the divisions.

[0323] In the embodiment, the image file from the imaging device 2 is transferred to the staff terminal 1, and the staff terminal 1 uploads it to the server device 4, but it is also possible for the imaging device 2 to upload it directly to the server device 4.

[0324] In the embodiment, the description is based on the assumption that an image collection of still images is generated, but the image collection may include moving images as part of its content, or an image collection may be generated using multiple moving images. In either case, the processing described in the embodiment can be applied in the same way. In this case, the moving image may be a moving image with sound or a moving image with only image information without sound.

[0325] Furthermore, the imaging device 2 may function as an information processing device according to the embodiment and perform the processing of the staff terminal 1. Alternatively, the staff terminal 1 may have an imaging function and function as the imaging device 2.

[0326] The techniques of the present disclosure are not limited to processing images of wedding events, but are also useful for selecting images captured at sporting events, for example. In particular, if the sub-events and scenes of a sporting event can be divided by type of sport or by the order of athletes competing in an individual sport, the event view 200 will be an extremely convenient list display format for checking and selecting images. In the case of sports, a more appropriate event view 200 can be realized by changing the division conditions for sub-events and scenes by sport.

[0327] The program of the embodiment is a program that causes, for example, a CPU, a DSP, or a device including these to execute the processes shown in FIGS. In other words, the program of the embodiment is a program that causes an information processing device to execute a process of displaying a list and an individual display as a display that allows images to be selected from a group of images captured at a specific event, a process of detecting an archive operation on the displayed image, and a process of storing archive information indicating that the image has been archived in correspondence with the image that is the target of the archive operation.

[0328] Another program according to the embodiment is a program that causes, for example, a CPU, a DSP, or a device including these to execute the processes shown in FIGS. 12 to 18 and 45. In other words, the program of the embodiment is a program that causes an information processing device to execute a division determination process that determines divisions in the time series for a group of images captured at a specific event, and a user interface control process that controls a division-reflecting display in which, for each time period separated by the divisions determined in the division determination process, all or part of the images captured within the time period are arranged in a first direction, and each time period is presented arranged in a second direction.

[0329] These programs enable the staff terminal 1 suitable for high-speed selection to be realized in, for example, a mobile terminal device, a personal computer, or other equipment capable of executing information processing.

[0330] A program for realizing such a staff terminal 1 can be recorded in advance on a HDD as a recording medium built into a device such as a computer device, or on a ROM in a microcomputer having a CPU. Alternatively, the software may be temporarily or permanently stored (recorded) on a removable recording medium such as a flexible disk, a CD-ROM (Compact Disc Read Only Memory), an MO (Magneto Optical) disk, a DVD (Digital Versatile Disc), a Blu-ray Disc (registered trademark), a magnetic disk, a semiconductor memory, a memory card, etc. Such removable recording media may be provided as a so-called package software. Such a program can be installed onto a personal computer or the like from a removable recording medium, or can be downloaded from a download site via a network such as a LAN (Local Area Network) or the Internet.

[0331] Furthermore, such a program is suitable for widespread provision of the staff terminal 1 of the embodiment. For example, by downloading the program to a mobile terminal device such as a smartphone or tablet, an imaging device, a mobile phone, a personal computer, a still camera, a video camera, a game device, a video device, a PDA (Personal Digital Assistant), or the like, the smartphone or the like can function as the staff terminal 1 of the present disclosure.

[0332] The effects described in this specification are merely examples and are not limiting, and other effects may also be present.

[0333] The present technology can also be configured as follows. (1) a user interface control unit that performs a process of displaying a list and an individual display as a display that allows an image to be selected from a group of images captured at a specific event, and a process of detecting an archive operation for the displayed image; an event data management unit that performs processing to store archive information indicating that the image has been archived in association with the image that is the target of the archive operation; Information processing device. (2) a filter processing unit that performs filtering based on the archive information, The user interface control unit controls the list display so that images extracted by filtering are displayed as a list. The information processing device according to (1) above. (3) Whether or not to perform filtering based on the archive information, or the filtering conditions, can be selected. The information processing device according to (2) above. (4) the user interface control unit performs control to provide a user interface that allows a user to set selection information for creating an image album by selectively using image data included in the image group; The event data management unit performs a process of storing the archive information and the selection information as separate information. The information processing device according to any one of (1) to (3) above. (5) The user interface control unit enables an archive operation for the displayed image during the individual display. An information processing device according to any one of (1) to (4) above. (6) The user interface control unit detects a swipe operation in a predetermined direction on a displayed image as an archive operation on the image. The information processing device according to any one of (1) to (5) above. (7) The user interface control unit, when detecting an archive operation, controls to execute a display that allows the archive operation to be canceled for a predetermined time. The information processing device according to any one of (1) to (6) above. (8) an image analysis unit that performs image analysis on each image of the image group and determines whether the subject person has closed their eyes; The event data management unit performs a process of storing information about eye closure in association with an image determined to be an eye closure. The information processing device according to any one of (1) to (7) above. (9) The user interface control unit controls the display of an image determined to be an image of an eye blink based on the eye blink information during the list display or the individual display. The information processing device according to (8) above. (10) a filter processing unit that performs filtering based on the blink information, The user interface control unit controls the list display so that images extracted by filtering are displayed as a list. The information processing device according to (8) or (9) above. (11) It is possible to select whether or not to perform filtering based on the blink information. The information processing device according to (10) above. (12) the user interface control unit performs control to provide a user interface that allows a user to set selection information for creating an image album by selectively using image data included in the image group; The event data management unit performs a process of storing the blink information and the selection information as separate information. The information processing device according to any one of (8) to (11) above. (13) a filter processing unit that performs filtering based on information about an imaging device that captured the image; The user interface control unit controls the list display so that images extracted by filtering are displayed as a list. The information processing device according to any one of (1) to (12) above. (14) A process of displaying a list and an individual display as a display that allows an image to be selected from a group of images captured at a specific event, and a process of detecting an archive operation for the displayed image; a process of storing archive information indicating that the image has been archived in association with the image that is the target of the archive operation; An information processing method performed by an information processing device. (15) A process of displaying a list and an individual display as a display that allows an image to be selected from a group of images captured at a specific event, and a process of detecting an archive operation for the displayed image; a process of storing archive information indicating that the image has been archived in association with the image that is the target of the archive operation; A program that causes an information processing device to execute the above. [Explanation of symbols]

[0334] 1 Staff terminal 2. Imaging device 3. Personal Computers 4. Server equipment 5. Client terminal 6 Network 30 Event Data Management Department 31 UI control section 32 Communication control section 33 Filter processing section 34 Image analysis unit 35 Delimiter 70 Information processing equipment 120 Time View 200 event views

Claims

1. A process for causing a display unit to perform a list display of a plurality of captured images and an individual display of an image selected from the plurality of captured images in the list display; a process of causing the display unit to display an image in which the subject person is determined to have their eyes closed in the list display or the individual display; A program that causes an information processing device to execute the above.

2. The information processing device is caused to execute a process of determining whether or not a captured image displayed in the list display or the individual display is an image in which a subject person has their eyes closed. The program according to claim 1.

3. The information processing device is caused to execute a process of determining whether or not a photographed image displayed in the list display or the individual display is an image in which a subject person has their eyes closed by image analysis processing. The program according to claim 1.

4. The information processing device is caused to execute a process in which the display unit displays an image in which the subject person is determined to have their eyes closed and a display in which the position in focus at the time of image capture is displayed in the individual display. The program according to any one of claims 1 to 3.

5. In either the list display or the individual display, the information processing device is caused to execute a process of causing the display unit to display an image in which the subject person is determined to be in a closed-eye state. The program according to any one of claims 1 to 4.

6. The display showing an image in which the subject person is determined to have their eyes closed is an icon display. The program according to any one of claims 1 to 5.

7. The information processing device executes a process of storing, in association with each of a plurality of captured images, blinking information based on a determination as to whether or not the subject person has their eyes closed for each of the captured images. The program according to any one of claims 1 to 6.

8. The information processing device is caused to execute a filtering process for a plurality of captured images using a filter condition of whether or not the subject person is in a closed-eye state. The program according to any one of claims 1 to 7.

9. A process of storing blink information based on a determination of whether or not the subject person has their eyes closed for each of a plurality of captured images, in association with the captured images; The information processing device executes a filtering process using the blink information as a filtering condition. The program according to any one of claims 1 to 8.

10. The information processing device is caused to execute a process of displaying rating information set for each captured image on the display unit in the list display or the individual display. The program according to any one of claims 1 to 9.

11. The information processing device is caused to execute a process of displaying the rating information on the display unit by the number of marks of a predetermined shape. The program according to claim 10.

12. The rating information is evaluation information of multiple levels set for each captured image. The program according to claim 10 or 11.

13. The rating information is evaluation information on a six-level scale set for each captured image. The program according to claim 10 or 11.

14. The information processing device is caused to execute a process of displaying the rating information below each captured image in the list display on the display unit. The program according to any one of claims 10 to 13.

15. The information processing device executes a process of storing the rating information in association with the captured image. The program according to any one of claims 10 to 14.

16. The information processing device is caused to execute a filtering process using rating information as a filtering condition for a plurality of captured images. The program according to any one of claims 10 to 15.

17. The information processing device is caused to execute a process of displaying, on the display unit, a number of images corresponding to each rating together with a rating-specified image that specifies a filter condition based on rating information for a plurality of captured images. The program according to claim 16.

18. The information processing device is caused to execute a filtering process using a plurality of filter conditions, including blinking information based on a determination of whether or not the subject person has their eyes closed for each of a plurality of captured images, and rating information set for each of the plurality of captured images. The program according to any one of claims 1 to 8.

19. The information processing device is caused to execute filtering processing for a plurality of captured images using an image capturing device used for capturing the images as a filtering condition.

19. The program according to any one of claims 1 to 18.

20. An information processing device comprising: a process of causing a display unit to perform a list display of a plurality of captured images and an individual display of an image selected from the plurality of captured images in the list display; a process of causing the display unit to display an image in which the subject person is determined to have their eyes closed in the list display or the individual display; An information processing method that performs the above.

Images