Information processing apparatus, information processing method, program

Abstract

The present invention makes it possible to: perform a break determination process which determines a break on a time series for an image group captured in a specific event; and perform a break reflection display in which, for each time period divided by the break determined in the break determination process, the entirety or a portion of images captured within the time period are arranged in a first direction, and each time period is presented as a state of being arranged in a second direction.

Description

Technical Field

[0001] The present technology relates to an information processing apparatus, an information processing method, and a program, and particularly to a technology suitable for image viewing of events.

Background Art

[0002] For example, in events such as weddings and banquets, sports events, entertainment events, and hobby events, there is a service where a cameraman takes pictures and creates a photo album as an image collection and provides it to participants and the like. In addition, reporters may conduct interviews of events, select specific images, attach them to articles, or provide them to news agencies and the like. Furthermore, general users may also select images from a large number of images taken at an event and upload them to an SNS (social networking service). Patent Document 1 below describes a technique for transferring and sharing images taken with a camera to a smartphone or the like.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] By the way, regarding event images, when making selections for creating an image collection or selecting images to be used in reports or on SNS, a case where a user views a list display of event images is assumed. The list display generally arranges thumbnail images or the like in chronological order according to the imaging time. However, such a simple list display may be inconvenient when searching for a specific scene or the like within an event. Therefore, in the present disclosure, in such a list display, a display mode that is more convenient for image search is proposed.

Means for Solving the Problems

[0005] The information processing apparatus according to the present technology includes a delimiter determination unit that determines a delimiter in the time series for a group of images captured at a specific event, and for each time period divided by the delimiter determined by the delimiter determination unit, all or part of the images captured within the time period are arranged in a first direction, and a user interface control unit that controls so that a delimiter reflection display in which each time period is arranged in a second direction is performed. For example, for a group of image data, which is a plurality of images captured at an event such as a wedding, assume a use case where an image (photo) is selected to create an image collection. In that case, the delimiter in the time series of a large number of images is determined. Then, for example, the images in the same time period are arranged in the first direction according to this delimiter, and the images in different time periods are arranged in the second direction.

[0006] In the information processing apparatus according to the present technology described above, it is conceivable that the user interface control unit performs switching control between a simple time series display in which images are arranged and displayed in the order of imaging time without being based on the delimiter, and the delimiter reflection display. The simple time series display is a list display that is performed without going through delimiter determination.

[0007] In the information processing apparatus according to the present technology described above, it is conceivable that the user interface control unit performs control to alternately switch between the simple time series display and the delimiter reflection display according to an operation. That is, the simple time series display and the delimiter determination display are toggled by a user operation.

[0008] In the information processing apparatus according to the present technology described above, in the delimiter reflection display, the user interface control unit may control such that, in response to a first direction operation, scrolling is performed so that each image in one time zone by the delimiter moves in the first direction, and in response to a second direction operation, scrolling in the second direction is performed so that each time zone by the delimiter is displayed. When arranging images of one time zone in the first direction and arranging each time zone in the second direction, scrolling display corresponding to those arrangement directions is performed by a scroll operation in each direction.

[0009] In the information processing apparatus according to the present technology described above, the delimiter determination unit may perform delimiter determination for sub-events occurring within the event. For example, in an event such as a wedding or a banquet, there are various events (hereinafter referred to as "sub-events" for the sake of distinction in explanation), such as a ceremony, a greeting from guests, a cake cutting, and bouquet tosses. Determine the delimiters of these sub-events.

[0010] In the information processing apparatus according to the present technology described above, the delimiter determination unit may perform delimiter determination for sub-events occurring within the event and delimiter determination for scenes within the sub-events. For example, in addition to the delimiters of the above-described sub-events in an event such as a wedding or a banquet, further determine the delimiters of "scenes" that subdivide within the sub-events.

[0011] In the information processing apparatus according to the present technology described above, the user interface control unit may control such that display is performed by arranging images in the first direction with the unit of the scene as one time zone. For example, while presenting the delimiters of sub-events, display a list of images in units of scenes.

[0012] In the information processing apparatus according to the present technology described above, it is conceivable that the delimiter determination unit determines the delimiter based on the time intervals of the respective images in the image group in the chronological order of the imaging times. Obtain the time interval for the imaging times of one image and the next image, and determine whether to use this as a reference for the delimiter.

[0013] In the information processing apparatus according to the present technology described above, it is conceivable that the delimiter determination unit determines the delimiter based on the image analysis results of the respective images in the image group in the chronological order of the imaging times. For one image and the next image, or several consecutive images, etc., determine the subject content by image analysis, and determine whether to use it as a delimiter based on the relevance of the subject.

[0014] In the information processing apparatus according to the present technology described above, it is conceivable that the user interface control unit prevents the number of images arranged in the first direction from exceeding the upper limit number. Even if the number of images in one time zone due to the delimiter increases, the images displayed side by side in the first direction are limited to a predetermined upper limit number.

[0015] In the information processing apparatus according to the present technology described above, it is conceivable that the delimiter determination unit executes the delimiter determination process when the execution of the delimiter reflection display is requested by an operation. The delimiter determination process is not executed in advance, but is executed when the execution of the delimiter reflection display is requested. In the information processing apparatus according to the present technology described above, it is conceivable that the user interface control unit requests confirmation of whether the delimiter determination process can be executed when the execution of the delimiter reflection display is requested by an operation. When the delimiter reflection display is requested, ask the user whether the delimiter determination process may be performed. In the information processing apparatus according to the present technology described above, it is conceivable that an operation for instructing the execution of the delimiter determination process by the delimiter determination unit is enabled. Enable the user to instruct the section determination process as needed.

[0016] In the information processing apparatus according to the present technology described above, in the section reflection display, it is conceivable that the title display for each sub-event is performed. For example, in events such as weddings and banquets, perform title display with numbers, characters, etc. for units of sub-events such as the ceremony, guest greetings, cake cutting, and bouquet tosses. In the information processing apparatus according to the present technology described above, in the section reflection display, it is conceivable that the title display for each scene is performed. For example, perform title display with numbers, characters, etc. in units of scenes.

[0017] In the information processing apparatus according to the present technology described above, in the section reflection display, it is conceivable that the index display for the time zone based on the section is performed. For example, perform index display for each unit of sub-events. In the information processing apparatus according to the present technology described above, it is conceivable that the index display is used as an operator for image search. That is, the items of the index display are used as an operator for requesting the display of images in the time zone according to the section.

[0018] The information processing method of the present technology includes a section determination process for determining a section in time series for a group of images captured in a specific event, and for each time zone divided by the section determined in the section determination process, all or part of the images captured within the time zone are arranged in a first direction, and the section reflection display is performed in a state where each time zone is arranged in a second direction. The information processing apparatus executes user interface control processing for controlling this. These are processes for providing a display suitable as a list display for image selection and the like for a group of images related to an event by a cameraman or the like. The program according to this technology is a program that causes an information processing apparatus to execute processing corresponding to such an information processing method.

Brief Description of the Drawings

[0019]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Figure 21

Figure 22

Figure 23

Figure 24

Figure 25

Figure 26

Figure 27

Figure 28

Figure 29

Figure 30

Figure 31

Figure 32

Figure 33

Figure 34

Figure 35

Figure 36

Figure 37

Figure 38

Figure 39

Figure 40

Figure 41

Figure 42

Figure 43

Figure 44

Figure 45

Figure 46

Figure 47

Embodiments for Carrying Out the Invention

[0020] Hereinafter, the embodiments will be described in the following order. <1. System Configuration and Working Procedures for Image Set Provision Service> <2. Configuration of Information Processing Apparatus> <3. Preset Processing> <4. Transfer / Editing Processing> <5. Selection Processing> [5-1 Overall Flow of Selection] [5-2 Filter Processing Based on Archive and Blinding] [5-3 Cover, Highlight Selection] <6. Server Processing> <7. Web Gallery Delivery Processing> <8. Delivery Processing> <9.Event View> <10. Summary and variations>

[0021] <1. System configuration and operation procedure for image gallery service> In the embodiment, it is assumed that a photographer takes still images (photographs) at an event such as a wedding ceremony, generates content as an image collection from the captured images, and provides the content to a client with or without payment. It should be noted that the present invention is not limited to still images, and that it is also possible to capture moving images with or without sound and generate an image collection including these moving images, or an image collection made up of multiple moving images.

[0022] For the purpose of explanation, cameramen and their assistants are collectively referred to as camera staff. The term "client" is used to refer not only to the person placing the order, but also to any user who is provided with and can view the image collection. For example, the term "client" refers collectively to the bride and groom, their relatives, friends, and other related parties.

[0023] An image collection broadly refers to content that is a collection of images (still images and videos), such as a photo album, and the form in which it is provided is not important, but in this embodiment, as an example, it is possible to provide an image collection as a web gallery and an image collection of actual delivery.

[0024] The image collection of a web gallery referred to here is an electronic image collection that allows photos of an event, such as a wedding, to be viewed quickly on a website after the event has ended. In the explanation, an example using a website is used, but this is just one example, and the content file as an image collection may also be sent to a client's terminal device using, for example, email, electronic message, SNS, etc.

[0025] The delivered image collection is, for example, an image collection of an event that a camera crew will formally produce as a photo album and provide to the client at a later date. The image data captured at the event may be edited to form an electronic image collection such as image album content or slide show content, or, for example, an image collection in paper form may be created. The electronic image collection may be provided by means such as download or streaming, or may be provided by being stored in a portable storage medium such as a disk-shaped storage medium, a card-shaped storage medium, a tape-shaped storage medium, or a flash memory medium.

[0026] In the present embodiment, as the image collection of the web gallery, an image collection that can be quickly viewed by the client is generated before the delivered image collection. Further, the image collection of the web gallery is not simply a collection of a large number of captured images arranged in a simple manner, but is selected images that can have a quality that viewers can enjoy. On the other hand, the delivered image collection is positioned such that a camera crew can create it over time with more creative editing.

[0027] FIG. 1 shows terminal devices 1A and 1B, an imaging device 2, a personal computer 3, a server device 4, terminal devices 5A and 5B, and a network 6. Note that the terminal devices 1A and 1B indicate terminal devices used by a camera crew, and for the sake of distinction in the description, these are collectively referred to as staff terminal 1. The terminal devices 5A and 5B indicate terminal devices used by the users as the above-described clients, and in the description, these are collectively referred to as client terminal 5.

[0028] As the staff terminal 1 and the client terminal 5, portable terminal devices such as smartphones and tablet devices are exemplified here. For example, it is assumed that the terminal device 1A is a smartphone used by a cameraman and the terminal device 1B is a smartphone used by an assistant. Further, the terminal device 5A is assumed to be a smartphone used by the bride, and the terminal device 5B is assumed to be a tablet device used by a friend at the venue. These staff terminals 1 and client terminals 5 may be so-called information processing devices. Specific examples thereof include various devices such as personal computer devices, mobile phone devices, game devices, audio devices, video devices, communication devices, and television devices. That is, any information processing device capable of performing information processing operations, for example, a device incorporating a microcomputer, can be used as the staff terminal 1 and the client terminal 5 of the present disclosure. However, in order to assume use at an event venue or the like, it is preferable that the terminal be a portable terminal such as a smartphone or a tablet device.

[0029] As the imaging device 2, various imaging devices such as a video camera and a still camera are assumed. The illustrated imaging device 2 assumes a camera used by a cameraman at a wedding venue.

[0030] Data communication is enabled between the imaging device 2 and the staff terminal 1 (for example, the terminal device 1A). For example, data communication is performed by FTP (File Transfer Protocol) communication. Specifically, it is conceivable that the terminal device 1A becomes an FTP server, and the image files (including image data and metadata) captured by the imaging device 2 are uploaded sequentially or collectively by FTP communication. Therefore, it is assumed that the imaging device 2 is set with FTP for transferring data to the terminal device 1A. The contents of the FTP setting information include the host name of the FTP server, the save destination path, the user name, the password, the connection type, and the like.

[0031] However, the imaging device 2 and the terminal device 1A are not necessarily limited to FTP, and other protocols may be used. Also, between the imaging device 2 and the terminal device 1A, any communication method capable of transferring images and metadata may be used. For example, short-range wireless communication such as Bluetooth (registered trademark), WI-FI (Wireless Fidelity: registered trademark), NFC (Near Field Communication: registered trademark), or infrared communication may be used to enable mutual information communication. Furthermore, the imaging device 2 and the terminal device 1A may be capable of communicating with each other by wired connection communication such as a wired LAN.

[0032] The personal computer 3 is exemplified as an information processing device used by, for example, a camera staff to create the delivered image collection content. This personal computer 3 acquires data related to event images from the server device 4 and is used for the work of creating the delivered image collection content by an image editing application or the like.

[0033] The server device 4 provides and manages various information for a camera staff to create a web gallery or a delivered image collection. For example, the staff terminal 1 has installed an application program for an image collection providing service and performs the following-described processing according to that application program. Correspondingly, the server device 4 manages data related to events and generates a web gallery.

[0034] The staff terminal 1 and the server device 4 are in a constantly connected state, for example, during the startup of the above application program, and event data is synchronized. Examples of event data will be described later and include image data captured at an event and data used for generating a web gallery.

[0035] In the present disclosure, "synchronization" means that at least a part of the event data stored in the staff terminal 1 and the content of the event data stored in the server device 4 are maintained to have the same data content. In particular, the data to be synchronized includes image data, rating information, selection information, editing information, archive information, blinding information, and the like. Each content will be described later.

[0036] The network 6 is assumed to be, for example, the Internet, a home network, a LAN (Local Area Network), a satellite communication network, or various other networks. The staff terminal 1 can upload image data and the like to the server device 4 via the network 6, or transmit information for synchronization. The client terminal 5 can access the web page provided by the server device 4 via the network 6 and view the web gallery. The personal computer 3 can obtain an image file for creating an image collection content of the present delivery from the server device 4 via the network 6.

[0037] Note that the imaging device 2 has, for example, a display panel provided on the back of the device, a display device such as a viewfinder, and can be operated and input by various operators, a touch panel, and the like. That is, it has sufficient functions as a user interface. The imaging device 2 is also equipped with a microcomputer and can perform various information processing and communication. Therefore, it is also assumed that the imaging device 2 functions as the information processing device referred to in the present disclosure, communicates with the server device 4 without going through the terminal devices 1A and 1B, and executes the processing performed by the terminal devices 1A and 1B as described later. In the embodiment, the processing of the staff terminal 1 and the server device 4 will be mainly described, but an example in which the imaging device 2 performs all or part of the processing of the staff terminal 1 described below is also conceivable.

[0038] The general procedure for providing an image collection realized in a system as shown in FIG. 1 will be described with reference to FIG. 2. This is the procedure for operations on the staff terminal 1 based on the operations of the camera staff as the service provider.

[0039] As step S1, preliminary settings are made. For example, the camera staff makes communication settings between the staff terminal 1 and the imaging device 2, event settings, image retouching settings, etc. This preliminary setting should be completed before the start of the wedding ceremony.

[0040] As step S2, imaging / transfer / auto - editing during the wedding ceremony is performed. The image files captured by the cameraman using the imaging device 2 are sequentially transferred to the staff terminal 1 (for example, terminal device 1A). The staff terminal 1 takes in the image files and performs operations such as transferring the image files to the server device 4 and automatically editing the images according to the preliminary settings.

[0041] As step S3, it shows the operations that can be performed on the same day after the wedding ceremony. The camera staff uses the staff terminal 1 to perform selection operations. Selection includes selecting images to be posted on the web gallery, selecting cover images, highlight images, and further image editing. The staff terminal 1 performs update processing of event data according to the operations of the camera staff. Processing for synchronizing with the server device 4 side of the event data is also sequentially performed. Note that this selection in step S3 may be performed during the progress of the wedding ceremony or the like.

[0042] In step S4, the process of delivering to the web gallery is performed. The server device 4 creates a web gallery based on the event data. After the camera staff checks the content of the web gallery using the staff terminal 1, an operation is performed to make it viewable by the client. As a result, for example, on the same day after the wedding ceremony, the client can view the web gallery as an image collection of the wedding ceremony.

[0043] Step S5 shows the creation of the image collection for this delivery and the processing of this delivery. The camera staff will later create the image collection content for this delivery using, for example, the personal computer 3 and provide it to the client. As a result, the client can receive the image collection content as this delivery.

[0044] <2. Configuration of the information processing device> A configuration example of the information processing device 70 that can be configured as the staff terminal 1, the client terminal 5, or the server device 4 or the personal computer 3 is shown in FIG. 3. The staff terminal 1, the personal computer 3, or the server device 4 can execute the following processes by having the configuration of the information processing device 70 below. Also, the imaging device 2 can execute the same processes as the staff terminal 1 described below by having the configuration of the information processing device 70 below.

[0045] The CPU (Central Processing Unit) 71 of the information processing device 70 executes various processes according to the programs stored in the ROM (Read Only Memory) 72 or the programs loaded from the storage unit 79 to the RAM (Random Access Memory) 73. The RAM 73 also appropriately stores data and the like necessary for the CPU 71 to execute various processes. The CPU 71, the ROM 72, and the RAM 73 are interconnected via the bus 74. An input / output interface 75 is also connected to this bus 74.

[0046] An input unit 76 consisting of an operator and an operation device is connected to the input / output interface 75. For example, as the input unit 76, various operators and operation devices such as a keyboard, a mouse, keys, a dial, a touch panel, a touch pad, and a remote controller are assumed. The operation of the user is detected by the input unit 76, and the signal corresponding to the input operation is interpreted by the CPU 71.

[0047] In addition, a display unit 77 composed of a liquid crystal panel (LCD: Liquid Crystal Display), an organic EL (Electro-Luminescence) display, etc., and an audio output unit 78 composed of a speaker, etc. are connected to the input / output interface 75 either integrally or separately.

[0048] The display unit 77 is a display unit that performs various displays, and is configured by, for example, a display device provided on the housing of the information processing device 70, a separate display device connected to the information processing device 70, etc. The display unit 77 executes the display of images for various image processes and images of processing targets on the display screen based on the instructions of the CPU 71. In addition, the display unit 77 performs displays such as various operation menus, icons, messages, etc., that is, displays as a GUI (Graphical User Interface) based on the instructions of the CPU 71.

[0049] A storage unit 79 composed of a hard disk, a solid-state memory, etc., and a communication unit 80 that performs communication using various communication methods may be connected to the input / output interface 75.

[0050] The communication unit 80 performs communication processing via a transmission path such as the Internet, and communication by wired / wireless communication with various devices, bus communication, etc. When this information processing device 70 is considered as the staff terminal 1, the communication unit 80 has a function of performing FTP communication with the imaging device 2 and a function of communicating with the server device 4 via the network 6. Alternatively, the communication unit 80 may have a function of performing communication by short-range wireless communication such as Bluetooth, WI-FI, NFC, etc., infrared communication, wired connection communication, etc. described above. In addition, the communication unit 80 may have a function of performing communication by a communication line for mobile phones such as LTE (Long Term Evolution). When this information processing device 70 is considered as the server device 4 or the personal computer 3, the communication unit 80 at least has a function of performing communication via the network 6.

[0051] The input / output interface 75 is also connected to a drive 82 as necessary, and a removable recording medium 81 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory is appropriately mounted thereon. The drive 82 can read data files such as image files and various computer programs from the removable recording medium 81. The read data files are stored in the storage unit 79, or the images and sounds included in the data files are output by the display unit 77 and the audio output unit 78. Also, computer programs and the like read from the removable recording medium 81 are installed in the storage unit 79 as necessary.

[0052] In this information processing apparatus 70, for example, software for the processing of the present disclosure can be installed via network communication by the communication unit 80 or via the removable recording medium 81. Alternatively, the software may be stored in advance in the ROM 72, the storage unit 79, or the like.

[0053] When assuming the staff terminal 1 as the information processing apparatus 70, in the information processing apparatus 70, a functional configuration as shown in FIG. 4 is constructed in the CPU 71 by an application program. FIG. 4 shows, as functions provided in the information processing apparatus 70 that is the staff terminal 1, an event data management unit 30, a UI (user interface) control unit 31, a communication control unit 32, a filter processing unit 33, an image analysis unit 34, and a delimiter determination unit 35.

[0054] The event data management unit 30 is a processing function that stores, as event data related to a specific event, the image data received by communication with the imaging apparatus 2 and additional information including rating information and the like corresponding to the image data. The event data management unit 30 also performs update processing of event data in response to the operation input of the camera staff.

[0055] An example of the content of the event data is schematically shown in FIG. 5. Event data is a group of data including images and various contents for one event registered by camera staff operating staff terminal 1. Figure 5 shows event data 60 for an event with the event name "event2". In this example, it is assumed that the event data 60 includes preset information 61, an imaging / editing information table 62, and delimiter information 63.

[0056] The preset information 61 is information set by the camera staff according to the preset in step S1 of FIG. 2. For example, it includes editing information such as retouch parameters.

[0057] The imaging / editing information table 62 is a table in which information is sequentially added and updated in the processes of steps S2 and S3 of FIG. 2. In this imaging / editing information table 62, various information is described corresponding to the image file transferred from the imaging device 2. The image files transferred from the imaging device 2 include image data and metadata (MT1, MT2...). This image data is managed as original image data, and the added metadata is also managed. The image data includes, for example, RAW data or data compressed in the JPEG format, and the data format is not limited. Here, data compressed in the JPEG format such as "DSC0001.jpg" is exemplified. The metadata (MT1, MT2...) includes the imaging date and time of the image data, camera information such as the model, manufacturer, and serial number of the imaging device 2, data format, data size, angle of view information, focus point information, and other various information added by the imaging device 2.

[0058] Rating information corresponding to the image data is stored in the imaging / editing information table 62. The rating information is information indicating the evaluation value obtained by a cameraman or the like evaluating the image. For example, in terms of the number of star marks, it is six-level evaluation information such as "no star", "one star", "two stars", "three stars", "four stars", and "five stars". For example, the higher the number of stars, the higher the evaluation. Of course, such evaluation information is just an example. Since such rating information is useful for camera staff when selecting images, for example, when setting the selection flag (setting the used image information) described later, it can be said that images with a high evaluation indicated by the rating information are likely to be used for the web gallery or the final delivery. This rating information can be given by the cameraman checking the captured image when taking the image. The imaging device 2 is provided with a user interface for inputting the rating information. It is conceivable that this rating information is included in the metadata corresponding to the image data and transferred to the staff terminal 1 together with the image data. Alternatively, it is also conceivable that it is written in the XMP area of Exif in the image file. At the staff terminal 1, the rating information is extracted from the metadata (or Exif data) and managed. This rating information can be added or updated in association with the image data by an operation on the staff terminal 1 side.

[0059] Selection information corresponding to the image data is stored in the imaging / editing information table 62. As one of the selection information, there is usage image information indicating whether the image is to be posted on the web gallery. This is the "selection flag" (sometimes simply referred to as the "flag") described later. When the flag is off, it means the image is not used for the web gallery, and when the flag is on, it indicates that the image has been selected as an image to be used in the web gallery. Also, as one of the selection information, there is cover image information indicating that the image has been selected as a cover image to be placed as a cover at the top of the web gallery. Also, as one of the selection information, there is highlight image information indicating that the selected image is to be highlighted (highlighted) within the web gallery. The highlight display shall be larger than other images. Alternatively, the normal image may be a monochrome image while the highlight image is displayed in color. Conversely, in the sense of emphasis, it is also conceivable that the normal image is a color image while the highlight image is displayed in monochrome. Also, the normal image may be displayed without a border, and the highlight image may be distinguished by having a border, etc. There are various ways to consider the highlight display.

[0060] The eye-closure information is information indicating the eye-closure state of the subject person obtained by the image analysis process executed by the function of the image analysis unit 34. For example, most simply, it can be considered as "0" or "1" flag information indicating whether it is an image of closed eyes.

[0061] The archive information is information indicating that it has been archived by the user. The archive operation, etc. will be described later. For example, most simply, it can be considered as "0" or "1" flag information indicating whether it is an archived image.

[0062] The editing information includes various image processing parameters such as retouching parameters and tilt correction parameters. The retouching parameters include image quality adjustment parameters such as brightness adjustment value, color adjustment value, contrast adjustment value, and sharpness adjustment value. The retouching parameters can be set by pre-setting, but can also be set for individual images. Also, the tilt correction parameters are to be set individually. For these reasons, the editing information corresponding to the image data is stored so that the parameters set for individual images can be remembered.

[0063] As shown in the figure, the captured / edited information table 62 may store the edited image data corresponding to the image data. Edited image data refers to image data obtained by performing image editing on original image data based on pre-set editing information or individually set editing information. In addition to image data retouched by editing information, image data with changed image quality may also be regarded as edited image data. Changes in quality include, for example, changes in image size, resolution, cropping, and frame rate in videos. In the figure, edited image data is indicated by attaching "E" to the file name such as "DSC0001E.jpg" to distinguish it from the original image data. This edited image data is used for display on the user interface of the staff terminal 1. Such edited image data does not necessarily have to be created and stored. For example, when displaying an image, the editing information may be applied each time for display. Therefore, in the imaging / editing information table 62, it is only necessary to update and manage the editing information, and it is not necessary to store the edited image data. However, of course, generating and storing the edited image data at any time as shown in the figure is effective in terms of reducing the processing load during the display process.

[0064] The segmentation information 63 is information on the segmentation of sub-events and scenes set based on the results of the segmentation determination process described later. The segmentation information 63 is updated each time the segmentation determination process is performed.

[0065] The CPU 71 of the information processing apparatus 70, which is the staff terminal 1, executes the additional storage and update of information about the event data 60 as described above by the functions of the event data management unit 30 in FIG. 4. Note that the format of the event data 60 and the format of the imaging / editing information table 62 are merely examples, and any format may be used as long as the above content is managed for each event at least. For example, the original image data, metadata, rating information, selection information, blurring information, archive information, editing information, and edited image data included in the imaging / editing information table 62 are not necessarily stored together as a table. As long as the metadata, rating information, selection information, blurring information, archive information, editing information, and edited image data are associated with each at least one original image data, they may be stored in any format or manner.

[0066] The UI control unit 31 in FIG. 4 is a function that performs presentation control of an image and rating information related to event data 60 of a specific event and also performs a process of detecting an operation input. That is, it is a function that performs user interface processing. Examples of user interface processing include presentation of various types of information, provision of an environment in which operation input is possible, a process of detecting an operation by the user, and a process of detecting / estimating the intention of the user. Specifically, the UI control unit 31 performs control processing to cause, for example, the display unit 77 or the audio output unit 78 to execute output such as display output or audio output to the user, thereby providing an operation input environment to the user or presenting information. Alternatively, the UI control unit 31 performs a process of detecting, for example, an operation by the user. Alternatively, the UI control unit 31 performs both a process of providing an operation input environment to the user and a process of detecting an operation by the user, for example. Of course, the UI control unit 31 may perform other user interface processing.

[0067] The communication control unit 32 is a function that controls communication to synchronize event data with an external server device 4 in response to storage or update of the event data 60. For example, when the communication control unit 32 receives an image transfer from the imaging device 2, it controls a process of transferring the image data from the communication unit 80 to the server device 4, or controls notification of the update content to the server device 4 in response to an update of the content of the event data 60.

[0068] The filter processing unit 33 is a function that performs processing to filter images and extract images to be displayed from among a group of images captured for an event according to a user operation. The filter conditions are set by the user operation. Specifically, the archive setting state, the eye-closed state, or metadata, etc. is set as the filter condition.

[0069] The image analysis unit 34 indicates a function of setting the above-mentioned eye-closed information. For example, image analysis is performed on the image data received by communication with the imaging device 2 to detect the person who is the subject and determine the eye-closed state of that person. And when it is an image in the eye-closed state, eye-closed information is generated. Such analysis is performed for each image, and the eye-closed information will be managed in the event data 60.

[0070] The delimiter determination unit 35 is a function that performs processing to determine the delimiter in the time series for a group of images as a series of images captured for an event. For example, it determines the delimiters such as sub-events in an event such as a wedding or scenes obtained by subdividing a sub-event. For example, when considering a wedding and a reception as one event, there are various events such as the ceremony, the reception, greetings, cake-cutting, toast, bouquet toss, etc. as the time-series delimiters. The content of the delimiter is arbitrary, but for example, when considering a series of weddings as an event, the events that delimit it are called "sub-events" for the sake of explanatory distinction. Also, there may be a two-stage delimiter determination for further subdividing one sub-event. In that case, one of the subdivided ones is called a "scene".

[0071] Which events, incidents, actions, etc. are regarded as "sub-events" or "scenes" is arbitrary. When considering the whole as one "event", each delimiter is regarded as a "sub-event", and the further subdivided unit is regarded as a "scene". For example, in some cases, "cake-cutting" may be one of the "sub-events", or it may be one of the "scenes".

[0072] The functions of FIG. 4 above are merely illustrative. By including at least the event data management unit 30, UI control unit 31, and communication control unit 32 in the information processing apparatus 70, the information processing apparatus 70 will perform the processing as the staff terminal 1 in the present embodiment. Such respective functions are realized, for example, by the information processing apparatus 70 installing an application program for creating image collection content.

[0073] Next, when assuming the server apparatus 4 as the information processing apparatus 70 as shown in FIG. 3, in the information processing apparatus 70, a functional configuration as shown in FIG. 6 is constructed in the CPU 71 by an application program. FIG. 6 shows, as functions provided in the information processing apparatus 70 regarded as the server apparatus 4, an event data management unit 40, an image collection generation unit 41, an event data providing control unit 42, and a data output unit 43.

[0074] The event data management unit 40 is a processing function for storing and updating event data in the server apparatus 4. The content of the event data 90 on the server apparatus 4 side is schematically shown in FIG. 7. Similar to FIG. 5, it is the event data 90 for the event with the event name "event2". In this example, it is assumed that the event data 90 includes preset information 91 and an imaging / editing information table 92.

[0075] The preset information 91 is the same information as the preset information 61 in the staff terminal 1. For example, the content set in the preset of step S1 in FIG. 2 is similarly managed in the server apparatus 4. Note that in the event data 90, the delimiter information 63 in FIG. 5 may be synchronously managed.

[0076] The imaging / editing information table 92 has information almost the same as that of the imaging / editing information table 62. That is, it enables management of original image data, metadata, rating information, selection information, blurring information, archive information, and editing information for each image. Note that the imaging / editing information table 92 does not associate edited image data because edited images are to be created when generating a web gallery. Of course, the server device 4 may also sequentially generate edited image data and associate the edited image data with the original image data in the imaging / editing information table 92. The CPU 71 of the information processing device 70 serving as the server device 4 executes additional storage and update of information about the event data 90 as described above by the functions of the event data management unit 40 in FIG. 6.

[0077] The image set generation unit 41 in FIG. 6 is a function for generating image set content as a web gallery for a specific event. In particular, the image set generation unit 41 refers to the selection information and editing information in the event data 90 to generate image set data, that is, web page data serving as a web gallery. An example of the web gallery data to be generated is shown in FIG. 8. The server device 4 generates page information in HTML (HyperText Markup Language) format or XML (Extensible Markup Language) format as web page setting information 96 as web gallery data, and generates an image folder 97 that collects images called from the web page setting information 96 and displayed within the page. The image folder 97 contains edited image data for the images adopted as the web gallery.

[0078] The event data providing control unit 42 in FIG. 6 is a function for performing control to cause transmission for providing the event data 90 to the staff terminal 1. For example, when the staff terminal 1 logs in to the server device 4 and specifies an event, all or part of the event data 90 of the event is transmitted to the staff terminal 1. The staff terminal 1 uses the received content as event data 60 under its own management. As a result, for example, on the terminal device 1B side, an assistant can perform operations using the event data 60. Of course, it is also assumed that the event data providing control unit 42 performs event data providing control for the terminal device 1A and the personal computer 3.

[0079] The data output unit 43 controls to transmit some or all of the data included in the event data, such as metadata, rating information, selection information, blinding information, archive information, editing information, or image data (for example, original image data), to the terminal device (for example, the personal computer 3) as a file in a predetermined format. That is, it is a processing function for providing the data necessary for creating the delivered image collection content to the camera staff side.

[0080] The functions in FIG. 6 above are merely examples. By providing the information processing device 70 with the event data management unit 40, event data synchronization can be achieved between the staff terminal 1 and the server device 4. Also, by providing the server device 4 with the image collection generation unit 41, web gallery generation can be performed quickly. Each function in FIG. 6 is realized, for example, by installing an application program for creating image collection content in the information processing device 70.

[0081] <3. Pre - setting Processing> Hereinafter, specific processing examples will be described. First, the pre - setting processing example on the staff terminal 1 shown as step S1 in FIG. 2 will be described with reference to FIGS. 9 and 10. Note that the processing of the staff terminal 1 described below is the processing performed by the CPU 71 of the information processing device 70 having the functions shown in FIG. 4. Each screen example described below together with the flowchart assumes, for example, that the information processing device 70 as the staff terminal 1 is a smartphone, and shows an example of the display content on the display formed on the housing thereof.

[0082] FIG. 9 shows the processing of the staff terminal 1. For example, a camera staff activates an application program using the staff terminal 1 and performs operations for preparation processing. In response to the operation, in the staff terminal 1, the processing after step S10 is executed by the CPU 71.

[0083] In step S10, the staff terminal 1 performs a process of creating a project. This is a process of setting an event for which an image collection is to be created. For example, on the display unit 77 of the staff terminal 1 that has activated the application program, a project list screen 110 is displayed as shown in FIG. 10A. The project list screen 110 is provided with a list area 111 in which event names for individual project targets are listed. In addition, an add icon 112, a communication icon 134, a menu icon 127, etc. are displayed.

[0084] On such a project list screen 110, the camera staff creates a project for which an image collection is to be created. For example, an operation of creating one project by inputting an event name or the like is performed. For example, by operating the add icon 112, a project setting screen (not shown) is displayed, and the title of the project (for example, the event name), the date and time of the event, the location, whether or not to apply the auto-retouch setting, etc. can be set. The camera staff appropriately inputs items and performs an operation of setting the project content. In response to this, the staff terminal 1 creates one project and causes it to be displayed in the list area 111.

[0085] FIG. 10B shows an example in which two projects named "event1" and "event2" are displayed. For example, for each project, information such as the event name, date and time, and location is presented. In step S10 of FIG. 9, the staff terminal 1 performs control to provide such a user interface of the screen by the function of the UI control unit 31, and performs project creation processing according to the operation of the camera staff.

[0086] Note that this project creation processing is performed, for example, when the staff terminal 1 and the server device 4 are in an online connection state. In this case, the staff terminal 1 transmits information for synchronization processing to the server device 4 according to the operation content of the user by the function of the communication control unit 32. As a result, on the server device 4 as well, the information as one project can be synchronized and entered.

[0087] In step S11 of FIG. 9, the staff terminal 1 performs transfer settings. This transfer setting is the setting of FTP transfer with the imaging device 2, and is, for example, the setting of the file format to be transferred and the FTP connection server. The staff terminal 1 executes a screen display for transfer settings for the camera staff by the function of the UI control unit 31, and performs necessary transfer settings according to the operation of the camera staff.

[0088] In step S12, the staff terminal 1 performs auto-retouch settings. The auto-retouch setting is a process of setting parameters for image editing processing that are commonly applied to each image. The staff terminal 1 executes a screen display for auto-retouch settings for the camera staff by the function of the UI control unit 31, and performs necessary auto-retouch settings according to the operation of the camera staff. The parameters of this auto-retouch setting are described in the event data 60 of the created project as the preset information 61. Also, this auto-touch setting is also performed, for example, when the staff terminal 1 and the server device 4 are in an online connection state, and the staff terminal 1 transmits the auto-touch set parameter information to the server device 4 for synchronization processing. As a result, the server device 4 can also store, as the event data 90 of the project, the preset information 91 having the same content as the preset information 61 of the event data 60.

[0089] In step S13, the staff terminal 1 performs watermark setting. For example, the name of the cameraman can be inserted as a watermark (digital watermark) into the images of the web gallery. The watermark setting is a process of setting the presence or absence and content of this watermark. The staff terminal 1 executes a screen display for watermark setting for the camera staff by the function of the UI control unit 31, and performs necessary watermark setting according to the operation of the camera staff. The information of this watermark setting is also described in the event data 60 of the created project as the preset information 61. Also, this watermark setting is also performed when the staff terminal 1 and the server device 4 are in an online connection state, and the staff terminal 1 transmits the information of the watermark setting to the server device 4 for synchronization processing. As a result, the server device 4 can also store, in the event data 90 of the project, the preset information 91 synchronized with the preset information 61.

[0090] Note that the order of the above steps S11, S12, and S13 may be different. Also, the processing of each step does not have to be performed as a series of processing, and for example, it may be performed each time according to the user's operation during startup. Also, each process may be skipped if not necessary. For example, the transfer setting in step S11 may be performed each time a project is created in step S10. However, after the FTP transfer setting has been performed once and there is no particular need to change the setting, step S11 may be skipped and the process may move to step S12 after a project is created in step S10. Of course, the same applies to the processes in steps S12 and S13. If there is no particular need to change them after the setting, these may be skipped. Also, the communication with the server device 4 for synchronization may be performed at the timing of each process. However, by transmitting the information collectively when several settings are made, the synchronization of the preset information 61, 91 may be achieved. Furthermore, if there is content set in an environment where an online connection to the server device 4 cannot be established, when the online connection state is established, the set information should be transmitted so that the preset information 61, 91 is synchronized.

[0091] <4. Transfer / Edit Process> Subsequently, a specific example of the process of the staff terminal 1 in step S2 of FIG. 2 will be described with reference to FIG. 11. That is, it is a process mainly executed by the staff terminal 1 by the functions of the event data management unit 30, the communication control unit 32, and the image analysis unit 34 in FIG. 4 when a wedding is being held.

[0092] The staff terminal 1 checks whether the transfer of the image file from the imaging device 2 has started in step S101 of FIG. 11. During the period when the image transfer is not being performed, the process in FIG. 11 is not particularly performed. For example, during a wedding, a cameraman is using the imaging device 2 to capture images of the ceremony and the banquet. After still images are captured, for example, the imaging device 2 automatically or in response to the operation of the cameraman, sequentially transfers the image files to the staff terminal 1. Note that the transfer timing is just an example. The transfer may be performed for each captured image, or a plurality of images may be transferred collectively. In the case of video imaging, it may be transferred during a period when recording is not performed in units where recording start / stop has occurred, or it may be transferred during the recording period after recording starts. All of the recorded video may be transferred, or only the first predetermined period may be transferred.

[0093] Also, the cameraman can add rating information to the captured image by operating on the imaging device 2 side. For example, the image is confirmed immediately after imaging and the rating information is input. This rating information is described in the metadata. The transfer of the image file including the image data and metadata may be executed, for example, in response to the cameraman confirming the captured image and inputting the rating information.

[0094] When the staff terminal 1 detects that the transfer of such an image file has started, the process proceeds from step S101 to step S102, and the reception process of the image data and metadata is performed. In this case, the received image data is managed as original image data in the imaging / editing information table 62 of the event data 60. Also, the received metadata is managed correspondingly.

[0095] The staff terminal 1 performs image compression processing in step S103. For example, compression processing is performed to increase the compression ratio of the received image data. This is a process of generating image data to be transmitted to the server device 4.

[0096] In step S104, the staff terminal 1 performs the process of analyzing the blinking image. That is, image analysis processing is performed on the received image or the image compressed in step S103 to detect a person as a subject, detect pupils, and determine blinking. And when it is determined that the image of the subject person is in a blinking state, blinking information indicating that it is in a blinking state is generated for that image. The blinking information is registered in the imaging / editing information table 62 of the event data 60.

[0097] In step S105, the staff terminal 1 performs rating information management. This is a process of checking the metadata of the received image file, extracting the rating information given on the imaging device 2 side, and managing it so that it can be updated in the imaging / editing information table 62 of the event data 60.

[0098] In step S106, the staff terminal 1 transmits information to the server device 4 for synchronizing the event data 60 and 90. In this case, the staff terminal 1 transmits the image data compressed in step S103, metadata, rating information, and blink information to the server device 4. On the server device 4 side, when receiving this, the event data 90 is updated and the synchronization state with the event data 60 is maintained.

[0099] In step S107, the staff terminal 1 performs auto retouch application processing. That is, image processing is automatically performed on the original image data using pre-set retouch parameters to generate edited image data and manage it in the imaging / editing information table 62. This edited image data is generated for use in the UI display on the staff terminal 1. Note that in this example, auto retouch application processing is performed as processing at the time of receiving an image file, but it may be performed as needed at other times, for example, when display of one image is requested. It is also conceivable to perform image processing on the compressed image data generated in step S103. In that case, for example, the order of the processes in step S106 and step S107 may be swapped so that after performing image processing for applying auto retouch to the compressed image data, it is transmitted to the server.

[0100] By performing the above processing of FIG. 11, in the staff terminal 1, an image is captured according to the imaging by the cameraman, and information corresponding to the image is managed by the event data 60. For example, when a wedding ceremony ends, all captured images are in a state of being managed by the event data 60. In addition, by performing transmission for sequential synchronization, at the time of and after the wedding ceremony, the event data 90 on the server device 4 side is in a synchronized state with the event data 60 on the staff terminal 1 side.

[0101] Also, even during the process of the processing in FIG. 11, by displaying the list of images transferred from the imaging device 2 and the communication status in the time view 120 described later, the camera staff can check the image capture status to the staff terminal 1 and the like.

[0102] <5. Selection Process> [5-1 Overall Flow of Selection] Subsequently, a detailed processing example as the selection in step S3 of FIG. 2 will be described with reference to the flowcharts in FIGS. 12 to 18 and the screen examples in FIGS. 19 to 35. Note that FIGS. 12 to 18 show a series of flowcharts separately, and the connection relationships are indicated by "c1", "c2", "c3", "c4", "c5", "c6", "c7", "c8". The processing of these flowcharts is the processing by the functions of the event data management unit 30, UI control unit 31, communication control unit 32, filter processing unit 33, and delimiter determination unit 35 in FIG. 4.

[0103] Step S201 in FIG. 12 shows a process of displaying a list of projects (event names, etc.) on the project list screen 110 as shown in FIG. 10B. In step S202, the staff terminal 1 monitors whether a project selection operation has been performed on this project list screen 110, and in step S203, it monitors an end operation of the application program. If an end operation of the application program is performed, the application program is closed and the process ends.

[0104] When the camera staff makes a selection, for example, during or immediately after a wedding ceremony, they perform an operation to select the target project on the project list screen 110. For example, they perform an operation such as tapping one of the projects displayed in the list area 111. When such an operation is detected, the staff terminal 1 advances the process from step S202 to step S204 and acquires the latest event data for the selected project. For example, the staff terminal 1 requests the event data 90 of the selected project from the server device 4 and captures the transmitted event data 90. Then, it compares with the event data 60 it holds and updates to the latest information content. For example, it compares some information that can determine the newness of information, such as the update date and time information and version management information of the event data 60 and the event data 90. If they are different, the event data 60 is made to have the latest information content.

[0105] For example, assuming the terminal device 1A held by a cameraman, during the wedding ceremony, the assistant may be inputting rating information and selection information on the terminal device 1B side, and there may be cases where they are not reflected in the event data 60 on the terminal device 1A side. Also, when the assistant tries to input rating information and selection information on the terminal device 1B side, it is appropriate to input based on the latest information on the terminal device 1A side. Therefore, the staff terminal 1 receives the event data 90 of the server device 4 from which the latest information is transmitted from either of the terminal devices 1A and 1B, and updates the information of the event data 60 if its own event data 60 is not the latest.

[0106] Note that there may be cases where there is only one staff terminal 1 and the information of the staff terminal 1 is always the latest. In such cases, the process of step S204 may not be necessary.

[0107] Subsequently, the staff terminal 1 proceeds to step S211 in FIG. 13 and displays a list of event images. For example, a time view 120 as shown in FIG. 19 is displayed. The time view 120 is a list display as a simple time series display in which images are arranged in the order of imaging time in the image area 128.

[0108] The display mode of the time view 120 changes as shown in FIGS. 20A, 20B, and 20C in response to the zoom in / out operation. In FIGS. 19 and 20A, four images are arranged in a row in the image area 128, in FIG. 20B, two images are arranged in a row, and in FIG. 20C, one image is arranged in the vertical direction of the screen. The user can arbitrarily adjust the image size and view the list display.

[0109] Also, in the event image list display in step S211 of FIG. 13, the staff terminal 1 may display an event view 200 as shown in FIGS. 21 and 22 instead of the time view 120. An image area 128 is also provided in the event view 200, and images are displayed in a list. In this case, the division of sub-events and scenes is set for each image, and the list display is performed in units of sub-events and scenes. FIG. 21 shows a state in which an index bar 201 is displayed in the event view 200, and FIG. 22 shows a state in which the index bar 201 is not displayed. Details of the event view 200 will be described later.

[0110] In the time view 120 and the event view 200, an event title 121 is displayed, and an all flag icon 123, a next icon 132, a communication icon 134, a menu icon 127, etc. are also displayed.

[0111] The menu icon 127 is an operator for displaying various menu items. The communication icon 134 is an icon for displaying the FTP communication status with the imaging device 2, etc. The all flag icon 123 is an operator for performing on / off setting of a selection flag indicating that an image is an image to be used in an image collection for all images. The next icon 132 is an operator for transitioning to the next screen.

[0112] As described above, the time view 120 and the event view 200 are provided with an image area 128, and images transferred from the imaging device 2 are displayed in a list by thumbnails. For the display of the image area 128, an all tab 125 and a candidate tab 126 are provided. When the all tab 125 is selected, in the image area 128, images transferred from the imaging device 2 are displayed regardless of whether the selection flag is on or off. For example, FIG. 19 is assumed to be a list display when the all tab 125 is selected. On the other hand, when the candidate tab 126 is selected, in the image area 128, only images with the selection flag set to on among all the images transferred from the imaging device 2 are displayed in a list. For example, FIG. 23 shows an example of a list display when the candidate tab 126 is selected. The on / off of the selection flag is set by an operation by a camera staff as to whether an individual image is to be an image adopted in the web gallery.

[0113] The all tab 125 and the candidate tab 126 also display the number of corresponding images. "2065" in FIG. 23 is the number of images displayed on the all tab 125, and "54" is the number of images displayed on the candidate tab 126.

[0114] The time view 120 and the event view 200 are displayed with a view switching button 202. The time view 120 is displayed by selecting "Time" as shown in FIG. 19. Also, the event view 200 is displayed by selecting "Event" as shown in FIG. 21. The user can arbitrarily switch between the time view 120 and the event view 200 with respect to the list display. For example, each time the view switching button 202 is tapped, "Time" and "Event" are alternately switched.

[0115] Also, for each image in the image area 128 in the time view 120 and the event view 200, the eye - closing icon 210 may be displayed as shown in FIG. 20B, FIG. 20C, or FIG. 21. This is to present, by means of the above - mentioned eye - closing information, an image in which the subject person is in a state of closing eyes with an icon. Especially when displayed as relatively small thumbnail images as in FIG. 20B or FIG. 21, it may be difficult to determine whether the person is in a state of closing eyes or not. The presentation of the eye - closing state by the eye - closing icon 210 is useful for image confirmation.

[0116] However, in this example, it is assumed that the eye - closing icon 210 is not displayed in FIG. 20A. This is because when the thumbnail images are extremely small and a large number of images are to be viewed at once, if the eye - closing icon 210 is also displayed, the screen will become cluttered. On the other hand, an example of displaying the eye - closing icon 210 even in such a case can also be considered.

[0117] Also, for each image in the image area 128 in the time view 120 and the event view 200, a rating icon 130 and a flag - setting icon 131 are displayed corresponding to the image, as shown in FIG. 20B, FIG. 20C, or FIG. 21.

[0118] The rating icon 130 not only displays rating information set by the number of stars but also serves as an operator for changing the rating. For example, by tapping or sliding on the part of the rating icon 130, the number of stars can be changed, which is the rating change operation. The flag setting icon 131 represents the on / off state of the selection flag, for example, by changing the color or brightness of the icon. The flag setting icon 131 also serves as an operator for switching the on / off state of the selection flag. For example, the on / off state of the selection flag can be switched by a tap operation.

[0119] In addition, in FIG. 20A, the rating icon 130 and the flag setting icon 131 are not displayed. This is to ensure that the rating icon 130 and the flag setting icon 131 are displayed when the image is in a size that is easy to view or easy to operate, as shown in FIG. 20B. Of course, the rating icon 130 and the flag setting icon 131 may also be displayed corresponding to the image even in the state of FIG. 20A.

[0120] In addition, a filter specification area 129 is provided in the time view 120 and the event view 200. By the rate specification icon 137 in the filter specification area 129, for example, images can be filtered by a six-level rating. For example, an operator in the form of the number of stars is provided, and filtering is performed according to the specified operator, and the extracted images are displayed in a list in the image area 128.

[0121] For example, when an operator with three stars is operated, images with a rating information of "three stars" or more (that is, images corresponding to any of "three stars", "four stars", and "five stars") are extracted and displayed in a list. Alternatively, in this case, only images with a rating information of "three stars" may be extracted and displayed in a list.

[0122] In addition, in the filter specification area 129, together with the rate specification icon 137 represented by the number of stars, the number of images with the set rating is also shown. Furthermore, a filter operation icon 136 is displayed in the filter specification area 129. By operating the filter operation icon 136, it is possible to set filter conditions other than the rating and filter the displayed images.

[0123] When the staff terminal 1 displays the time view 120 or the event view 200 as described above in step S211 of FIG. 13, it performs the processing of the monitoring loop from step S212 to step S222 of FIG. 15.

[0124] In step S212 of FIG. 13, the staff terminal 1 monitors the operation of the next icon 132. The processing when the operation of the next icon 132 is detected will be described later.

[0125] In step S213, the staff terminal 1 monitors the tab switching operation. The tab switching operation is an operation on the candidate tab 126 during the list display in the all tab 125 or an operation on the all tab 125 during the list display in the candidate tab 126. When detecting the tab switching operation, the staff terminal 1 performs the process of switching the list display content in the image area 128 according to the selected tab in step S240.

[0126] In step S214, the staff terminal 1 monitors the operations related to the screen state performed by the camera staff on the image area 128. The operations related to the screen state here refer to operations such as image enlargement / reduction, screen scrolling, appearance / disappearance of display items, etc.

[0127] For example, the staff terminal 1 monitors the pinch operation. The pinch operation here refers to the pinch-out operation for image enlargement and the pinch-in operation for image reduction. When detecting the pinch operation, the staff terminal 1 enlarges or reduces the display state in the image area 128 in step S241.

[0128] FIGS. 20A, 20B, and 20C show examples of changes in the display of the image area 128 according to the pinch-in / pinch-out. FIG. 20A shows the display state where the thumbnail image is the smallest. When the pinch-out operation is performed, the images displayed in the list are enlarged as shown in FIG. 20B. Further, it is enlarged as shown in FIG. 20C by the pinch-out operation. When a pinch-in operation is performed, it shrinks from the state of FIG. 20C to the state of FIG. 20B, and further returns to the state of FIG. 20A by the pinch-in operation. Also, as described above, the display presence or absence of the blink icon 210, the rating icon 130, the flag setting icon 131, etc. is also switched according to the enlargement / reduction.

[0129] Also, in step S214, the staff terminal 1 also monitors the swipe operation. For example, in the time view 120 as shown in FIG. 19 or the event view 200 as shown in FIG. 21, the up and down swipe operations are recognized as scroll operations in the up and down directions, and the display is vertically scrolled in step S241. Also, the left and right swipe operations in the event view 200 are recognized as scroll operations in the left and right directions, and the staff terminal 1 horizontally scrolls the display in step S241. Also, the staff terminal 1 recognizes a rightward swipe operation on the index bar 201 in the event view 200 as shown in FIG. 21 as an operation to delete the index bar 201, and recognizes a leftward swipe operation from the right end of the screen in the state of FIG. 22 as an operation to call out the index bar 201. Then, in step S241, display control is performed to close or appear the index bar 201.

[0130] In step S215 of FIG. 13, the staff terminal 1 monitors whether an operation of selecting one of the images displayed in the image area 128 has been performed. For example, it is an operation such as tapping one thumbnail image. The processing when this selection operation is detected will be described later.

[0131] In step S216, the staff terminal 1 monitors the filter operation. That is, it is an operation of the rate designation icon 137 in the filter designation area 129 or an operation of the filter operation icon 136. When detecting an operation of any operator in the filter specification area 129, the staff terminal 1 proceeds to step S242, sets and stores filter conditions according to the operation, performs filtering processing according to the filter conditions, and extracts the corresponding image. Then, the extracted image of the filtering result is displayed in a list in the image area 128. By detecting the end of the filtering process in step S243, the monitoring loop is returned to. Note that specific examples of the processing in steps S242 and S243 when the filter operation icon 136 is operated will be described later.

[0132] Subsequently, in step S217 of FIG. 14, the staff terminal 1 monitors the rating operation. For example, it is an operation on the rating icon 130 as shown in FIGS. 20B, 20C, and 21. When detecting an operation on the rating icon 130, the staff terminal 1 proceeds to step S230 and updates the event data 60 so that the rating information of the image corresponding to the rating icon 130 becomes a value according to the operation. Also, in step S231, the staff terminal 1 transmits the updated rating information to the server device 4 so that the event data 90 is updated on the server device 4 side. That is, the synchronization state is maintained.

[0133] In step S218, the staff terminal 1 monitors the flag on / off operation. For example, it is an operation on the flag setting icon 131 as shown in FIGS. 20B, 20C, and 21. When detecting an operation on the flag setting icon 131, the staff terminal 1 proceeds to step S232 and updates the event data 60 so that the on / off of the selection flag is switched as the selection information of the image corresponding to the flag setting icon 131. Also, in step S233, the staff terminal 1 transmits the updated flag information to the server device 4 so that the event data 90 is updated on the server device 4 side. That is, the synchronization state is maintained.

[0134] In step S219, the staff terminal 1 monitors the operation of the all-flag icon 123. When an operation on the all-flag icon 123 is detected, the staff terminal 1 proceeds to step S234 and branches the process depending on whether the selection flags of all current images are on or not. If some of the images are flag-on or all are flag-off and not all are in the flag-on state, the staff terminal 1 proceeds to step S236 and updates the event data 60 to set the flag to on for all images. On the other hand, if the all-flag icon 123 is operated when all images are flag-on, the staff terminal 1 proceeds to step S235 and updates the event data 60 to set the flag to off for all images. Also in step S237, the staff terminal 1 transmits the updated flag information to the server device 4 so that the event data 90 on the server device 4 side is updated. That is, the synchronization state is maintained.

[0135] In step S220 of FIG. 15, the staff terminal 1 monitors the switching operation to the time view 120. That is, in the display state of the event view 200, when the display of the time view 120 is instructed by the operation of the view switching button 202. In this case, the staff terminal 1 proceeds to step S350 and performs the process of switching to the display of the time view 120.

[0136] In step S221, the staff terminal 1 monitors the switching operation to the event view 200. That is, in the display state of the time view 120, when the display of the event view 200 is instructed by the operation of the view switching button 202. In this case, the staff terminal 1 will perform the processes shown from step S351 to step S359. The details of these processes will be described later together with the explanation of the image transition related to the event view 200.

[0137] In step S222, the staff terminal 1 monitors the update operation for the scene setting. The scene setting refers to the setting of the separation of sub-events and scenes in the event view 200, and the update here refers to the recalculation of the separation determination process. In response to this update operation, the staff terminal 1 performs the processes from step S360 to step S363, but this process will be described later as a process related to the event view 200.

[0138] After the monitoring process up to step S222 above, the staff terminal 1 returns to step S211 in FIG. 13 and repeats the monitoring process.

[0139] Subsequently, the process when an image selection operation is detected in step S215 of FIG. 13 will be described. That is, it is a case where the user performs an operation of selecting one image from the list in the time view 120 or the event view 200. In this case, the process of the staff terminal 1 proceeds to step S250 in FIG. 16, and a single display screen 140 as shown in FIG. 24 is displayed.

[0140] A single display area 142 is provided on the single display screen 140, and the selected image is displayed large. The image displayed in this single display area 142 is, for example, an image based on the edited image data managed by the event data 60. That is, it is the edited image data generated by the auto-retouch application process in step S107 of FIG. 11, and is a playback image of the image data reflecting the retouch parameters in the preset information 61. In addition, a focus point mark 148 indicating the in-focus position in the image may be displayed on the image.

[0141] In addition, on the single display screen 140, a return icon 133 which is an operator for returning the display to the time view 120 or the event view 200, a filter condition icon 138 for displaying the filter condition, a rating icon 130 for the displayed image, and a flag setting icon 131 are displayed.

[0142] When the image shows a closed-eye state based on the eye closure information, the closed-eye icon 210 is displayed.

[0143] Furthermore, on the single-display screen 140, an edit icon 145, a focus point operation icon 146, an export icon 149, an archive icon 135, and an original icon 141 for operating on the displayed image are displayed.

[0144] With such a single-display screen 140 being displayed, the staff terminal 1 performs the monitoring loop process from step S251 to step S259 in FIGS. 16 and 17.

[0145] In step S251, the staff terminal 1 monitors the operation of the edit icon 145. When the operation of the operator of the edit icon 145 is detected, the staff terminal 1 proceeds to step S260 and displays an edit screen (not shown). In the edit screen, for example, a user interface enabling retouch operations and tilt correction operations is provided, and the camera staff can perform image editing operations using the user interface. As retouch operations, for example, as retouch parameters, a brightness adjustment value, a color adjustment value, a contrast adjustment value, a sharpness adjustment value, etc. can be set. As a tilt correction operation, for example, an operator for adjusting the angle of the image is provided. Note that the edit screen may be a screen separate from the single-display screen 140, or may be a screen that is superimposed on the single-display screen 140 to display various operators.

[0146] When the staff terminal 1 detects a retouch operation, it proceeds from step S261 to step S262 and performs retouch processing. This is a process of further editing the edited image data based on the retouch parameters input by the operation of the camera staff. Also, in this case, the input retouch parameters are stored in the event data 60 as edit information for individual image data.

[0147] When the staff terminal 1 detects a tilt correction operation, it proceeds from step S263 to step S264 and performs tilt correction processing on the image. This is a process of editing the edited image data according to the tilt correction parameters input by the operation of the camera staff. Also, in this case, the input tilt correction parameters are stored in the event data 60 as editing information for individual image data.

[0148] When it detects the end of the editing operation in step S265, the staff terminal 1 transmits the editing information of the event data 60 updated according to the editing process to the server device 4 in step S266, so that the event data 90 on the server device 4 side is updated. That is, the synchronization state is maintained. In step S267, the staff terminal 1 closes the editing screen and returns to the normal single display screen 140. The image displayed at this time is made to reflect the editing result. In this way, by the operation from the editing icon 145, the camera staff can perform retouching and tilt correction of arbitrary images.

[0149] In the display state of the single display screen 140, the staff terminal 1 monitors the operation of the focus point operation icon 146 in step S252. When detecting the operation of the focus point operation icon 146, the staff terminal 1 proceeds to step S270 and branches the process according to whether the focus point mark 148 is currently displayed on the image in the single display area 142. If the focus point mark 148 is not currently being displayed, the staff terminal 1 proceeds to step S271 and acquires the focus point information about the displayed image. The focus point is information indicating the position where the imaging device 2 was in the in-focus state within the image at the time of imaging, and is described in the metadata. For example, the focus point is described by the coordinate information of a point within the image.

[0150] The staff terminal 1 acquires the focus point information from the metadata of the displayed image, and according to that information, as shown in FIG. 24, it causes a focus point mark 148 to be displayed on the displayed image. For example, with the coordinate information of a single point within the image stored as the focus point as the center, the focus point mark 148 is made to be displayed as a region having a predetermined spread. As a result, the user can confirm the subject that was in focus during imaging.

[0151] Note that in FIG. 24, the display mode of the focus point mark 148 is a mark (a square represented by parentheses) that displays at the four corners, but other display modes such as a rectangular frame or a circular frame may also be used. Also, multiple focus point marks 148 may be displayed. Also, as shown in FIG. 24, it is assumed that the focus point mark 148 is displayed on a single display screen, but for example, the focus point mark 148 may be displayed on the images listed in the image area 128 of the time view 120 or the event view 200.

[0152] When the operation of the focus point operation icon 146 is detected in step S252 while the focus point mark 148 is being displayed, the staff terminal 1 proceeds from step S270 to step S273, and ends the display of the focus point mark 148. Therefore, the camera staff can turn the display of the focus point mark 148 on / off using the focus point operation icon 146.

[0153] In step S253, the staff terminal 1 monitors the on / off operation of the filter condition display. That is, it monitors the operation on the filter condition icon 138. In that case, the staff terminal 1 proceeds to step S268 and controls the display related to the setting of the filter conditions as will be described later with reference to FIG. 33.

[0154] The staff terminal 1 monitors the operation of the export icon 149 in step S254 of FIG. 17 in the display state of the single display screen 140. When the operation of the export icon 149 is detected, the staff terminal 1 proceeds to step S280 and performs export processing. That is, export processing is performed on the information regarding the displayed image data.

[0155] In step S255, the staff terminal 1 monitors the image switching operation. The image switching operation in this case is the operation of the original icon 141. When the operation of the original icon 141 is detected, the staff terminal 1 proceeds to step S281 and switches between the image by the original image data and the image by the edited image data. That is, if the reproduced image by the edited image data was being displayed at that time, the reproduced image by the original image data is displayed. Also, if the reproduced image by the original image data was being displayed at that time, the reproduced image by the edited image data is displayed. Therefore, the camera staff can arbitrarily compare the edited image and the original image by operating the original icon 141.

[0156] On the single display screen 140, the rating icon 130 for the currently displayed image is displayed. In step S256, the staff terminal 1 monitors the rating operation. When an operation on the rating icon 130 is detected, the staff terminal 1 proceeds to step S282 and updates the event data 60 so that the rating information of the displayed image becomes a value corresponding to the operation. Also in step S283, the staff terminal 1 transmits the updated rating information to the server device 4 so that the event data 90 is updated on the server device 4 side. That is, the synchronization state is maintained.

[0157] On the single display screen 140, the flag setting icon 131 for the currently displayed image is displayed. In step S257, the staff terminal 1 monitors the flag on / off operation, that is, the operation of the flag setting icon 131. When an operation on the flag setting icon 131 is detected, the staff terminal 1 proceeds to step S284 and updates the event data 60 so that the on / off state of the flag in the selection information of the displayed image is switched. Also in step S285, the staff terminal 1 transmits the updated flag information to the server device 4 so that the event data 90 on the server device 4 side is updated. That is, the synchronization state is maintained.

[0158] In step S258, the staff terminal 1 monitors the archive operation on the image. When an archive operation is detected, the staff terminal 1 performs the processes from step S390 to step S395. The processes related to these archives will be described later.

[0159] In step S259, the staff terminal 1 monitors the operation of the return icon 133. When an operation of the return icon 133 is detected, the staff terminal 1 proceeds to step S211 in FIG. 13, ends the single display screen 140, and returns to the state of displaying the time view 120 or the event view 200.

[0160] Although omitted in the flowchart, for example, on the single display screen 140, it is also possible to switch the image to the previous image or the next image by a swipe operation in the left - right direction.

[0161] [5 - 2 Filter Processing Based on Archive and Blurring] Here, the above - mentioned processes related to the archive, the processes according to the blurring information, and further the filter processing using them will be described in detail.

[0162] First, the archive operation detected by the staff terminal 1 in step S258 of FIG. 17 will be described. FIG. 25A shows an example of an archive operation on the single display screen 140. One is the operation of the archive icon 135. Another is a swipe operation upward on the screen for the image, indicated by the arrow UP. On the single-display screen 140, the user can archive the displayed image by, for example, these two operations. In this embodiment, the archive operation is possible in the case of the single-display screen 140 in this way, and the archive operation is not possible in the case of the list displays such as the time view 120 and the event view 200. However, when a single image is largely displayed as shown in FIG. 20C in the time view 120, the archive icon 135 may be displayed, and thus the archive operation may be made possible.

[0163] When the staff terminal 1 detects an archive operation in step S258 of FIG. 17, it proceeds to step S390 and performs a display switch according to the display setting at that time. The display setting in this case is a setting as to whether or not to display the archived image. This can be selected by the filtering setting.

[0164] In the case of the setting to display the archived image, the image is not switched as shown in FIG. 26B according to the archive operation in FIG. 26A. In this case, the display color of the archive icon 135 is changed to indicate that the displayed image has been archived. Therefore, on the single-display screen 140, the archive icon 135 also has a function of indicating whether or not the image being displayed has been archived.

[0165] In the case of the setting not to display the archived image, according to the archive operation in FIG. 27A, it immediately switches to another image as shown in FIG. 27B. The image to be switched is the next image in the chronological order. If there is no next image, the previous image in the chronological order is used. Also, if there is no image that can be displayed, it notifies that there is no image to be displayed as shown in FIG. 27C.

[0166] As described in the above example, the staff terminal 1 switches the displayed image according to the display setting in step S390, and executes a toast display for a predetermined time (for example, about 5 seconds) for undo on the screen in step S391. An example of the toast display 220 is shown in FIG. 25B. In this toast display 220, it notifies that the archiving has been done and enables the "undo" operation.

[0167] If the user does not perform the "undo" operation, that is, the undo operation, the staff terminal 1 proceeds from step S392 to step S393 in FIG. 17 and updates the archive information. That is, the staff terminal 1 updates the archive information of the event data 60 so that the displayed image is regarded as archived. Also in step S394, the staff terminal 1 transmits the updated archive information to the server device 4 so that the event data 90 is updated on the server device 4 side. That is, the synchronization state is maintained.

[0168] On the other hand, if the user selects the "undo" operation, that is, undo, for the toast display 220 in step S391, the staff terminal 1 proceeds from step S392 to step S395 in FIG. 17 and returns the display. That is, if the display is switched as shown in FIG. 27B in step S390, the display is returned to the state of FIG. 27A. Also, if the archive icon 135 is changed as shown in FIG. 26B, it is returned to the state of FIG. 26A. Then it proceeds to step S259. That is, in this case, the archive setting processes in steps S393 and S394 are not performed. As a processing example, there is also a processing example in which the archive information is updated in steps S393 and S394 while performing the toast display 220, and if an undo operation is performed, the archive information is restored.

[0169] By enabling the archiving of images as described above, camera staff can archive images that do not need to be displayed, reducing the number of images to be listed or individually displayed in combination with the filtering described below. This reduces the population of the selection work and enables efficient selection. In particular, for images that can be immediately determined by camera staff not to be adopted in the image collection, archiving them is suitable for improving selection efficiency. Furthermore, by archiving images with the selection flag turned on and not displaying them in combination with the filtering process, it is also possible to reduce the population of images at the time of selection. Since the archive information is treated as separate information from the selection information in the event data 60, archiving does not affect the selection flag.

[0170] Note that once archived images can also be unarchived. For example, when the archive icon 135 indicating that it has been archived due to a color change is operated, the image is unarchived.

[0171] As for the processing of the staff terminal 1, for the archive operation detected in step S258, in the case of unarchiving (that is, for the archive operation on the archived image), in step S390, a dialog for unarchiving is displayed, in step S393, the update of unarchiving is performed, and accordingly, the processing of step S394 is performed.

[0172] Mention is also made of the eye closure information. As described in step S104 of FIG. 11, the staff terminal 1 performs an eye closure determination on the image received from the imaging device 2 and sets the eye closure information. Then, as described above, in the time view 120, the event view 200, and the single display screen 140, based on the eye closure information, an eye closure icon 210 is displayed for an image of the subject person in the eye closure state.

[0173] By combining this eye occlusion information with filtering, it is also possible to reduce the number of images to be displayed in the list view or individual view, reduce the number of candidates for the selection operation, and improve the efficiency of selection. In addition, in the event data 60, since the eye occlusion information is treated as information separate from the selection information, the eye occlusion information does not affect the selection flag. In other words, even an image determined to be in the eye occlusion state can be adopted in the image set with the selection flag turned on.

[0174] The filtering using the above eye occlusion information and archive information will be described. As described above, in the time view 120 and the event view 200, the filter operation icon 136 is displayed. FIG. 28A shows a state in which the filter operation icon 136 is operated. By this operation, the process of the staff terminal 1 proceeds from step S216 in FIG. 13 to step S242, sets filter conditions according to the operation, and performs filtering and corresponding display changes as follows.

[0175] First, a display example for setting filter conditions is shown in FIG. 28B. A filter condition setting section 221 is displayed on the screen and is made operable by the user. The filter condition setting section 221 is provided with a close button 222, a camera condition button 223, an archive condition button 224, an eye occlusion condition switch 225, and information buttons 226 and 227.

[0176] The eye occlusion condition switch 225 is a switch for selecting whether to display eye occlusion images, and the user can arbitrarily select on / off of the display of eye occlusion images.

[0177] When the archive condition button 224 is operated, an archive condition setting section 230 is displayed as shown in FIG. 28D, and the user can select archive conditions. For example, check boxes 232 are provided for "display archived images" and "display non-archived images". Also, the number of archived images (80) and the number of non-archived images (123) are displayed.

[0178] As a result, the user can · display only archived images · display only non-archived images · display both archived and non-archived images select any one of them.

[0179] Instead of displaying the above archive condition buttons 224 (and the corresponding archive condition setting unit 230), an archive condition switch may be provided in the same way as the eye closure condition switch 225 so that the user can simply select on / off of the filter condition for archived images. In that case, the selectable conditions are · display only non-archived images · display both archived and non-archived images and either one of them may be considered.

[0180] When the camera condition button 223 is operated, a camera condition setting unit 235 is displayed as shown in FIG. 28C, and the user can select camera conditions. The camera conditions are conditions for specifying the imaging device 2 that has captured an image. Model information and serial numbers of the imaging device 2 are added to the metadata of each image. In the camera condition setting unit 235, information on the imaging device and check boxes 232 are displayed for all images of the event to be processed. For example, in this case, the model name and serial number are displayed. For the imaging device 2 with an unknown serial number, only the model name is displayed. Also, for each imaging device 2, the number of images is displayed. For example, in this figure, the number of images is displayed as "80", "123", and "333".

[0181] In this example, three imaging devices 2 are displayed. If there are three or more imaging devices 2, they will be displayed by a scroll operation. The user can specify the imaged imaging device 2 by checking the checkbox 232 and set the filter condition to display the image of that imaging device 2.

[0182] Whenever the condition is changed in any of the filter condition setting unit 221, camera condition setting unit 235, and archive condition setting unit 230 of the staff terminal 1, filtering is performed with the new condition, and the resulting image display and other display changes are made. That is, as the process of step S242 in FIG. 13, filtering is performed based on the condition settings of the eye closure condition switch 225, archive condition setting unit 230, and camera condition setting unit 235 at that time. Then, the extracted image of the filtering result is displayed in a list in the image area 128.

[0183] When the return icon 228 is operated in the camera condition setting unit 235 in FIG. 28C and the archive condition setting unit 230 in FIG. 28D, the display returns to the filter condition setting unit 221 in FIG. 28B. Also, when the close button 222 is operated in any of FIGS. 28B, 28C, and 28D, the filter condition setting unit 221, camera condition setting unit 235, or archive condition setting unit 230 is closed and returns to the state of FIG. 28A. This is the case when it is determined that the filter setting change is completed in step S243 of FIG. 13 and the monitoring loop is returned to. Note that not limited to the close button 222, when an area other than the filter condition setting unit 221, camera condition setting unit 235, or archive condition setting unit 230 is tapped on the screen, it may be similarly regarded as the end of the filter setting change and returned to the monitoring loop from step S243.

[0184] As display changes according to filtering, not only the displayed image but also the display mode of the filter operation icon 136 and the display of the number of images are executed. Figure 29A shows the state before filtering is executed, and Figure 29B shows the state after filtering is executed. For example, it is assumed that the display of the blurred image is turned off by the eye closure condition switch 225. As the images listed in the image area 128, Figure 29A includes the blurred image, but in Figure 29B, the blurred image is not displayed. Also, the filter operation icon 136 changes color in the state of Figure 29B where filtering has been performed. This indicates that it is a list display after filtering. Also, the number of images displayed in the all tab 125 changes from "2065" to "2010". This represents a decrease in the number of images corresponding to the fact that the blurred image is no longer displayed due to filtering.

[0185] Note that the change in the display of the number of images is immediately made when the filter conditions are changed. In Figure 30A, all three imaging devices 2 are selected in the camera condition setting unit 235, the number of images of each imaging device 2 is "100", "1000", and "1065", and the number of images displayed in the all tab 125, that is, the total number, is "2165". Figure 30B shows the state where the user unchecks the first imaging device 2 from this state. In response to 100 images becoming non-displayable due to filtering, the number of images displayed in the all tab 125 becomes "2065".

[0186] When the information button 226 is tapped as shown in Figure 31A, the guidance display in Figure 31B is performed. Here, a guide to the settings in the imaging device 2 for performing filtering for each model is displayed. When the information button 227 is tapped as shown in Figure 32A, the guidance display in Figure 32B is performed. Here, it is displayed that the archiving of images is executable on the single display screen 140. The guidance displays in Figures 31B and 32B are closed by an OK operation.

[0187] Each process such as the above filter condition setting, filtering, display change, and guidance display is performed in step S242 of FIG. 13. Depending on this filtering, the display of archived images, blurred images, and images for each model of the imaging device 2 can be turned on / off. This improves the efficiency of user selection. Note that the filter process is merely to set whether to display on the screen or not. Even if it becomes invisible due to the filter process, it does not affect the adoption / non-adoption into the image collection. That is, it does not affect the setting of the selection flag.

[0188] The non-display of images by filtering is also effective when the candidate tab 126 is displayed. That is, even if the selection flag is on, there may be images that are made non-displayed in the candidate tab 126. This can be used to reduce the population when reexamining those with the selection flag once turned on in the candidate tab 126, etc. For example, when migrating from the candidate tab 126 to the single-display screen 140 and archiving the image that must be used for delivery, and then making the archived image non-displayed in the candidate tab 126, the population for selection can be reduced when selecting an image to unselect the selection flag.

[0189] By the way, when displaying the images extracted under the selected filter conditions, it is desirable to clearly inform the user that not all images are being displayed. Therefore, the display mode of the filter operation icon 136 is changed as shown in FIG. 29B. For example, change the color. Thus, even if the user selects the all tab 125, they can recognize that not all images are being shown.

[0190] On the other hand, in the case of the single display screen 140, it is convenient to be able to know the current filter conditions. Therefore, on the single display screen 140, as shown in FIG. 33A, by operating the filter condition icon 138, the filtering condition display in FIG. 33B is performed. That is, the setting states regarding the rating conditions, the conditions of the model of the imaging device, the display of archived images / non-archived images, and the display of blurred images are shown. This corresponds to the processes of steps S253 and S268 in FIG. 16. By showing the current filtering conditions, it is possible to recognize under what conditions the current image is being displayed.

[0191] Note that when an OK operation is performed in the filtering condition display in FIG. 33B, it corresponds to the off operation of the filter condition display in step S253 of FIG. 16. In this case, the filter condition display in FIG. 33B is terminated in step S268.

[0192] [5-3 Cover, Highlight Selection] Subsequently, the process when the operation of the next icon 132 is detected in step S212 of FIG. 13 will be described. In this case, the process of the staff terminal 1 proceeds to step S300 in FIG. 18, and a cover / highlight selection screen 150 as shown in FIG. 34 is displayed.

[0193] The cover / highlight selection screen 150 is a screen for the camera staff to perform an operation of selecting an image to be used as a cover (front cover) or an image to be highlighted in the web gallery. The return icon 133 and the next icon 132 are displayed on the cover / highlight selection screen 150.

[0194] In addition, a list designation area 153 is provided on the cover / highlight selection screen 150, and a candidate tab 151 and a selection tab 152 are prepared. When the candidate tab 151 is selected, the images flagged on (that is, the images selected as those to be used in the web gallery) are listed and displayed in the list designation area 153. For each image, a highlight button 155 and a cover button 156 are displayed. The highlight button 155 is an operator for specifying image highlighting, and the cover button 156 is an operator for specifying the image as a cover. Note that the highlight button 155 may also represent the presence or absence of the current highlight setting according to its display mode, and the cover button 156 may represent the current cover setting state according to its display mode. When the selection tab 152 is selected, the images designated as cover or highlight are listed and displayed in the list designation area 153.

[0195] The camera staff operates such a cover / highlight selection screen 150 to select an image to be covered or highlighted.

[0196] With the cover / highlight selection screen 150 being displayed in step S300 of FIG. 18, the staff terminal 1 performs the processing of the monitoring loop from step S301 to step S305.

[0197] In step S301, the staff terminal 1 monitors the operation of the cover button 156. When an operation on the cover button 156 is detected, the staff terminal 1 proceeds to step S310, sets the cover image information in the selection information so as to set the corresponding image as the cover image, and updates the event data 60. Also in step S311, the staff terminal 1 transmits the updated selection information to the server device 4 so that the event data 90 is updated on the server device 4 side. That is, the synchronization state is maintained.

[0198] In step S302, the staff terminal 1 monitors the operation of the highlight button 155. When an operation on the highlight button 155 is detected, the staff terminal 1 proceeds to step S320, sets the highlighted image information in the selection information so as to set the corresponding image as the highlighted image, and updates the event data 60. Also, in step S321, the staff terminal 1 transmits the updated selection information to the server device 4 so that the event data 90 is updated on the server device 4 side, that is, the synchronization state is maintained.

[0199] In step S303, the staff terminal 1 monitors the tab switching operation. The tab switching operation in this case is an operation of the selected tab 152 during the list display on the candidate tab 151 or an operation of the candidate tab 151 during the list display on the selected tab 152. When detecting the tab switching operation, the staff terminal 1 performs a process of switching the list display content in the list specification area 153 according to the selected tab in step S330.

[0200] In step S305, the staff terminal 1 monitors the operation of the back icon 133. When detecting the operation of the back icon 133, the staff terminal 1 proceeds to step S211 in FIG. 13 and returns to the display state of the time view 120 or the event view 200. Thereby, the camera staff can interrupt the cover - highlight designation or re - select from the flag setting.

[0201] When completing the operation on the cover - highlight selection screen 150, the camera staff operates the next icon 132. In step S304 of FIG. 18, the staff terminal 1 monitors the operation of the next icon 132. When detecting the operation of the next icon 132, the staff terminal 1 proceeds to step S340 and displays a confirmation screen.

[0202] An example of the confirmation screen 160 is shown in FIG. 35. On the confirmation screen 160, a back icon 133, a next icon 132 are prepared, and a detail area 161 is prepared, and the final confirmation content is displayed. For example, details such as the number of images with flags to be adopted in the web gallery, the number of images to be highlighted, the title, and the date are displayed.

[0203] The staff terminal 1 monitors the operation of the next icon 132 in step S341 of FIG. 18 and monitors the operation of the return icon 133 in step S342. When detecting the operation of the return icon 133, the staff terminal 1 returns to step S300 and returns to the display state of the cover highlight selection screen 150.

[0204] When detecting the operation of the next icon 132, the staff terminal 1 proceeds to step S343 and transmits a web gallery generation request to the server device 4. Then it proceeds to step S201 of FIG. 12 and returns to the display state of the project list screen 110. In this case, it may also proceed to step S211 of FIG. 13 and return to the time view 120 or the event view 200.

[0205] <6. Server Processing> So far, the processing of the staff terminal 1 up to the selection stage of step S3 of FIG. 2 has been described. Here, the processing on the server device 4 side will be described. FIG. 36 shows the processing of the server device 4 corresponding to the communication from the staff terminal 1. The processing of the server device 4 mentioned below is the processing performed by the CPU 71 of the information processing device 70 having the functions of FIG. 6. In this FIG. 36, it is mainly the processing executed by the functions of the event data management unit 40 and the image set generation unit 41.

[0206] At the stage of step S1 of FIG. 2, the pre-set information from the staff terminal 1 is transmitted to the server device 4. When the server device 4 receives the information regarding the project setting from the staff terminal 1, it proceeds from step S500 to step S510 and performs project setting processing within the server device 4.

[0207] The communication of project settings from the staff terminal 1 is the communication that the staff terminal 1 performs with the server in the processes from step S10 to step S13 in FIG. 9. For example, information such as the event name, date and time, and location of the created project is transmitted. The server device 4 sets a new project based on this information and sets the event data 90. Also, on the staff terminal 1 side, not only the settings of the project itself but also auto-retouch settings, watermark settings, etc. are performed, and sequential setting information is transmitted to the server device 4. The server device 4 describes these information as the pre-setting information 91 of the event data 90, thereby synchronizing the event data 90 with the event data 60 in the pre-set state.

[0208] At the stage of step S2 in FIG. 2, metadata including images and rating information transferred from the imaging device 2, eye closing information, etc. are transmitted to the server device 4 by the process of step S105 in FIG. 11 of the staff terminal 1. When the server device 4 receives an image or metadata from the staff terminal 1, it proceeds from step S501 to step S520 in FIG. 36, and takes in the image and metadata as information of the event data 90 of the corresponding project. The rating information in the metadata is extracted from the metadata and managed in an updatable state in the event data 90 thereafter.

[0209] At the stage of step S3 in FIG. 2, during the processes from FIG. 12 to FIG. 18 of the staff terminal 1, various information for maintaining synchronization with the imaging device 2 is transmitted from the staff terminal 1 to the server device 4.

[0210] When the server device 4 receives the rating information from the staff terminal 1, it proceeds from step S502 to step S530 in FIG. 36, and updates the rating information for the corresponding image in the event data 90 of the corresponding project.

[0211] When the server device 4 receives the selection information from the staff terminal 1, it proceeds from step S503 to step S540, and updates the selection information for the corresponding image within the event data 90 of the corresponding project. That is, updates such as the usage image information by flag setting, the cover image information as a cover, and the highlighted image information by highlight setting are sequentially performed on the server device 4 side as well.

[0212] When the server device 4 receives the editing information from the staff terminal 1, it proceeds from step S504 to step S550, and updates the editing information for the corresponding image within the event data 90 of the corresponding project.

[0213] When the server device 4 receives the archive information from the staff terminal 1, it proceeds from step S505 to step S555, and updates the archive information for the corresponding image within the event data 90 of the corresponding project.

[0214] When the server device 4 receives the web gallery editing information from the staff terminal 1, it proceeds from step S506 to step S560. This is the information transmitted by the staff terminal 1 in step S343 of FIG. 18. In step S560 of FIG. 36, the server device 4 first performs an image editing process using the parameters as the editing information (including the editing information according to the pre-set information 61) for each image flagged on as the usage image information, and writes it out as an image for the web gallery. That is, each edited image stored in the image folder 97 of FIG. 8 is generated.

[0215] In step S561 of FIG. 36, the server device 4 performs a web gallery generation process. That is, for example, the web page setting information 96 of FIG. 8 is generated as HTML data or the like, and is also entered as a web page. Thereby, a web gallery is formed. In step S562 of FIG. 36, the server device 4 transmits the URL (Uniform Resource Locator) of the web gallery to the staff terminal 1, enabling the staff terminal 1 to view the web gallery. At this point, the web gallery is still set to private, and only the staff terminal 1 at the URL destination can view it.

[0216] The above is the processing of the server device 4 corresponding to the processing of the staff terminal 1 up to step S3 of FIG. 2. Although not shown in FIG. 36, the server device 4 will perform processing to provide event data 90 to the staff terminal 1 that has logged in as needed (see the description of step S201 in FIG. 12).

[0217] After generating the web gallery, at the stage of step S4 in FIG. 2, a share request is sent from the staff terminal 1 to the server device 4 (to be described later in FIG. 37). In that case, the staff terminal 1 proceeds from step S507 to step S570 in FIG. 36 and sets the corresponding web gallery to public, for example, making it viewable even from the client terminal 5.

[0218] <7. Web Gallery Delivery Process> The processing of the staff terminal 1 at the stage of the web gallery delivery process in step S4 of FIG. 2 will be described with reference to FIG. 37. When a web gallery generation request is sent to the server device 4 as described above, the server device 4 generates a web gallery based on the event data 90, and the URL of the web page is sent. FIG. 37 shows the processing of the staff terminal 1 after obtaining the URL.

[0219] The staff terminal 1 accesses the web page using the URL obtained in step S370, enabling the staff terminal 1 to preview and view the web gallery. This is for preview by camera staff for confirmation, and the web gallery for the preview will be like the preview screen 180 in FIG. 38, for example. For example, a web gallery created in the preview area 183 is displayed, and an edit button 181 and a share button 182 are provided.

[0220] The content of the web gallery displayed in the preview area 183, that is, the web gallery created by the server device 4, is configured to arrange images with the flag turned on in chronological order, for example. Also, the image with the cover image information set is displayed at the top as the cover. Also, the image highlighted by the highlighted display image information is displayed in a larger size than the image that is not highlighted. Note that even an image that is not highlighted may be automatically arranged in a large size. This is done to give balance and emphasis to the entire gallery.

[0221] On the staff terminal 1, the browsing end operation is monitored in step S371 of FIG. 37, the operation of the edit button 181 is monitored in step S372, and the operation of the share button 182 is monitored in step S373. When the operation of ending browsing is detected, the web page browsing is ended. When the operation of the edit button 181 is detected, the staff terminal 1 proceeds to step S380 and performs an edit process.

[0222] The camera staff can check the content of the web gallery in the preview area 183 and, if necessary, operate the edit button 181 to perform further editing. In the edit process of step S380, the staff terminal 1 displays an interface image for editing, accepts the operation of the camera staff, and thereby edits the preview image. For example, the background color, the font of the title, the color of the title, the position of the title, the music of the slide show, etc. can be edited. Then, in response to the completion of the editing operation, the editing information is transmitted to the server device 4 so that the editing operation is reflected in the web gallery.

[0223] After the camera staff performs an editing operation as needed, the sharing button 182 is operated. In this case, the staff terminal 1 proceeds to step S381 and sends a sharing request to the server device 4. As described above, the server device 4 publicly sets the web gallery in step S570 of FIG. 36 in response to the sharing request.

[0224] The staff terminal 1 performs processing corresponding to the display and operation of the delivery completion screen of the web gallery in step S382 of FIG. 37. For example, the staff terminal 1 displays the web gallery delivery screen 190 of FIG. 39. On this web gallery delivery screen 190, a notification of the completion of the creation of the web gallery, an expiration period, and the URL 193 of the web gallery are displayed, and a copy button 191 and a sharing button 192 are also displayed. The camera staff can operate the copy button 191 to copy the URL, attach it to an e-mail, etc., and send it to the client terminal 5. Also, by operating the sharing button 192, the URL can be provided to an SNS, etc., so that the client can view the web gallery via the SNS. As described above, after the wedding ceremony, the client can view the web gallery at an extremely early time such as on the same day. Note that delivering the URL to the client so that the client can view the image collection as a web gallery is just an example. For example, an image collection content corresponding to the above web gallery may be created and delivered to the client as a content file.

[0225] <8. This Delivery Process> This delivery process is performed at the stage of step S5 in FIG. 2. Figure 40 shows the processing at the stage of final delivery. This is processing performed, for example, by the personal computer 3 or the staff terminal 1. Below, the processing performed by the personal computer 3 will be described.

[0226] The camera staff operates using the personal computer 3, accesses the server device 4 as step S400, and makes a request to read information for final delivery. And in step S401, event data 90 is acquired from the server device 4. For example, in this case, it is conceivable that the server device 4 downloads rating information, selection information, or editing information as an XMP file so that it can be applied to the RAW image file in the personal computer 3. That is, rating information, usage image information indicating flag settings, cover image information indicating that it is a cover image, highlighted display image information indicating that highlighting has been performed, etc. are passed on to the personal computer 3. Note that all of the event data 90 may be provided to the personal computer 3.

[0227] The camera staff takes in the RAW image data as the image data captured by the imaging device 2 into the personal computer 3, and generates a final delivery image collection using this RAW image data. In this case, by acquiring the XMP file based on the event data 90 from the server device 4, the creation work can be made more efficient.

[0228] In the personal computer 3, necessary editing processing is performed in step S402 to complete the final delivery image collection. After that, processing for final delivery is performed as step S403. For example, processing such as generating content data as image collection content, electronically transmitting it, recording it on a recording medium, or making it into print data is performed. Then, the created content data, or the recording medium on which the content data is recorded, or the image collection on paper medium printed will be delivered to the client.

[0229] <9. Event View> The event view 200 shown in FIG. 21, FIG. 22, etc. will be described. In the event view 200, as a difference from the time view 120, there is an image arrangement method in the image area 128. A series of images in an event such as a wedding ceremony are divided into sub-events and scenes, and the images of one scene are arranged horizontally in the image area 128. And each scene and each sub-event are arranged vertically.

[0230] For each sub-event, an event title section 240 is displayed. In the event title section 240, names of sub-events such as "Ceremony" and "Cocktails" are shown, for example. Note that they may be more regularly named "event1", "event2",... etc. In the event title section 240, the number of images included in the sub-event, the time when the sub-event was held, etc. are also displayed.

[0231] Also, although the sub-event is subdivided into scenes, a name for each scene is displayed as the scene title section 241. For example, it is set as "Scene1", "Scene2",...

[0232] The names of sub-events and scenes may be arbitrarily input by the user, or candidates may be set in advance and made selectable. When sub-events and scenes can be predicted for each type of event, their name candidates may be prepared for the user to select, or automatically determined from the image content.

[0233] The images of one scene are arranged horizontally. Each image appears with a horizontal scroll operation. In the example of FIG. 21, within the sub - event "Ceremony", "Scene1", "Scene2", and "Scene3" are classified, and then there is a sub - event "Cocktails". They are arranged vertically. With a vertical scroll operation, sub - events and scenes appear in chronological order.

[0234] In the event view 200, an update button 203 is displayed. This serves as an operator for instructing the update of the classification of sub - events and scenes.

[0235] In the event view 200, an index bar 201 can be displayed. The index bar 201 displays, for example, the time and title of each sub - event. Thus, the number and types of sub - events can be listed. When the number of sub - events is large, it is handled by scrolling the index bar 201 itself. Also, the index bar 201 also functions as a jump operation part for displaying sub - events. For example, by tapping the "Party Time" part of the index bar 201, the display jumps in the vertical scroll direction, and the image part of each scene of the sub - event "Party Time" is displayed. The tap operation on the index bar 201 is detected in step S214 of FIG. 13, and as the processing of step S241, the display jump is performed.

[0236] Also, it can be considered that the index bar 201 is automatically erased after being displayed for a predetermined time when the event view 200 is displayed. In that case, the user can call the index bar 201 by swiping from the right end of the screen. Also, during the display of the index bar 201, the index bar 201 can be closed by swiping to the right from the position of the index bar 201. The processing corresponding to such swipes is also the processing of step S214 and step S241 of FIG. 13.

[0237] For each image, the eye - closing icon 210, rating icon 130, and flag - setting icon 131 are displayed, and ratings and selection flag settings can be made in the same way as in the time view 120.

[0238] Also, in the event view 200, switching between the all tab 125 and the candidate tab 126 is possible in the same way as in the time view 120. Also, in the event view 200, a filter - specifying area 129 is provided, and the filtering function described above can be realized.

[0239] Figure 41 shows the display switching. When proceeding from the project list screen 110 shown in Figure 10 to step S211 in Figure 13, the time view 120 or the event view 200 is displayed. At this time, which view to display can be, for example, the view that was last selected for that event at the time of the previous viewing. As described above, the time view 120 and the event view 200 can be switched by the view - switching button 202.

[0240] Even when switching from the time view 120 to the event view 200, it is considered that the filtering conditions are maintained. That is, when switching from the time view 120 in a filtered state to the event view 200, in that event view 200 as well, images corresponding to the filtering conditions are displayed. For example, if a filtering condition is set such that archived images are not displayed, archived images will not be displayed even when switching to the event view 200. Of course, in the event view 200, the filter conditions can also be changed from the filter - operation icon 136.

[0241] When one image is selected from the time view 120 or the event view 200, the display shifts to the single-display screen 140. When the return icon 133 on the single-display screen 140 is operated, it returns to the time view 120 or the event view 200 in the list state before shifting to the single-display screen 140.

[0242] Because such screen transitions occur, the user can arbitrarily switch between the time view 120 and the event view 200 as a list display. The differences between the time view 120 and the event view 200 are shown in FIG. 42. FIG. 42 shows the arrangement of images in the time view 120. For example, as shown in FIG. 20B, it is a case where two images are displayed in the horizontal direction of the screen.

[0243] Each image is simply arranged in chronological order as the imaging time. The user can check each image by a vertical scroll operation. However, in other words, when wanting to check an image of a desired sub-event, it means that it is not possible to reach the target image without making a long vertical scroll considering approximately the time.

[0244] On the other hand, the image arrangement of the event view 200 is as shown in FIG. 42B. They are arranged vertically for each scene, and a plurality of images of one scene are arranged side by side horizontally. When searching for an image within one scene, each image of that scene is made to appear within the image area 128 by a horizontal scroll. Since the sub-events and scenes are arranged vertically, when there is a sub-event for which an image is to be checked, it is possible to reach the scene of that sub-event relatively quickly by a vertical scroll. Moreover, within the scene to be checked, since the images are arranged horizontally, they are easy to compare. From the above, the event view 200 has the advantages that access to each image is easier and comparison of images of the same scene for selection is easier than the time view 120.

[0245] Note that multiple images of one scene are arranged horizontally as one row. However, if the number of images in a scene becomes excessive, the horizontal scroll will become long, which may deteriorate the usability. Therefore, an upper limit for the number of images arranged horizontally is set. For example, the upper limit for the number of images arranged horizontally is 30. If the number of images in a scene exceeds this, the next row is used for horizontal arrangement. Therefore, the images of one scene may be displayed over multiple rows.

[0246] Also, when switching from the time view 120 to the event view 200, it is desirable to provide a display that is easy for the user to understand. Therefore, in the time view 120 immediately before the display switch, attention is paid to the image at the upper left corner of the image area 128, and the display state in the event view 200 is set.

[0247] Suppose there are six images from image pct1 to image pct6 in a certain scene. In the time view 120 immediately before the switch, assume that image pct1 was displayed at the upper left corner of the image area 128. In this case, when switching to the event view 200, as shown in FIG. 43A, the state is set such that image pct1 is displayed at the upper left corner of the image area 128. In the figure, the broken-line image or a part of the image is not displayed at that time, but is an image or a part of the image that will be revealed by scrolling.

[0248] Also, in the time view 120 immediately before the switch, assume that image pct3 was displayed at the upper left corner of the image area 128. In this case, when switching to the event view 200, as shown in FIG. 43B, the state is set such that image pct3 is displayed at the upper left corner of the image area 128.

[0249] Assume that in the time view 120 just before switching, the image pct6 at the rear end of the scene was displayed at the upper left of the image area 128. In this case, when switching to the event view 200, it is not very appropriate for the image pct6 to be displayed at the upper left of the image area 128. Therefore, as shown in FIG. 43C, the image pct6 is at least displayed.

[0250] As described above, if the upper left image in the time view 120 is switched to the event view 200 and is still arranged at the upper left, the user will not be confused even if the display is changed. Even if it cannot be displayed at the upper left after switching, it is desirable that at least the same image is displayed.

[0251] Next, FIG. 44 shows the display switching between the all tab 125 and the candidate tab 126 in the event view 200. In the display of the all tab 125 in FIG. 44A, all images are displayed for each scene. In the display of the candidate tab 126 in FIG. 44B, the images with the selection flag turned on are displayed for each scene.

[0252] In the display of the candidate tab 126, the event title section 240 and the scene title section 241 are also displayed, and the images of each scene are arranged side by side horizontally. Furthermore, in the candidate tab 126, the event title section 240 is also displayed for sub-events and scenes where no image has been selected. For example, in FIG. 44B, the sub-event "EVENT2" has no image with the selection flag turned on and the number of images is also set to "0". Also, for the scene "SCENE1" in the sub-event "EVENT3", there is no image with the selection flag turned on, but the scene title section 241 is displayed.

[0253] By browsing such candidate tabs 126, the user can check, for each sub-event or scene, what images are selected (with the selection flag on) to be used in the image collection, or how many images are selected, etc. This is useful for considering the balance of the image content and quantity in terms of sub-events or scenes.

[0254] Regarding the display of the event view 200 as described above, the processes from step S351 to step S359 and the processes from step S360 to step S363 in FIG. 15 are performed. These processes will be described.

[0255] When the switching operation from the time view 120 to the event view 200 is detected in step S221 of FIG. 15, the staff terminal 1 proceeds to step S351 and branches the process based on whether it is the first request for displaying the event view 200 for the currently targeted event (the event set as one project). The first time can be said to be a state where the delimiter information 63 is not stored in the event data 60 of FIG. 5. If it is not the first time, it proceeds to step S355. If it is the first time, in step S352, it is confirmed whether the number of images of the targeted event is less than a predetermined number. For example, it is determined whether it is less than 100.

[0256] If the number of images is less than the predetermined number, the staff terminal 1 displays a dialog for confirming the event view display in step S353 and asks the user for OK or cancel. For example, to accurately classify sub-events and scenes and appropriately display the event view 200, it is preferable to have a large number of images. If the number of images is small, it may not be possible to make an appropriate scene determination. Also, if the number of images in each scene is one, etc., the display of the event view 200 may not be very effective. In addition, for the transition to the event view 200, a delimiter determination process is required, and it may take time, such as from several seconds to a maximum of about 10 seconds.

[0257] Therefore, such an explanation is given through a confirmation dialog. When it is the first time and the number of images is less than a predetermined number, the user's confirmation is requested. If the user cancels the operation, the process returns to the monitoring loop. If the user performs an OK operation on the displayed dialog, the staff terminal 1 proceeds to step S358. Note that the reason for requesting the user's confirmation in steps S353 and S354 is to ask the user whether it is okay to execute the time-consuming delimiter determination process when, as described above, the number of images is small and the event view 200 may not be very effective (not much different from the time view). Here, the time required for the delimiter determination process varies depending on the device performance and program optimization, and it is assumed that the user will hardly feel the waiting time. If the delimiter determination process does not require time, there will be no waiting time for the user even if the delimiter determination process is performed, so the processes in steps S353 and S354 may not be performed.

[0258] Also, even if the switching operation to the event view 200 is the first time, if the number of images is equal to or more than a predetermined number, the staff terminal 1 proceeds to step S358 without presenting the above confirmation dialog. In this case, since the number of images is equal to or more than a predetermined number, the event view 200 is assumed to be useful as a list, and a delimiter determination process is required for this display.

[0259] The display of the event view 200 requires performing a delimiter determination process to determine the delimiters of sub-events and scenes for a series of images in chronological order. Therefore, when responding to the first switching request for the project to be processed, the delimiter determination process will be performed in step S358.

[0260] Note that the delimiter determination process may be performed in advance prior to the first request to display the event view 200. In that case, it is conceivable to proceed to step S355 even if it is the first time.

[0261] In step S358, perform the segmentation determination process. If the segmentation of sub-events and scenes for each image in chronological order is determined, proceed to step S359 and display the event view 200 using the information on the result of the determination process.

[0262] If the switching operation to the event view 200 is not the first time, the staff terminal 1 proceeds from step S351 to step S355 to check whether there is an image with an unset scene. For the images of the target event, if the segmentation determination process has been performed in the past and the segmentation of sub-events and scenes has been set, the event view 200 can be displayed accordingly. However, even if the segmentation determination process has been performed in the past, if new images of the target event are transferred from the imaging device 2 afterwards, those images are not subject to the segmentation determination process and thus have an unset scene.

[0263] If there is no image with an unset scene and the segmentation of all images has been set at the current time, proceed to step S359 and display the event view 200 using the information on the result of the past segmentation determination process stored as the segmentation information 63 in FIG. 5.

[0264] If it is determined in step S355 that there is an image with an unset scene, the staff terminal 1 proceeds from step S355 to step S356, displays a dialog for determining whether the calculation for the segmentation determination process can be executed, and checks with the user whether the segmentation determination process for updating the scene setting can be performed.

[0265] If the user performs an OK operation, the staff terminal 1 performs the segmentation determination process in step S358 to determine the segmentation of sub-events and scenes for each image in chronological order. Then it proceeds to step S359 and displays the event view 200 using the information on the result of the determination process.

[0266] If the user does not perform an OK operation on the dialog in step S356, the staff terminal 1 proceeds to step S359 without performing a new delimiter determination process, and displays the event view 200 using the information on the result of the past delimiter determination process. In this case, images not included in the scene (images waiting for update) will also be displayed. Note that steps S356 and S357 are to ask whether to allow the user to wait for the delimiter determination process. Therefore, if the delimiter determination process can be executed in a short time (for example, about several seconds), the processes of steps S356 and S357 may be omitted. That is, when there are images with no scene set, it may be possible to unconditionally proceed from step S355 to step S358. Alternatively, the expected time for the delimiter determination process may be determined based on the processing capacity of the staff terminal 1 and the number of images at that time, and the user may be asked for permission only when the expected time becomes long, such as several tens of seconds, in the processes of steps S356 and S357. Furthermore, in the example of FIG. 15, when detecting the switching operation to the event view in step S221, the images with no scene set are determined in step S355, and the delimiter determination process is performed in step S358. However, it is not limited to this. For example, the staff terminal 1 may sequentially check for the existence of images with no scene set, and if there are images with no scene set, automatically perform the delimiter determination process to re-set the event and the scene. Particularly when the processing time of the delimiter determination process is extremely short or the processing load is light, it is suitable to perform the delimiter determination process in the background process. When performing such sequential delimiter determination processes automatically, it is also possible to immediately proceed to step S359 in response to the operation detection in step S221.

[0267] An example of the delimiter determination process in step S358 is shown in FIG. 45. First, in step S601, the staff terminal 1 sorts the processing order of all the images of the event, which is the project subject to the delimiter determination process, by the imaging time. For example, the sorting is performed by referring to the imaging time in the metadata of each image. In this case, even if images are transferred from a plurality of imaging devices 2, all the images of the event are sorted in the order of the imaging time regardless of the imaging device 2.

[0268] In step S602, the staff terminal 1 sets the total number of target images as the total number xmax, sets the variable x to 1, and then repeats the processing from step S603 to step S609 while incrementing the variable x in step S611 until the variable x reaches the total number xmax in step S610.

[0269] In step S603, the staff terminal 1 acquires the information of the x-th image in the sorting order in step S601. For example, the imaging time is acquired from the metadata. If there is information as the image analysis result, it is also conceivable to acquire the information of the recognized subject, such as a person, the number of people, face recognition information, personal identification information, and article information. It is also conceivable to acquire various information at the time of imaging included in the metadata, such as position information, environmental information such as the surrounding brightness, identification information of the imaging device, angle of view information at the time of imaging, exposure information, white balance information, and the fixed state of the imaging device to the tripod.

[0270] When the variable x = 1, that is, when the first image in the time series is targeted, the staff terminal 1 proceeds from step S604 to steps S610 and S611, sets x = 2, and acquires the information of the next image in step S603.

[0271] When acquiring information about the second and subsequent images in the sorting order, the staff terminal 1 proceeds from step S604 to step S605 and compares the acquired information with the image at the previous imaging time.

[0272] In step S606, the staff terminal 1 determines whether the interval between the x-th image and the (x - 1)-th image in the order of imaging times satisfies the sub-event separation condition. For example, when obtaining the imaging time information in step S603, if the time difference between the two images is greater than or equal to the first threshold, it is considered to satisfy the sub-event separation condition. For example, the first threshold is set to 5 minutes or the like.

[0273] When the sub-event separation condition is satisfied, the staff terminal 1 sets one sub-event range in step S607, considering that the interval between the x-th image and the (x - 1)-th image is the sub-event separation. That is, the range of images from the previously detected sub-event separation (the start time in the case of the first sub-event separation) to the current sub-event separation is regarded as one sub-event range.

[0274] When the sub-event separation condition is not satisfied, the staff terminal 1 proceeds from step S606 to step S608 and determines whether the interval between the x-th image and the (x - 1)-th image satisfies the scene separation condition. For example, when obtaining the imaging time information in step S603, if the time difference between the two images is greater than or equal to the second threshold, it is considered to satisfy the scene separation condition. For example, the second threshold is set to a shorter time than the first threshold. For example, 3 minutes.

[0275] When the scene separation condition is satisfied, the staff terminal 1 sets one scene range in step S609, considering that the interval between the x-th image and the (x - 1)-th image is the scene separation. That is, the range of images from the previously detected scene separation or sub-event separation to the current scene separation is regarded as one scene range.

[0276] By repeating the above process until the variable x = xmax in step S610, the sub-event separations and scene separations are determined among all the images sorted in time series. When the variable x = xmax, the staff terminal 1 proceeds from step S610 to step S612 and stores the information on the delimiters of the determined sub-events and scenes as delimiter information 63 in the event data of FIG. 5.

[0277] By performing such delimiter determination processing in step S358 of FIG. 15, in step S359, it becomes possible to display the event view 200 as shown in FIG. 21 based on the delimiter determination result. Particularly in the delimiter determination processing, by determining the delimiters of sub-events and scenes based on the time difference between images arranged in the order of imaging time, it is possible to relatively easily realize the display for each scene in the event view 200. Also, for the cameraman, the delimiters of scenes are likely to be appropriate.

[0278] In the delimiter determination processing of FIG. 45 described above, the determination of sub-event delimiters and scene delimiters in steps S606 and S608 was based on the time difference (for example, 5 minutes and 3 minutes) between images, but other determination conditions may also be used. The following examples can be considered.

[0279] · Changes in human behavior (how much movement) For example, by comparing the position information of each image, it is possible to detect the movement of locations (such as the ceremony hall, banquet hall, outdoors, etc.). Therefore, the delimiters of sub-events and scenes can be determined based on the change or amount of change in the position information. Note that by saving the position information of the staff terminal 1 held by the camera staff at each time to enable determination of the movement trajectory and collating it with the imaging time of each image, the position and movement of the camera staff at the time of imaging each image can be determined. Based on that information, delimiter determination can also be performed.

[0280] · Changes in zoom magnification (change in angle of view) The zoom state is determined by comparing the angle-of-view information of each image. Assuming that the zoom magnification change is an operation performed by the cameraman in response to changes in the subject situation, it can be one of the determination elements for the delimiters of sub-events and scenes.

[0281] · Face recognition (number of people whose faces are captured) Changes in the number of subjects, or changes in individual subjects, etc. can also be considered as changes in the scene or sub-events. By comparing the information of the results of image analysis between images, the boundaries of sub-events and scenes can be determined. Note that the information of image analysis may be stored and used, for example, for image analysis information for blink determination. Also, the number of subjects and the identification information of the subject person may be obtained as the results of image analysis of each image from the server device 4.

[0282] · Object recognition Determine sub-events and scenes based on the objects shown in each image. For example, the intervals of images showing cakes, the intervals of images showing bouquets, etc. can be determined in time series, and the boundaries of scenes and sub-events can be set.

[0283] · Tripod detection (whether the camera is fixed to a tripod) Compare the information on the fixed state of each image, and determine the timing when the imaging device 2 is fixed to the tripod and the timing when it is removed from the fixed state as the boundaries of scenes and sub-events.

[0284] · Exposure correction, white balance When the changes in exposure correction and white balance are large, determine them as the boundaries of scenes and sub-events.

[0285] · Measured light amount Inside the imaging device 2, the current brightness is being measured, so refer to that value to determine the boundaries of scenes and sub-events.

[0286] The above are examples, but the boundaries of sub-events and scenes can be determined based on various criteria in this way. Of course, the boundary determination may be performed by combining a plurality of determination conditions.

[0287] Next, the process when an update operation of the scene setting is detected in step S222 of FIG. 15 will be described. This is the case where the user operates the update button 203 in the event view 200.

[0288] In step S360, the staff terminal 1 may display a dialog to confirm with the user whether to update the scene setting. This is because the update involves the above-mentioned delimiter determination process and may take time. If the user performs a cancel operation, the process returns to the monitoring loop from step S361. If the user performs an OK operation, the staff terminal 1 proceeds to step S362 and performs the delimiter determination process described in FIG. 45. Then, based on the result of the delimiter determination, the staff terminal 1 updates the display of the event view 200 in step S363.

[0289] For example, after the event view 200 is displayed, it is also possible that an image is newly transferred from the imaging device 2. When the camera staff uses a plurality of imaging devices 2, after receiving an image from one imaging device 2 and displaying the event view 200, it is also possible to receive an image from another imaging device 2. Those new images cannot be reflected in the sub-events or scenes in the event view 200. Therefore, it is preferable to re-perform the delimiter determination process including the new images so that the display of the event view 200 can be updated. Note that it is also assumed that the delimiter determination process does not take much time as described above. In that case, the processes of steps S360 and S361 may be omitted. Also, steps S360 and S361 may be performed when it is expected that a relatively long time will be required depending on the device performance and the number of images.

[0290] As an interface for updating this event view 200, examples such as FIGS. 46 and 47 below can also be considered. FIG. 46A shows an example in which an image waiting to be updated is displayed in a separate frame from a sub - event in the image area 128 of the event view 200. An image waiting to be updated is an image that has not yet been the subject of the segmentation determination process, that is, an image received after the latest segmentation determination process. For example, the images waiting to be updated are collectively displayed at a position in front (upward in the scroll direction) of the first sub - event or at a position behind (downward in the scroll direction) of the last sub - event. In addition, an update - waiting label 204 is superimposed on the image waiting to be updated to clearly indicate that it is an image waiting to be updated.

[0291] Also at this time, an update dialog 205 is displayed to indicate the existence of the image waiting to be updated and to function as an update operator. With such a display, the user can recognize the existence of the image waiting to be updated and is recommended to perform an update operation.

[0292] When the user performs an operation such as tapping the update dialog 205, the staff terminal 1 starts the segmentation determination process and displays an in - progress update dialog 206 as shown in FIG. 46B. Then, when the segmentation determination process is completed, a completion dialog 207 is displayed as shown in FIG. 46C. When the user taps it, the display is updated as shown in FIG. 46D. That is, all the images of the event at that time, including the images that were waiting to be updated, are listed based on the segmentation of sub - events and scenes. The example of FIG. 46 is an example in which other operations are possible for the user even during the update. Therefore, the display is updated after waiting for the tap operation on the completion dialog 207.

[0293] It may be made impossible to perform other operations during the update. An example of that case is shown in FIG. 47. FIG. 47A is the same as FIG. 46A.

[0294] When the user performs an operation such as tapping the update dialog 205, the staff terminal 1 starts the delimiter determination process and displays the updating dialog 206 in the center of the screen as shown in FIG. 47B. Other images may be grayed out and made inoperable. Also, allow the cancel operation of the update. And when the delimiter determination process is completed, the display is updated as shown in FIG. 47C.

[0295] <10. Summary and Variation Examples> In the above embodiments, the following effects can be obtained. The staff terminal 1, which is the information processing apparatus of the embodiment, includes a UI control unit 31 that executes a process of performing a list display and an individual display as a display capable of selecting an image from an image group captured by a specific event, and a process of detecting an archive operation on the displayed image, and an event data management unit 30 that performs a process of storing archive information indicating that an archive setting has been made corresponding to the image targeted for the archive operation. By being able to arbitrarily set an archive for an image, the camera staff can distinguish images that are not to be delivered, images that do not need to be confirmed, images that have already been determined to be delivered, etc. from other images. As a result, the number of images to be considered whether to select or not in the selection can also be reduced, and the efficiency of the selection can be promoted.

[0296] The staff terminal 1 of the embodiment includes a filter processing unit 33 that performs filtering based on the archive information. The UI control unit 31 has been described as an example of controlling so that the images extracted by the filtering are displayed in a list display. Thereby, after arbitrarily setting an archive, it is possible to prevent the image from being displayed in a list or the like. For example, if an image determined not to be delivered is archived, it can be prevented from being displayed as a selection target, reducing the number of selections and promoting the efficiency of the selection.

[0297] In the embodiment, an example was given in which filtering based on archive information is performed or not, or filtering conditions are selectable (see FIG. 28D). As a result, the user can choose to display images regardless of whether archive settings are present, display only images that are not archive - set, or display only images that are archive - set, and can execute a display according to the circumstances at that time.

[0298] In the embodiment, the UI control unit 31 performs control to provide a user interface that enables a setting operation of selection information for creating an image collection by selectively using the image data included in the image group of the event, and the event data management unit 30 performs processing to store the archive information and the selection information as separate information in the imaging / editing information table 62 of the event data 60 (see FIG. 5). As a result, the user can perform archive settings separately from the selection settings. For example, for a certain image, archive settings can be made without considering whether to adopt it in the image collection. That is, archive settings can be made only from the perspective of whether to be displayed or not. As a result, it becomes possible to archive not only images that will not be delivered but also images that have already been determined to be delivered, reducing the number of selections.

[0299] In the embodiment, the UI control unit 31 gave an example in which an archive operation on the display image is possible during individual display as a single - display screen 140. Also, in the embodiment, during list displays such as the time view 120 and the event view 200, an archive operation on the display image is disabled. This enables the user to perform an archive operation on an image after carefully checking it while the image is being displayed one by one. If an icon for the archive operation is displayed for each image in the list view, the screen will become cluttered, and it will be difficult to perform icon operations on small images. Also, it is difficult to perform an operation of swiping a specific image on the list of images. Under such circumstances, if an archive operation can be performed on the list of images, the screen is likely to become cluttered and there is a high possibility of accidental operations. Therefore, the archive operation is made possible only in the case of individual image display, thereby preventing accidental operations and eliminating screen clutter. Note that an example in which an archive operation can be performed by designating an image during the list view may also be considered.

[0300] In the embodiment, the UI control unit 31 is configured to detect a swipe operation in a predetermined direction on the displayed image as an archive operation for the image (see FIG. 25). This enables the user to perform an archive setting for any image by an intuitive operation of swiping the image upward on the screen. Also, in combination with the switching of images according to the archive operation and the switching of images by a horizontal swipe operation, it is possible to provide efficient operability such that while quickly checking each image one by one by a horizontal swipe, any image can be archived by a swipe upward.

[0301] In the embodiment, when the UI control unit 31 detects an archive operation, it performs control to execute a display that enables the archive operation to be canceled for a predetermined time. For example, an undo instruction is enabled as a toast display during the archive operation (see FIGS. 17 and 25). For example, when an archive setting can be performed by a simple operation such as a swipe, it is possible that the user may accidentally perform an archive operation on an image that the user does not intend to archive. Therefore, the archive operation can be easily canceled so that the user can recover from an unintended operation.

[0302] The staff terminal 1 in the embodiment includes an image analysis unit 34 that performs image analysis on each image in the image group and determines whether the subject person's eyes are closed, and the event data management unit 30 performs a process of storing eye-closure information corresponding to the image determined to have closed eyes. By storing eye-closure information for each image, it becomes possible to distinguish between images with closed eyes and images with open eyes.

[0303] In the embodiment, the UI control unit 31 performs control to cause a display indicating an image determined to have closed eyes based on the eye-closure information to be executed during the list display (time view 120 or event view 200) or the individual display (single-image display screen 140). For example, the eye-closure icon 210 is displayed corresponding to the image. As a result, the camera staff can easily determine whether each image is an image with closed eyes. Especially for thumbnail images or so-called "pull" images, it may be difficult to tell whether the eyes are closed. By presenting the closed-eye image with the eye-closure icon 210 as in the embodiment, it becomes possible to efficiently distinguish images that are not to be adopted in the image collection.

[0304] In the embodiment, a filter processing unit 33 that performs filtering based on the eye-closure information is provided, and the UI control unit 31 gives an example of controlling so that the images extracted by the filtering are displayed in a list display such as the time view 120 or the event view 200. As a result, it becomes possible to perform selection with the closed-eye images excluded. Since closed-eye images are usually not suitable for publication in the image collection, by performing a list display and selection excluding such images, the number of options for selection can be reduced, promoting the efficiency of selection.

[0305] In the embodiment, it is assumed that it is possible to select whether to perform filtering based on the eye-closure information (see FIG. 28A). As a result, the user can arbitrarily select to view the display excluding the eye-closed images or to view the images with the eye-closed images added. Since there may be eye-closed images suitable for the image collection depending on the scene or situation even for eye-closed images, it is desirable for image collection production to enable the display of eye-closed images as well.

[0306] In the embodiment, the event data management unit 30 performs a process of storing the eye-closed information and the selection information as separate information in the imaging / editing information table 62 of the event data 60. By managing the eye-closed information based on image analysis as information separate from the selection information, the eye-closed situation does not affect the selection for the image collection. The camera staff can decide, according to their own will, whether or not to close their eyes and select the images to be adopted in the image collection.

[0307] In the embodiment, a filter processing unit 33 that performs filtering based on the information of the imaging device 2 that captured the image is provided, and the UI control unit 31 controls to display the images extracted by filtering as a list display (see FIG. 28C). For example, images captured by a specific model or an imaging device 2 with a specific serial number are to be displayed in a list. As a result, selection can be made in a state where the types of the imaging devices 2 and the captured images for each individual model are extracted. This is extremely useful from the viewpoint of speeding up the selection when the camera staff uses the imaging devices 2 separately.

[0308] The staff terminal 1 of the embodiment includes a delimiter determination unit 35 that determines the delimiter in the time series for a group of images captured in a specific event, and for each time zone separated by the delimiter determined by the delimiter determination unit 35, all or part of the images captured within the time zone are arranged in a first direction (for example, the horizontal direction: left-right direction), and a UI control unit 31 that controls to perform a delimiter reflection display in which each time zone is arranged in a second direction (for example, the vertical direction: up-down direction), that is, to display the event view 200. As this event view 200, a large number of images can be arranged in the horizontal direction (the first direction) and the vertical direction (the second direction) with different meanings, and the operability for image confirmation can be improved compared to a simple time-series arrangement display. By providing a UI that makes it easy to view images, the efficiency of selection can be promoted. Note that the vertical direction may be the first direction and the horizontal direction may be the second direction. That is, images in the same time zone may be arranged vertically, and sub-events and scenes may be arranged in order horizontally.

[0309] In the embodiment, the UI control unit 31 performs switching control between a time view 120 as a simple time-series display in which images are arranged and displayed in the order of imaging time without relying on a delimiter, and an event view 200 as a delimiter-reflecting display. Since the time view 120 (simple time-series display) is a simple list display, it is useful when you want to immediately view a list. On the other hand, since the event view 200 (delimiter-reflecting display) is performed through a delimiter determination process, it may take some time to display, but since the delimiters of sub-events and scenes are reflected as a list display, it is easy to view and searchable. Also, the balance for each scene and sub-event is easy to understand. Therefore, by switching between the time view 120 and the event view 200, a list display according to the situation is provided.

[0310] In the embodiment, the UI control unit 31 performs control to alternately switch between the time view 120 and the event view 200 in response to an operation of a view switching button 202. By alternately switching between the time view 120 and the event view 200, the user can easily select a suitable list display mode according to the situation.

[0311] In the embodiment, in the event view 200, the UI control unit 31 controls such that, in response to a first-direction operation such as a left-right swipe, the images of each time period (for example, a scene) separated by a delimiter move in the left-right direction (the first direction) so as to perform a scroll, and in response to a second-direction operation such as an up-down swipe, a scroll in the up-down direction (the second direction) is performed so that each time period separated by a delimiter is displayed. In the event view 200, the user will be able to view the images of a certain scene by horizontal scrolling. Also, by vertical scrolling, the user will be able to quickly search for the scene they want to view. By setting the vertical and horizontal arrangements that reflect the delimiters in this way, the operability of image viewing can be significantly improved.

[0312] The delimiter determination unit 35 of the embodiment is configured to perform delimiter determination for sub-events occurring within an event. By determining the delimiter of a sub-event in the delimiter determination process, it becomes easy for the camera staff to check the images for each sub-event. In the embodiment, an example is given in which images are arranged horizontally in units of scenes. However, if the number of images is relatively small, the images may be arranged horizontally in units of sub-events. This makes it suitable for checking the images for each sub-event. That is, the delimiter may be at one level, for example, only for sub-events, without being hierarchical like sub-events and scenes.

[0313] The delimiter determination unit 35 of the embodiment is configured to perform delimiter determination for sub-events occurring within an event and delimiter determination for scenes within a sub-event. By determining the delimiters of sub-events and scenes in the delimiter determination process, a two-stage delimiter can be achieved in particular, and a list display can be provided in units of sub-events, scenes, etc. Especially when there are a large number of images even in units of sub-events, by subdividing into scenes, the image list can be viewed in a finer delimiter unit. Of course, a delimiter with three or more stages for further subdividing scenes may be set.

[0314] In the embodiment, the UI control unit 31 controls such that images are arranged in the left - right direction (the first direction) with one time period as a unit of a scene. When there are a large number of images captured by an event, or even when the number of images is extremely large in terms of sub - event units, it is preferable to further subdivide into scenes and provide a list display. That is, the images are arranged horizontally in units of scenes. This enables the camera staff to search for images horizontally in an easy - to - view unit, and provides an interface that makes it easier to confirm and select images.

[0315] An example was given in the embodiment where the segmentation determination unit 35 determines segmentation based on the time intervals between each image in the chronological order of the imaging times in the image group (see FIG. 45). If the time interval between the imaging times of one image and the next image is large, it can be determined that the subject content has changed significantly, that is, it is determined as the segmentation of a sub - event or a scene. This enables a relatively simple and highly reliable segmentation determination, and thus a suitable segmentation - reflected display can be realized relatively easily.

[0316] An example was also described in the embodiment where the segmentation determination unit 35 determines segmentation based on the image analysis results of each image in the chronological order of the imaging times in the image group. The segmentation of sub - events or scenes can be performed based on the subject person, the number of people, the items shown, etc. This enables the realization of a suitable segmentation - reflected display.

[0317] In the embodiment, the UI control unit 31 is configured such that the number of images arranged in the left - right direction (the first direction) does not exceed the upper limit number. When arranging images horizontally without setting an upper limit per scene, if the number of images in that scene is extremely large, it becomes difficult to search for images by horizontal scrolling. Therefore, when the number of images in one time period due to segmentation increases, for example, when it exceeds 30, they are displayed by changing the line. This prevents the number of images scrolled horizontally side by side from becoming excessive and maintains the ease of image confirmation.

[0318] The segmentation determination unit 35 of the embodiment is configured to execute segmentation determination processing when the display of the event view 200 is requested by an operation (see FIG. 15). When the segmentation determination process is a process with a large load that requires a certain amount of time, it is preferable to perform it only when necessary, so as not to perform unnecessary processing in situations where normal list display is required. Of course, it may be performed when images are received in a batch or sequentially from the imaging device 2. Particularly when there are abundant processing resources or when the segmentation determination process is based on an algorithm with a relatively light load, performing it in advance enables a quick display response when a user requests a segmentation reflection display.

[0319] In the embodiment, an example is given in which the UI control unit 31 requests confirmation of whether the segmentation determination process can be executed when the execution of the display of the event view 200 is requested by an operation. When the segmentation determination process is a process with a large load that requires a certain amount of time, a dialog is presented notifying the user to that effect and requesting confirmation of whether to execute it (see steps S356, S353, and S360 in FIG. 15). This enables the segmentation determination process to be performed according to the user's convenience. In other words, when the user does not want a time-consuming process to be performed, it is possible to prevent the segmentation determination process from being forcibly executed.

[0320] In the embodiment, an operation for instructing the execution of the segmentation determination process by the segmentation determination unit 35 is enabled. For example, an update button 203 and an update dialog 205 are provided, and a relatively time-consuming delimiter determination process is executed when it is convenient for the user.

[0321] In the embodiment, title display for each sub-event is performed in the event view 200. For example, by displaying sub-event names such as "Ceremony", "Cocktails", "Party Time", etc. or mechanically assigned sub-event names such as "event1", "event2", etc. in units of sub-events, the delimiter reflection display is easy to see and is also convenient for the camera staff when searching for images. Also, in the event view 200, title display for each scene is performed. For example, by displaying names such as "scene1", "scene2", etc. in units of scenes, the delimiter reflection display is easy to see, especially when arranging images horizontally in units of scenes, and is also convenient for the camera staff when searching for images.

[0322] In the event view 200 of the embodiment, a time zone based on a delimiter, for example, a display of an index bar 201 for sub-events is performed (see FIG. 21). For example, by displaying names in units of sub-events such as "Ceremony", "Cocktails", etc., it becomes clear what kind of delimiters are made in the entire list. This index bar 201 is also used as an operator for image search. By specifying the title in the index bar 201 in the event view 200, it jumps to the display of images in the time zone of the sub-event (steps S214 and S241 in FIG. 13). Thereby, the searchability of the delimiter reflection display can be extremely improved.

[0323] In the embodiment, the image file from the imaging device 2 is transferred to the staff terminal 1, and the staff terminal 1 uploads it to the server device 4. However, the imaging device 2 may directly upload it to the server device 4.

[0324] In the embodiment, the generation of the still image collection has been described. However, the image collection may include a moving image as part of the content, or a moving image collection may be generated. In these cases as well, the processes described in the embodiment can be similarly applied. The moving image in this case may be a moving image with sound or a moving image of only image information without sound.

[0325] Further, the imaging device 2 may perform the processing of the staff terminal 1 described above as the information processing device of the embodiment. Alternatively, the staff terminal 1 may be provided with an imaging function and may also function as the imaging device 2.

[0326] The technology of the present disclosure is not limited to the processing of the image group related to the event related to marriage. For example, it is also useful for the selection of the image group captured in a sports event or the like. In particular, if the event view 200 can divide sub-events and scenes in a sports event according to the type of competition or the difference between the athletes competing in order in an individual competition, etc., it becomes a very convenient list display mode for image confirmation and selection. In the case of sports, a more appropriate event view 200 can be realized by changing the division conditions of sub-events and scenes for each competition.

[0327] The program of the embodiment is a program that causes a device such as a CPU, a DSP, or the like, or a device including these to execute the processes as shown in FIGS. 12 to 18. That is, the program of the embodiment causes an information processing apparatus to execute a process of performing a list display and an individual display as a display capable of selecting an image from an image group captured in a specific event, a process of detecting an archive operation on the displayed image, and a process of storing archive information indicating that an archive setting has been made corresponding to the image that is the target of the archive operation.

[0328] Another program of the embodiment is a program that causes a device such as a CPU, a DSP, or a device including these to execute processes such as those shown in FIGS. 12 to 18 and FIG. 45. That is, the program of the embodiment performs a delimiter determination process for determining a delimiter in the time series for an image group captured in a specific event, and for each time zone divided by the delimiter determined in the delimiter determination process, all or part of the images captured within the time zone are arranged in a first direction, and a user interface control process for controlling so that a delimiter reflection display is presented in a state where each time zone is arranged in a second direction is a program that causes an information processing apparatus to execute.

[0329] By these programs, the staff terminal 1 suitable for accelerating selection can be realized in, for example, a mobile terminal device, a personal computer, or other devices capable of executing information processing.

[0330] A program for realizing such a staff terminal 1 can be pre-recorded in an HDD as a recording medium built in a device such as a computer device, or in a ROM in a microcomputer having a CPU. Alternatively, it can be temporarily or permanently stored (recorded) on a removable recording medium such as a flexible disk, CD-ROM (Compact Disc Read Only Memory), MO (Magneto Optical) disk, DVD (Digital Versatile Disc), Blu-ray Disc (registered trademark), magnetic disk, semiconductor memory, memory card, etc. Such a removable recording medium can be provided as so-called packaged software. In addition, such a program can be installed from a removable recording medium into a personal computer or the like, or can also be downloaded from a download site via a network such as a LAN (Local Area Network) or the Internet.

[0331] Also, according to such a program, it is suitable for wide provision of the staff terminal 1 of the embodiment. For example, by downloading the program to a portable terminal device such as a smartphone or tablet, an imaging device, a mobile phone, a personal computer, a still camera, a video camera, a game device, a video device, a PDA (Personal Digital Assistant), etc., the smartphone or the like can be made to function as the staff terminal 1 of the present disclosure.

[0332] Note that the effects described in this specification are merely examples and are not limited, and there may be other effects.

[0333] Note that the present technology can also adopt the following configuration. (1) a section determination unit that determines a time series separation for a group of images captured in a specific event; a user interface control unit that controls so that a section reflection display is performed in which all or part of the images captured within a time zone are arranged in a first direction and each time zone is arranged in a second direction, for each time zone separated by the section determined by the section determination unit; Information processing apparatus. (2) The user interface control unit performs switching control between a simple time series display in which images are arranged and displayed in the order of imaging time without being based on the division, and the division reflection display. The information processing apparatus according to (1) above. (3) The user interface control unit performs control to alternately switch between the simple time series display and the division reflection display according to an operation. The information processing apparatus according to (2) above. (4) The user interface control unit In the division reflection display, in response to a first direction operation, scrolling is performed so that each image in one time zone by the division moves in the first direction, in response to a second direction operation, control is performed so that scrolling in the second direction is performed so that each time zone by the division appears. The information processing apparatus according to any one of (1) to (3) above. (5) The division determination unit performs division determination for sub-events performed within the event. The information processing apparatus according to any one of (1) to (4) above. (6) The division determination unit performs division determination for sub-events performed within the event and division determination for scenes within the sub-events. The information processing apparatus according to any one of (1) to (5) above. (7) The user interface control unit controls to perform display in which images are arranged in the first direction with the unit of the scene as one time zone. The information processing apparatus according to (6) above. (8) The division determination unit determines the division based on the time intervals between the images in the image group in chronological order of the imaging times. The information processing apparatus according to any one of (1) to (7) above. (9) The division determination unit determines the division based on the image analysis results of the images in the image group in chronological order of the imaging times. The information processing apparatus according to any one of (1) to (8) above. (10) The user interface control unit prevents the number of images arranged in the first direction from exceeding the upper limit number. The information processing apparatus according to any one of (1) to (9) above. (11) When execution of the division reflection display is requested by an operation, the division determination unit executes division determination processing. The information processing apparatus according to any one of (1) to (10) above. (12) The user interface control unit When execution of the division reflection display is requested by an operation, requests confirmation of whether division determination processing can be executed. The information processing apparatus according to any one of (1) to (11) above. (13) An operation for instructing execution of division determination processing by the division determination unit is enabled. The information processing apparatus according to any one of (1) to (10) above. (14) In the division reflection display, title display for each sub-event is performed. The information processing apparatus according to any one of (5), (6), and (7) above. (15) In the division reflection display, title display for each scene is performed. The information processing apparatus according to (6) or (7) above. (16) In the division reflection display, index display for the time zone based on the division is performed. The information processing apparatus according to any one of (1) to (15) above. (17) The index display is used as an operator for image search. The information processing apparatus according to (16) above. (18) For an image group captured in a specific event, a delimiter determination process for determining a delimiter in time series, and User interface control processing for controlling so that a delimiter reflection display is performed in which all or part of the images captured within a time zone are arranged in a first direction and each time zone is arranged in a second direction for each time zone divided by the delimiter determined by the delimiter determination process, and An information processing method executed by an information processing apparatus. (19) For an image group captured in a specific event, a delimiter determination process for determining a delimiter in time series, and User interface control processing for controlling so that a delimiter reflection display is performed in which all or part of the images captured within a time zone are arranged in a first direction and each time zone is arranged in a second direction for each time zone divided by the delimiter determined by the delimiter determination process, and A program for causing an information processing apparatus to execute.

Explanation of Signs

[0334] 1 Staff terminal 2 Imaging device 3 Personal computer 4 Server device 5 Client terminal 6 Network 30 Event data management unit 31 UI control unit 32 Communication control unit 33 Filter processing unit 34 Image analysis unit 35 Delimiter determination unit 70 Information processing apparatus 120 Time view 200 Event view

Claims

1. A segmentation determination unit that determines a segmentation in the time series for an image group captured at a specific event, and a user interface control unit that controls so that a segmentation reflection display is performed in which all or part of the images captured within a time period divided by the segmentation determined by the segmentation determination unit are arranged in a first direction, and each time period is presented in a state of being arranged in a second direction, wherein the user interface control unit performs switching control between a simple time series display in which images are arranged and displayed in the order of imaging times without based on the segmentation, and the segmentation reflection display An information processing apparatus.

2. A segmentation determination unit that determines a segmentation in the time series for an image group captured at a specific event, and a user interface control unit that controls so that a segmentation reflection display is performed in which all or part of the images captured within a time period divided by the segmentation determined by the segmentation determination unit are arranged in a first direction, and each time period is presented in a state of being arranged in a second direction, wherein the user interface control unit in the segmentation reflection display, in response to a first direction operation, scrolling is performed so that each image in one time period by the segmentation moves in the first direction, and controls so that scrolling in the second direction is performed so that each time period by the segmentation is revealed in response to a second direction operation An information processing apparatus.

3. A segmentation determination unit that determines a segmentation in the time series for an image group captured at a specific event, and a user interface control unit that controls so that a segmentation reflection display is performed in which all or part of the images captured within a time period divided by the segmentation determined by the segmentation determination unit are arranged in a first direction, and each time period is presented in a state of being arranged in a second direction, wherein the segmentation determination unit performs segmentation determination for sub-events occurring within the event and segmentation determination for scenes within the sub-events An information processing apparatus.

4. A segmentation determination unit that determines a segmentation in the time series for an image group captured at a specific event, For each time period separated by the division determined by the division determination unit, all or part of the images captured within the time period are arranged in a first direction, and a division reflection display is performed in which each time period is arranged in a second direction so as to be presented. A user interface control unit that controls so as to be performed; The division determination unit performs the determination of the division based on the time intervals of the respective images in the chronological order of the imaging times in the image group. An information processing apparatus.

5. For an image group captured by a specific event, a division determination unit that determines a division in time series, For each time period separated by the division determined by the division determination unit, all or part of the images captured within the time period are arranged in a first direction, and a division reflection display is performed in which each time period is arranged in a second direction so as to be presented. A user interface control unit that controls so as to be performed; In the division reflection display, index display for the time period based on the division is performed. An information processing apparatus.

6. The user interface control unit Performs control to alternately switch between the simple time series display and the division reflection display according to an operation. The information processing apparatus according to claim 1.

7. The division determination unit Performs division determination for sub-events occurring within the event. The information processing apparatus according to any one of claims 1 to 6.

8. The user interface control unit Controls so that the images are arranged in the first direction with the unit of the scene as one time period. The information processing apparatus according to claim 3.

9. The division determination unit performs the determination of the division based on the image analysis results of the respective images in the chronological order of the imaging times in the image group. The information processing apparatus according to any one of claims 1 to 8.

10. The user interface control unit Makes the number of images arranged in the first direction not exceed the upper limit number. The information processing apparatus according to any one of claims 1 to 9.

11. The division determination unit executes a division determination process when execution of the division reflection display is requested by an operation. The information processing apparatus according to any one of claims 1 to 10.

12. The user interface control unit When execution of the division reflection display is requested by an operation, requests confirmation of whether or not the division determination process can be executed. The information processing apparatus according to any one of claims 1 to 11.

13. An operation for instructing execution of the delimiter determination process by the delimiter determination unit is enabled. The information processing apparatus according to any one of claims 1 to 10.

14. In the delimiter reflection display, title display for each sub-event is performed. The information processing apparatus according to any one of claims 3, 7, and 8.

15. In the delimiter reflection display, title display for each scene is performed. The information processing apparatus according to claim 3.

16. The index display is an operator for image search. The information processing apparatus according to claim 5.

17. An information processing apparatus performs a delimiter determination process for determining a delimiter in time series for an image group captured in a specific event, and controls to perform a delimiter reflection display in which all or part of the images captured within each time zone are arranged in a first direction and each time zone is arranged in a second direction, divided by the delimiter determined in the delimiter determination process, and in the user interface control process performs switching control between a simple time series display in which images are arranged and displayed in the order of imaging time without being based on the delimiter, and the delimiter reflection display. Information processing method.

18. In an information processing apparatus perform a delimiter determination process for determining a delimiter in time series for an image group captured in a specific event, and control to perform a delimiter reflection display in which all or part of the images captured within each time zone are arranged in a first direction and each time zone is arranged in a second direction, divided by the delimiter determined in the delimiter determination process, and in the user interface control process execute switching control between a simple time series display in which images are arranged and displayed in the order of imaging time without being based on the delimiter, and the delimiter reflection display. Program.

Images