Information processing device, information processing method, and program

Abstract

This information processing device comprises: a delivery management unit that executes instruction processing related to image delivery with respect to image data which is obtained by imaging a specific event and which is transmitted to a server device; an event data management unit that executes processing in which evaluation information related to delivered images is associated with the image data and the same is managed; and a filter processing unit that executes filtering of the image data, using the evaluation information as conditions for filtering.

Description

[Technical Field]

[0001] The present technology relates to an information processing device, an information processing method, and a program, and in particular to an information processing technology for distributing images of an event or creating an image album. [Background technology]

[0002] For example, there is a service in which a photographer takes photos at wedding events such as weddings, wedding receptions, and after-parties, creates a photo album as a collection of images, and provides the photos to participants. In this case, photographers and others will import the images captured with the imaging device into a personal computer, smartphone, or the like after the event, edit them using editing software, and create an image collection. This image collection can then be made available via SNS (social networking service), cloud services, email, messaging applications, and the like. The following Patent Document 1 describes a technology for transferring images taken with a camera to a smartphone or the like for sharing. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2016-81173 Summary of the Invention [Problem to be solved by the invention]

[0004] In recent years, with the development of communication environments, there are more opportunities for users who do not attend events in person to participate remotely. For example, fixed cameras can be placed in the wedding hall, allowing people who cannot attend the wedding to participate remotely by watching a live broadcast of the wedding on a terminal device such as a personal computer or smartphone. However, for remote participants, viewing only the image from a fixed camera, for example, is not enjoyable.

[0005] In addition, at an event, a photographer may take a large number of images, and create an image collection using selected images to be available for viewing by those involved. In this case, it can be a tedious task for the photographer or other person creating the image collection to decide or select which images to include in the collection.

[0006] Therefore, an object of the present disclosure is to provide a technology that enables remote users to perform live streaming that is more enjoyable, and also enables photographers and the like to select images more efficiently. [Means for solving the problem]

[0007] The information processing device according to the present technology performs instruction processing related to image distribution of image data captured at a specific event and transmitted to a server device. To the server device A distribution management department that carries out By viewers of the image distribution An event data management unit that manages evaluation information for the distributed image in association with the image data, and , photographed at the event Image data filtering It is possible to and a filter processing unit. The distribution management unit controls distribution by issuing instructions regarding the distribution of image data transmitted to the server device. The event data management unit associates evaluation information regarding the image to be distributed with the image data. The filtering processing unit filters the image data captured at the event using the evaluation information. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is an explanatory diagram of a system configuration for providing services according to an embodiment of the present technology; [Figure 2] FIG. 10 is an explanatory diagram of a work procedure for providing a service according to an embodiment. [Figure 3] FIG. 1 is an explanatory diagram of live gallery distribution according to an embodiment. [Figure 4] FIG. 2 is a block diagram illustrating the configuration of a terminal device and a server device according to an embodiment. [Figure 5] FIG. 2 is an explanatory diagram of a functional configuration of a staff terminal according to an embodiment. [Figure 6] FIG. 10 is an explanatory diagram of event data on the staff terminal side according to the embodiment. [Figure 7] FIG. 2 is an explanatory diagram of a functional configuration of a server device according to an embodiment. [Figure 8] FIG. 10 is an explanatory diagram of event data on the server device side according to the embodiment; [Figure 9] FIG. 10 is an explanatory diagram of web gallery information generated by the server device according to the embodiment. [Figure 10] FIG. 10 is an explanatory diagram of a live gallery screen according to an embodiment. [Figure 11] 1A and 1B are explanatory diagrams of an index view and a live view of a live gallery according to an embodiment. [Figure 12] 10 is a flowchart of a presetting process of a staff terminal according to an embodiment. [Figure 13] 3A and 3B are explanatory diagrams of a project creation screen and a project list screen according to an embodiment. [Figure 14] FIG. 10 is an explanatory diagram of the preparation of a live gallery according to an embodiment. [Figure 15] 10 is a flowchart of a transfer / editing process of the staff terminal according to the embodiment. [Figure 16] 10 is a flowchart of UI-related processing of the staff terminal according to the embodiment. [Figure 17] 10 is a flowchart of UI-related processing of the staff terminal according to the embodiment. [Figure 18] 10 is a flowchart of UI-related processing of the staff terminal according to the embodiment. [Figure 19] 10 is a flowchart of UI-related processing of the staff terminal according to the embodiment. [Figure 20] 10 is a flowchart of UI-related processing of the staff terminal according to the embodiment. [Figure 21] 10 is a flowchart of UI-related processing of the staff terminal according to the embodiment. [Figure 22] 10 is a flowchart of UI-related processing of the staff terminal according to the embodiment. [Figure 23] FIG. 2 is an explanatory diagram of a time view according to an embodiment. [Figure 24] FIG. 10 is an explanatory diagram of zooming in / out of a time view according to an embodiment. [Figure 25] FIG. 2 is an explanatory diagram of an event view according to an embodiment. [Figure 26] FIG. 2 is an explanatory diagram of an event view according to an embodiment. [Figure 27] FIG. 10 is an explanatory diagram of a time view candidate tab screen according to an embodiment. [Figure 28] FIG. 10 is an explanatory diagram of view switching according to an embodiment. [Figure 29] FIG. 10 is an explanatory diagram of a single image display screen according to an embodiment. [Figure 30] FIG. 10 is an explanatory diagram of a live gallery operation screen according to the embodiment. [Figure 31] FIG. 10 is an explanatory diagram of the progress of a live gallery according to an embodiment. [Figure 32] FIG. 2 is an explanatory diagram of a screen transition according to an embodiment. [Figure 33] FIG. 10 is an explanatory diagram of a cover / highlight selection screen according to an embodiment. [Figure 34] FIG. 10 is an explanatory diagram of a confirmation screen according to the embodiment. [Figure 35] 10 is a flowchart of a process of a server device according to an embodiment. [Figure 36] 10 is a flowchart of a live gallery process of the server device according to the embodiment. [Figure 37] 10 is a flowchart of a process after receiving a URL of the terminal device according to the embodiment. [Figure 38] FIG. 10 is an explanatory diagram of a preview screen of a web gallery according to an embodiment. [Figure 39] FIG. 10 is an explanatory diagram of a web gallery delivery screen according to an embodiment. [Figure 40]10 is a flowchart of a final delivery process of the terminal device according to the embodiment. [Figure 41] 1A and 1B are explanatory diagrams of images to be distributed as a live gallery according to an embodiment. [Figure 42] FIG. 10 is an explanatory diagram of an example of a process from image capture to distribution according to an embodiment. [Figure 43] FIG. 10 is an explanatory diagram of an example of a process from image capture to distribution according to an embodiment. [Figure 44] FIG. 10 is an explanatory diagram of an example of a process from image capture to distribution according to an embodiment. [Figure 45] FIG. 10 is an explanatory diagram of an example of a process from image capture to distribution according to an embodiment. [Figure 46] FIG. 10 is an explanatory diagram of an example of a process from image capture to distribution according to an embodiment. [Figure 47] FIG. 10 is an explanatory diagram of an example of a process from image capture to distribution according to an embodiment. [Figure 48] FIG. 10 is an explanatory diagram of an example of a process from image capture to distribution according to an embodiment. [Figure 49] FIG. 10 is an explanatory diagram of an example of a process from image capture to distribution according to an embodiment. [Figure 50] FIG. 10 is an explanatory diagram of an example of a process from image capture to distribution according to an embodiment. [Figure 51] FIG. 10 is an explanatory diagram of an example of a process from image capture to distribution according to an embodiment. [Figure 52] FIG. 10 is an explanatory diagram of an example of a process from image capture to distribution according to an embodiment. [Figure 53] FIG. 10 is an explanatory diagram of an example of a process from image capture to distribution according to an embodiment. [Figure 54] FIG. 10 is an explanatory diagram of an example of a process from image capture to distribution according to an embodiment. [Figure 55] FIG. 2 is an explanatory diagram of a filter designation region according to an embodiment. [Figure 56] 10 is a flowchart of a filter designation area correspondence process according to an embodiment. [Figure 57] 10 is a flowchart of a filter process according to an embodiment. [Figure 58] 10 is a flowchart of a tab switching process according to an embodiment. [Figure 59]FIG. 10 is an explanatory diagram of a rating condition panel according to an embodiment. [Figure 60] FIG. 10 is an explanatory diagram of a content condition panel according to an embodiment. [Figure 61] FIG. 10 is an explanatory diagram of a content condition panel according to an embodiment. [Figure 62] FIG. 10 is an explanatory diagram of a people condition panel according to an embodiment. [Figure 63] FIG. 10 is an explanatory diagram of a camera condition panel according to the embodiment. [Figure 64] FIG. 10 is an explanatory diagram of an other condition panel according to the embodiment. [Figure 65] FIG. 10 is an explanatory diagram of a reset operation according to an embodiment. [Figure 66] FIG. 4 is an explanatory diagram of a filter on / off operation according to an embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] The embodiments will be described below in the following order. <1. System configuration and operation procedures for image gallery service> <2. Configuration of information processing device> <3. Pre-setting process> <4. Transfer / editing process after the event starts> <5. Selection and Live Gallery> <6. Server project processing> <7. Web Gallery Delivery Processing> <8. Final delivery processing> <9. Live Gallery Streaming Images> <10. Filtering> <11. Summary and Variations>

[0010] <1. System configuration and operation procedures for image gallery service> In the embodiment, a case will be described in which a photographer takes still images (photographs) at an event such as a wedding, generates content as an image collection from the captured images, and provides the content to a client for a fee or free of charge. It should be noted that the present invention is not limited to still images, and moving images with or without sound may be captured, and an image collection including these moving images or an image collection consisting of multiple moving images may be generated.

[0011] For the purpose of this explanation, photographers and their assistants will be collectively referred to as "camera staff." The term "client" is not limited to the person placing the order, but also refers to any user who receives and can view the image collection. For example, the term "client" refers to the bride and groom, their relatives, friends, and other related parties. In this embodiment, it is also assumed that participants who do not directly attend an event such as a wedding ceremony but instead watch a live broadcast of the event from a remote location are also considered clients, but for the sake of explanation, they will be referred to as "remote participants."

[0012] An image collection created by a photographer or the like broadly refers to content that is a collection of images (still images and videos) such as a photo album, and the form in which it is provided does not matter, but in this embodiment, as an example, it is possible to provide an image collection as a web gallery and an image collection for actual delivery.

[0013] The image collection of a web gallery referred to here is an electronic image collection that allows photos of an event, such as a wedding, to be quickly viewed on a website after the event has ended. In the explanation, a website is used as an example, but this is just one example, and the content file as an image collection can also be provided in a form that allows it to be sent to the client's terminal device using, for example, email, electronic messages, SNS, etc.

[0014] The image collection to be delivered is, for example, a collection of images from an event that will later be officially produced as a photo album by a camera staff member and provided to a client. The image data captured at the event may be edited to create an electronic image collection as image album content or slideshow content, or an image collection may be created on paper, for example. The electronic image collection may be provided via download or streaming, or may be stored on portable storage media such as a disk-type storage medium, card-type storage medium, tape-type storage medium, or flash memory medium.

[0015] Furthermore, in the embodiment, live gallery distribution is performed assuming that it will be viewed mainly by remote participants. Live gallery streaming involves streaming image data captured by a photographer at an event, such as a wedding, over the web during the event, allowing remote participants to view the images (stills and videos) captured by the photographer in near real time.

[0016] For example, it is possible to place fixed cameras at an event venue and broadcast live video of the event, but simply watching video from a fixed camera is not very interesting. Therefore, remote participants can use a terminal device such as a personal computer (PC) or a smartphone to sequentially view images as a live gallery, for example, still images taken by a photographer. This allows remote participants to view images taken by a photographer at the venue in addition to video from a fixed camera, for example, thereby enhancing the sense of realism.

[0017] In addition, in order to create a collection of images to be published as a web gallery after the event and a collection of images to be delivered, the camera staff must select from the images they have taken which will be included in the collection. However, it is common for several thousand photos to be taken at a single event, making the selection of images to include in the photo book an extremely tedious task for the camera staff. In this embodiment, the reactions of viewers in the live gallery can be used to select images for the web gallery or the delivered image collection.

[0018] This allows us to quickly generate a collection of images that clients can view as a web gallery before the final image collection is delivered. Furthermore, the web gallery image collection will not simply be a collection of a large number of captured images, but will be selected images with a quality that viewers can enjoy. On the other hand, the image collection delivered is positioned as something that camera crews can take their time to create by editing with more creativity.

[0019] FIG. 1 shows terminal devices 1A and 1B, an imaging device 2, a personal computer 3, a server device 4, terminal devices 5A and 5B, a network 6, and terminal devices 7A and 7B. The terminal devices 1A and 1B are terminal devices used by camera staff, and for ease of explanation, they are collectively referred to as staff terminal 1. The terminal devices 5A and 5B are terminal devices used by users as the above-mentioned clients, and for the sake of explanation, these will be collectively referred to as client terminals 5. The terminal devices 7A and 7B are terminal devices used by the remote participants as clients, and for the sake of explanation, these are collectively referred to as the remote participant terminal 7.

[0020] Here, the staff terminal 1 and the client terminal 5 are exemplified by portable terminal devices such as smartphones and tablet devices. For example, the terminal device 1A is assumed to be a smartphone used by a photographer, and the terminal device 1B is assumed to be a smartphone used by an assistant. The terminal device 5A is assumed to be a smartphone used by the bride, and the terminal device 5B is assumed to be a tablet device used by a friend at the venue. Furthermore, devices such as PCs and smartphones are exemplified as the remote participant terminals 7. These are terminal devices that can be used by remote participants at home or on the go.

[0021] The staff terminal 1, client terminal 5, and remote participant terminal 7 may be any information processing device, specific examples of which include personal computers, mobile phones, game devices, audio devices, video devices, communication devices, television devices, etc. In other words, any information processing device capable of performing information processing operations, such as a device with a built-in microcomputer, can be used as the staff terminal 1, client terminal 5, or remote participant terminal 7 of the present disclosure. However, since the staff terminal 1 and the client terminal 5 are intended for use at an event venue or the like, it is preferable that they be portable terminals such as smartphones and tablet devices.

[0022] Various types of imaging devices such as video cameras and still cameras are assumed to be the imaging device 2. The imaging device 2 shown in the figure is assumed to be a camera used by a photographer at a wedding venue.

[0023] Data communication is possible between the imaging device 2 and the staff terminal 1 (for example, terminal device 1A) by, for example, FTP (File Transfer Protocol) communication. Specifically, it is conceivable that the terminal device 1A functions as an FTP server, and image files (including image data and metadata) captured by the imaging device 2 are uploaded sequentially or all at once via FTP communication. For this reason, it is assumed that the imaging device 2 is configured with FTP settings for transferring data to the terminal device 1A. The FTP setting information includes the host name of the FTP server, the destination path, the user name, the password, the connection type, and so on.

[0024] However, the imaging device 2 and the terminal device 1A may use other protocols than FTP. Any communication method may be used between the imaging device 2 and the terminal device 1A as long as it allows for the transfer of images and metadata. For example, mutual information communication may be possible using short-range wireless communication such as Bluetooth (registered trademark), Wi-Fi (Wireless Fidelity (registered trademark)), or NFC (Near Field Communication (registered trademark), or infrared communication. Furthermore, the imaging device 2 and the terminal device 1A may be able to communicate with each other via a wired connection such as a wired LAN.

[0025] The personal computer 3 is exemplified as an information processing device used by, for example, camera staff to create the image album content for final delivery. This personal computer 3 is used to obtain data relating to images of the event from the server device 4 and to create the image album content for delivery using an image editing application or the like.

[0026] The server device 4 provides and manages various information for the camera staff to create a web gallery or a collection of images for actual delivery. For example, an application program for an image album providing service is installed on the staff terminal 1, and the process described below is performed in accordance with the application program. Correspondingly, the server device 4 manages data related to the event, generates a web gallery, etc. Furthermore, the server device 4 performs live gallery distribution in response to instructions from the staff terminal 1.

[0027] The staff terminal 1 and the server device 4 are always connected while the application program is running, for example, and event data is synchronized. Examples of event data will be described later, but they include image data captured at the event, data used to generate a web gallery, data related to a live gallery, and the like.

[0028] In this disclosure, "synchronization" refers to maintaining the event data stored in the staff terminal 1 and the event data stored in the server device 4 so that at least a portion of the data content is the same. In particular, data to be synchronized includes image data, rating information, selection information, editing information, evaluation information, archive information, analysis information, distribution information, etc. The content of each will be described later.

[0029] The network 6 may be, for example, the Internet, a home network, a LAN (Local Area Network), a satellite communication network, or any other type of network. The staff terminal 1 can upload image data and the like to the server device 4 via the network 6 and transmit information for synchronization. After the event, the client terminal 5 and the remote participant terminal 7 can access the web page provided by the server device 4 via the network 6 and view the web gallery. During the event, the remote participant terminals 7 and the client terminals 5 can access the web page provided by the server device 4 via the network 6 and view the live gallery. The personal computer 3 can acquire image files for creating the image album content for actual delivery from the server device 4 via the network 6 .

[0030] The imaging device 2 has a display device such as a display panel on the back of the device or a viewfinder, and is capable of inputting operations using various controls, a touch panel, etc. In other words, it has sufficient functionality as a user interface. The imaging device 2 also has a built-in microcomputer, which enables various types of information processing and communication. For this reason, it is also assumed that the imaging device 2 functions as an information processing device as referred to in the present disclosure, and communicates with the server device 4 without going through the terminal devices 1A and 1B, and executes processing performed by the terminal devices 1A and 1B as described below. In the embodiment, the processing of the staff terminal 1 and the server device 4 will be mainly described, but an example in which the imaging device 2 performs all or part of the processing of the staff terminal 1 described below is also conceivable.

[0031] The outline of the procedure for providing a live gallery and an image collection realized by the system shown in Fig. 1 is explained with reference to Fig. 2. This is a procedure for operations at the staff terminal 1 based on the operations of the camera staff as the service provider.

[0032] In step S1, advance settings are made. For example, the camera staff performs communication settings between the staff terminal 1 and the imaging device 2, event settings, image retouching settings, live gallery settings, etc. This advance setting is performed before the start of an event such as a wedding.

[0033] In step S2, image capture / transfer / automatic editing / live gallery processing is performed during the event. Image files taken by a photographer with an image capture device 2 during an event are sequentially transferred to a staff terminal 1 (for example, terminal device 1A). The staff terminal 1 takes in the image file, transfers the image file to the server device 4, and automatically edits the image according to the pre-set settings. Furthermore, in response to operations by the camera staff, the staff terminal 1 issues various instructions to the server device 4 regarding live gallery distribution. In response to the instruction processing, the server device 4 distributes all or part of the transferred images as live gallery images. This allows remote participants to view images captured by the photographer during the event.

[0034] Step S3 shows the tasks that can be performed on the day after the wedding ceremony. The camera crew uses the staff terminal 1 to perform selection operations. Selection includes the selection of images to be posted in the web gallery, the selection of cover images and highlight images, and even image editing. The staff terminal 1 performs update processing of the event data in response to the camera crew's operations. Processing for synchronizing the event data with the server device 4 is also performed sequentially. The selection in step S3 may be performed while the wedding ceremony or the like is in progress. The live gallery may be viewable only during the event, or may be viewable for a certain period of time even after the event has ended. In addition, processes such as ending the live gallery and resuming uploading to the server device 4 may also be performed.

[0035] In step S4, the web gallery delivery process is performed. The server device 4 creates a web gallery based on the event data. The camera staff member checks the contents of the web gallery on the staff terminal 1 and then makes it available for viewing by clients. This allows the client to view the web gallery, which is a collection of images from the event, for example, on the day after the event ends.

[0036] Step S5 shows the creation of an image collection for the actual delivery and the processing of the actual delivery. The camera staff will later create the image album content for the actual delivery using, for example, a personal computer 3 and provide it to the client. This allows the client to receive the image collection content as the final delivery.

[0037] Here we will explain about live gallery streaming. Images captured by the photographer's imaging device 2 are transferred sequentially to the staff terminal 1 during the event, and further transferred to the server device 4. Therefore, basically, all images taken by the photographer are transferred to the server device 4. These are shown as transferred images in FIG.

[0038] While images are being transferred in this manner, the camera staff can use the staff terminal 1 to give instructions to start or stop the live gallery to the server device 4. In this case, the start instruction is an instruction to determine the image to start distributing based on the image capture time at the imaging device 2, the reception time at the staff terminal 1, etc. The stop instruction is an instruction to determine images not to be distributed based on the time of image capture by the imaging device 2 and the time of reception by the staff terminal 1. For example, the server device 4 does not consider image data captured by the imaging device 2 after the stop instruction is issued as a candidate for uploading to the live gallery among all transferred images. That is, the server device 4 sets, for example, an image captured between the start instruction and the stop instruction as an image related to the live gallery distribution process.

[0039] Here, all images between the start instruction and the stop instruction may be delivered as a live gallery, but it is more preferable to deliver a selected portion of them as a live gallery. For example, when the transfer images in Fig. 3 are images between the start instruction and the stop instruction, instead of distributing all of them, they are set as candidates for distribution and images to be actually distributed are selected by automatic processing of the server device 4. Then, only the selected images are uploaded to the live gallery. Figure 3 shows some of the transferred images selected for Live Gallery upload. Images with diagonal lines indicate images that were not selected for upload.

[0040] The server device 4 selects images suitable for distribution by, for example, image analysis processing, AI (artificial intelligence) processing using learning data, etc., and uses only a portion of the transferred images for live gallery distribution. For example, the server device 4 selects only one of images captured at similar times and with similar subjects, or selects a suitable image by determining the composition, the focus state, or the objects or people that are the subjects.The server device 4 can also remove images that are not suitable for live gallery distribution from the selection candidates by determining whether the image is a failure, such as a pitch-black image or an image where the main subject is not in focus, and select the images to actually be distributed from among the images that are suitable for live gallery distribution. By doing so, the number of images distributed as a live gallery will not be excessively large, and a high-quality live gallery can be provided.

[0041] <2. Configuration of information processing device> 4 shows an example of the configuration of an information processing device 70 that can be configured as a staff terminal 1, a client terminal 5, a remote participant terminal 7, or a server device 4 or a personal computer 3. The staff terminal 1, the personal computer 3, or the server device 4 can execute the processes described below by having the following configuration of the information processing device 70. In addition, the imaging device 2 can also execute the same processes as the staff terminal 1 described below by having the following configuration of the information processing device 70.

[0042] A CPU (Central Processing Unit) 71 of the information processing device 70 executes various processes in accordance with a program stored in a ROM (Read Only Memory) 72 or a program loaded from a storage unit 79 into a RAM (Random Access Memory) 73. The RAM 73 also stores data necessary for the CPU 71 to execute various processes as appropriate. Instead of the CPU 71, or together with the CPU 71, a GPU (Graphics Processing Unit), a GPGPU (General-purpose computing on graphics processing units), an AI (Artificial Intelligence) processor, or the like may be provided. The CPU 71, ROM 72, and RAM 73 are interconnected via a bus 74. An input / output interface 75 is also connected to this bus 74.

[0043] The input / output interface 75 is connected to an input unit 76 that includes an operator and an operation device. For example, the input unit 76 may be various types of operators or operation devices such as a keyboard, a mouse, keys, a dial, a touch panel, a touch pad, or a remote controller. An operation by the user is detected by the input unit 76, and a signal corresponding to the input operation is interpreted by the CPU 71.

[0044] Furthermore, the input / output interface 75 is connected integrally or separately to a display unit 77 such as a liquid crystal panel (LCD: Liquid Crystal Display) or an organic EL (Electro-Luminescence) display, and an audio output unit 78 such as a speaker.

[0045] The display unit 77 is a display unit that displays various types of information, and is configured by, for example, a display device provided in the housing of the information processing device 70, or a separate display device connected to the information processing device 70, or the like. The display unit 77 displays images for various image processing and images to be processed on the display screen based on instructions from the CPU 71. The display unit 77 also displays various operation menus, icons, messages, etc., i.e., a GUI (Graphical User Interface), based on instructions from the CPU 71.

[0046] The input / output interface 75 may be connected to a storage unit 79 configured from a hard disk or solid-state memory, or a communication unit 80 that performs communication using various communication methods.

[0047] The storage unit 79 is used to store image data, management data, and the like. The storage unit 79 also stores various programs. The communication unit 80 performs communication processing via a transmission path such as the Internet, and communication with various devices via wired / wireless communication, bus communication, and the like.

[0048] When this information processing device 70 is considered as the staff terminal 1, the communication unit 80 has a function for FTP communication with the imaging device 2 and a function for communicating with the server device 4 via the network 6. Alternatively, the communication unit 80 may have a function for communicating using short-range wireless communication such as the above-mentioned Bluetooth, Wi-Fi, and NFC, infrared communication, wired connection communication, etc. The communication unit 80 may also have a function for communicating using a communication line for mobile phones such as LTE (Long Term Evolution). When this information processing device 70 is considered as the server device 4, the personal computer 3, the client terminal 5, the remote participant terminal 7, or the like, the communication unit 80 has at least a function for performing communication via the network 6.

[0049] A drive 82 is also connected to the input / output interface 75 as required, and a removable recording medium 81 such as a magnetic disk, optical disk, magneto-optical disk, or semiconductor memory is appropriately mounted thereon. The drive 82 allows data files such as image files and various computer programs to be read from the removable recording medium 81. The read data files are stored in the storage unit 79, and images and sounds contained in the data files are output on the display unit 77 and the audio output unit 78. Furthermore, the computer programs and the like read from the removable recording medium 81 are installed in the storage unit 79 as necessary.

[0050] In this information processing device 70, for example, software for the processing of the present disclosure can be installed via network communication by a communication unit 80 or a removable recording medium 81. Alternatively, the software may be stored in advance in the ROM 72, the storage unit 79, etc.

[0051] Assuming that the staff terminal 1 is the information processing device 70, the CPU 71 of the information processing device 70 will implement a functional configuration as shown in FIG. 5 by an application program. Figure 5 shows the functions provided in the information processing device 70, which is the staff terminal 1, including an event data management unit 30, a UI (user interface) control unit 31, a communication control unit 32, a filter processing unit 33, an image analysis unit 34, and a distribution management unit 35.

[0052] The event data management unit 30 is a processing function that stores, as event data relating to a specific event, image data received through communication with the imaging device 2 and additional information including rating information corresponding to the image data. The event data management unit 30 also updates the event data in response to operational inputs from the camera staff. The event data management unit 30 also receives evaluation information on images distributed via the live gallery from the server device 4 and manages the information in association with the image data. Furthermore, the event data management unit 30 also receives distribution information from the server device 4 indicating that the image data distributed through the live gallery is an image distributed through the live gallery, and manages the information in association with the image data.

[0053] An example of the contents of the event data is Figure 6 is shown diagrammatically in The event data is a group of data including images and various details of an event that is registered as a project by the camera staff member using the staff terminal 1. Figure 6 shows event data 60 for an event with a project name "event2". In this example, the event data 60 includes preset information 61 , an imaging / editing information table 62 , and filter condition information 63 .

[0054] The preset information 61 is information set by the camera staff in advance in step S1 of Fig. 2. For example, it includes editing information such as retouching parameters.

[0055] The imaging / editing information table 62 is a table to which information is successively added and updated in the processing of steps S2 and S3 in FIG. In this imaging / editing information table 62, various information is written in correspondence with the image files transferred from the imaging device 2. Image data and metadata (MT1, MT2, etc.) are included in the image file transferred from the imaging device 2. This image data is managed as original image data, and the added metadata is also managed. Image data can be, for example, RAW data or data compressed using the JPEG format, and the data format does not matter, but here we will use JPEG compressed data such as ``DSC0001.jpg'' as an example. The metadata (MT1, MT2, etc.) includes camera information such as the time the image data was captured, the model, manufacturer, and serial number of the imaging device 2, data format, data size, angle of view information, focus point information, and other information added by the imaging device 2.

[0056] The imaging and editing information table 62 stores rating information corresponding to image data. The rating information indicates the rating value given to an image by a photographer or other professional, and is, for example, the number of stars, representing a six-level rating system, such as "no stars," "one star," "two stars," "three stars," "four stars," and "five stars." For example, the more stars, the higher the rating. Of course, this type of rating information is only an example. Such rating information serves as a reference for camera staff when selecting images. Therefore, for example, when setting the selection flag (to select an image for use in an image collection), images with high ratings indicated by the rating information are more likely to be used. In other words, these images are more likely to be used in web galleries or for final delivery. This rating information can be assigned to an image by a photographer after checking the captured image when the photographer captures the image. The imaging device 2 is provided with a user interface for inputting rating information. This rating information may be included in metadata corresponding to the image data and transferred to the staff terminal 1 together with the image data. Alternatively, it may be written in the XMP area of ​​Exif within the image file. The staff terminal 1 extracts and manages rating information from the metadata (or Exif data). This rating information can be added or updated in association with image data by operating the staff terminal 1 side.

[0057] The imaging / editing information table 62 stores selection information corresponding to image data. One of the selection information is the "selection flag" (sometimes simply referred to as "flag"), which indicates whether the image will be included in the Web Gallery. When the flag is off, the image will not be used in the Web Gallery, and when the flag is on, the image has been selected for use in the Web Gallery. One of the pieces of selection information is cover image information indicating that the image is selected as a cover image to be placed as a cover at the top of the web gallery. One type of selection information is highlight image information, which indicates that the image has been selected to be highlighted in the web gallery. Highlighting means that the image is displayed larger than other images. Alternatively, normal images may be monochrome images, while highlight images may be displayed in color. Conversely, in terms of emphasis, normal images may be color images, while highlight images may be displayed in monochrome. Furthermore, normal images may be displayed borderless, while highlight images may be displayed with a border. There are a variety of possible ways of highlighting.

[0058] The imaging / editing information table 62 stores analysis information corresponding to the image data. The analysis information is information indicating the analysis results obtained by the image analysis processing executed by the function of the image analysis unit 34. For example, it is information indicating the analysis results such as whether the subject person has their eyes closed. It may also contain personal identification information of the person in the photograph. Furthermore, the recognition result information may be included in the object determined by performing semantic segmentation processing on the image.

[0059] The imaging / editing information table 62 stores archive information corresponding to image data. Archive information is information indicating that an image has been archived by the user. Archive operations will be described later. For example, the simplest example would be flag information such as "0" or "1" that indicates whether the image has been archived.

[0060] The imaging / editing information table 62 stores evaluation information corresponding to image data. The evaluation information is information on the evaluation of an image, and may be evaluation information by a user or information on an evaluation by, for example, AI. In particular, information on user ratings includes whether or not remote participants who viewed the live gallery gave it a high rating (i.e., "liked") and the number of high ratings.

[0061] The imaging / editing information table 62 stores distribution information corresponding to image data. This distribution information is information indicating whether or not the image has been distributed via a live gallery. The distribution information is updated in response to a synchronization request from the server device 4. This allows the staff terminal 1 to also manage whether or not the server device 4 has distributed live gallery data for each image data. Also, information indicating that the content was distributed but deleted from the live gallery by an operation from the staff terminal 1 may be included.

[0062] The imaging / editing information table 62 stores editing information corresponding to image data. The editing information includes various image processing parameters such as retouching parameters, tilt correction parameters, etc. The retouching parameters include image quality adjustment parameters such as brightness adjustment values, color adjustment values, contrast adjustment values, and sharpness adjustment values. Retouching parameters can be set in advance, but they can also be set for individual images. Tilt correction parameters must be set individually. For these reasons, editing information corresponding to image data is stored so that parameters set for individual images can be stored.

[0063] As shown in the figure, the imaging / editing information table 62 may store edited image data corresponding to the image data. Edited image data is image data that has been edited based on preset or individually set editing information for original image data. It is not limited to image data that has been retouched using editing information, but can also refer to image data that has had its quality changed. Examples of quality changes include changes in image size, resolution, cropping, and frame rate for video. In the figure, edited image data is distinguished from original image data by adding an "E" to the file name, such as "DSC0001E.jpg." This edited image data is used for display on the user interface of the staff terminal 1. Such edited image data does not necessarily have to be created and stored; for example, editing information may be applied each time an image is displayed. Therefore, it is sufficient for the imaging / editing information table 62 to update and manage the editing information, and it is not necessary to store the edited image data. However, of course, generating and storing edited image data as needed, as shown in the figure, is effective in reducing the processing load during display processing.

[0064] The filter condition information 63 in the event data 60 is information that stores filter conditions for filtering images in the staff terminal 1. Although details of the filter process will be described later, in this embodiment, filtering can be performed using filter conditions specified by the camera staff when displaying a list of images on the staff terminal 1. The filter conditions are stored as filter condition information 63 and are updated successively in response to the user's operation to select conditions. As the image list, an all tab 125 and a candidate tab 126, which will be described later, are prepared, and as the filter condition information 63, the filter conditions for the all tab 125 and the filter conditions for the candidate tab 126 are stored independently.

[0065] The CPU 71 of the information processing device 70 serving as the staff terminal 1 performs additional storage and updating of information about the event data 60 as described above using the function of the event data management unit 30 shown in FIG. The format of the event data 60 and the format of the imaging / editing information table 62 are merely examples, and any format may be used as long as it allows at least the above content to be managed for each event. For example, the original image data, metadata, rating information, selection information, analysis information, archive information, evaluation information, distribution information, editing information, and edited image data included in the imaging / editing information table 62 are not limited to being stored together as a table, and may be stored in any format or manner as long as this information is associated with at least one piece of original image data. The event data management unit 30 may also have a function of simply acquiring event data 90 (see FIG. 8) stored in the server device 4, which will be described later. In other words, by acquiring the pre-setting information 61, the imaging / editing information table 62, etc. in FIG. 6 as needed through communication with the server device 4, the management form allows for successive reference without having to store them in the staff terminal 1. Even in such a case, the event data management unit 30 receives evaluation information for images distributed through the live gallery from the server device 4 via communication processing with the server device 4, and manages the information in association with the image data. For example, the staff terminal 1 may successively acquire the evaluation information and image data in a correlated state from the server device 4, thereby managing the information in association with the image data as temporary information, or, if the image data is stored, may associate the evaluation information received from the server device 4 by adding it as metadata or the like to the stored image data.

[0066] 5 is a function that controls the presentation of images and rating information related to event data 60 of a specific event and also detects operation inputs, that is, a function that performs user interface processing. User interface processing includes presenting various types of information, providing an environment in which operation input is possible, detecting operations by the user, and detecting / estimating the user's intentions. Specifically, the UI control unit 31 performs control processing to provide the user with an operation input environment and present information by, for example, causing the display unit 77 and the audio output unit 78 to perform display output, audio output, etc. to the user. Alternatively, the UI control unit 31 performs a process of detecting an operation by the user, for example. Alternatively, the UI control unit 31 performs both a process of providing an operation input environment to the user and a process of detecting an operation by the user, for example. In particular, in the present embodiment, the UI control unit 31 allows multiple types of filter conditions to be selected by operation, and controls the presentation of images extracted by the filtering process performed by the filter processing unit 33 based on the selected filter conditions. Of course, the UI control unit 31 may perform other user interface processing.

[0067] The communication control unit 32 has a function of performing communication with the imaging device 2 and communication control and synchronization with the server device 4. For example, the communication control unit 32 controls the execution of communication to synchronize the event data 60 with the external server device 4 in response to the storage or update of the event data 60. For example, when the communication control unit 32 receives an image transfer from the imaging device 2, it controls the process of transferring the image data from the communication unit 80 to the server device 4, and also controls the notification of the updated content to the server device 4 in response to an update of the content of the event data 60.

[0068] The filter processing unit 33 has a function of filtering images from among a group of images captured for an event in response to a user operation, and extracting images to be displayed. Filter conditions are set by a user operation. Specifically, the filter conditions set include ratings, specific objects, people, the imaging device 2, archive setting status, blink status, high rating information (presence or absence of "like"), metadata, etc.

[0069] The image analysis unit 34 performs image analysis to determine whether the subject person has closed their eyes, recognize the objects in the subject, or recognize the subject person. For example, it performs various recognition processes using a face detection algorithm, semantic segmentation processing, or individual determination algorithm. Information on the analysis results for each image is managed as analysis information in the event data 60. The image analysis unit 34 may receive the analysis results of each image in the server device 4. Therefore, the function provided in the staff terminal 1 is not necessarily to perform actual image analysis processing.

[0070] The distribution management unit 35 is a function that performs instruction processing regarding live gallery distribution by the server device 4. For example, the distribution management unit 35 performs processing to notify the server device 4 of instruction processes such as a "start instruction," "stop instruction," "resume instruction," "end instruction," "upload resume instruction," and "delete instruction." That is, when an operation related to live distribution is detected by the UI provided to the camera staff under the control of the UI control unit 31, the distribution management unit 35 receives the detection and issues the above-mentioned instruction, and causes the communication control unit 32 to transmit it to the server device 4.

[0071] The above functions in Fig. 5 are merely examples. When the information processing device 70 includes at least the event data management unit 30, the UI control unit 31, the filter processing unit 33, and the distribution management unit 35, the information processing device 70 performs processing as the staff terminal 1 of this embodiment. These functions are realized, for example, by installing an application program for creating image album content on the information processing device 70.

[0072] Next, assuming that the server device 4 is the information processing device 70 as shown in FIG. 4, the CPU 71 of the information processing device 70 implements a functional configuration as shown in FIG. 7 by an application program. FIG. 7 shows a server data management unit 40, an image album generation unit 41, an event data provision control unit 42, a data output unit 43, and a live distribution processing unit 44 as functions provided in an information processing device 70 serving as the server device 4.

[0073] The server data management unit 40 is a processing function that manages the storage and update of event data in the server device 4. The contents of the event data 90 on the server device 4 side are shown in Fig. 8. As in Fig. 6, this is event data 90 for an event with the event name "event2". In this example, the event data 90 includes preset information 91 and an imaging / editing information table 92 .

[0074] The preset information 91 is the same information as the preset information 61 in the staff terminal 1. For example, the contents set in the preset in step S1 in FIG.

[0075] The imaging and editing information table 92 has almost the same information as the imaging and editing information table 62. That is, it is possible to manage original image data, metadata, rating information, selection information, analysis information, archive information, evaluation information, distribution information, and editing information for each image. It should be noted that the imaging / editing information table 92 does not associate edited image data, but this is because edited images are created when uploading to a live gallery or when creating a web gallery. Of course, the server device 4 may also generate edited image data sequentially and associate the edited image data with the original image data in the imaging and editing information table 92 .

[0076] The CPU 71 of the information processing device 70 serving as the server device 4 performs additional storage and updating of information about the event data 90 as described above using the functions of the server data management unit 40 shown in FIG. In the embodiment, the event data 60 is managed by the event data management unit 30 on the staff terminal 1 side, and the event data 90 is managed by the server data management unit 40 on the server device 4 side, and the event data 60, 90 are synchronized, but as a variant, the event data may be stored and managed by either one. For example, if the event data 60 is stored by the server data management unit 40, even if the event data 60 is not stored on the staff terminal 1 side, by receiving it sequentially as described above, the event data can be associated with image data on the staff terminal 1 side, managed, and used.

[0077] 7 is a function that generates image album content as a web gallery of a specific event. In particular, the image album generation unit 41 references the selection information and editing information in the event data 90 to generate image album data, i.e., web page data to be used as a web gallery. An example of the generated web gallery data is shown in FIG. The server device 4 generates page information in HTML (HyperText Markup Language) format or XML (Extensible Markup Language) format as web gallery data, for example, as web page setting information 96, and also generates an image folder 97 that collects images called from the web page setting information 96 and displayed on the page. The image folder 97 contains edited image data for images that have been adopted as web galleries.

[0078] The event data provision control unit 42 in FIG. 7 is a function that controls transmission of the event data 90 to the staff terminal 1 for provision. For example, the staff terminal 1 logs in to the server device 4 and, in response to specifying an event, transmits all or part of the event data 90 for that event to the staff terminal 1. The staff terminal 1 then treats the received content as event data 60 under its own management. This allows an assistant to perform operations using the event data 60 on the terminal device 1B side, for example. Of course, the event data provision control unit 42 may also control the provision of event data to the terminal device 1A and the personal computer 3.

[0079] The data output unit 43 controls the transmission of some or all of the data contained in the event data, such as metadata, rating information, selection information, analysis information, archive information, evaluation information, distribution information, editing information, or image data (e.g., original image data), to a terminal device (e.g., a personal computer 3) as a file in a predetermined format. In other words, it is a processing function that provides the camera staff with the data necessary to create the image collection content for delivery.

[0080] The live distribution processing unit 44 is a function that performs processing to execute live gallery distribution. Specifically, it performs processing such as starting, stopping, restarting, and ending the live gallery based on instruction information from the staff terminal 1. The live distribution processing unit 44 also performs a process of selecting images to be uploaded to the live gallery from the image data transferred from the staff terminal 1, uploading the selected image data to the live gallery, and acquiring evaluation information (likes) from viewers of the live gallery.

[0081] The functions shown in Fig. 7 above are merely examples. The information processing device 70 serving as the server device 4 is provided with a server data management unit 40 that manages event data 90, allowing the event data to be synchronized between the staff terminal 1 and the server device 4. Furthermore, the server device 4 is provided with an image album generation unit 41, enabling quick generation of a web gallery. The server device 4 is provided with a live distribution processing unit 44, allowing live gallery distribution during the event to be carried out. Each function in FIG. 6 is realized, for example, by installing an application program for creating image album content on the information processing device 70.

[0082] Here, the live gallery viewing screen realized by the server device 4 having the function of the live distribution processing unit 44 will be described. FIG. 10 is an example of a live gallery viewing screen 400 viewed by the remote participant terminal 7. A remote participant or the like can view the live gallery viewing screen 400 by arbitrarily switching between, for example, a live view 401, a live view (full screen) 403, an index view 402, and a single view 404 shown in the figure.

[0083] The live view 401 and the live view (full screen) 403 are screens in which the latest images are automatically and sequentially displayed in a live display section 411 set within the screen. The remote participant can view the live gallery by accessing the URL notified in advance on the remote participant terminal 7. For example, the remote participant can first view the live gallery in the state of live view 401. In this live view 401, only images captured more recently than the currently displayed image are displayed in chronological order of their capture times. Also, as shown as live view (full screen) 403, only the image can be viewed in full screen display.

[0084] During the event, the server device 4 sequentially selects and processes image data transferred from the staff terminal 1 and uploads it to the live gallery. Therefore, images in the live gallery are updated and added at predetermined time intervals. The live gallery is viewed on the remote participant terminal 7 using a browser or a dedicated application, and these browsers, for example, can automatically perform a process of periodically updating themselves to the latest version, allowing viewers to view the live gallery in a state where new images are continually being added. Also, the user may view the latest content by performing an update operation on the browser, etc.

[0085] In this way, images are added to the live gallery one after another, so the latest image is displayed in the live view 401 . When the latest image is updated in the live gallery, the displayed image will be switched every 10 seconds or so. At this time, effect processing may be applied. If there are multiple newest images, the display will be switched in order from oldest to newest. Also, if there is no next image to display while the newest image is being displayed, that image will be displayed until the next new image is added. This live view 401 does not allow manual image forwarding or backward. Also, a full screen button 422 on the live view 401 can be used to switch to a live view (full screen) 403 .

[0086] The index view 402 is a screen that displays a list of images that have been distributed up to now in the list display section 410. For example, the images are displayed in chronological order with the oldest images at the bottom and the newest images at the top. Each time a new image is distributed by automatic updating, the new image is added to the list display of the index view 402. Alternatively, the addition of an image by updating may be performed in response to a manual operation. Even if an image is delivered that is inserted in the middle in the order of the time of capture, it will be inserted and displayed in chronological order.

[0087] The single view 404 is a screen that displays an enlarged image selected by tapping / clicking or the like in the index view 402. Images can be switched by operating left and right on the screen of the single view 404. For example, operating right displays older images in chronological order, and operating left displays newer images. If a new image is uploaded while the single view 404 is being displayed, it can also be played back by image forwarding.

[0088] FIG. 11 shows a live view 401 and an index view 402 . A project name 415 is displayed in the live view 401 and the index view 402 . A live icon 412 is displayed in the live view 401 and index view 402. For example, the live icon 412 is hidden before distribution and is displayed during distribution. Also, a pause icon is displayed while distribution is stopped. After the event ends, the live icon 412 is hidden. At the same time, a message indicating the end of the event may be displayed. These displays allow viewers, such as remote participants, to check the distribution status of the live gallery. For example, when the image in the live view 401 is not updated for a long time, the viewer can recognize that the distribution is paused.

[0089] The photographer's name 413 is displayed in the live view 401 and the index view 402, and the photographer's name is clearly displayed to the remote participants and the like. In addition to the name, for example, the URL of the photographer's web page may also be displayed.

[0090] The live view 401 and index view 402 display an expiration date 414. This indicates the date until which the live gallery can be viewed. A message or the like may be displayed together with or instead of the expiration date 414. The expiration date 414 or the like may also be displayed after the distribution of new images in the live gallery has ended.

[0091] As shown in FIGS. 10 and 11, in each view, a like button 420 and the number of likes 421 are displayed corresponding to the image. A viewer can give a high rating of "Like" by operating the high rating button 420. These high ratings are tallied by the server device 4 and displayed as the number of high ratings 421. The server device 4 also successively notifies the staff terminal 1 of the information on the number of high ratings for each image, so that the staff terminal 1 can manage the number of high ratings as the rating information of FIG. 6. Viewers of the live gallery can give a high rating by tapping / clicking the high rating button 420, but can cancel the high rating by tapping / clicking again.

[0092] <3. Pre-setting process> A specific example of processing in the above-described system, particularly the processing of the staff terminal 1 and the server device 4, will be described below. First, an example of the presetting process at the staff terminal 1 shown as step S1 in FIG. 2 will be described with reference to FIGS. The processing of the staff terminal 1 referred to below refers to processing performed by the CPU 71 of the information processing device 70 having the functions of FIG. In addition, the screen examples described below along with the flowcharts are examples of the contents displayed on a display formed on the housing of an information processing device 70 serving as the staff terminal 1, for example, a smartphone.

[0093] FIG. 12 shows the process of the staff terminal 1. For example, the camera staff member starts an application program using the staff terminal 1 and performs an operation for preparation processing. In response to this operation, the CPU 71 of the staff terminal 1 executes the processing from step S10 onwards.

[0094] In step S10, a project creation process is performed on the staff terminal 1. This is a process for setting up a project to create an image album for a certain event. At this time, the camera staff can also set up a live gallery for the project being created.

[0095] For example, after an application program is started, a project creation screen 105 such as that shown in FIG. 13A is displayed on the display unit 77 of the staff terminal 1. The camera staff can create a project for creating an image album on this project creation screen 105. For example, the project title (such as the name of the event), the date and time of the event, the location, whether or not to apply auto-retouching settings, etc. can be entered. The project creation screen 105 is provided with a project creation button 106 and a live gallery setting button 107 . The live gallery setting button 107 is an operator for setting whether or not to execute live gallery distribution in the project to be created. The camera staff member makes various inputs on the project creation screen 105, operates the live gallery setting button 107 in the state of FIG. 13A to turn it on as shown in FIG. 13B, and then operates the project creation button 106.

[0096] This will create a single project that runs the Live Gallery. The created project is displayed on a project list screen 110 as shown in FIG. 13C. The project list screen 110 has a list area 111 where the project names of the individual projects are displayed in a list, as well as an add icon 112, a communication icon 134, a menu icon 127, and the like.

[0097] 13C shows an example in which four projects are displayed. For each project, information such as the project name, date and time, and location is displayed. For projects created with Live Gallery turned on, a Live icon 122 is displayed. 13A without turning on the live gallery setting button 107, the project will be created without executing the live gallery, and the live icon 122 will not be displayed. However, the setting can be changed to execute the live gallery later.

[0098] In step S10 of FIG. 12, the staff terminal 1 performs control to provide such a screen user interface by using the function of the UI control section 31, and performs project creation processing in response to operations by the camera staff.

[0099] This project creation process is performed, for example, while the staff terminal 1 and the server device 4 are connected online. In this case, the staff terminal 1 uses the function of the communication control unit 32 to send information for synchronization processing to the server device 4 in accordance with the user's operation. This allows the server device 4 to be in a state where information for one project is entered synchronously.

[0100] 12, the staff terminal 1 performs transfer settings. These transfer settings are settings for FTP transfer between the staff terminal 1 and the imaging device 2, such as the file format to be transferred and the FTP connection server. The staff terminal 1 uses the function of the UI control unit 31 to display a screen for transfer settings to the camera staff, and performs the necessary transfer settings in response to operations by the camera staff.

[0101] In step S12, the staff terminal 1 performs auto-retouching settings, which are processing for setting parameters for image editing processing that is commonly applied to each image. The staff terminal 1 displays a screen for auto-retouching settings to the camera staff using the functions of the UI control unit 31, and performs the necessary auto-retouching settings in response to operations by the camera staff. The parameters for these auto-retouching settings are written as pre-setting information 61 in the event data 60 of the created project. Furthermore, this auto-retouching setting is also performed, for example, while the staff terminal 1 and the server device 4 are connected online, and the staff terminal 1 transmits the parameter information for which auto-retouching has been set to the server device 4 for synchronization processing. This allows the server device 4 to store preset information 91 having the same content as the preset information 61 of the event data 60 as the event data 90 of the project.

[0102] In step S13, the staff terminal 1 sets a watermark. For example, the photographer's name can be inserted as a watermark (digital watermark) into the images in the web gallery. Watermark setting is a process for setting whether or not to include this watermark and its contents. The staff terminal 1 displays a screen for setting a watermark to the camera staff using the function of the UI control unit 31, and sets the necessary watermark in response to the camera staff's operation. This watermark setting information is also written as pre-setting information 61 in the event data 60 of the created project. This watermark setting is also performed while the staff terminal 1 and the server device 4 are connected online, and the staff terminal 1 transmits the watermark setting information to the server device 4 for synchronization processing. This allows the server device 4 to store preset information 91 synchronized with the preset information 61 in the event data 90 of the project.

[0103] In step S14, the staff terminal 1 can perform live gallery preparation processing using the function of the UI control unit 31. This is a task of performing a live gallery trial in response to operations by the camera staff member to confirm whether the live gallery can be executed properly. 14A and 14B show examples of UI screens for this preparation process.

[0104] 14A shows a state in which an administration panel 300 for giving instructions for live gallery distribution is displayed on the screen. This administration panel 300 will be described in detail later, but it can be opened from a list screen of captured images during an actual event (while a project is being executed). By operating the start button 301 on this management panel 300, a start instruction for live gallery distribution is sent from the staff terminal 1 to the server device 4. Then, images captured by the imaging device 2 and transferred to the server device 4 via the staff terminal 1 are uploaded to the live gallery after undergoing selection processing in the server device 4. Therefore, when the camera staff takes test shots using the imaging device 2, the test shot photos are uploaded to the live gallery.

[0105] Fig. 14B is a live gallery setting screen 310 to which transition can be made from the screen of Fig. 14A on the staff terminal 1. For example, operation of the settings / share button 305 in Fig. 14A transitions to the live gallery setting screen 310 in Fig. 14B. The live gallery setting screen 310 is provided with a live gallery creation button 311, a URL display section 312, an open button 313, a share button 314, a delete button 315, a resume upload button 316, and the like.

[0106] The live gallery creation button 311 is operated when a live gallery is to be executed in one project. For example, even if the camera staff does not turn on the live gallery setting when creating the above-mentioned project, the live gallery can be set to be executed by operating this live gallery creation button 311.

[0107] The URL display section 312 displays the URL of the live gallery. The open button 313 is an operator for accessing the URL of the live gallery and starting viewing of the live gallery. Therefore, the camera staff member operates start button 301 in Fig. 13A, takes a test shot with imaging device 2, and then operates open button 313. This causes staff terminal 1 to access the live gallery and display live gallery viewing screen 400 as shown in Fig. 10 above. This allows the camera staff member to check whether the live gallery is functioning properly.

[0108] The delete button 315 is an operator that instructs that an image uploaded to the live gallery be deleted from the live gallery. After the camera staff has confirmed that the live gallery is working, they can delete the image that they uploaded for trial purposes by operating the delete button 315. For example, if all images can be deleted at once by pressing the delete button 315 or by other necessary operations, this will be a convenient function for the camera staff.

[0109] After checking the live gallery as described above, the camera staff operates the share button 314 to share the URL of the live gallery with the client. In response to the operation of the share button 314, the staff terminal 1 performs processing to provide a URL to the client terminal 5. For example, the URL is sent to the client who has requested the camera staff to take photos at the wedding, such as the client terminal 5 of the bride or her relatives. For example, the bride or the like may share the URL with the remote participant terminal 7 of a friend or acquaintance who will be a remote participant on the day of the wedding ceremony. This allows the remote participants to view the live gallery on the day of the event.

[0110] The above-described processes of trying out the live gallery, deleting the images uploaded as a result of the trial, and providing the URL of the live gallery to the client terminal 5 are carried out in step S14 of FIG.

[0111] The order of steps S11, S12, S13, and S14 may be different. Furthermore, the processing of each step does not have to be performed as a series of processes, and may be performed each time in response to a user operation during startup, for example. Furthermore, each process may be skipped if not necessary. For example, the transfer settings in step S11 may be performed each time a project is created in step S10, but if the FTP transfer settings have already been configured once and no changes to the settings are required, step S11 may be skipped after the project is created in step S10, and the process may proceed to step S12. Of course, the same applies to the processes in steps S12 and S13, and if no changes are required after the settings have been configured, these may be skipped. In addition, communication with the server device 4 for synchronization may be performed at the timing of each process, but it is also possible to synchronize the pre-setting information 61, 91 by sending the information together when several settings have been made. Furthermore, if there is content that has been set in an environment where online connection with the server device 4 is not possible, it is preferable that the set information be sent when an online connection state is established, and the pre-setting information 61, 91 be synchronized.

[0112] <4. Transfer / editing process after the event starts> Next, a specific example of the processing of the staff terminal 1 in step S2 of Fig. 2, which is performed after the start of an event, will be described with reference to Fig. 15. That is, when a wedding or other event is taking place, this is processing related to the transfer of image data and event data that is executed on the staff terminal 1 mainly by the functions of the event data management unit 30, communication control unit 32, and image analysis unit 34 of Fig. 5.

[0113] When the event starts, the staff terminal 1 starts processing the project, and the process of FIG. 15 is executed repeatedly. 15, the staff terminal 1 checks whether or not an image file has been transferred from the imaging device 2. If no image transfer has been performed, the process proceeds from step S101 to step S108, but if an image transfer has been performed, the process proceeds from step S101 to step S102.

[0114] For example, during a wedding event, a photographer uses the imaging device 2 to capture images of the ceremony and reception. After capturing still images, for example, the imaging device 2 transfers the image files to the staff terminal 1 automatically or in response to the photographer's operation. Note that the transfer timing is an example. The transfer may be performed for each image captured, or multiple images may be transferred together. In the case of video recording, the data may be transferred during periods when recording is not being performed, or during the recording period after recording has started. All recorded video may be transferred, or only the first specified period may be transferred.

[0115] Furthermore, the photographer can add rating information to the captured image by operating the imaging device 2. For example, the photographer can check the image immediately after capturing it and input the rating information. This rating information is written in the metadata. The transfer of the image file containing the image data and metadata may be performed, for example, in response to a photographer checking the captured image and inputting rating information.

[0116] When the staff terminal 1 detects that such an image file has been transferred, it performs a process of receiving the image data and metadata in step S102. In this case, the received image data is managed as original image data in the imaging / editing information table 62 of the event data 60. The received metadata is also managed accordingly.

[0117] The staff terminal 1 performs image compression processing in step S103. For example, the compression processing is performed so as to increase the compression rate of the received image data. This is processing to generate image data to be sent to the server device 4.

[0118] In step S104, the staff terminal 1 performs image analysis processing. That is, image analysis processing is performed on the received image or the image compressed in step S103, and person detection, personal recognition, object recognition, pupil detection, blink determination, etc. are performed as subjects. Analysis information is then generated according to the analysis results. The analysis information is registered in the imaging and editing information table 62 of the event data 60.

[0119] In step S105, the staff terminal 1 performs event data management, such as rating information management. This process checks the metadata of the received image file, extracts the rating information assigned by the imaging device 2, and manages it in the imaging / editing information table 62 of the event data 60. At this time, other event data 60 may be updated. For example, information may be added to the metadata on the event data 60.

[0120] In step S106, the staff terminal 1 transmits information to the server device 4 to synchronize the event data 60 and 90. In this case, the staff terminal 1 transmits the image data compressed in step S103, as well as the metadata, rating information, analysis information, and other information contained in the event data 60, to the server device 4. Upon receiving this, the server device 4 updates the event data 90 and maintains the synchronized state with the event data 60.

[0121] In step S107, the staff terminal 1 performs auto-retouch application processing. That is, image processing is automatically performed on the original image data using preset retouching parameters to generate edited image data, which is managed in the imaging and editing information table 62. This edited image data is generated for use in UI display on the staff terminal 1. In this example, auto-retouching is performed as part of the process when an image file is received, but it may also be performed at other times as needed, such as when a request is made to display a single image. It is also possible to perform image processing on the compressed image data generated in step S103. In this case, for example, the order of the processes in steps S106 and S107 may be reversed, and the compressed image data may be subjected to image processing that applies auto-retouching before being sent to the server.

[0122] 15, information synchronization processing is performed in step S108, regardless of whether an image is transferred. This information synchronization processing is processing for updating the contents of the event data 60 based on information transmitted from the server device 4. In particular, the latest evaluation information and distribution information for each image is received from the server device 4, and the event data 60 is updated. This allows the staff terminal 1 to manage information about each image, such as the number of likes given by viewers of the live gallery, and information about whether the server device 4 has uploaded the image to the live gallery, while updating it as needed.

[0123] 15 is performed, the staff terminal 1 captures images captured by the photographer, and information corresponding to the images is managed by the event data 60. For example, when a wedding ceremony is over, all captured images are managed by the event data 60. Furthermore, by carrying out transmission for successive synchronization, the event data 90 on the server device 4 side is synchronized with the event data 60 on the staff terminal 1 side during and at the end of the wedding ceremony.

[0124] Also, during the processing of Figure 15, a list of images transferred from the imaging device 2 and the communication status are displayed on the time view 120 described below, so that the camera staff can check the status of image import into the staff terminal 1, etc.

[0125] <5. Selection and Live Gallery> Next, the UI-related processing by the staff terminal 1 will be described. This is a process performed in relation to the operation of the camera staff after an event such as a wedding has started, and is performed in parallel with the process described above in Fig. 15. In terms of Fig. 2, this includes the live gallery distribution instruction process and selection process in steps S2 and S3. Examples of UI-related processing will be described with reference to the flowcharts of FIGS. 16 to 22 and the screen examples of FIGS. 23 to 34. Note that Figures 16 to 22 show a series of flowcharts in separate parts, with connections indicated by "c1", "c2", "c3", "c4", "c5", "c6", "c7", and "c8". The processing of these flowcharts is performed by the functions of the event data management unit 30, UI control unit 31, communication control unit 32, filter processing unit 33, and distribution management unit 35 in FIG.

[0126] Step S201 in FIG. 16 shows the process of displaying a list of projects (event names, etc.) on the project list screen 110 as shown in FIG. 13C. In step S202, the staff terminal 1 monitors whether or not a project selection operation has been performed on the project list screen 110, and in step S203 monitors whether or not an operation to terminate the application program has been performed. When an operation to terminate the application program is performed, the application program is closed and the process is completed.

[0127] For example, when a camera crew member gives instructions for live gallery distribution or makes a selection after the start of a wedding ceremony or the like, the camera crew member performs an operation to select a target project on the project list screen 110. For example, the camera crew member performs an operation such as tapping one of the projects displayed in the list area 111. When such an operation is detected, the staff terminal 1 advances the process from step S202 to step S204 and acquires the latest event data for the selected project. For example, the staff terminal 1 requests the event data 90 for the selected project from the server device 4 and imports the transmitted event data 90. The staff terminal 1 then compares it with the event data 60 it holds and updates it to the latest information. For example, it compares some information that can determine whether the information is new or old, such as update time information or version control information for the event data 60 and the event data 90, and if they differ, it updates the event data 60 to the latest information.

[0128] For example, if we consider terminal device 1A held by a photographer, during the wedding ceremony, an assistant may be entering rating information and selection information on terminal device 1B, and this information may not be reflected in the event data 60 on terminal device 1A. Furthermore, when rating information or selection information is to be input on the side of terminal device 1B held by the assistant, it is appropriate to input the latest information on the side of terminal device 1A as a standard. Therefore, the staff terminal 1 receives the event data 90 of the server device 4, which has the latest information sent from both the terminal devices 1A and 1B, and updates the information of its own event data 60 if it is not the latest.

[0129] It should be noted that there may be only one staff terminal 1, and the information on the staff terminal 1 may always be the latest. In such a case, the processing of step S204 may be unnecessary.

[0130] 17, the staff terminal 1 displays a list of event images, for example, a time view 120 as shown in FIG. The time view 120 is a list display in the image area 128 as a simple time-series display in which images are arranged in the order of their capture times.

[0131] The time view 120 changes its display form as shown in FIG. 24A, FIG. 24B, and FIG. 24C in response to the zoom-in / zoom-out operation. 23 and 24A show four images arranged in a row in image area 128, Fig. 24B shows two images arranged in a row, and Fig. 24C shows one image arranged vertically on the screen. The user can adjust the image size as desired to view the list display.

[0132] 17, the staff terminal 1 may display the event view 200 as shown in FIG. 25 or 26 instead of the time view 120. In the event image list display in step S211 of FIG. The event view 200 also has an image area 128 where images are displayed in a list, but in this case, sub-event and scene divisions are set for each image, and the list is displayed in sub-event and scene units. Sub-events and scenes are chronological divisions of an event, such as a wedding. For example, if a wedding ceremony and reception are considered to be one event, then there are various events that divide the time series, such as the ceremony, reception, greetings, cake cutting, toast, bouquet toss, etc. The content of the divisions is arbitrary, but for example, if a series of weddings is considered to be an event, the events that divide it will be called "sub-events" for the purpose of explanation. There are also cases where a two-stage division is made to further divide a single sub-event. In such cases, each division is called a "scene."

[0133] FIG. 25 shows a state in which the index bar 201 is displayed in the event view 200, and FIG. 26 shows a state in which the index bar 201 is not displayed.

[0134] In the time view 120 and the event view 200, a project name 121 is displayed, and also a live icon 122, an all flags icon 123, a next icon 132, a communication icon 134, a menu icon 127, and the like are displayed.

[0135] The menu icon 127 is an operator for displaying various menu items. The communication icon 134 is an icon for displaying the status of FTP communication with the image capture device 2, etc. The all flag icon 123 is an operator for setting on / off the selection flag for all images, which indicates that the images are to be used in the image album. The next icon 132 is an operator for transitioning to the next screen.

[0136] The live icon 122 indicates the status of the live gallery and also serves as an operator for displaying the live gallery management panel 300. The display mode of this live icon 122 changes between the execution period and non-execution period of the live gallery. The execution period here refers to the period during which a captured image is a target (candidate) for uploading to the live gallery. Specifically, the execution period is the period from when the start button 301 on the management panel 300 (described later) is operated until the stop button 302 is operated, and the rest is the non-execution period. The "non-execution period" here does not coincide with the period during which the server device 4 is not performing live gallery distribution itself. It is merely a period during which the camera staff member has decided not to transfer images to the server device 4 as images for the live gallery. Therefore, even during the non-execution period, the live gallery itself may continue, and images may be transmitted from the staff terminal 1 to the server device 4 in response to image capture. During non-execution periods, the live icon 122 displays the characters "!LIVE," for example, as shown in FIG. 23, with the "!" in red and "LIVE" in white, so that the camera staff can recognize that distribution has not started. During the execution period, the live icon 122 displays the word "LIVE" in green, for example, as shown in FIG. 25, so that the camera staff can recognize that the captured image is being distributed.

[0137] As described above, the time view 120 and the event view 200 have an image area 128 in which images transferred from the imaging device 2 are displayed as a list of thumbnails, and an all tab 125 and a candidate tab 126 are provided for displaying the image area 128. When the all tab 125 is selected, images transferred from the imaging device 2 are displayed in the image area 128 regardless of whether the selection flag is on or off. For example, assume that Fig. 23 shows a list display when the all tab 125 is selected. On the other hand, when the candidate tab 126 is selected, only images for which the selection flag is set to ON are displayed in the image area 128, out of all images transferred from the imaging device 2. For example, Fig. 27 shows an example of the list display when the candidate tab 126 is selected. The selection flag is set to ON / OFF for each individual image based on whether the camera staff thinks the image should be used in the web gallery.

[0138] The number of corresponding images is also displayed in the all tab 125 and the candidate tab 126. In FIG. 23, "2065" is the number of images displayed in the all tab 125, and "54" is the number of images displayed in the candidate tab 126. Note that if the number of images displayed in the all tab 125 or candidate tab 126 is narrowed down by a filter process described later, the number of images displayed may be the number after narrowing down. Alternatively, even if a filter process is performed, the number to be displayed may remain unchanged and the total number may be displayed.

[0139] A view switching button 202 is displayed in the time view 120 and the event view 200. When "Time" is selected as shown in Fig. 23, the time view 120 is displayed. When "Event" is selected as shown in Fig. 25, the event view 200 is displayed. The user can arbitrarily switch between the list display in the time view 120 and the event view 200. For example, the view switching button 202 alternates between "Time" and "Event" each time it is tapped.

[0140] 24B, 24C, and 25, a closed eyes icon 210 may be displayed for each image in the image area 128 in the time view 120 and the event view 200. This icon is used to present an image in which the subject person has their eyes closed based on the closed eyes information, which is one of the above-mentioned analysis information. In particular, when a relatively small thumbnail image is displayed as in Figures 24B and 25, it may be difficult to determine whether the person has their eyes closed. The closed eyes icon 210 indicates the closed eyes state, which is useful for camera staff when checking the image.

[0141] However, in this example, the closed eyes icon 210 is not displayed in Fig. 24A. This is because if the thumbnail images are made extremely small and multiple images are to be viewed at once, displaying the closed eyes icon 210 would clutter the screen. However, even in such cases, examples in which the closed eyes icon 210 is displayed can be considered.

[0142] For each image in the image area 128 in the time view 120 and the event view 200, a rating icon 130 and a flag setting icon 131 are displayed in association with the image, as shown in FIGS. 24B, 24C, and 25.

[0143] The rating icon 130 not only displays rating information set by the number of stars, but also serves as an operator for changing the rating. For example, the number of stars can be changed by tapping or sliding the rating icon 130, which is a rating change operation. The flag setting icon 131 indicates whether the selection flag is on or off by, for example, changing the color or brightness of the icon. The flag setting icon 131 is also used as an operator for switching the selection flag on or off. For example, the selection flag can be switched on or off by a tap operation.

[0144] 24A does not display the rating icon 130 and the flag setting icon 131. This is because the rating icon 130 and the flag setting icon 131 are displayed when the display corresponding to the image is sized to be easy to see or operate, as in FIG. 24B. Of course, even in the state of FIG. 24A, the rating icon 130 and the flag setting icon 131 may be displayed corresponding to the image.

[0145] For images displayed in the image area 128 in the time view 120 and the event view 200, a like mark 162, a number of likes 163, and a distribution mark 164 may be displayed.

[0146] The distribution mark 164 indicates that the image has been uploaded to the Live Gallery. The like mark 162 is a mark that is displayed on an image that has been given a high rating by a viewer of the live gallery. The number of likes 163 shows how many viewers of the live gallery have performed the like action.

[0147] Additionally, the time view 120 and the event view 200 are provided with a filter specification area 129 . The filter designation area 129 is provided with a filter on / off button 350 for enabling / temporarily disabling filtering. In addition, the filter designation area 129 displays icons indicating various filters, such as a rating filter 361, a content filter 362, a people filter 363, a camera filter 364, and an other filter 365. The camera staff can set various filter conditions and execute filtering by operating the filter designation area 129. Details will be described later.

[0148] FIG. 28 shows the display switching between the time view 120 and event view 200 described above and the single image display screen 140 described later. 17, the display is switched between the project list screen 110, the time view 120, and the event view 200. At this time, which view is displayed may be, for example, the view last selected the previous time the event was viewed. The camera crew can switch between the time view 120 and the event view 200 at any time using the view switching button 202.

[0149] When an image is selected from the time view 120 or the event view 200, the display shifts to the single image display screen 140. When the return icon 133 on the single image display screen 140 is operated, the display returns to the time view 120 or the event view 200 as the list state before the shift to the single image display screen 140.

[0150] The differences between the time view 120 and the event view 200 are as follows. In the time view 120 of Fig. 23, the images are simply arranged in chronological order based on the time of capture. The user can check each image by scrolling vertically. In other words, if a user wants to check an image of a desired sub-event, they must roughly consider the time and perform a long vertical scroll to reach the target image.

[0151] 25 and 26, scenes are arranged vertically, and multiple images of one scene are arranged horizontally. When searching for an image within one scene, horizontal scrolling is used to reveal each image of that scene within image area 128. Since the sub-events and scenes are arranged vertically, if there is a sub-event you want to check, you can reach the scene of that sub-event relatively quickly by scrolling vertically. You can also use the index bar 201 to specify the desired sub-event or scene and jump to that position. Furthermore, within the scene you want to check, the images are arranged horizontally, making comparison easy. From the above, the event view 200 has the advantage over the time view 120 that it is easier to access each image and easier to compare images of the same scene for selection.

[0152] Note that multiple images from one scene are arranged horizontally in one row, but if the number of images in a scene becomes excessive, horizontal scrolling becomes long and usability may decrease. Therefore, an upper limit is set on the number of images that can be arranged horizontally. For example, the maximum number of images that can be arranged horizontally is 30. If the number of images in a scene exceeds this limit, the next row will be used to arrange them horizontally. Therefore, images from one scene may be displayed across multiple rows.

[0153] In the state where the staff terminal 1 has displayed the time view 120 or the event view 200 as described above in step S211 of FIG. 17, the staff terminal 1 performs the monitoring loop process from step S212 to step S222 of FIG.

[0154] 17, the staff terminal 1 monitors the operation of the next icon 132. The process when the operation of the next icon 132 is detected will be described later.

[0155] In step S213, the staff terminal 1 monitors a tab switching operation. A tab switching operation is an operation on the candidate tab 126 while the list of all tabs 125 is displayed, or an operation on the all tab 125 while the list of candidate tabs 126 is displayed. When the tab switching operation is detected, the staff terminal 1 performs processing to switch the list display contents in the image area 128 in accordance with the selected tab in step S240. When switching tabs, filtering processing is also performed, but details of this will be described later.

[0156] In step S214, the staff terminal 1 monitors the operations relating to the screen state performed on the image area 128 by the camera staff. The operations relating to the screen state here include operations such as enlarging / reducing an image, scrolling the screen, and making a displayed item appear / disappear.

[0157] For example, the staff terminal 1 monitors pinch operations. The pinch operations here include pinch out operations for enlarging an image and pinch in operations for reducing an image. When the pinch operation is detected, the staff terminal 1 enlarges or reduces the display state in the image area 128 in step S241.

[0158] 24A, 24B, and 24C show examples of changes in the display of image area 128 in response to pinch-in / pinch-out. Figure 24A shows the smallest displayed thumbnail images. When a pinch-out operation is performed, the images displayed in a list are enlarged as shown in Figure 24B. When a further pinch-out operation is performed, the images are enlarged as shown in Figure 24C. Furthermore, when a pinch-in operation is performed, the screen shrinks from the state in FIG. 24C to the state in FIG. 24B, and further pinch-in operation returns it to the state in FIG. 24A. As described above, the display of the closed eye icon 210, rating icon 130, flag setting icon 131, etc. is also switched depending on whether the image is enlarged or reduced.

[0159] In step S214, the staff terminal 1 also monitors swipe operations. For example, in the time view 120 shown in Fig. 23 or the event view 200 shown in Fig. 25, an up / down swipe operation is recognized as a scroll operation in the up / down direction, and the display is scrolled vertically in step S241.

[0160] Furthermore, the staff terminal 1 recognizes the left and right swipe operation on the event view 200 as a scroll operation in the left and right direction, and the staff terminal 1 scrolls the display horizontally in step S241.

[0161] Furthermore, the staff terminal 1 recognizes, for example, a swipe operation to the right on the index bar 201 in the event view 200 as an operation to erase the index bar 201, and recognizes a swipe operation from the right edge of the screen to the left in the state of Fig. 22 as an operation to call up the index bar 201. Then, in step S241, display control is performed to close or reveal the index bar 201.

[0162] 17, the staff terminal 1 monitors whether an operation has been performed to select one of the images displayed in the image area 128. For example, this is an operation such as tapping on one of the thumbnail images. The processing performed when this selection operation is detected will be described later.

[0163] In step S216, the staff terminal 1 monitors operations in the filter designation area 129. That is, operations of the filter on / off button 350, the rating filter 361, the content filter 362, the people filter 363, the camera filter 364, and the other filter 365. When any of these operations is detected, the staff terminal 1 performs processing to deal with the operation in step S242. Specifically, the staff terminal 1 updates the display in response to the invalidation or validity of the filtering state in response to the operation of the filter on / off button 350, or performs a screen transition in response to the operation of an icon such as the rating filter 361.

[0164] In step S217, the staff terminal 1 monitors filter operations. These operations are mainly filter condition operations on the screens transitioned from the rating filter 361, content filter 362, people filter 363, camera filter 364, and other filter 365. If a filter operation is detected, the staff terminal 1 proceeds to step S243, sets and stores filter conditions according to the operation, performs filtering processing according to the filter conditions, and extracts corresponding images. The extracted images as a result of filtering are then displayed in a list in the image area 128. Specific examples of the processes in steps S242 and S243 will be described later.

[0165] 18, the staff terminal 1 monitors rating operations, such as operations on the rating icons 130 shown in FIGS. 24B, 24C, and 25. If an operation on the rating icon 130 is detected, the staff terminal 1 proceeds to step S230 and updates the event data 60 so that the rating information of the image corresponding to the rating icon 130 has a value according to the operation. Also, in step S231, the staff terminal 1 transmits the updated rating information to the server device 4, so that the event data 90 is updated on the server device 4 side. That is, a synchronized state is maintained.

[0166] In step S219, the staff terminal 1 monitors flag on / off operations, such as operations on the flag setting icon 131 shown in FIGS. 24B, 24C, and 25. If an operation on the flag setting icon 131 is detected, the staff terminal 1 proceeds to step S232 and updates the event data 60 so that the selection flag as selection information for the image corresponding to the flag setting icon 131 is switched on / off. In step S233, the staff terminal 1 transmits the updated flag information to the server device 4, so that the event data 90 is updated on the server device 4 side. That is, the synchronized state is maintained.

[0167] In step S220, the staff terminal 1 monitors the operation of the all flag icon 123. If an operation on the all flag icon 123 is detected, the staff terminal 1 proceeds to step S234, where the process branches depending on whether the selection flags of all images are currently on. If some images have flags on or all have flags off, and not all images have flags on, the staff terminal 1 proceeds to step S236, where it updates the event data 60 so that the flags of all images are on. On the other hand, if the all flags icon 123 is operated when all the images are flagged on, the staff terminal 1 proceeds to step S235 and updates the event data 60 so that the flags for all the images are set to off. In step S237, the staff terminal 1 transmits the updated flag information to the server device 4, so that the event data 90 is updated on the server device 4 side. That is, the synchronized state is maintained.

[0168] In step S221, the staff terminal 1 monitors the view switching operation. That is, it monitors whether the view switching button 202 is operated to instruct the display of the time view 120 while the event view 200 is displayed, or whether the view switching button 202 is operated to instruct the display of the event view 200 while the time view 120 is displayed. When an operation on the view switching button 202 is detected, the staff terminal 1 proceeds to step S238 and performs view switching processing. That is, if the time view display has been performed up until then, the view is switched to the event view. Also, if the event view display has been performed up until then, the view is switched to the time view.

[0169] 19, the staff terminal 1 monitors an operation to open the management panel 300 of the live gallery. This is assumed to be an operation on the live icon 122, for example. If an operation to open the administration panel 300 is detected, the staff terminal 1 proceeds to step S350 and displays the administration panel 300.

[0170] 14A, the staff terminal 1 displays the management panel 300 superimposed on the display of the time view 120 or the event view 200. Note that the display contents of the time view 120 or the event view 200 may be grayed out, for example, so that operations on the management panel 300 are disabled while the management panel 300 is displayed.

[0171] Fig. 30A shows an example of the management panel 300 before a command to start distribution of a live gallery is given. In this case, the management panel 300 displays the start button 301 and the settings / share button 305, as described in Fig. 14A. In addition, a live icon 306 and a close button 307 are also displayed. The display mode of the live icon 306 on the management panel 300 is the same as the display mode of the live icon 122 on the time view 120 or event view 200. Therefore, in the case of Fig. 30A, the live icon 306 is set to "!LIVE", indicating that it is a non-execution period in which no start instruction has been given for the live gallery yet. The display content of this management panel 300 changes depending on the state, as shown in Figures 30B and 30C. Figure 30B shows the state in which captured images are being distributed after an instruction to start live gallery distribution has been given. In this case, the live icon 306 displays the execution period, and instead of the start button 301, a stop button 302 for issuing a stop instruction and an end button 303 for issuing an end instruction are displayed. 30C shows a state in which live gallery distribution is stopped. In this case, the live icon 306 is displayed to indicate a non-execution period, and the resume button 304 and the end button 303 are also displayed.

[0172] The stop instruction means that the live gallery is not terminated and the captured images are not included in the live gallery distribution, and means a temporary stop. On the other hand, the end instruction means to end the transfer of new images to be distributed in the live gallery.

[0173] After the staff terminal 1 displays the management panel 300 as shown in FIG. 30A in step S350 of FIG. 19, it performs monitoring processing from step S351 to step S354. In step S351, the operation to end the display of the management panel 300, that is, the operation of the close button 307, is monitored. If the operation of the close button 307 is detected, in step S360 the staff terminal 1 ends the display of the management panel 300 and returns to the original display of the time view 120 or the event view 200. 30A, 30B, and 30C, the close button 307 is always displayed on the administration panel 300, and the user can use this operation to arbitrarily close the administration panel 300. Note that this operation is an operation to close the administration panel 300, and does not change the execution state or standby state of the live gallery.

[0174] 30A or 30C, the user can issue a start instruction or a resume instruction, that is, by operating the start button 301 or the resume button 304. When such an operation is detected, the staff terminal 1 proceeds from step S352 to step S361, and performs processing to transmit a start instruction or a resume instruction for the image to be distributed to the server device 4. The start instruction in this case means an instruction to the server device 4 to make images captured by the imaging device 2 from this point onward into candidates for distribution to the live gallery. In response to this, the server device 4 selects images captured at subsequent times (times) and uploads them to the live gallery.

[0175] After issuing the start instruction, the staff terminal 1 changes the display in step S362. This is the process of changing the management panel 300 to the state shown in FIG. 30B.

[0176] 30B, the user can issue an instruction to stop distribution by operating the stop button 302. If the operation of the stop button 302 is detected, the staff terminal 1 proceeds from step S353 to step S363 in FIG. 19, and performs processing to transmit to the server device 4 a stop instruction for the image to be distributed. The stop instruction in this case means that the server device 4 is instructed not to consider images captured by the imaging device 2 after this point in time as candidates for distribution to the live gallery. In response to this, the server device 4 excludes images captured at subsequent times (times) from the live gallery unless the resume button 304 is operated.

[0177] After issuing the stop command, the staff terminal 1 changes the display in step S364. This is the process of changing the management panel 300 to the state shown in FIG. 30C.

[0178] 30B or 30C, the user can perform an operation to instruct the end of the live gallery distribution. That is, the user can operate the end button 303. If the operation of the end button 303 is detected, the staff terminal 1 proceeds from step S354 to step S365 in FIG. When the end button 303 is operated, it is advisable to display a confirmation screen prompting the user to decide whether to end the process or to cancel the end operation before proceeding to step S365.

[0179] As described above, the end instruction notifies the server device 4 to end the transfer of new images to be distributed in the live gallery, and has the meaning of ending the capture of images for the live gallery. The live gallery itself does not have to become unavailable for viewing immediately, but for the camera staff, this is an operation to inform the server device 4 that the transfer of images to be distributed in the live gallery to the server device 4 should be ended. In response to this, the server device 4 recognizes that the transfer of images for the live gallery has ended and performs the necessary processing. For example, from this point on, the server device 4 starts counting the time that has elapsed until the live gallery is closed. The server device 4 closes the live gallery after a predetermined time has elapsed, such as two hours after the end instruction.

[0180] After issuing the end instruction in step S365, the staff terminal 1 closes the management panel 300 in step S360 and returns the screen to the original time view 120 or event view 200.

[0181] After the monitoring process up to step S222 as described above, the staff terminal 1 returns to step S211 in FIG. 17 and repeats the monitoring process.

[0182] Here, the progress of the live gallery realized by the processing according to the operation of the management panel 300 will be explained with reference to FIG. FIG. 31 shows the transition of images displayed on the live gallery viewing screen 400 viewed by the remote participants and the state of the management panel 300 of the staff terminal 1 in chronological order.

[0183] At time t0, the live gallery has not yet started, and no images are available for viewing on the live gallery viewing screen 400. Assume that the start button 301 is operated on the staff terminal 1 at time t1. Images captured by the imaging device 2 from that time on become candidates for uploading to the live gallery, and some of them are selected by the server device 4 and uploaded to the live gallery. Therefore, at time t2, some images become available for viewing by remote participants on the live gallery viewing screen 400.

[0184] Assume that the stop button 302 is operated at time t3 on the staff terminal 1. Images captured by the imaging device 2 from this point on are excluded from the live gallery. Therefore, even if the remote participants view the live gallery viewing screen 400 at time t4, the captured images from time t3 onwards are not added.

[0185] Assume that the resume button 304 is operated on the staff terminal 1 at time t5. Images captured by the imaging device 2 from that point onwards become candidates for uploading to the live gallery again, and some of them are selected by the server device 4 and uploaded to the live gallery. Therefore, at time t6, the remote participants can view the newly added images on the live gallery viewing screen 400.

[0186] Assume that the end button 303 is operated on the staff terminal 1 at time t7. At that point, the transfer of images for the live gallery from the staff terminal 1 to the server device 4 is terminated. In other words, the server device 4 is notified that the resume button 304 will not be operated. Therefore, the uploading of new images to the live gallery by the server device 4 is also terminated. Note that, as will be described later, there may be cases where images that were captured before the stop instruction and transferred later are uploaded. At time t8, the server device 4 notifies the live gallery of the end of the live gallery event, and closes the live gallery at a predetermined time.

[0187] In this way, images captured by the imaging device 2 between the time the camera staff operates the start button 301 and the time they operate the stop button 302 become candidates for distribution in the live gallery, and images selected by the server device 4 are uploaded to the live gallery.

[0188] An example of screen transitions executed by the process of FIG. 19 will be described. 32B shows the time view 120 before the live gallery begins, with the live icon 122 indicating a non-running period. From this state, for example, by operating the live icon 122, the management panel 300 is displayed as shown in Fig. 32A. The live icon 306 indicates that the period is not being executed.

[0189] Operating the close button 307 on the management panel 300 in FIG. 32A returns to the time view 120 in FIG. 32A. By operating the start button 301 on the management panel 300 in Fig. 32A, the management panel 300 changes to the state shown in Fig. 32C. The live icon 306 changes to a state indicating the execution period. By operating the close button 307 on the management panel 300 in Fig. 32C, you can return to the time view 120 in Fig. 32D. At this time, the live icon 122 indicates that it is in the execution period. From the time view 120 in FIG. 32D, the management panel 300 in FIG. 32C is opened by operating the live icon 122.

[0190] By operating the stop button 302 on the management panel 300 in Fig. 32C, the management panel 300 changes to the state shown in Fig. 32E. The live icon 306 changes to a state indicating a non-execution period. By operating the close button 307 on the management panel 300 in Fig. 32E, you can return to the time view 120 in Fig. 32F. At this time, the live icon 122 indicates that it is in a non-execution period. From the time view 120 in FIG. 32F, the management panel 300 in FIG. 32E is opened by operating the live icon 122.

[0191] By operating the resume button 304 on the management panel 300 in FIG. 32E, the management panel 300 changes to the state in FIG. 32C.

[0192] Clicking the end button 303 on the management panel 300 in Figure 32C or 32E will cause the management panel 300 to go to the state in Figure 32G. Here, an example is shown in which a confirmation screen for ending is displayed. If the camera staff member performs an operation to cancel the ending operation, the state returns to that in Figure 32C or 32E. If the end operation is OK, the process returns to the time view 120 in Fig. 32H. In this case, the time view 120 ends the display of the live icon 122 in response to the end of the live gallery. Although the above description has been given in terms of screen transitions from the time view 120, the event view 200 can be considered to be similar to the time view 120.

[0193] Incidentally, in addition to the above-described operations from the management panel 300, the live gallery can also be operated from the live gallery setting screen 310 shown in FIG. 14B. The camera staff can transition to the live gallery setting screen 310 from the setting / share button 305 on the management panel 300. In this case, the delete button 315 or the resume upload button 316 may be operated, as shown in FIG.

[0194] If it is detected that the live gallery setting screen 310 has been opened and the delete button 315 has been operated, the staff terminal 1 proceeds from step S223 to step S367, and issues a delete instruction to the server device 4. In this case, for example, an operation to delete all images or an operation to delete an individual image by specifying it is possible. Regarding an operation to delete an individual image by specifying it, the camera staff member can delete the image displayed in the single image display area 142 from the live gallery by performing an operation such as tapping the distribution mark 164 in FIG. 29 while the image is displayed in the single image display area 142. In response to the deletion operation by the camera staff member, the staff terminal 1 transmits an instruction to delete all images or an instruction to delete a specified image to the server device 4. In response to this, the server device 4 performs processing to delete the corresponding image from the live gallery.

[0195] This allows camera staff to delete images from the Live Gallery even after the Live Gallery has started, if an image that they do not agree with has been uploaded to the Live Gallery.

[0196] If it is detected that the live gallery setting screen 310 has been opened and the resume upload button 316 has been operated, the staff terminal 1 proceeds from step S224 to step S366 and instructs the server device 4 to resume upload. This is a process of notifying the server device 4 that the transfer of images to be uploaded to the live gallery, which has once terminated the transfer of images to be uploaded by operating the end button 303, will be resumed. In response to this, the server device 4 restarts the process for uploading new images to the live gallery.

[0197] This allows the camera staff to resume uploading newly captured images as candidates to the server device 4 for the live gallery that was temporarily terminated. In response to this, the server device 4 resumes the selection process of the received images and uploads them to the live gallery. For example, when the wedding ceremony or reception is over, the user operates the end button 303 with the intention of ending the image transfer for the live gallery, but may wish to resume the transfer at the after-party.

[0198] Next, the process when an image selection operation is detected in step S215 of FIG. 17 will be described. That is, this is the case when the user performs an operation to select one image from the list in the time view 120 or the event view 200. In this case, the process of the staff terminal 1 proceeds to step S250 in FIG. 20, and a single image display screen 140 as shown in FIG. 29 is displayed.

[0199] The single image display screen 140 is provided with a single image display area 142 in which a selected image is displayed in a large size. The image displayed in this single image display area 142 is, for example, an image based on edited image data managed by the event data 60. That is, the image is edited image data generated by the auto-retouching process in step S106 of FIG. 11, and is a reproduced image of the image data that reflects the retouching parameters in the preset information 61. Additionally, a focus point mark 149 indicating the in-focus position within the image may be displayed on the image.

[0200] The single image display screen 140 also displays a back icon 133, which is an operator for returning the display to the time view 120 or the event view 200, a filter condition icon 138 for displaying the filter conditions, a rating icon 130 for the displayed image, and a flag setting icon 131.

[0201] If the closed eyes information for that image indicates a closed eyes state, a closed eyes icon 210 is displayed. If the image has been uploaded to the Live Gallery, a distribution mark 164 is displayed. If a viewer of the live gallery performs an operation to give the image a high rating, a high rating mark 162 is displayed and the number of high ratings 163 is also displayed. The camera staff member can delete from the live gallery an image corresponding to the image displayed in the single image display area 142 of the staff terminal 1 by operating the distribution mark 164 using the staff terminal 1. Furthermore, if the image deleted from the live gallery by the camera staff member's operation on the distribution mark 164 is an image that has been given a high rating by a viewer of the live gallery, information indicating that it is a highly rated image, such as the high rating mark 162 and number of high ratings 163 in FIG. 29, will continue to be displayed on the staff terminal 1.

[0202] Additionally, the single image display screen 140 displays an edit icon 145 for operations relating to the displayed image, a focus point operation icon 146, an export icon 147, an archive icon 135, and an original icon 141.

[0203] With such a single-image display screen 140 displayed, the staff terminal 1 performs a monitoring loop process from step S251 to step S259 in FIGS.

[0204] In step S251, the staff terminal 1 monitors the operation of the edit icon 145. If an operation of the control of the edit icon 145 is detected, the staff terminal 1 proceeds to step S260 and displays an edit screen (not shown). The edit screen provides a user interface that allows, for example, retouching and tilt correction operations, and the camera staff can perform image editing operations using the user interface. In the retouching operation, for example, brightness adjustment values, color adjustment values, contrast adjustment values, sharpness adjustment values, etc. can be set as retouching parameters. As the tilt correction operation, for example, an operator for adjusting the angle of the image is provided. The editing screen may be a screen separate from the single image display screen 140, or may be a screen that is superimposed on the single image display screen 140 and displays various controls.

[0205] If the staff terminal 1 detects an editing operation such as a retouching operation or a tilt correction operation, the process proceeds from step S261 to step S262, and an editing process is performed. For example, in the case of retouching, the edited image data is further edited using retouching parameters input by the camera staff, and the input retouching parameters are stored in the event data 60 as editing information for each individual image data. In the case of tilt correction processing, the edited image data is edited using tilt correction parameters input by the camera staff. The input tilt correction parameters are stored in the event data 60 as editing information for each individual image data.

[0206] When the end of the editing operation is detected in step S265, the staff terminal 1 transmits the editing information of the event data 60 updated in accordance with the editing process to the server device 4 in step S266, so that the event data 90 is updated on the server device 4 side. In other words, the synchronized state is maintained. In step S267, the staff terminal 1 ends the editing screen and returns to the normal single image display screen 140. The image displayed at this time reflects the editing results. In this way, by operating the edit icon 145, the camera staff can perform image editing such as retouching or tilt correction of any image.

[0207] In the display state of the single image display screen 140, the staff terminal 1 monitors the operation of the focus point operation icon 146 in step S252. If an operation of the focus point operation icon 146 is detected, the staff terminal 1 proceeds to step S270, and branches the process depending on whether or not the focus point mark 149 is currently displayed on the image in the single image display area 142. If the focus point mark 149 is not currently being displayed, the staff terminal 1 proceeds to step S271 to acquire focus point information for the displayed image. The focus point is information that indicates the position in the image that the imaging device 2 focused on when capturing the image, and is described in the metadata. For example, the focus point is described as the coordinate information of a point in the image.

[0208] The staff terminal 1 acquires focus point information from the metadata of the displayed image and, in accordance with that information, displays a focus point mark 149 on the displayed image, as shown in Fig. 29. For example, the focus point mark 149 may be displayed as an area of ​​a predetermined extent centered on the coordinate information of a point in the image stored as the focus point. This allows the user to confirm the subject that was in focus when the image was captured.

[0209] 29, the focus point mark 149 is displayed as a mark indicating the four corners (a square in parentheses), but other display forms are also possible, such as a square frame or a circular frame.More than one focus point mark 149 may also be displayed. Also, as shown in Figure 29, the focus point mark 149 is displayed on a single image display screen, but the focus point mark 149 may also be displayed on an image displayed in a list in the image area 128 of the time view 120 or event view 200, for example.

[0210] If an operation on the focus point operation icon 146 is detected in step S252 while the focus point operation icon 146 is being displayed, the staff terminal 1 proceeds from step S270 to step S273, and ends the display of the focus point operation icon 146. Therefore, the cameraman can use the focus point operation icon 146 to turn on / off the display of the focus point mark 149 .

[0211] In step S253, the staff terminal 1 monitors the on / off operation of the filter condition display. That is, it monitors the operation on the filter condition icon 138. In that case, the staff terminal 1 proceeds to step S268 and controls the display of the current filter condition. By displaying the current filter conditions, the camera staff can recognize the conditions that the current image corresponds to when it is displayed.

[0212] The staff terminal 1 monitors the operation of the export icon 147 in step S254 of FIG. 21 while the single image display screen 140 is displayed. If an operation on the export icon 147 is detected, the staff terminal 1 proceeds to step S280 to perform export processing, that is, to perform export processing on information relating to the displayed image data.

[0213] In step S255, the staff terminal 1 monitors the image switching operation. In this case, the image switching operation is the operation of the original icon 141. When an operation of the original icon 141 is detected, the staff terminal 1 proceeds to step S281 and switches between an image based on the original image data and an image based on the edited image data. That is, if a playback image based on the edited image data was being displayed at that time, the playback image based on the original image data is displayed. Also, if a playback image based on the original image data was being displayed at that time, the playback image based on the edited image data is displayed. Therefore, by operating the original icon 141, the camera staff can compare the edited image with the original image at will.

[0214] On the single image display screen 140, a rating icon 130 for the image currently being displayed is displayed. In step S256, the staff terminal 1 monitors the rating operation. If an operation on the rating icon 130 is detected, the staff terminal 1 proceeds to step S282 and updates the event data 60 so that the rating information of the displayed image is set to a value according to the operation. In step S283, the staff terminal 1 transmits the updated rating information to the server device 4, so that the event data 90 is updated on the server device 4 side. That is, a synchronized state is maintained.

[0215] On the single image display screen 140, a flag setting icon 131 for the image currently being displayed is displayed. In step S257, the staff terminal 1 monitors the flag on / off operation, that is, the operation of the flag setting icon 131. If an operation on the flag setting icon 131 is detected, the staff terminal 1 proceeds to step S284 and updates the event data 60 so that the flag in the selection information of the displayed image is switched on / off. In step S285, the staff terminal 1 transmits the updated flag information to the server device 4, so that the event data 90 is updated on the server device 4 side. That is, the synchronized state is maintained.

[0216] In step S258, the staff terminal 1 monitors an archive operation for the image, for example, an operation on the archive icon 135. Alternatively, an archive operation may be an operation of swiping an image upward on the screen. When the staff terminal 1 detects an archive operation, the process proceeds to step S390, where the display is switched according to the display setting at that time. The display setting in this case is a setting for whether or not to display archived images. This can be selected using the filter conditions described below.

[0217] If the setting is to display archived images, the image will not be switched even in response to the archive operation. However, the display color of the archive icon 135 will change to indicate that the displayed image has been archived. If the setting is not to display archived images, the image will be switched to another image in response to the archive operation. For example, it will be switched to the next image in chronological order. Then, the staff terminal 1 proceeds to step S393 to update the archive information, i.e., the staff terminal 1 updates the archive information of the event data 60 so that the displayed image has been archived. In step S394, the staff terminal 1 transmits the updated archive information to the server device 4, so that the event data 90 is updated on the server device 4 side. That is, a synchronized state is maintained.

[0218] By making it possible to archive images as described above, camera staff can archive images that do not need to be displayed, and in combination with the filter processing described below, reduce the number of images to be displayed in a list or individually. This reduces the number of selection tasks and makes selection more efficient.

[0219] It is also possible to unarchive images that have been archived. For example, when an archive icon 135, which indicates that an image has been archived by changing its color, is operated, the image is unarchived. In terms of processing, the staff terminal 1 will, in regards to the archive operation detected in step S258, if it is an unarchive operation (i.e., an archive operation on an archived image), display an unarchive dialog in step S390, update the unarchive operation in step S393, and then perform processing in step S394 accordingly.

[0220] In step S259, the staff terminal 1 monitors whether the return icon 133 is operated. When the operation of the back icon 133 is detected, the staff terminal 1 proceeds to step S211 in FIG. 17, terminates the single image display screen 140, and returns to a state in which the time view 120 or the event view 200 is displayed.

[0221] Although not shown in the flowchart, for example, on the single image display screen 140, it is also possible to switch between the previous and next images by swiping left and right.

[0222] Next, a process when an operation on the next icon 132 is detected in step S212 of FIG. 17 will be described. In this case, the process of the staff terminal 1 proceeds to step S300 in FIG. 22, and the cover / highlight selection screen 150 shown in FIG. 33 is displayed.

[0223] The cover / highlight selection screen 150 is a screen for the camera staff to perform an operation to select an image to be used as a cover (cover page) or an image to be highlighted (highlighted) in the web gallery. The cover / highlight selection screen 150 displays a back icon 133 and a next icon 132.

[0224] The cover / highlight selection screen 150 also has a list specification area 153, a candidate tab 151, and a selection tab 152. When the candidate tab 151 is selected, a list of flagged images, that is, images selected to be used in the web gallery, is displayed in a list specification area 153 . Also displayed for each image are a highlight button 155 and a cover button 156. The highlight button 155 is an operator for designating an image as a highlight, and the cover button 156 is an operator for designating an image as a cover. The highlight button 155 may also indicate whether or not a highlight setting is currently set, depending on its display mode, and the cover button 156 may indicate the current cover setting status, depending on its display mode. When the selection tab 152 is selected, a list of images designated as covers or highlights is displayed in a list designation area 153 .

[0225] The camera staff operates the cover / highlight selection screen 150 to select an image to be used as a cover or an image to be highlighted.

[0226] With the cover / highlight selection screen 150 displayed in step S300 of FIG. 22, the staff terminal 1 performs the monitoring loop process from step S301 to step S305.

[0227] In step S301, the staff terminal 1 monitors the operation of the cover button 156. If an operation on the cover button 156 is detected, the staff terminal 1 proceeds to step S310, sets the cover image information in the selection information so that the corresponding image is set as the cover image, and updates the event data 60. In step S311, the staff terminal 1 transmits the updated selection information to the server device 4, so that the event data 90 is updated on the server device 4 side. That is, a synchronized state is maintained.

[0228] In step S302, the staff terminal 1 monitors the operation of the highlight button 155. If an operation on the highlight button 155 is detected, the staff terminal 1 proceeds to step S320, sets the highlighted display image information in the selection information so that the corresponding image is set as the highlighted image, and updates the event data 60. In step S321, the staff terminal 1 transmits the updated selection information to the server device 4, so that the event data 90 is updated on the server device 4 side. That is, a synchronized state is maintained.

[0229] In step S303, the staff terminal 1 monitors a tab switching operation. The tab switching operation in this case is an operation of the selected tab 152 while the list of candidate tabs 151 is displayed, or an operation of the candidate tab 151 while the list of selected tabs 152 is displayed. When the tab switching operation is detected, the staff terminal 1 performs processing to switch the list display contents in the list designation area 153 in accordance with the selected tab in step S330.

[0230] In step S305, the staff terminal 1 monitors the operation of the back icon 133. If the operation of the back icon 133 is detected, the staff terminal 1 proceeds to step S211 in FIG. This allows camera crews to abort cover / highlight selections or restart selections by setting flags.

[0231] When the operation on the cover / highlight selection screen 150 is completed, the camera staff operates the next icon 132 in FIG. 22, the staff terminal 1 monitors the operation of the next icon 132. If the operation of the next icon 132 is detected, the staff terminal 1 proceeds to step S340 and displays a confirmation screen.

[0232] 34 shows an example of a confirmation screen 160. The confirmation screen 160 has a back icon 133, a next icon 132, and a details area 161 in which the final confirmation content is displayed. For example, detailed information such as the number of images flagged for inclusion in the web gallery, the number of images to be highlighted, the title, and the date are displayed.

[0233] The staff terminal 1 monitors the operation of the next icon 132 in FIG. 34 in step S341 of FIG. 22, and monitors the operation of the back icon 133 in step S342. If the operation of the return icon 133 is detected, the staff terminal 1 returns to step S300 and returns to the display state of the cover / highlight selection screen 150.

[0234] If an operation on the next icon 132 is detected, the staff terminal 1 proceeds to step S343 and transmits a web gallery generation request to the server device 4. 16, and returns to the display state of the project list screen 110. In this case, it is also possible to proceed to step S211 in FIG.

[0235] <6. Server project processing> Up to this point, the processing of the staff terminal 1 up to the selection stage in step S3 of FIG. 2 has been explained, but the processing on the server device 4 side will now be explained. 35 and 36 show the processing of the server device 4 in response to communication from the staff terminal 1. Note that the processing of the server device 4 referred to below refers to processing performed by the CPU 71 of the information processing device 70 having the functions of FIG. 7. In FIG. 35, the processing is mainly performed by the functions of the server data management unit 40, image album generation unit 41, and live distribution processing unit 44.

[0236] At step S1 in FIG. 2, pre-setting information is transmitted from the staff terminal 1 to the server device 4. When the server device 4 receives the information regarding the project setting from the staff terminal 1, the process proceeds from step S500 to step S510 in FIG.

[0237] The project setting communication from the staff terminal 1 is communication that the staff terminal 1 makes to the server device 4 in the processing from step S10 to step S13 in Fig. 12. For example, information such as the event name, time, and location of the created project is transmitted. Based on this information, the server device 4 sets up a new project and sets the event data 90. Furthermore, on the staff terminal 1 side, not only the project itself is set, but also auto-retouch settings, watermark settings, etc. are made, and the setting information is successively transmitted to the server device 4. The server device 4 records this information as pre-setting information 91 of the event data 90, thereby synchronizing the event data 90 with the pre-set event data 60.

[0238] At step S2 in FIG. 2, the staff terminal 1 performs the processing of step S106 in FIG. 15, and transmits the images transferred from the imaging device 2, metadata including rating information, analysis information, etc. to the server device 4. When the server device 4 receives images, metadata, etc. from the staff terminal 1, it proceeds from step S501 to step S520 in Fig. 35 and imports the images, metadata, analysis information, etc. as information in the event data 90 of the corresponding project. Rating information in the metadata is extracted from the metadata and managed in the event data 90 in a state where it can be updated later.

[0239] 2, during the process of the staff terminal 1 in FIGS. 16 to 22, various information related to the image data for maintaining synchronization with the imaging device 2 is transmitted from the staff terminal 1 to the server device 4. For example, rating information, selection information, editing information, and archive information are transmitted.

[0240] When the server device 4 receives information about these images from the staff terminal 1, it proceeds from step S502 to step S530 in FIG. 35 and updates the information about the corresponding images in the event data 90 of the corresponding project. This allows the server device 4 to sequentially update rating changes, image information used by flag settings, cover image information as a cover, highlighted image information by highlight settings, image editing information, and archive status.

[0241] When the server device 4 receives the web gallery editing information from the staff terminal 1, the process proceeds from step S506 to step S560. This is the information sent by the staff terminal 1 in step S343 of FIG. 35, the server device 4 first performs image editing processing using parameters as editing information (including editing information based on the preset information 61) for each image flagged as use image information, and writes out the images as images for the web gallery. That is, it generates each edited image to be stored in the image folder 97 in FIG. 9.

[0242] In step S561 of Fig. 35, the server device 4 performs a web gallery generation process. That is, the server device 4 generates the web page setting information 96 of Fig. 9 as HTML data, for example, and enters it as a web page. This creates a web gallery. 35, the server device 4 transmits the URL (uniform resource locator) of the web gallery to the staff terminal 1. This enables the staff terminal 1 to view the web gallery. At this point, the web gallery is still set to private and can only be viewed on staff terminal 1, the URL destination.

[0243] Up to this point, the processing of the server device 4 corresponds to the processing of the staff terminal 1 up to step S3 in FIG. Although not shown in FIG. 35, a process of providing the event data 90 to the staff terminal 1 that has logged in to the server device 4 is performed as needed (see the description of step S201 in FIG. 16).

[0244] After the web gallery is generated, a share request is sent from the staff terminal 1 to the server device 4 in step S4 of FIG. 2 (described later with reference to FIG. 37). In this case, the staff terminal 1 proceeds from step S507 to step S570 in Fig. 35 and sets the corresponding web gallery to public, so that it can be viewed from the client terminal 5, for example.

[0245] Here, at steps S1, S2, and S3 in Figure 2, the staff terminal 1 processes Figure 19, and sends start instructions, stop instructions, end instructions, resume instructions, delete instructions, etc. related to the live gallery to the server device 4. When the server device 4 receives the instruction information relating to the live gallery, it performs the process relating to the live gallery as shown in FIG. That is, for a project in which a live gallery is set to be executed, the server device 4 performs the process of FIG. 36 in parallel with the process of FIG.

[0246] In step S600 of Fig. 36, the server device 4 monitors a start instruction for the live gallery. That is, the start instruction is issued at the staff terminal 1 in step S361 of Fig. 19 when the camera staff operates the start button 301 or the resume button 304.

[0247] While waiting for a start instruction, the processes of steps S600, S610, S612, and S613 are repeated. This waiting state occurs before the live gallery starts, or after an instruction to stop a live gallery that has already started is given.

[0248] If a start instruction is received, the server device 4 proceeds to step S601, and performs a process to determine whether each piece of image data transferred from the staff terminal 1 is a candidate for the live gallery, that is, a candidate determination. Examples of this candidate determination depending on various situations will be described later, but basically, image data captured by the imaging device 2 after the time of the start instruction and before the time of the stop instruction is selected as a candidate image to be distributed to the live gallery.

[0249] In step S602, a selection process for images to be distributed is performed. This is a process for selecting images to actually be uploaded from among the images that have been selected as candidates for uploading to the live gallery. That is, as described in FIG. 3, instead of uploading all captured images within the period from the start instruction to the stop instruction to the live gallery, only selected images are uploaded.

[0250] In step S603, the server device 4 performs image distribution processing. That is, the server device 4 uploads the image data selected in step S602 to the live gallery, allowing remote participants and the like to view the distributed images.

[0251] In step S604, information synchronization is performed. In this case, the server device 4 sequentially updates the distribution information and evaluation information about the live gallery on the event data 90, and also transmits the information to the staff terminal 1 to update the event data 60, thereby maintaining a synchronized state. Regarding distribution information, the server device 4 adds information about distribution execution to image data uploaded to the live gallery, updates the event data 90, and notifies the staff terminal 1 to update the event data 60. This allows the staff terminal 1 to recognize whether each image has been uploaded to the live gallery. Regarding rating information, the server device 4 successively detects the high rating information of viewers and periodically updates the event data 90. Then, for example, at step S604, the server device 4 notifies the staff terminal 1 of the number of high ratings. The staff terminal 1 updates the event data 60 accordingly, thereby being able to recognize the ratings of viewers of the live gallery.

[0252] In step S605, the server device 4 monitors the deletion instruction, which is, for example, the deletion instruction explained as steps S223 and S367 in FIG. If a deletion instruction has been issued, the server device 4 performs a deletion process in step S606 of Fig. 36. That is, the server device 4 performs a process of deleting the image specified in the deletion instruction from the live gallery.

[0253] In step S607, the server device 4 monitors the stop instruction, which is the stop instruction explained in steps S353 and S363 of FIG. The server device 4 repeats steps S601 to S606 until it receives a stop command. As a result, images selected from the transferred images are sequentially uploaded to the live gallery. Therefore, remote participants can enjoy the live gallery in real time, with images being sequentially added and updated.

[0254] If a stop instruction is given, the server device 4 returns to a state in which it repeats the processes of steps S600, S610, S612, and S613. In step S610, the deletion instruction is monitored. This is because the camera staff can issue the deletion instruction in step S223 of Fig. 19 on the staff terminal 1 side even if the live gallery is not running. For example, the deletion instruction at the stage of step S14 of Fig. 12 or the deletion instruction while stopped is possible in step S223 of Fig. 19. If a deletion instruction is received, the server device 4 performs processing to delete the image in question from the live gallery in step S611 of FIG.

[0255] In step S612, the server device 4 synchronizes information. Even after the stop instruction, the live gallery itself remains open to the public, so the rating information from viewers continues to be updated. Therefore, even during the stop period, the server device 4 updates the rating information in the event data 90 one by one, and transmits information to the staff terminal 1 to update the event data 60, thereby maintaining a synchronized state.

[0256] In step S613, the server device 4 monitors the end instruction, which is the end instruction explained in steps S354 and S365 of FIG.

[0257] While the processes of the above steps S600, S610, S612, and S613 are being repeated, if a start instruction is given by operating the start button 301 or the resume button 304, the server device 4 again performs the processes of steps S601 to S607.

[0258] If an end instruction is detected in step S613, the server device 4 performs end processing in step S620. This is a process to terminate new uploads to the Live Gallery. However, at this point, the Live Gallery is not closed so that it cannot be viewed, but rather the Live Gallery remains viewable for a certain period of time. For example, the live gallery is automatically closed when a predetermined time has elapsed since the end instruction was given, and therefore in step S620, the time count until closure is started. The predetermined time is set to 2 hours, etc. Of course, this is just an example, and it may be set to 5 hours or 24 hours.

[0259] In step S621, the server device 4 monitors an instruction to resume live gallery transfer. As described in steps S224 and S366 of Fig. 19, the camera staff can perform an operation to resume transfer of images that are candidates for upload to the server device 4 for a live gallery in which transfer of images to be uploaded has been temporarily terminated by operating the end button 303. When such a notification of transfer resumption is received, the server device 4 returns from step S621 to step S600, and returns to a state in which new images can be uploaded to the live gallery.

[0260] In step S622, the server device 4 synchronizes information. Even after the end instruction is issued, the live gallery itself remains open to the public, so the rating information from viewers continues to be updated. Therefore, even after the end instruction is issued, the server device 4 continues to update the rating information in the event data 90, and also transmits information to the staff terminal 1 to update the event data 60, thereby maintaining a synchronized state.

[0261] In step S623, the server device 4 determines whether it is time to close the live gallery, that is, whether a predetermined time, such as two hours, has elapsed since the end instruction was issued. Furthermore, even before the predetermined time has elapsed, if an instruction to close the live gallery is given from the staff terminal 1 by the camera staff member, it is considered to be the time to close the gallery. The server device 4 repeats the processes of steps S621 and S622 until the closing timing arrives.

[0262] When the timing for closing has arrived, the server device 4 proceeds to step S624 and closes the live gallery for the project, that is, the live gallery becomes unavailable for viewing by remote participants and the like. In addition, when it is time to close after a predetermined time has passed, such as two hours, the staff terminal 1 should be notified as to whether it is okay to close the live gallery, and the live gallery should be closed depending on the camera staff's approval.

[0263] In addition, the server device 4 may automatically determine that the event has ended and that the live gallery should be closed when a set time has passed since no new images were transferred from the staff terminal 1, even if there was no stop or end instruction, and perform a closing process. Here, when the process of closing the live gallery is performed, all images in the live gallery are deleted or hidden, and information indicating that distribution of the live gallery has ended or information indicating that there are no images in the live gallery is displayed on the live gallery viewing screen 400. Note that even when the process of closing the live gallery is performed, the URL of the live gallery is not deleted, so the camera staff can re-distribute the closed live gallery by operating the staff terminal 1. After the live gallery is resumed, the images that were displayed before the live gallery was closed will no longer be displayed, and images captured by the imaging device 2 after the live gallery distribution will be the subject of distribution. Furthermore, even when a process for closing a live gallery is performed, the images displayed in the live gallery and information such as high ratings for the images can remain stored on the server device 4, and the images displayed in the live gallery before the closure do not need to be deleted from the server device 4. In this case, the camera staff member can issue an instruction to start streaming the live gallery from the staff terminal 1, thereby making it possible to stream the closed live gallery again and display the images that were displayed before the closure again. Additionally, if the camera staff deletes the URL of the Live Gallery webpage, it will be impossible to rebroadcast or access the Live Gallery.

[0264] <7. Web Gallery Delivery Processing> The process of the staff terminal 1 at the stage of the web gallery delivery process in step S4 of FIG. 2 will be described with reference to FIG. When a web gallery generation request is sent to the server device 4 as described above, the server device 4 generates a web gallery based on the event data 90, and the URL of the web page is sent. Figure 37 shows the processing of the staff terminal 1 after the URL is acquired.

[0265] The staff terminal 1 accesses the web page using the URL acquired in step S370, thereby allowing the staff terminal 1 to preview the web gallery. This is a preview for the camera staff to check, and the web gallery for this preview will look like a preview screen 180 in FIG. 38, for example. For example, the created web gallery is displayed in a preview area 183, and an edit button 181 and a share button 182 are provided.

[0266] The web gallery content displayed in the preview area 183, i.e., the web gallery created by the server device 4, is configured by arranging images with flags set to "on," for example, in chronological order. An image with cover image information set is displayed at the top as the cover. Images that are highlighted using highlight image information are displayed in a larger size than images that are not highlighted. Note that even images that are not highlighted may be automatically displayed in a larger size. This is done to add balance and emphasis to the gallery as a whole.

[0267] The staff terminal 1 monitors the browsing end operation in step S371 of FIG. 37, monitors the operation of the edit button 181 in step S372, and monitors the operation of the share button 182 in step S373. When an operation to end browsing is detected, web page viewing is terminated. When the operation of the edit button 181 is detected, the staff terminal 1 proceeds to step S380 and performs editing processing.

[0268] The camera staff can check the web gallery contents in the preview area 183 and, if necessary, operate the edit button 181 to perform further editing. In the editing process of step S380, the staff terminal 1 displays an interface image for editing, accepts operations by the camera staff, and edits the preview image accordingly. For example, the background color, title font, title color, title position, slideshow music, etc. can be edited. Then, in response to the edit completion operation, the edit information is transmitted to the server device 4 so that the edit operation is reflected in the web gallery.

[0269] The camera staff member performs editing operations as necessary and then operates the share button 182. In this case, the staff terminal 1 proceeds to step S381 and transmits a share request to the server device 4. As described above, in response to the share request, the server device 4 sets the web gallery to be public in step S570 of FIG.

[0270] In step S382 of FIG. 37, the staff terminal 1 displays a screen indicating the completion of delivery of the web gallery and performs processing corresponding to the operation on the screen. For example, the staff terminal 1 displays a web gallery delivery screen 190 shown in Fig. 39. This web gallery delivery screen 190 displays a notification that the web gallery has been created, a validity period, and a web gallery URL 193. Also displayed are a copy button 191 and a share button 192. The camera staff can operate the copy button 191 to copy the URL, attach it to an email or the like, and send it to the client terminal 5. They can also operate the share button 192 to provide the URL to an SNS or the like, allowing clients to view the web gallery via the SNS. This allows clients to view the web gallery as early as possible, such as after the wedding ceremony is over, or on the day itself. Note that distributing a URL to a client to allow the client to view the image collection as a web gallery is one example. For example, image collection content equivalent to the above-mentioned web gallery may be created and distributed to the client as a content file.

[0271] <8. Final delivery processing> The actual delivery process is carried out at step S5 in FIG. 40 shows the process at the final delivery stage. This process is carried out, for example, by the personal computer 3 or the staff terminal 1. The following description will be given assuming that the process is carried out by the personal computer 3.

[0272] The camera staff operates the personal computer 3, accesses the server device 4 in step S400, and issues a request to read information for the actual delivery. Then, in step S401, the event data 90 is acquired from the server device 4. For example, in this case, the server device 4 may allow rating information, selection information, evaluation information, distribution information, editing information, etc. to be downloaded as XMP files so that they can be applied to RAW image files in the personal computer 3. That is, rating information, used image information indicating flag setting, cover image information indicating that the image has been used as a cover image, and highlighted image information indicating that a highlight has been set are transferred to the personal computer 3. In addition, information on whether or not the image has been distributed to the live gallery, high ratings given by viewers of the live gallery, and the number of high ratings are also transferred to the personal computer 3. All of the event data 90 may be provided to the personal computer 3 .

[0273] The camera crew imports RAW image data captured by the imaging device 2 into the personal computer 3, and uses this RAW image data to create the image collection for delivery. In this case, the creation process can be made more efficient by obtaining an XMP file based on the event data 90 from the server device 4. It is also possible to include images that are particularly highly rated by viewers of the live gallery in the image collection for delivery.

[0274] In step S402, the personal computer 3 performs the necessary editing processes to complete the image collection for delivery. Thereafter, in step S403, processing for actual delivery is performed, such as generating content data as image album content, transmitting it electronically, recording it on a recording medium, or making it into print data. The created content data, a recording medium on which the content data is recorded, or a printed collection of images on paper is then delivered to the client.

[0275] <9. Live Gallery Streaming Images> Image data that is a candidate for the above-mentioned live gallery distribution will be described. Whether or not an image captured by the imaging device 2 is a candidate for distribution in the live gallery can be controlled by the camera staff member by operating the start button 301 and stop button 302. The word "candidate" is used because the image that is actually uploaded to the live gallery is selected by the server device 4. In other words, the term "candidate" means whether or not the image can be included in the selection for uploading to the live gallery.

[0276] At this time, the start button 301 and stop button 302 are operated on the staff terminal 1, and the image is captured on the imaging device 2. Furthermore, the transfer between the imaging device 2 and the staff terminal 1 is not always performed in real time, and delays and temporary communication failures may occur. Taking such circumstances into consideration, it is desirable for camera staff, especially photographers, to be able to control which images are included in the live gallery and which are not, as desired.

[0277] First, assuming that the image data captured by the imaging device 2 is transferred to the staff terminal 1 with almost no delay, it is conceivable to determine whether or not to make it a candidate for the live gallery based on the time of reception at the staff terminal 1. In this case, for example, in step S105 of Fig. 15, the staff terminal 1 adds information about the time of reception of the image transferred from the imaging device 2 to the metadata before transferring it to the server device 4. This allows the server device 4 to determine whether the transferred image was received by the staff terminal 1 between the start instruction and the end instruction.

[0278] However, in this case, there may be a difference between the image capture time and the reception time due to delays in transfer from the image capture device 2 to the staff terminal 1 and other factors. For example, even if the imaging device 2 is in a mode where captured images are transmitted to the staff terminal 1 in real time, delays may occur due to communication conditions or device processing conditions. Furthermore, a mode is also possible in which the imaging device 2 transfers all captured images at once to the staff terminal 1. In this case, it is generally assumed that the reception time of the staff terminal 1 and the capture time of each image data will differ. Furthermore, when an image that has been taken and recorded as a so-called camera roll is imported into the staff terminal 1, the time of taking the image and the time of receiving the image are different.

[0279] Considering these factors, it is desirable to make the determination based on the image capture time. Therefore, whether or not each image data is a candidate for the live gallery is determined based on the information on the image capture time (year, month, hour, minute, second). In this disclosure, "time" is used to mean "year, month, day, hour, minute, second" and includes "year, month, day", but as a minimum example, only "hour, minute, second" may be used. However, since there may be events that continue over two or more days after the date changes, it is desirable to also include "year, month, day".

[0280] Information about the image capture time is recorded in the metadata of each image data in the image capture device 2. Therefore, the staff terminal 1 and the server device 4 can determine the image capture time for each image data by referring to the metadata.

[0281] FIG. 41 shows the difference between the time when the image data captured by the imaging device 2 is captured and the time when the image data is received by the staff terminal 1. The captured image data is shown as images pct1, pct2, pct3, etc. in the following figures. In the case of this figure, for example, images pct1, pct2, pct3, . . . taken by the imaging device 2 are received by the staff terminal 1 with a uniform delay.

[0282] As shown in the figure, it is assumed that a start instruction and an end instruction are given by operating the staff terminal 1 at a certain point in time. If images received between the start instruction and the end instruction are considered as candidates for the live gallery, images pct1 to pct6 become candidates, and the image selected by the server device 4 is uploaded to the live gallery. On the other hand, if images captured between the start and end instruction times are considered as candidates for the live gallery, images pct4 to pct9 become candidates, and the image selected by the server device 4 is uploaded to the live gallery.

[0283] Either of these methods can be adopted. However, it is easier for photographers in particular to select photos taken after pressing the start button 301 on the staff terminal 1 as candidates. This is because by pressing the start button 301 on the staff terminal 1, the photographer can be aware that the photos they are about to take will be included in the live gallery distribution. Also, by pressing the stop button 302, the photographer can be aware that the photos they are about to take will not be distributed to the live gallery. Therefore, it is preferable to select a candidate for the live gallery based on the image capture time.

[0284] 42 to 54 show various examples of the process from capturing images to uploading them to the live gallery. Each figure shows the chronological flow of the images from the imaging device 2, the staff terminal 1, and the transfer of the server device 4, and the images included on the live gallery viewing screen 400 that can be viewed on the remote participant terminal 7. In these cases, live gallery candidates are determined based on the image capture time. Also, dashed lines indicate start, stop, and end instructions from the staff terminal 1 to the server device 4 in response to operations by the camera staff. Also, for example, it is assumed that the camera staff consists of one photographer, and the explanation will be given assuming that the photographer operates the imaging device 2 and the staff terminal 1. This is one example, and the following explanation also applies to cases where multiple camera staff operate the imaging device 2 and the staff terminal 1 separately.

[0285] Figure 42 shows the basic flow of live gallery distribution. Images pct1 to pct12 are selected as candidates for distribution as images captured by the imaging device 2 from the time when the staff terminal 1 issues a start instruction to the server device 4 until the time when the server device 4 issues a stop instruction, and images pct1, pct6, pct8, and pct12 selected from among them are uploaded to the live gallery one after another. An end instruction after a stop instruction will terminate the transfer and upload of candidate images to the live gallery.

[0286] FIG. 43 shows a case where there is a delay in transfer from the imaging device 2 to the staff terminal 1. For example, suppose that a photographer takes images pct1 to pct12 after issuing a start command, and then issues a stop command or an end command. However, the transfer of images pct11 and pct12 is delayed, and they are received by staff terminal 1 after the stop command or end command. The server device 4 receives the image pct11 after the stop instruction, and receives the image pct12 after the end instruction. Even in this case, the server device 4 determines whether the image is within the period from the start instruction to the end instruction based on the image capture time, so images pct11 and pct12 are determined to be candidates for the live gallery, and are selected as upload targets in processing within the server device 4, and are uploaded to the live gallery as shown.

[0287] Figure 44 shows the case of importing from the camera roll. For example, suppose that a photographer issues a start instruction on staff terminal 1, then captures images pct1 to pct5 with imaging device 2, and then issues a stop instruction or an end instruction. Then, suppose that all captured image data from images pct1 to pct5 is transferred to staff terminal 1 by the photographer's operation after the end instruction. The server device 4 receives images pct1 to pct5 after the end instruction. The server device 4 determines images pct1 to pct5 as candidates for the live gallery if the image capturing times are within the period from the start instruction to the end instruction, and uploads the selected images to the live gallery.

[0288] FIG. 45 shows a case where the transfer from the staff terminal 1 to the server device 4 is delayed. For example, suppose that the photographer performs a start instruction operation on the staff terminal 1, then captures images pct1 to pct5 with the imaging device 2, and then performs a stop instruction operation or an end instruction operation. Images pct1 to pct5 were received by staff terminal 1 before the stop instruction. Among them, images pct1 to pct3 were transferred to the server device 4 before the stop instruction, but images pct4 and pct5 were received by the server device 4 after the stop instruction and the end instruction. The server device 4 determines images pct1 to pct5 as candidates for the live gallery if the image capturing times are within the period from the start instruction to the end instruction, and uploads the selected images to the live gallery.

[0289] FIG. 46 shows a case where the staff terminal 1 is not connected to the server device 4 for communication. For example, suppose that the photographer performs a start instruction operation on the staff terminal 1 and then captures images pct1 to pct5 with the imaging device 2. However, when the start instruction is issued, the staff terminal 1 is not connected to the server device 4, and therefore the start instruction is not notified to the server device 4. In this case, images pct1 to pct5 will be transferred to the server device 4 when the staff terminal 1 is subsequently connected to the server device 4 for communication. However, since the server device 4 has not received a start instruction, these images will not become candidates for the live gallery. If the staff terminal 1 receives a start instruction from the photographer even though the staff terminal 1 is not connected to the server device 4, images captured while the communication connection was not established may be excluded from the live gallery candidates, contrary to the photographer's intention, or synchronization with another imaging device may not function properly. To prevent this, in this embodiment, if the staff terminal 1 is not connected to the server device 4, the staff terminal 1 cannot issue an instruction to start or stop streaming to the live gallery. For example, the staff terminal 1 may display information indicating that it is not connected to the network or that network communication is not available.

[0290] FIG. 47 shows the case where an instruction to delete all images is given. For example, suppose that a photographer prepares a live gallery (see step S14 in Figure 12) by issuing a start command on staff terminal 1, then captures images pct1 to pct5 with imaging device 2, and then issues a command to delete all images and a command to stop. In this case, test shot images pct1 to pct5 become candidates, and some of the images pct1 are uploaded to the live gallery. This allows the camera staff to check the live gallery operation. In addition, in response to a deletion instruction, the server device 4 performs a deletion process, so that the test shot image pct1 can be deleted from the live gallery.

[0291] Then, at the actual event, the photographer takes image pct6, then issues a start command, takes images pct7 through pct10, and then issues a stop command. In this case, the server device 4 determines images pct7 to pct10, whose capture times fall within the period from the start instruction to the end instruction, as candidates for the live gallery, and uploads the selected images to the live gallery. If the images were captured before the stop instruction, they may be uploaded after the stop instruction, as with image pct10.

[0292] FIG. 48 shows a case where an instruction to delete all images is given and the transfer from the staff terminal 1 to the server device 4 is delayed. For example, suppose that, as in Fig. 47, a photographer prepares for a live gallery by issuing a start instruction on staff terminal 1, capturing images pct1 to pct5 with imaging device 2, and then issuing an instruction to delete all images and an instruction to stop. Images pct4 and pct5 arrive at server device 4 after issuing the delete instruction and the stop instruction. In this case, images pct1 through pct3 are candidates for the test shot, and some of the images pct1 are uploaded to the Live Gallery. Images pct4 and pct5 are also candidates, but because they were taken before the instruction to delete all images was issued, they are treated as deleted images and are not selected as candidates.

[0293] In the example of Figure 48, it is assumed that during the actual event, the photographer takes image pct6, then issues a start instruction, takes images pct7 to pct10, and then issues a stop instruction. In this case, it is assumed that image pct6 is received by the server device 4 after the start instruction is given, and images pct9 and pct10 are received by the server device 4 after the stop instruction is given. The server device 4 determines images pct7 to pct10, whose image capturing times fall within the period from the start instruction to the end instruction, as candidates for the live gallery, and uploads the selected images to the live gallery.

[0294] 49 shows a case where a captured image captured at a time earlier than the time when the stop instruction was performed is transferred from the imaging device 2 to the staff terminal 1. For example, this may be the case where there is a delay in transfer or when some of the images are transferred from the camera roll at a later time. For example, suppose that the photographer performs a start instruction operation on the staff terminal 1, then captures images pct1 to pct12 with the imaging device 2, and then performs a stop instruction operation. Images pct1, pct2, pct3, and images pct8 to pct12 were transferred to the staff terminal 1 almost in real time, but images pct4 to pct7 were transferred to the staff terminal 1 after a stop instruction was given. These images pct4 to pct7 were received by the server device 4 after the stop instruction was given. Even in this case, the server device 4 determines all of the images pct1 to pct12 whose image capturing times fall within the period from the start instruction to the end instruction as candidates for the live gallery, and uploads the selected images to the live gallery. Note that, here, it has been described that all images captured within the period from the start instruction to the end instruction (i.e., images pct1 to pct12 in FIG. 49) are uploaded to the live gallery. However, the present technology is not limited to this. When the staff terminal 1 receives an image captured a predetermined time before the captured image of the captured image already transferred from the staff terminal 1 to the server device 4, the server device 4 may not select the past captured image as a candidate for the live gallery and may not upload the image to the live gallery. Taking FIG. 49 as an example, after receiving images pct1, pct2, pct3, and images pct8 to pct12, the server device 4 receives the past captured images (i.e., images pct4 to pct7). However, since it determines that images pct4 to pct7 are not candidates for the live gallery, image pct6 is not distributed to the live gallery.

[0295] 50 to 54 show examples of image analysis processing periods for selecting images to upload from candidate images in the server device 4. The selection processing periods (SL1, SL2, etc.) in each figure are periods during which the server device 4 is performing image analysis processing to select images to upload. The server device 4 basically needs to perform the selection process between the start instruction and the stop instruction, but as in the above example, from the perspective of the server device 4, image data to be used as candidates may be received after the stop instruction or the end instruction. Also, since the stop instruction or the end instruction is based on the operation of the camera staff, the camera staff may leave it without performing the stop instruction or the end instruction. There may also be communication failures or delays. Therefore, the selection process in the server device 4 continues to some extent even if a stop instruction or an end instruction is received, while also being able to handle situations where a stop instruction or an end instruction is not received.

[0296] FIG. 50 shows a case where the photographer performs a start instruction operation on the staff terminal 1, then captures images pct1 to pct5 with the imaging device 2, and then leaves it for a long time without performing any stop instruction operation or the like. The server device 4 performs selection processing after the start instruction (selection processing period SL1) using images pct1 to pct5, which are images captured at times after the start instruction, as candidates. As a result, it is assumed that images pct1 and pct5 are uploaded. However, suppose that after receiving image pct5, for example, two hours have passed since no image was transferred from the staff terminal 1. In this case, the server device 4 ends the selection process and notifies the staff terminal 1 of a stop instruction. For example, if two hours pass without any new images being transferred, the server device 4 may consider this to be a stop instruction received in step S607 of Figure 36, and may process the same and notify the staff terminal 1. On the other hand, the staff terminal 1 may perform the process in step S364 of FIG. 19 in the same manner as when the notification stop button 302 is operated. Furthermore, if there is no image transfer from the staff terminal 1 for, for example, 12 hours after receiving the image pct5, the server device 4 performs processing to close the live gallery.

[0297] Thereafter, it is assumed that the photographer performs a start instruction operation on the staff terminal 1, then captures images pct6 and pct7 with the imaging device 2, and then performs a stop instruction operation. The server device 4 reopens the closed live gallery and performs selection processing after the start instruction using images pct6 and pct7, which are images captured after the start instruction, as candidates (selection processing period SL2). As a result, for example, image pct7 is uploaded. Let's assume that after receiving the stop command, the photographer does not take any images with the imaging device 2 or issue an end command on the staff terminal 1. Then, the server device 4 ends the selection process for the selection process period SL2 if, for example, no images are transferred from the staff terminal 1 for two hours after receiving image pct7. After a further 12 hours have passed, the server device 4 performs a process to close the live gallery.

[0298] FIG. 51 shows a case where candidate image data is received after the selection process is stopped. Suppose that the photographer issues a start command on staff terminal 1, then captures images pct1 to pct5 with imaging device 2, and then leaves the device for a long time without issuing a stop command, etc. Also suppose that the transfer of image pct5 is delayed. The server device 4 performs selection processing after the start instruction using images pct1 to pct4, which are images captured at image capture times after the start instruction, as candidates (selection processing period SL1). If there is no image transfer from the staff terminal 1 for, for example, two hours after receiving the image pct4, the server device 4 ends the selection process and notifies the staff terminal 1 of a stop instruction. Furthermore, if there is no image transfer from the staff terminal 1 for, for example, 12 hours after receiving the image pct4, the server device 4 performs processing to close the live gallery.

[0299] However, suppose that the server device 4 subsequently receives an image pct5 that should be a candidate. In this case, the selection process may be restarted as shown in a selection process period SL2. However, it is also possible that the selection process may not be restarted because the live gallery has already been closed.

[0300] Thereafter, it is assumed that the photographer performs a start instruction operation on the staff terminal 1, then captures images pct6 and pct7 with the imaging device 2, and then performs a stop instruction operation. The server device 4 performs selection processing after the start instruction (selection processing period SL3) using images pct6 and pct7, which are images captured at times after the start instruction, as candidates. At this time, the previous image pct5 may also be included in the selection processing. The rest is the same as in Figure 50.

[0301] Figure 52 shows the case where a network interruption occurs. Let us assume that the photographer issues a start command on staff terminal 1, then captures images pct1 to pct12 with imaging device 2, and then issues a stop command and an end command. However, let us assume that a network outage occurred during the period when images pct5 to pct9 were being captured. The server device 4 performs selection processing after the start instruction using images pct1 to pct4, which are images captured at image capture times after the start instruction, as candidates (selection processing period SL1). If there is no image transfer from the staff terminal 1 for, for example, two hours due to a network interruption after receiving the image pct4, the server device 4 ends the selection process and notifies the staff terminal 1 of a stop instruction.

[0302] It is assumed that the network is subsequently restored and the candidate images pct5 and onward are received by the server device 4. In this case, the selection process may not be restarted, ie, images pct5 and onward may not be uploaded to the Live Gallery. Alternatively, if the time for closing the live gallery has not yet arrived, such as before 12 hours have elapsed in the example of Figure 50, a selection process can be performed on images pct5 and onwards, and the images can be uploaded to the live gallery according to the results of the selection process, as shown by the dotted line.

[0303] FIG. 53 shows a case where the selection process of the server device 4 is completed when the application program that performs the process of the present disclosure is closed on the staff terminal 1. Assume that the photographer issues a start command on staff terminal 1, then captures images pct1 through pct5 with imaging device 2, then closes the application program, then launches the application program and issues a stop command, and then the photographer captures images pct6 and pct7. The server device 4 performs selection processing after the start instruction (selection processing period SL1) using images pct1 to pct5, which are images captured at times after the start instruction, as candidates. If no image is transferred from the staff terminal 1 for, for example, two hours after receiving the image pct5, the server device 4 ends the selection process. After 12 hours have passed, the live gallery is closed.

[0304] The application program is then started on the staff terminal 1, and the status of the selection process on the server device 4 is checked, and if the selection process is not being performed, the status is set to the same as when a stop instruction operation is performed. As a result, the images pct6 and pct7 captured thereafter are not candidates for the live gallery.

[0305] FIG. 54 shows a case where an image is transferred from the staff terminal 1 to the server device 4 after the selection process of the server device 4 is completed. It is assumed that the photographer performs a start instruction operation on the staff terminal 1, then captures images pct1 to pct3 with the imaging device 2, and then performs a stop instruction operation. However, it is assumed that the transfer of images pct1 to pct3 from the imaging device 2 to the staff terminal 1 occurred after the stop instruction operation. The server device 4 performs the selection process after the start instruction (selection process period SL1), but if there is no image transfer from the staff terminal 1 for, for example, two hours, the selection process ends.

[0306] After that, images pct1 to pct3 are received by the server device 4 as candidate images, but in this case, the server device 4 may not resume the selection process, i.e., images pct5 and onward are not uploaded to the live gallery. This is because the transfer from the imaging device 2 to the staff terminal 1 is not in real-time mode. Alternatively, if the time for closing the live gallery has not yet arrived, such as before 12 hours have elapsed in the example of Figure 50, the server device 4 may perform a selection process on images pct1 to pct3 and upload them to the live gallery as shown by the dotted line according to the results of the selection process. 50 to 54 show examples of image analysis processing periods for selecting images to upload from candidate images in the server device 4, and describe processes in which the server device 4 terminates the image analysis processing for selecting images to upload to the live gallery or closes the live gallery when the camera staff member has not issued a stop instruction to the staff terminal 1 for a predetermined period of time (FIG. 50) or when no image transfer has occurred for a predetermined period of time (FIGS. 51 to 54). However, the server device 4 does not have to set an image analysis processing period. In other words, instead of the server device 4 automatically stopping or ending the image analysis processing or stopping or closing the distribution of the live gallery as described above, these operations may be performed in response to an operation by the photographer on the staff terminal 1.

[0307] Although examples corresponding to various situations have been described above, these are merely examples, and other examples are also possible. For example, some of the various processes from capturing an image to uploading it to the live gallery shown in Figures 42 to 54 may not be performed. Furthermore, up to this point, an example has been described in which start and stop instructions are given to the server device 4 separately from the transfer of image data (steps S361 and S363 in FIG. 19), but for example, the staff terminal 1 may add information to the metadata of the image data, such as whether the image is a candidate for a live gallery or not, and then transfer the image data to the server device 4. In other words, there may also be an example in which start and stop instructions regarding the image to be distributed are notified to the server device 4 together with the image data.

[0308] In this case, the processing in step S361 in FIG. 19 is a setting process in which, for image data whose capture time is a point after the operation of start button 301, live gallery target image information is added to the metadata, and when managing event data in step S105 in FIG. 15, the live gallery target image information is added to the metadata before being transferred in step S107. Furthermore, the processing in step S363 in FIG. 19 is a setting process in which, for image data whose image capture time is after the operation of the stop button 302, non-target image information is added to the metadata to exclude the image data from being a candidate for the live gallery, and when managing event data in step S105 in FIG. 15, the non-target image information is added to the metadata before transfer in step S107. In this way, the server device 4 can also deliver a live gallery in accordance with the camera staff's wishes.

[0309] <10. Filtering> Next, a description will be given of filtering at the staff terminal 1. The following mainly describes specific examples of the processing in steps S216, S217, S242, S243, and S240 in FIG.

[0310] 55A shows an example of the All tab 125, and Fig. 55B shows an example of the Candidate tab 126. In the All tab 125, a filter on / off button 350 is displayed in the filter specification area 129, along with icons for a rating filter 361, a content filter 362, a people filter 363, a camera filter 364, and an other filter 365.

[0311] In the case of the candidate tab 126, icons for a content filter 362 and a people filter 363 are displayed in the filter specification area 129 along with a filter on / off button 350. The rating filter 361, camera filter 364, and other filter 365 are not displayed in the candidate tab 126 because these filters are mainly used for setting selection flags and are less necessary in the candidate tab 126, which displays a list of images with selection flags set on. On the other hand, the content filter 362 and people filter 363 are also made available in the candidate tab 126 because they perform filtering that is useful for checking the balance of objects and people that you want to include in the image album.

[0312] Specific processing examples are shown in FIGS. 56, 57, and 58, and will be described below with reference to screen display examples in FIGS. 59 to 66.

[0313] Figure 56 shows an example of the processing of step S242 in Figure 17. That is, in either the time view 120 or the event view 200, an operation is performed on the filter designation area 129 while the all tab 125 or the candidate tab 126 is displayed as shown in Figure 55A or Figure 55B.

[0314] 56, the staff terminal 1 monitors the operation of specifying a filter type. That is, it monitors whether any of the icons of the rating filter 361, content filter 362, people filter 363, camera filter 364, and other filter 365 is operated. In the case of the candidate tab 126, it monitors whether any of the people filter 363 or camera filter 364 is operated.

[0315] If an operation on any of these icons is detected, the staff terminal 1 proceeds to step S602 and controls the display of the corresponding filter condition panel. Alternatively, when a filter condition panel is already being displayed and an icon of another filter is operated, the display of the filter condition panel is switched. The filter condition panels are a rating condition panel 320, a content condition panel 321, a people condition panel 322, a camera condition panel 323, and an other condition panel 324, which will be described below.

[0316] FIG. 59A shows a state in which rating condition panel 320 is displayed in step S602 of FIG. 56 as a result of operating rating filter 361. The rating condition panel 320 is provided with a rating condition selection section 371, which allows the user to specify filter conditions using, for example, six-level ratings. For example, an operator may be provided to indicate the rating level as a number of stars, such as "no stars," "one star," "two stars," "three stars," "four stars," and "five stars."

[0317] None of the controls are selected in the initial state. When one is selected, it becomes the filter condition. For example, when the three-star control is operated, the filter condition is set to extract images with a rating of "three stars." You can also select multiple controls. In this case, the filter condition will be an OR condition. For example, if the 3-star control and the 4-star control are operated, the filter condition will be set to extract images with rating information of "3 stars" or "4 stars."

[0318] Additionally, the number of images for which that rating has been set is also displayed adjacent to the star-based controls in the rating condition selection section 371. This allows users to estimate the number of images that will be narrowed down when filter conditions are specified.

[0319] The rating condition panel 320 also has a reset button 370 . The reset button 370 is an operator for initializing the settings of the rating condition selection section 371 .

[0320] FIG. 60B shows a state in which the content condition panel 321 is displayed in step S602 of FIG. 56 in response to the content filter 362 being operated from the state of FIG. 60A. The content condition panel 321 is provided with a thing condition selection section 372. The thing condition selection section 372 is provided with various things (i.e., content) and check boxes for selecting each thing, and any thing can be specified by checking the check boxes. For example, things related to a wedding event are expected to be listed in the thing condition selection section 372, such as objects like "dress," "cake," "flowers / plants," "accessories," "suit," "food," "tableware," "nails," and "lips," as well as people's actions like "dance," "smile (laughing person)," and "tears (crying person)." The types of "things" listed in the thing condition selection section 372 as these objects and actions may be determined, for example, for each type of event, or the staff terminal 1 may detect things that exist as subjects through image analysis processing and list them in the thing condition selection section 372.

[0321] None of the objects listed in the object condition selection section 372 are selected in the initial state. When one is selected, it becomes the filter condition. For example, when "dress" is selected, the filter condition of extracting images showing dresses is set. You can also select multiple things. In that case, the filter condition will be an AND condition. For example, if "dress" and "cake" are selected, the filter condition will be set to extract images of a person wearing a dress and a cake. The filter condition may be an OR condition, or it may be possible to select either an AND condition or an OR condition.

[0322] The object condition selection section 372 also displays the number of images that correspond to each object, allowing users to estimate the number of images that will be narrowed down when filter conditions are specified.

[0323] The content condition panel 321 is also provided with a reset button 370 . In this case, the reset button 370 is an operator for initializing the settings of the object condition selection section 372 .

[0324] FIG. 62A shows a state in which people condition panel 322 is displayed in step S602 of FIG. 56 in response to operation of people filter 363 in filter designation area 129. The people condition panel 322 is provided with a person condition selection section 373. The face of each individual is displayed in the person condition selection section 373, allowing any person to be specified. For example, the staff terminal 1 performs personal identification based on the analysis processing results of each image, extracts the face of the person appearing in the image, turns it into an icon, and displays it in the person condition selection section 373.

[0325] None of the people listed in the person condition selection section 373 are selected in the initial state. When one of them is selected, it becomes the filter condition. For example, when the face of a certain person "Mr. A" is selected, the filter condition of extracting images in which Mr. A appears is set. It is also possible to select multiple people. In this case, the filter condition can be an AND condition. Or it can also be an OR condition. It is also possible to select either the AND condition or the OR condition.

[0326] Furthermore, the person condition selection section 373 also displays the number of images in which each person appears, allowing users to estimate the number of images that will be narrowed down when filter conditions are specified. The people condition panel 322 also has a reset button 370 . In this case, the reset button 370 is an operator for initializing the settings of the person condition selection section 373 .

[0327] FIG. 63A shows a state in which the camera condition panel 323 is displayed in step S602 of FIG. 56 in response to an operation on the camera filter 364 in the filter designation area 129. The camera condition panel 323 is provided with a camera condition selection section 374. The camera condition selection section 374 shows the name and model name of the imaging device 2 used by the camera staff, and allows selection using check boxes. For example, the staff terminal 1 may list the equipment name and model name of the imaging device 2 for which FTP communication settings have been made in the camera condition selection section 374.

[0328] None of the imaging devices 2 listed in the camera condition selection section 374 are selected in the initial state. When one is selected, it becomes the filter condition. It is also possible to select multiple imaging devices 2. In this case, the filter condition becomes an OR condition. The initial state may be a state in which all of the imaging devices 2 are selected.

[0329] The camera condition selection section 374 also shows the number of images captured by each imaging device 2 in the current project, allowing users to estimate the number of images that will be narrowed down when filter conditions are specified. The camera condition panel 323 is also provided with a reset button 370 . In this case, the reset button 370 is an operator for initializing the settings of the camera condition selection section 374 .

[0330] FIG. 64A shows a state in which the other conditions panel 324 is displayed in step S602 of FIG. 56 in response to an operation on the other filter 365 in the filter designation area 129. The other conditions panel 324 is provided with an archive conditions button 381 , a blink conditions button 382 , a delivery image conditions button 383 , and an evaluation image conditions button 384 .

[0331] The archive condition button 381 is an operator for turning on / off the archive condition. For example, the filter condition can be switched between "display archived images" when on and "hide archived images" when off.

[0332] The blink condition button 382 is an operator that turns on / off the display of images in which blinking of the subject person has been detected. For example, the filter condition can be switched between "do not display images with blinking eyes" when on and "display all images" when off.

[0333] The delivery image condition button 383 is an operator that turns on / off the filter condition for images delivered through the live gallery. For example, when it is on, the filter condition can be switched between "display only images delivered through the live gallery" and when it is off, the filter condition can be switched between "display all images."

[0334] The rating image condition button 384 is an operator for turning on / off the filter condition for highly rated images in the live gallery. For example, the filter condition can be switched between "display only highly rated images" when on and "display all images" when off.

[0335] The archive condition button 381, the blink condition button 382, ​​the delivery image condition button 383, and the evaluation image condition button 384 may be configured to display the number of images that match when narrowed down. The other conditions panel 324 also has a reset button 370 . In this case, the reset button 370 is an operator that resets each button on the other conditions panel 324 to its initial state. The initial state may be, for example, the archive conditions button 381 is off, the blink conditions button 382 is on, the delivery image conditions button 383 is off, and the evaluation image conditions button 384 is off. Other states are also possible.

[0336] In step S602 of Figure 56, as in each of the above examples, display control is performed for the relevant filter condition panel in response to the operation of the filter designation area 129, namely, the rating condition panel 320, the content condition panel 321, the people condition panel 322, the camera condition panel 323, or the other condition panel 324.

[0337] 56, the staff terminal 1 monitors the operation of the filter on / off button 350. If the staff terminal 1 detects the operation of the filter on / off button 350, it performs the processes in and after step S611, which will be described later.

[0338] Next, an example of the process in step S243 in FIG. 17 will be described with reference to FIG. Note that the filter operation in step S217 in Figure 17 mainly refers to the operation of the filter conditions, that is, the operation of specifying the filter conditions in any of the rating condition panel 320, content condition panel 321, people condition panel 322, camera condition panel 323, and other condition panel 324.

[0339] If the filter operation detected in step S217 of FIG. 17 is an operation of any of the controls from "no stars" to "five stars" on the rating condition panel 320, the staff terminal 1 proceeds from step S620 to step S630 of FIG. 57, and performs filtering based on the specified filter conditions, display control based on the filtering results, and updating the filter conditions.

[0340] For example, in the state of FIG. 59A, when two operators, "2 stars" and "3 stars", are selected in rating condition selection section 371, the state is shown in FIG. 59B. In this case, the staff terminal 1 performs a filter process to extract images with rating information of "two stars" and images with rating information of "three stars." As display control, the extracted image is displayed in the image area 128, and the two controls for "2 stars" and "3 stars" are displayed in different colors to indicate that they are currently selected. Furthermore, the display color of the rating filter 361 in the filter specification area 129 is changed to indicate that a filter condition based on the rating has been set.

[0341] Furthermore, as a process for updating the filter conditions, the staff terminal 1 updates and stores the filter condition based on the rating, "'2 stars' and '3 stars' OR," as the filter condition for the all tabs 125. The reason for using the filter condition as the all tabs 125 is that the rating condition can be selected only on the all tabs 125.

[0342] If the filter operation detected in step S217 of FIG. 17 is a selection operation of the imaging device 2 on the camera condition panel 323, the staff terminal 1 proceeds from step S621 to step S631 of FIG. 57, and performs processing of filtering, display control based on the filtering results, and updating of the filter conditions.

[0343] For example, FIG. 63B shows a case where one imaging device 2 is selected from the state shown in FIG. 63A. In this case, the staff terminal 1 performs a filter process to extract the image of the corresponding imaging device 2. As display control, the extracted image is displayed in the image area 128, and the check box of the selected image capture device 2 is checked to indicate that it is selected. Furthermore, the display color of the camera filter 364 in the filter designation area 129 is also changed to indicate that a filter condition has been set for each image capture device 2. Furthermore, as a process of updating the filter conditions, the staff terminal 1 updates and stores the filter conditions according to the imaging device 2 as filter conditions for the all tabs 125. In this case as well, the reason for using the filter conditions according to the imaging device 2 as filter conditions for the all tabs 125 is that the filter conditions according to the imaging device 2 can be selected only on the all tabs 125.

[0344] Furthermore, FIG. 63B shows a case where multiple imaging devices 2 are selected. In this case, the staff terminal 1 performs a filter process to extract images from the corresponding plurality of imaging devices 2. As display control, the extracted images are displayed in the image area 128, and the check boxes of the selected imaging devices 2 are checked to indicate that they are currently selected. Furthermore, the filter conditions according to the imaging device 2 are updated and stored as the filter conditions for all tabs 125.

[0345] If the filter operation detected in step S217 of Figure 17 is the operation of any button on the other conditions panel 324, the staff terminal 1 proceeds from step S622 to step S632 of Figure 57, and performs filtering, display control based on the filtering results, and updating the filter conditions.

[0346] For example, FIG. 64B shows a state in which the evaluation image condition button 384 is operated from the state in FIG. 64A. In this case, the staff terminal 1 performs a filtering process to extract images that have been given high evaluation information. As display control, the extracted image is displayed in the image area 128, and the state of the evaluation image condition button 384 is changed to the operating state. Furthermore, the display color of the other filter 365 in the filter designation area 129 is also changed to clearly indicate that the filter conditions as the other filter have been set. Furthermore, as a process for updating the filter conditions, the staff terminal 1 updates and stores the filter conditions according to the operation of the other filter as the filter conditions for the all tabs 125. In this case, the filter conditions are set as the filter conditions for the all tabs 125 because the filter conditions for the other filter 365 can be selected only on the all tabs 125.

[0347] In addition, when the evaluation image condition button 384 is operated as shown in the figure, the filter processing may be, for example, a process of extracting images with a predetermined number of high ratings or more, in addition to extracting images with high ratings. Furthermore, the camera staff may input the number of high ratings, and the process may be such that images with the number of high ratings equal to or greater than the input number are extracted. Furthermore, the camera staff may be allowed to select which of these to extract.

[0348] Furthermore, when the delivery image conditions button 383 is operated, the processing of step S632 involves extracting the image uploaded to the live gallery, displaying it in the image area 128, changing the display of the delivery image conditions button 383 to an operating state, and changing the display color of the other filter 365. The same can be considered when the archive condition button 381 or the blink condition button 382 is operated.

[0349] If the filter operation detected in step S217 of Figure 17 is a selection operation on the content condition panel 321, the staff terminal 1 proceeds from step S623 to step S640 of Figure 57, and branches the processing depending on whether the all tabs 125 or the candidate tabs 126 are currently being displayed. If the all tabs 125 are being displayed, the staff terminal 1 proceeds to step S641, and performs filtering, display control based on the filtering results, and updating of the filter conditions for the all tabs 125.

[0350] For example, FIG. 60C shows the case where one thing is selected from the state of FIG. 60B. In this case, the staff terminal 1 performs a filter process to extract images that include the relevant object. As display control, the extracted image is displayed in the image area 128, and the checkbox of the selected object is checked to indicate that it is selected. Furthermore, the display color of the content filter 362 in the filter specification area 129 is also changed to indicate that a filter condition by object has been set. Furthermore, the staff terminal 1 updates and stores the filter condition by the thing as the filter condition for the all tabs 125 as a filter condition update process.

[0351] If the candidate tab 126 is being displayed, the staff terminal 1 proceeds to step S642, where it performs filtering within the image to which the selection flag has been assigned, display control based on the filtering results, and updating of the filter conditions for the candidate tab 126. In this case, the filter conditions are updated and stored as filter conditions for the candidate tab 126. This means that the filter conditions are stored independently of the filter conditions for the all tabs 125 based on the things.

[0352] 61B shows a case where more items are specified than in the state of FIG. 61A, and multiple items are selected. In this case, the extraction process in step S641 or step S642 uses an AND condition to extract images that include the selected multiple items together, and the display control is to display the corresponding images in image area 128.

[0353] If the filter operation detected in step S217 of FIG. 17 is a selection operation on the people condition panel 322, the staff terminal 1 proceeds from step S624 to step S650 of FIG. 57, and branches the processing depending on whether the all tab 125 or the candidate tab 126 is currently being displayed. If the all tabs 125 are being displayed, the staff terminal 1 proceeds to step S651, and performs filtering, display control based on the filtering results, and updating of the filter conditions for the all tabs 125.

[0354] For example, FIG. 62B shows a state in which a certain person has been selected. In this case, the staff terminal 1 performs a filter process to extract images in which the person in question appears. As display control, the extracted image is displayed in the image area 128, and the image of the selected person is highlighted or changed in color to indicate that the person is currently selected. Furthermore, the display color of the people filter 363 in the filter specification area 129 is also changed to indicate that a filter condition based on people has been set. Furthermore, the staff terminal 1 updates and stores the filter conditions by person as the filter conditions for the all tabs 125 as part of the process of updating the filter conditions.

[0355] If the candidate tab 126 is being displayed, the staff terminal 1 proceeds to step S652, where it performs filtering within the image to which the selection flag has been assigned, display control based on the filtering results, and updating of the filter conditions for the candidate tab 126. In this case, the filter condition update process updates and stores the filter conditions by person as the filter conditions for the candidate tab 126. This means that the filter conditions are stored independently from the storage of the filter conditions by person for the all tab 125.

[0356] Note that the above steps S630, S631, S632, S641, S642, S651, and S652 have been described as a case where a certain filter condition is selected on any of the rating condition panel 320, content condition panel 321, people condition panel 322, camera condition panel 323, and other condition panel 324. However, when an operation to cancel the selection is performed, the same processing is performed in accordance with the operation. In other words, filtering, display control, and updating of the filter conditions are performed with a certain condition canceled. An operation to cancel a selection is, for example, an operation to tap again on the operator of the selected filter condition.

[0357] If the filter operation detected in step S217 of FIG. 17 is an operation of the reset button 370, the staff terminal 1 proceeds from step S625 to step S660 of FIG. 57, and performs filtering, display control, and filter condition update processing, as well as resetting the filter conditions in the currently open panel.

[0358] For example, FIG. 65A shows the initial state of the content condition panel 321, FIG. 65B shows the state in which "dress" is selected, and FIG. 65C shows the state in which multiple things are selected. The display of image area 128 shows a state in which no object conditions are selected in Figure 65A, a state in which images containing "dress" are extracted and displayed in Figure 65B, and a state in which only images containing all selected objects are extracted and displayed in Figure 65C.

[0359] For example, if the reset button 370 is operated in the state of FIG. 65B, the condition "dress" is reset, and the display state of FIG. 65 is restored. For example, if the reset button 370 is operated in the state of FIG. 65C, the conditions of the plurality of things are reset, and the display state of FIG. 65 is restored. In addition, with the conditions of the things reset, the filter conditions for the all tabs 125 or the candidate tabs 126 are updated and stored.

[0360] The provision of the reset button 370 is convenient when, after specifying multiple filter conditions, one wishes to cancel the filter conditions.

[0361] Similarly, in the case of the rating condition panel 320, the people condition panel 322, the camera condition panel 323, and the other condition panel 324, the filter conditions selected in that panel are reset in response to the operation of the reset button 370. Although the above description is based on resetting each filter condition panel, the filter condition settings in all filter condition panels may be reset by operating the reset button 370 in one filter condition panel. However, it is desirable that the filter conditions in the all tab 125 and the filter conditions in the candidate tab 126 be reset independently.

[0362] If the filter operation detected in step S217 of Figure 17 is an operation to close a panel, the staff terminal 1 proceeds from step S626 to step S661 of Figure 57 and performs processing to close the currently open filter condition panel (either the rating condition panel 320, content condition panel 321, people condition panel 322, camera condition panel 323, or other condition panel 324). The operation to close the panel may be, for example, a tap operation on an area outside the filter condition panel, etc. Also, a close button may be provided on each panel.

[0363] Here, the process when the filter on / off button 350 is operated in step S610 in FIG. 56 mentioned above will be described. If an operation of the filter on / off button 350 is detected, the staff terminal 1 proceeds from step S610 to step S611, and branches the process depending on whether the operation is an operation from on to off or an operation from off to on.

[0364] If the operation is from on to off, the staff terminal 1 proceeds to step S612 and performs processing to switch to full display. That is, the filter conditions at that time are considered to be temporarily canceled, and all images are displayed in the image area 128. Fig. 66A shows a state in which filtering conditions for objects are set in the content condition panel 321. If the filter on / off button 350 is turned off at this time, all images are displayed regardless of the filtering conditions, as shown in Fig. 66B.

[0365] Note that switching from on to off in this case does not erase the memory of the filter conditions. When filter on / off button 350 is switched from off to on, the filter conditions in Fig. 66A, for example, are re-enabled, and only images extracted under those filter conditions are displayed in image area 128. That is, in the case of an operation from OFF to ON, the process proceeds from step S611 to step S613 in FIG. 56, and the process branches depending on whether the all tabs 125 or the candidate tabs 126 are displayed at that time. If it is the all tab 125, then in step S614, an image extracted according to the filter conditions stored for the all tab 125 at that time is displayed. If the candidate tab 126 is currently being displayed, then in step S615, an image extracted according to the filter conditions currently stored for the candidate tab 126 is displayed.

[0366] In steps S630, S631, S632, S641, S642, S651, and S652 in FIG. 57 described above, the filter conditions corresponding to all tabs 125 or candidate tabs 126 are updated and stored in accordance with the operation of the filter conditions. These filter conditions are updated, for example, by updating the filter condition information 63 of the event data 60 in Fig. 6. Alternatively, the filter conditions may be temporarily stored in the RAM 73 or the like as the latest filter conditions. In either case, the latest filter conditions are stored when the filter on / off button 350 is turned off. Therefore, when the filter on / off button 350 is turned on, display processing according to the latest filter conditions becomes possible in step S614 or step S615.

[0367] Next, a process when tab switching is performed will be described with reference to Fig. 58. This is an example of the process in step S240 in Fig. 17.

[0368] In step S680 of FIG. 58, the staff terminal 1 branches the process depending on whether the tab switching operation is an operation from the all tabs 125 to the candidate tabs 126 or not. In the case of an operation from the all tab 125 to the candidate tab 126, the staff terminal 1 checks the filter condition for the candidate tab 126 in step S681, for example, by referring to the filter condition information 63 of the event data 60 at that time.

[0369] If no filter conditions have been set, the staff terminal 1 performs control in step S684 to display all of the candidate images, that is, all of the images to which selection flags have been assigned, in the candidate tab 126.

[0370] If a filter condition has been set, the staff terminal 1 similarly performs control in step S682 to display all images that are candidates in the candidate tab 126, that is, all images to which selection flags have been assigned. However, in step S683, the staff terminal 1 controls the display of the filter designation area 129 of the candidate tab 126. In this case, the filter on / off button 350 is displayed as off, and the display color of each filter display of the rating filter 361, content filter 362, people filter 363, camera filter 364, and other filter 365 is set according to the set filter conditions. In other words, the filter type for which the conditions are set is clearly indicated.

[0371] If the filter on / off button 350 is subsequently turned on in the candidate tab 126, the process of step S615 in FIG. 56 described above is performed, and the filter conditions are enabled.

[0372] Therefore, when the candidate tab 126 starts to be displayed, images are initially displayed with the filter conditions turned off, even if filter conditions were previously set when the candidate tab 126 was opened. This is because the candidate tab 126 is used to check images that have been given selection flags, and it is therefore preferable for camera staff if all candidate images are displayed when the candidate tab 126 is opened. In addition, since the filter conditions are stored, by turning on the filter on / off button 350, the previous filtering state can be immediately displayed.

[0373] If the tab switching operation is from the candidate tab 126 to the all tab 125, the staff terminal 1 proceeds from step S680 to step S691, and at that time checks the filter conditions for the all tab 125, for example, by referring to the filter condition information 63 of the event data 60.

[0374] If no filter conditions are set, the staff terminal 1 performs control to display all of the images on the all tabs 125 in step S694. In other words, the images are displayed according to the filter conditions set in the previous All Tabs.

[0375] In step S693, the staff terminal 1 also controls the display of the filter designation area 129. In this case, the filter on / off button 350 is turned on, and the display color of each filter display of the rating filter 361, content filter 362, people filter 363, camera filter 364, and other filter 365 is set according to the set filter conditions. In other words, the filter type for which the conditions are set is clearly indicated.

[0376] Therefore, when the display of the all tabs 125 starts, unlike the candidate tabs 126, the display is performed according to the previous filter conditions. This is because it is preferable to narrow down the number of images for selection on the All Tab 125, and it is thought that the selection process can be made more efficient by displaying images while taking advantage of the previous filter conditions.

[0377] The above is realized by updating and storing the filter conditions for the all tab 125 and the candidate tab 126 independently.

[0378] It is possible to maintain the filtering conditions even when switching between the time view 120 and the event view 200. That is, when the time view 120 is filtered and then switched to the event view 200, images according to the filtering conditions are displayed in the event view 200. For example, if filtering conditions are set so that archived images are not displayed, the archived images will not be displayed when switched to the event view 200. Furthermore, the filter conditions can be changed on the event view 200 screen.

[0379] <11. Summary and Variations> The above embodiment can provide the following effects.

[0380] The staff terminal 1, which is an information processing device according to the embodiment, includes a distribution management unit 35 that performs instruction processing for image distribution, i.e., live gallery distribution, for image data captured at a specific event such as a wedding and transmitted sequentially to the server device 4, for example, in substantially real time. The staff terminal 1 also includes an event data management unit 30 that performs processing to manage evaluation information for images distributed as a live gallery in association with the image data. The staff terminal 1 also includes a filter processing unit 33 that performs filtering processing on the image data using the evaluation information as a filtering condition. The instruction process related to live gallery distribution includes, for example, instructions to start or end image distribution related to image distribution, such as images to be candidates for the live gallery, and instructions to end the live gallery. This allows live gallery distribution, allowing remote participants viewing the event on the remote participant terminal 7 to enjoy the wedding or other event even more. In particular, being able to view images taken by the photographer in near real time during the event makes the event even more enjoyable for remote participants. Furthermore, the staff terminal 1 acquires evaluation information such as "likes" for images in the live gallery and links it to the images, enabling filtering using that evaluation information. This makes it possible to use feedback from the live gallery when selecting images for delivery. This allows for selection that takes into account an objective viewpoint, improving the accuracy of the selection. This allows for support in the creation of desirable image collections.

[0381] The staff terminal 1 is configured to manage live gallery distribution by the distribution management unit 35 and to perform filtering processing for delivery by the event data management unit 30 and the filter processing unit 33. However, the management of live gallery distribution and the filtering processing for delivery may be performed by a separate information processing device.

[0382] In the embodiment, the distribution management unit 35 performs an example of issuing a start instruction and a stop instruction for an image to be distributed as an instruction process. For example, the distribution management unit 35 performs a process of transmitting a start instruction and a stop instruction to the server device 4. For example, on the staff terminal 1, the camera staff can operate the start button 301 or the stop button 302 on the management panel 300. The staff terminal 1, using the function of the distribution management unit 35, performs processing to send an instruction to start distributing images or an instruction to stop distributing images to the server device 4 in response to these operations (see FIG. 19). In particular, in the example described in the embodiment, the criteria for determining the image capture time are set to instruct the start timing and stop timing for determining images related to live gallery distribution (for example, candidate images). This allows the camera crew to perform live gallery distribution of images from any period of time.

[0383] As another example of notifying the server device 4 of the start instruction separately from the image data, as described above, the start instruction may be notified as live gallery target image information in the metadata of the image data captured at the time after the start button 301 is operated. In other words, the start instruction may be transmitted indirectly by adding information to each image data indicating that the image was captured at a time after the start instruction. Similarly, the stop instruction may be notified as non-target image information in the metadata of the image data captured at the time after the operation of the stop button 302. In other words, the stop instruction may be transmitted indirectly by adding information to each image data indicating that the image was captured at the time of the stop instruction.

[0384] In the embodiment, image distribution as a live gallery is performed on image data captured between the time of the start instruction and the time of the stop instruction. When the staff terminal 1 issues a start instruction or a stop instruction regarding the image to be distributed in response to an operation by the camera staff, the server device 4 recognizes the image to be distributed and executes live gallery distribution. In this case, the images to be distributed are all or part of the image data captured by the imaging device 2 during the period from the time of the start instruction issued by operating the start button 301 to the time of the stop instruction issued by operating the stop button 302 (see Figures 41 to 54). Therefore, if a photographer wants to execute live gallery distribution of the images they are about to capture, they can simply operate the start button 301. If a photographer does not want to execute live gallery distribution of the images they are about to capture, they can simply operate the stop button 302. These operations only need to be performed in between shots, allowing the photographer to concentrate on taking photos while actually taking them. Furthermore, the photographer can easily control which images are to be distributed and which are not. This makes it extremely easy for photographers to shoot and broadcast live gallery footage at their own convenience. As mentioned in FIG. 41, image data corresponding to the period from the start instruction to the stop instruction may be determined based on the time of reception at the staff terminal 1, rather than the time of image capture.

[0385] In the embodiment, the image distribution as a live gallery is a distribution of image data selected by the server device 4 from image data captured between the time of the start instruction and the time of the stop instruction. Of the image data captured by the imaging device 2 during the period from the time of the start instruction to the time of the stop instruction issued from the staff terminal 1, the server device 4 selects image data to be uploaded to the live gallery. For example, the server device 4 may remove similar images from among the images captured during that period from the images to be uploaded, or may remove images from the images to be uploaded based on evaluation of the composition, the expressions of people in the images, etc. (see step S602 in FIG. 36). This eliminates the need for camera staff to select images to be distributed as a live gallery, and images that are appropriate in terms of content are selected and distributed, achieving high-quality live gallery distribution while minimizing the operational burden on camera staff.

[0386] In the embodiment, the distribution management unit 35 can issue a stop instruction and then issue a resume instruction for the image to be distributed, for example, by transmitting the resume instruction to the server device. 31, the cameraman can issue a stop instruction by operating the stop button 302 on the staff terminal 1, and then operate the resume button 304. In this case, the staff terminal 1 issues a resume instruction to the server device 4 (see steps S352 and S361 in FIG. 19). Therefore, camera staff can freely stop and restart the live gallery broadcast, giving them full control over the images they broadcast to the live gallery. This allows them to broadcast the live gallery in accordance with their own wishes.

[0387] In the embodiment, the example has been given in which the distribution management unit 35 issues a stop instruction and then performs an end instruction process indicating the end of transfer of the distribution image. For example, the end instruction is transmitted to the server device 4. On the staff terminal 1, the camera staff member can perform an operation to end the transfer of images to be distributed via the live gallery using the end button 303. In this case, the staff terminal 1 instructs the server device 4 to end the live gallery distribution event (see steps S354 and S365 in FIG. 19). This allows the camera staff to freely control the end timing of the series of processes for delivering captured image data as a live gallery.

[0388] In the embodiment, an example has been given in which the distribution management unit 35 can perform, as the instruction process, a process of issuing a transfer resume instruction indicating the resumption of transfer of the distribution image after transmitting an end instruction. For example, the distribution management unit 35 can perform a process of sending an upload resume instruction to the server device 4. On the staff terminal 1, the camera staff can perform an operation to notify the server device 4 of the resumption of image transfer for a series of live gallery distributions, for example, by using the resume upload button 316 on the live gallery setting screen 310 of Figure 14B (see steps S224 and S366 in Figure 19). This allows the camera crew to freely control when image transfer for a live gallery that has been stopped can be resumed. For example, this can be used when terminating image transfer for a live gallery after a wedding reception and then wanting to resume it at the after-party. Remote participants can then view a series of images from the wedding ceremony to the after-party as a live gallery on a common URL website.

[0389] In the embodiment, an example has been given in which the distribution management unit 35 can perform, as the instruction process, a process of issuing an instruction to delete a distributed image. For example, the deletion instruction is transmitted to the server device 4. For example, the camera staff can delete the image that has been distributed from the live gallery by operating the staff terminal 1 (see steps S223 and S367 in FIGS. 12, 14B, and 19). This allows you to delete images that have been distributed on a trial basis, for example, when conducting trials in preparation for a live gallery. Also, during events such as weddings, camera staff can check the live gallery and, if there are any images they do not want to be distributed in the live gallery, they can delete those images from the live gallery. Therefore, live gallery distribution according to the camera staff's wishes can be realized. In particular, by automatically selecting and distributing images on the server device 4 side and allowing the camera staff to delete images from the live gallery at their discretion in some cases, it is possible to reduce the operational burden on the camera staff and distribute images according to their wishes.

[0390] In the embodiment, an example has been described in which the event data management unit 30 manages distribution information indicating that the image is distributed by the server device 4 in association with the image data (see FIG. 6). This makes it possible to use information as to whether or not an image has been distributed to the live gallery. For example, in filter processing, as described in Fig. 64, images distributed to the live gallery can be extracted by operating the distribution image condition button 383. This allows the results of the selection process in the server device 4 as to whether or not to upload to the live gallery to be used in the selection of image collections, contributing to more efficient selection. Furthermore, by managing distribution information for image data in the event data management unit 30 and the server data management unit 40, it becomes possible to provide the distribution information as reference information for producing an image collection for actual delivery, for example (see step S400 in Figure 40).

[0391] In the embodiment, an example is given in which the event data management unit 30 performs processing in which, for image data captured at a specific event, information indicating whether the image is a candidate for distribution by the server device 4 or not (live gallery target image information / asymmetric image information) is added to the metadata, and then the image is sent to the server device 4. The start instruction and end instruction to the server device 4 may be issued separately from the transfer of image data, or live gallery target image information or asymmetric image information may be added to the image data in response to the start instruction or end instruction operation and transmitted to the server device 4. In this case, the server device 4 can determine whether or not to make each piece of transmitted image data a candidate, eliminating the need for time management between the start instruction and the end instruction.

[0392] In the embodiment, an example has been given in which the evaluation information is information based on an input by a viewer regarding a distribution image. For example, the evaluation information may be whether or not a viewer has clicked "Liked," which indicates high evaluation information, or the number of high evaluations. By filtering in this way, the camera staff can extract images according to the viewer's evaluation and select the images to be delivered. In other words, the camera staff can recognize the reputation of the images from the remote participants viewing the live gallery broadcast on the remote participant terminal 7 and select the images to be delivered. This makes it possible to make selections that take into account an objective perspective, resulting in an image collection with higher user satisfaction.

[0393] The staff terminal 1 of the embodiment is an example that allows multiple types of filter conditions to be selected by operation and is equipped with a UI control unit 31 that presents images extracted by the filtering process performed by the filter processing unit 33 based on the selected filter conditions. For example, filtering based on various filter conditions is provided, such as filtering by rating, filtering by object, filtering by person, filtering by type of imaging device 2, filtering by evaluation information, filtering by whether or not it is a live gallery distribution image, filtering by archive, and filtering by blinking. By selecting these through operations from the filter specification area 129 or the respective condition panels (such as the other condition panel 324), the camera staff can extract images under any condition, thereby realizing efficient selection. The types of filter conditions shown are merely examples. For example, there may be cases where filters based on people are not provided. Other filter types may also be added.

[0394] In the embodiment, an example is shown in which the UI control unit 31 allows a thing to be selected as a filter condition, and controls the filter processing unit 33 to present an image extracted by a filtering process performed using the thing as a filter condition. For example, objects such as "dress," "cake," and "flowers" or actions such as "dance" can be specified as filter conditions. This allows the camera crew to easily check images that include those subjects and select images that have a good balance of subject matter. This improves the efficiency of selection and the quality of the resulting image collection. For example, it makes it easy to select images that do not end up being monotonous, containing only images of the same subject. When a subject is used as a filter condition, the subject can be selected using the content condition panel 321. This allows the camera staff to easily select the subject to be used as a filter condition.

[0395] In the embodiment, an example is shown in which the UI control unit 31 allows a person to be selected as a filter condition, and controls the filter processing unit 33 to present images extracted by a filtering process performed using a person as a filter condition. For example, by specifying an image of a face, individual people can be specified as filter conditions. This allows camera staff to easily check images that include each person and select images that have a good balance of subjects. This improves the efficiency of selection and the quality of the resulting image collection. For example, it becomes easy to select an image collection that includes a balanced number of event participants. When people are used as a filtering condition, individuals can be selected using the people condition panel 322. This allows the camera staff to easily select people to use as filtering conditions.

[0396] In the embodiment, the UI control unit 31 performs control to present an all tab 125, which is a first tab that presents captured images, and a candidate tab 126, which is a second tab that presents images from the captured images that are candidates for inclusion in an image album. An example has been given in which the filter conditions selectable in the all tab 125 and the filter conditions selectable in the candidate tab 126 are different. For example, All Tab 125 allows you to select filter conditions such as rating, things, people, camera, and other (archives, blinks, rating information, and distributed images). On the other hand, the candidate tab 126 allows selection of filtering conditions for things and people. In other words, the all tab 125 and the candidate tab 126 allow selection of filtering conditions different from each other. This allows for filtering that is appropriate for each tab. For example, All Tab 125 provides a number of filter conditions so that camera staff can narrow down and select based on various criteria. On the other hand, the images that have been selected are displayed in the candidate tab 126. It is important for the camera staff to check the balance of specific objects and people in the images in the candidate tab 126 before using them in the image album. Therefore, the filter conditions for objects and people can be selected and checked.

[0397] In the embodiment, the filter conditions selected in the all tab 125 and the filter conditions selected in the candidate tab 126 are stored separately. That is, the all tab 125 and the candidate tab 126 have their filter conditions set independently and undergo filtering processing. As a result, even when switching between the all tab 125 and the candidate tab 126, images are displayed without being affected by the filter conditions of the other tab. Because the all tab 125 and the candidate tab 126 have different purposes for confirmation, it is preferable that the filter conditions do not affect each other. This also prevents camera staff from becoming confused when recognizing images. For example, if filter conditions are shared between the All tab 125 and the Candidate tab 126, some images may not be displayed when switching from the All tab 125 to the Candidate tab 126. This may confuse camera staff, as it may seem that images they selected as candidates are not displayed in the Candidate tab 126. Furthermore, after extracting only a certain object in the Candidate tab 126, when switching back to the All tab 125, only images of that object may be displayed. By setting filter conditions independently for each section, such situations can be prevented. Furthermore, since the filter conditions for each tab are stored independently, even after switching tabs, the previous filter conditions for that tab can be used for display. For example, after filtering on the All tab 125, if the user switches to the Candidate tab 126, filters, and then returns to the All tab 125, images can be displayed using the previous filter conditions on the All tab 125. In other words, the camera staff can proceed with the selection by effectively using the previous filter condition settings.

[0398] In the embodiment, an example has been given in which, when switching from all tabs 125 to candidate tabs 126, control is performed so that images are displayed without reflecting the filter conditions (see step S381 in FIG. 58). When switching from the all tab 125 to the candidate tab 126, all images included in the candidate tab 126 are displayed without reflecting the filtering. The candidate tab 126 is used to check the images to be used in the image album. Therefore, when switching to the candidate tab 126, all images that have been selected as candidates are displayed. This allows the camera staff to accurately check the candidate images. This is because if the display is filtered using past filter conditions, it is easy for the misunderstanding to occur that an image that should have been selected as a candidate is no longer visible.

[0399] The UI control unit 31 of the embodiment enables a filter on / off operation using the filter on / off button 350, and performs control to present an image that reflects the filtering process when the filter on operation is performed, and to present an image that does not reflect the filtering process when the filter off operation is performed. The set filter conditions are maintained even when the filter off operation is performed (see FIGS. 56 and 57). The reflection of the filtering state for the displayed image is turned on / off by operating the filter on / off button 350 in the all tab 125 or candidate tab 126. Moreover, by operating this filter on / off button 350, the filter condition settings are not discarded but maintained. This allows camera crew to easily enable or disable filtering, and the filter conditions selected are not wasted, improving the efficiency of selection.

[0400] In the embodiment, an example has been given in which the UI control unit 31 enables a reset operation of the filter conditions, and the set filter conditions are initialized in response to the reset operation. That is, a reset button 370 is provided in each of the rating condition panel 320, content condition panel 321, people condition panel 322, camera condition panel 323, and other condition panel 324, allowing a reset operation. By performing the reset operation, the filter conditions selected in those condition panels are initialized, and a state in which no filter conditions are selected can be restored. This provides a convenient operation when the camera crew wants to cancel the filter conditions. For example, if multiple objects are selected in the content condition panel 321, they can cancel the selection of all of those objects with a single touch.

[0401] In the embodiment, an example has been given in which the UI control unit 31 performs control to present the number of images extracted by the filtering process for each selectable filter condition. For example, the number of images to be displayed by filtering is displayed in the rating condition panel 320, content condition panel 321, people condition panel 322, camera condition panel 323, etc. (see FIGS. 59 to 63). This allows the camera crew to see how much filtering can narrow down the image. In particular, the content condition panel 321 displays the number of images containing each object, allowing the camera crew to get an idea of ​​how much they can narrow down the results by selecting each object as a filter condition, which is also useful for deciding what kind of filtering to perform. In addition, the number of images containing each person in the people condition panel 322 can be displayed, allowing the camera crew to use this information as a reference when selecting images to include as many people as possible in the image album. This is particularly useful for selecting images of people who appear in a small number of images. The people condition panel 322 in the candidate tab 126 is also useful for checking the balance of the number of images containing each person in the images to be used in the image album.

[0402] In the embodiment, the image file from the imaging device 2 is transferred to the staff terminal 1, and the staff terminal 1 uploads it to the server device 4, but it is also possible for the imaging device 2 to upload it directly to the server device 4.

[0403] The processing of the staff terminal 1 in the embodiment, for example, all or part of the processing of Figures 12, 16 to 22, and 56 to 58, may be performed as cloud server processing by, for example, the server device 4 or another server device. All processing of the staff terminal 1 may be performed by the server device 4 or the like, and the staff terminal 1 may be used as a user interface device, and may only display UI images provided by the server device 4 or the like and detect operations.

[0404] In the embodiment, the description is based on the assumption that an image collection of still images is generated, but the image collection may include moving images as part of its content, or an image collection may be generated using multiple moving images. In either case, the processing described in the embodiment can be applied in the same way. In this case, the moving image may be a moving image with sound or a moving image with only image information without sound.

[0405] Furthermore, the imaging device 2 may function as an information processing device according to the embodiment and perform the processing of the staff terminal 1. Alternatively, the staff terminal 1 may have an imaging function and function as the imaging device 2.

[0406] The techniques of the present disclosure are not limited to processing images of wedding events, but are also useful for selecting images captured at sporting events, for example. In particular, if the sub-events and scenes of a sporting event can be divided by type of sport or by the order of athletes competing in an individual sport, the event view 200 will be an extremely convenient list display format for checking and selecting images. In the case of sports, a more appropriate event view 200 can be realized by changing the division conditions for sub-events and scenes by sport.

[0407] The program of the embodiment is a program that causes an information processing device such as a CPU or DSP, or a device including these, to execute the processes shown in FIGS. 12, 16 to 22, and 56 to 58. In other words, the program of the embodiment is a program that causes an information processing device to execute instruction processing regarding image distribution for image data captured at a specific event and transmitted to the server device 4, processing for managing evaluation information for the distributed images in association with the image data, and processing for filtering the image data using the evaluation information as a filtering condition.

[0408] With such a program, the staff terminal 1 that can improve selection efficiency using instructions for live gallery and evaluations of live gallery can be realized in, for example, a mobile terminal device, a personal computer, or other device capable of executing information processing. The cloud server may perform the processing of the staff terminal 1 using such a program.

[0409] The program that realizes such a staff terminal 1 or a cloud server that functions as a staff terminal 1 can be pre-recorded on a HDD as a recording medium built into a device such as a computer device, or on a ROM within a microcomputer having a CPU. Alternatively, the software may be temporarily or permanently stored (recorded) on a removable recording medium such as a flexible disk, a CD-ROM (Compact Disc Read Only Memory), an MO (Magneto Optical) disk, a DVD (Digital Versatile Disc), a Blu-ray Disc (registered trademark), a magnetic disk, a semiconductor memory, a memory card, etc. Such removable recording media may be provided as a so-called package software. Such a program can be installed onto a personal computer or the like from a removable recording medium, or can be downloaded from a download site via a network such as a LAN (Local Area Network) or the Internet.

[0410] Furthermore, such a program is suitable for widespread provision of the staff terminal 1 of the embodiment. For example, by downloading the program to a mobile terminal device such as a smartphone or tablet, an imaging device, a mobile phone, a personal computer, a still camera, a video camera, a game device, a video device, a PDA (Personal Digital Assistant), or the like, the smartphone or the like can function as the staff terminal 1 of the present disclosure.

[0411] The effects described in this specification are merely examples and are not limiting, and other effects may also be present.

[0412] This technology can also adopt the following configurations (1) to (20). (1) a distribution management unit that performs instruction processing regarding image distribution of image data captured at a specific event and transmitted to a server device; an event data management unit that manages evaluation information for the distributed images in association with the image data; a filtering processing unit that performs filtering processing on image data using the evaluation information as a filtering condition; Information processing device. (2) The distribution management unit performs processing of start and stop instructions regarding distribution images as the instruction processing. The information processing device according to (1) above. (3) The image distribution includes: The distribution is performed for image data captured between the time of the start instruction and the time of the stop instruction. The information processing device according to (2) above. (4) The image distribution includes: The delivery is performed for image data selected by the server device from image data captured between the time of the start instruction and the time of the stop instruction. The information processing device according to (2) or (3) above. (5) As the instruction process, the distribution management unit is capable of processing a restart instruction for the distribution image or processing an end instruction indicating the end of transfer of the distribution image after issuing the stop instruction. The information processing device according to any one of (2) to (4) above. (6) The distribution management unit performs a deletion instruction process for the distributed image as the instruction process. The information processing device according to any one of (1) to (5) above. (7) The event data management unit and performing a process of managing distribution information indicating that the image is distributed by the server device in association with the image data. An information processing device according to any one of (1) to (6) above. (8) The event data management unit For image data captured at the specific event, information indicating whether the image is a candidate for distribution by the server device or not is added to metadata, and then processing is performed to transmit the image data to the server device. The information processing device according to any one of (1) to (7) above. (9) The evaluation information is information based on input from viewers regarding the distributed image. An information processing device according to any one of (1) to (8) above. (10) A user interface control unit is provided that allows a plurality of types of filter conditions to be selected by operation and controls a user interface to present an image extracted by the filtering process executed by the filter processing unit based on the selected filter conditions. An information processing device according to any one of (1) to (9) above. (11) The user interface control unit The object can be selected as a filter condition, and the filtering processing unit performs control to present an image extracted by the filtering process performed using the object as a filter condition. The information processing device according to (10) above. (12) The user interface control unit A person can be selected as a filter condition, and the filter processing unit performs control to present an image extracted by the filtering process executed using the person as a filter condition. The information processing device according to (10) or (11) above. (13) The user interface control unit a first tab presenting the captured image; A second tab is displayed to display images that are candidates for inclusion in the image gallery among the captured images. A filter condition selectable on the first tab; Make the filter conditions selectable in the second tab different. The information processing device according to any one of (10) to (12) above. (14) the user interface control unit performs control to present a first tab that presents captured images and a second tab that presents images that are candidates for inclusion in the image album among the captured images; The filter conditions selected in the first tab and the filter conditions selected in the second tab are stored separately. The information processing device according to any one of (10) to (13) above. (15) The user interface control unit Controlling the display by switching between a first tab that displays captured images and a second tab that displays images that are candidates for inclusion in an image gallery among the captured images; When switching from the first tab to the second tab, the image is displayed without reflecting the filter conditions. The information processing device according to any one of (10) to (14) above. (16) the user interface control unit enables a filter on / off operation, and performs control to display an image that reflects the filtering process when the filter is on, and to display an image that does not reflect the filtering process when the filter is off; The set filter conditions are maintained even if the filter off operation is performed. The information processing device according to any one of (10) to (15) above. (17) the user interface control unit enables a reset operation of the filter conditions; The set filter conditions are initialized according to the reset operation. The information processing device according to any one of (10) to (16) above. (18) The user interface control unit Controls the display of the number of images extracted by the filtering process for each selectable filter condition. The information processing device according to any one of (10) to (17) above. (19) An instruction process for image distribution of image data captured at a specific event and transmitted to a server device; a process of managing evaluation information for the distributed image in association with the image data; a filtering process for the image data using the evaluation information as a filtering condition; An information processing method performed by an information processing device. (20) An instruction process for image distribution of image data captured at a specific event and transmitted to a server device; a process of managing evaluation information for the distributed image in association with the image data; a filtering process for the image data using the evaluation information as a filtering condition; A program that causes an information processing device to execute the above.

[0413] As described above, the staff terminal 1 in the embodiment performs both the management of live gallery distribution by the distribution management unit 35 and the filtering process for delivery by the event data management unit 30 and the filter processing unit 33. Alternatively, the management of live gallery distribution and the filtering process for delivery may be performed by a separate staff terminal 1. Therefore, the information processing device corresponding to the staff terminal 1 can also have the following configurations (101) and (102).

[0414] (101) An information processing device including a distribution management unit that performs instruction processing regarding image distribution of image data captured at a specific event and transmitted to a server device. (102) an event data management unit that manages evaluation information for images captured at a specific event and distributed to a server device by associating the evaluation information with the image data; a filtering processing unit that performs filtering processing on image data using the evaluation information as a filtering condition; Information processing device. [Explanation of symbols]

[0415] 1 Staff terminal 2. Imaging device 3. Personal Computers 4. Server equipment 5. Client terminal 6 Network 7 Remote participant terminals 30 Event Data Management Department 31 UI control section 32 Communication control section 33 Filter processing section 34 Image analysis unit 35 Distribution Management Department 60 Event Data 61 Pre-configuration information 62 Imaging and editing information table 63 Filter condition information 70 Information processing equipment 71 CPU 125 All Tab 126 Candidate Tab 300 Admin Panel 301 Start button 302 Stop button 303 Exit button 304 Resume button 316 Resume Upload Button 320 Rating Criteria Panel 321 Content Condition Panel 322 People Condition Panel 323 Camera Condition Panel 324 Other Condition Panel 350 Filter On / Off Button 370 Reset Button 371 Rating Condition Selection Section 372 Object Condition Selection Section 373 Person Condition Selection Section 374 Camera condition selection section 381 Archive Condition Button 382 Blink Condition Button 383 Delivery image conditions button 384 Evaluation image condition button 400 Live Gallery Viewing Screen

Claims

1. a distribution management unit that instructs the server device to process image data captured at a specific event and transmitted to the server device for image distribution; an event data management unit that manages evaluation information on the distributed images by viewers of the image distribution in association with the image data; a filter processing unit that is capable of filtering image data captured at the event using the evaluation information as a filtering condition. Information processing device.

2. The distribution management unit performs processing of start and stop instructions regarding distribution images as the instruction processing. The information processing device according to claim 1 .

3. The image distribution includes: The distribution is performed for image data captured between the time of the start instruction and the time of the stop instruction. The information processing device according to claim 2 .

4. The server device performs image analysis processing or AI processing to select images to be distributed from the images transmitted to the server device, The image distribution includes: The delivery is performed for the image data selected in the selection process in the server device from the image data captured between the time of the start instruction and the time of the stop instruction. The information processing device according to claim 2 .

5. As the instruction process, the distribution management unit is capable of processing a restart instruction for the distribution image or processing an end instruction indicating the end of transfer of the distribution image after issuing the stop instruction. The information processing device according to claim 2 .

6. The distribution management unit performs a process of issuing a deletion instruction for the distributed image as the instruction process. The information processing device according to claim 1 .

7. The event data management unit and performing a process of managing distribution information indicating that the image is distributed by the server device in association with the image data. The information processing device according to claim 1 .

8. The event data management unit For image data captured at the specific event, information indicating whether the image is a candidate for distribution by the server device or not is added to metadata, and then processing is performed to transmit the image data to the server device. The information processing device according to claim 1 .

9. The evaluation information is information based on input from viewers regarding the distributed image. The information processing device according to claim 1 .

10. A user interface control unit that allows a user to select a plurality of types of filter conditions including the evaluation information by operation and that controls a user interface to present an image extracted by the filtering process executed by the filter processing unit based on the selected filter conditions. The information processing device according to claim 1 .

11. The user interface control unit The object can be selected as a filter condition, and the filtering processing unit performs control to present an image extracted by the filtering process performed using the object as a filter condition. The information processing device according to claim 10.

12. The user interface control unit A person can be selected as a filter condition, and the filter processing unit performs control to present an image extracted by the filtering process executed using the person as a filter condition. The information processing device according to claim 10.

13. The user interface control unit a first tab presenting a captured image; and a second tab that presents images that are candidates for inclusion in the image album among the captured images. a filter condition selectable on the first tab; The filter conditions selectable in the second tab are different. The information processing device according to claim 10.

14. the user interface control unit performs control to present a first tab that presents captured images and a second tab that presents images that are candidates for inclusion in the image album among the captured images; The filter conditions selected in the first tab and the filter conditions selected in the second tab are stored separately. The information processing device according to claim 10.

15. The user interface control unit Controlling the display by switching between a first tab that displays captured images and a second tab that displays images that are candidates for inclusion in an image album from among the captured images; When switching from the first tab to the second tab, the image is displayed without reflecting the filter conditions. The information processing device according to claim 10.

16. the user interface control unit enables a filter on / off operation, and performs control to display an image that reflects the filtering process when the filter is on, and to display an image that does not reflect the filtering process when the filter is off; The set filter conditions are maintained even if the filter off operation is performed. The information processing device according to claim 10.

17. the user interface control unit enables a reset operation of the filter conditions; The set filter conditions are initialized according to the reset operation. The information processing device according to claim 10.

18. The user interface control unit Controls the display of the number of images extracted by the filtering process for each selectable filter condition. The information processing device according to claim 10.

19. An instruction process to the server device regarding image distribution of image data captured at a specific event and transmitted to the server device; a process of managing evaluation information on the distributed image by viewers of the image distribution in association with the image data; filtering image data captured at the event using the evaluation information as a filtering condition; An information processing method performed by an information processing device.

20. An instruction process to the server device regarding image distribution of image data captured at a specific event and transmitted to the server device; a process of managing evaluation information on the distributed image by viewers of the image distribution in association with the image data; filtering image data captured at the event using the evaluation information as a filtering condition; A program that causes an information processing device to execute the above.

Images