Server device, system, server device control method and program

Abstract

Provided is a server device which contributes to increasing attractiveness of a sight-seeing area, etc. This server device is provided with a storage unit, an acquisition image control unit, an album creation unit, and a preferential treatment processing execution unit. The storage unit stores biological information on an album creation applicant. The acquisition image control unit receives image data from an imaging terminal. The acquisition image control unit executes collation processing using the stored biological information and biological information extracted from the received image data. The acquisition image control unit determines whether the album creation applicant is imaged in the received image data by the collation processing, and stores information regarding the image data in which the album creation applicant is imaged. The album creation unit allows the album creation applicant to select image data to be adopted for an album from pieces of image data in which the album creation applicant is imaged, and creates the album using the image data selected by the album creation applicant. The preferential treatment processing execution unit performs processing for preferentially treating an entity that has installed the imaging terminal that has provided the image data adopted for the album.

Description

[Technical Field]

[0001] The present invention relates to a server device, a system, a method for controlling a server device, and a storage medium. [Background technology]

[0002] 2. Description of the Related Art There is a system in which a user is photographed by a photographing device installed at a tourist spot or the like, and image data acquired by the photographing is provided to the user.

[0003] For example, Patent Document 1 describes an image provision system that holds a photo rally in which users are automatically photographed at multiple locations in a tourist spot or the like, and provides the photographed images after the rally is over. The image provision system in Patent Document 1 includes multiple photography systems and a server communicably connected to the multiple photography systems. The multiple photography systems each have a photography unit that photographs the user, a communication unit that transmits the photographed image data and identification information that identifies the user to the server, and a display unit that presents information to the user. The server generates an image to be provided to the user using at least a portion of the photographed image data received from the multiple photography systems. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Publication No. 2018-098755 Summary of the Invention [Problem to be solved by the invention]

[0005] As shown in Patent Document 1, efforts are being made to install photographic devices (cameras) at tourist spots to enhance the attractions of those spots. However, the installation of the photographic devices requires costs, and there is a problem in that installation of the photographic devices will not progress unless the installers are motivated.

[0006] It should be noted that this problem cannot be solved by applying the technology disclosed in the above-mentioned Patent Document 1. Patent Document 1 does not take into consideration the installation costs of the imaging device.

[0007] A primary object of the present invention is to provide a server device, a system, a method for controlling a server device, and a storage medium that contribute to increasing the appeal of tourist destinations and the like. [Means for solving the problem]

[0008] According to a first aspect of the present invention, there is provided a server device comprising: a memory unit that stores biometric information of an album production applicant; an acquired image control unit that receives image data from at least one or more photography terminals and determines whether the album production applicant is depicted in the received image data by performing a matching process using the stored biometric information and biometric information extracted from the received image data, and stores information regarding the image data in which the album production applicant is depicted; an album production unit that allows the album production applicant to select image data to be used in the album from at least one or more image data in which the album production applicant is depicted, and creates the album using the image data selected by the album production applicant; and a preferential processing execution unit that performs processing to give preferential treatment to the entity that installed the photography terminal that provided the image data adopted in the album.

[0009] According to a second aspect of the present invention, there is provided a system including at least one photography terminal installed at a photography point in a tourist destination, and a server device, wherein the server device is equipped with: a memory unit that stores biometric information of an album production applicant; an acquired image control unit that receives image data from the at least one photography terminal, and determines whether the album production applicant is depicted in the received image data by a matching process using the stored biometric information and biometric information extracted from the received image data, and stores information regarding the image data in which the album production applicant is depicted; an album production unit that allows the album production applicant to select image data to be used in the album from at least one image data in which the album production applicant is depicted, and creates the album using the image data selected by the album production applicant; and a preferential processing execution unit that performs processing to give preferential treatment to the installation entity of the photography terminal that provided the image data adopted in the album.

[0010] According to a third aspect of the present invention, there is provided a control method for a server device, which includes a memory unit that stores biometric information of an album production applicant, receives image data from at least one photography terminal, determines whether the album production applicant is depicted in the received image data by performing a matching process using the stored biometric information and biometric information extracted from the received image data, stores information regarding the image data in which the album production applicant is depicted, allows the album production applicant to select image data to be used in the album from at least one image data in which the album production applicant is depicted, creates the album using the image data selected by the album production applicant, and performs a process that gives preferential treatment to the entity that installed the photography terminal that provided the image data used in the album.

[0011] According to a fourth aspect of the present invention, there is provided a computer-readable storage medium for storing a program for causing a computer mounted on a server device, the computer having a memory unit for storing biometric information of an album production applicant, to execute the following processes: receiving image data from at least one or more photography terminals, determining whether the album production applicant is depicted in the received image data by a matching process using the stored biometric information and biometric information extracted from the received image data, and storing information regarding the image data in which the album production applicant is depicted; allowing the album production applicant to select image data to be used in the album from at least one or more image data in which the album production applicant is depicted, and producing the album using the image data selected by the album production applicant; and giving preferential treatment to the entity that installed the photography terminal that provided the image data used in the album. [Effects of the Invention]

[0012] According to each aspect of the present invention, a server device, a system, a method for controlling a server device, and a storage medium are provided that contribute to increasing the appeal of tourist destinations, etc. Note that the effects of the present invention are not limited to those described above. The present invention may achieve other effects instead of or in addition to the effects described above. [Brief explanation of the drawings]

[0013] [Figure 1] FIG. 1 is a diagram for explaining an outline of an embodiment. [Figure 2] FIG. 2 is a flowchart illustrating the operation of one embodiment. [Figure 3] FIG. 3 is a diagram illustrating an example of a schematic configuration of an information processing system according to the first embodiment. [Figure 4] FIG. 4 is a diagram illustrating the operation of the information processing system according to the first embodiment. [Figure 5] FIG. 5 is a diagram for explaining the operation of the information processing system according to the first embodiment. [Figure 6]FIG. 6 is a diagram illustrating an example of a processing configuration of the signage according to the first embodiment. [Figure 7] FIG. 7 is a diagram illustrating an example of a signage display according to the first embodiment. [Figure 8] FIG. 8 is a diagram illustrating an example of a processing configuration of a server device according to the first embodiment. [Figure 9] FIG. 9 is a diagram illustrating an example of the applicant information database according to the first embodiment. [Figure 10] FIG. 10 is a flowchart showing an example of the operation of the captured image control unit according to the first embodiment. [Figure 11] FIG. 11 is a sequence diagram illustrating an example of the operation of the information processing system according to the first embodiment. [Figure 12] FIG. 12 is a diagram illustrating an example of a display on a terminal according to the second embodiment. [Figure 13] FIG. 13 is a diagram illustrating an example of the applicant information database according to the second embodiment. [Figure 14] FIG. 14 is a diagram illustrating an example of a processing configuration of a server device according to the third embodiment. [Figure 15] FIG. 15 is a diagram illustrating an example of a preference information database according to the third embodiment. [Figure 16] FIG. 16 is a diagram illustrating an example of a hardware configuration of a server device according to the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0014] First, an overview of one embodiment will be described. Note that the reference numerals in the drawings are added to each element for convenience as an example to facilitate understanding, and the description of this overview is not intended to be limiting in any way. Furthermore, unless otherwise specified, the blocks shown in each drawing represent functional units, not hardware units. Connection lines between blocks in each drawing include both bidirectional and unidirectional lines. Unidirectional arrows are used to schematically indicate the flow of main signals (data) and do not exclude bidirectionality. Note that in this specification and drawings, elements that can be similarly described may be assigned the same reference numerals to avoid redundant explanation.

[0015] The server device 100 according to one embodiment includes a storage unit 101, an acquired image control unit 102, an album creation unit 103, and a preferential treatment processing execution unit 104 (see FIG. 1). The storage unit 101 stores biometric information of an album creation applicant (step S1 in FIG. 2). The acquired image control unit 102 receives image data from at least one or more photography terminals (step S2). The acquired image control unit 102 executes a matching process using the stored biometric information and biometric information extracted from the received image data (step S3). The acquired image control unit 102 determines, through the matching process, whether the album creation applicant is included in the received image data, and stores information about the image data in which the album creation applicant is included (applicant image information, described below) (step S4). The album creation unit 103 allows the album creation applicant to select image data to be used in the album from at least one or more image data in which the album creation applicant is included, and creates the album using the image data selected by the album creation applicant (step S5). The preferential treatment execution unit 104 performs a process of giving preferential treatment to the entity that installed the photographing terminal that provided the image data adopted in the album (step S6).

[0016] The server device 100 extracts image data of the album creation applicant from image data captured by photographic devices (signage 20 and camera devices 30, described below) installed at various locations in the tourist destination and presents the extracted image data to the applicant. The server device 100 performs a process to provide preferential treatment to the installer of the photographic device that captured the image data selected by the album creation applicant. For example, the server device 100 pays all or a portion of the album production fee received from the user to the installer of the photographic device that captured the image data selected by the album creation applicant. As a result, a large amount of distribution money is paid to a business that installs a photographic device that captures image data selected by many users. In other words, a business that cooperates in installing a photographic device is given an incentive according to the number of photos used in the album. In other words, providing attractive photos to users leads to profits for the business that installs the photographic device. If profits lead to profits for the business, each business in the tourist destination will install a photographic device in a location where better photos can be taken. If better photos are taken and more satisfying albums are provided to users, the reputation of the tourist destination will improve, leading to the revitalization of the area. In this way, the server device 100 realizes a virtuous cycle of revitalizing the local economy and the tourist destination.

[0017] Specific embodiments will be described in more detail below with reference to the drawings.

[0018] [First embodiment] The first embodiment will be described in more detail with reference to the drawings.

[0019] [System Configuration] Fig. 3 is a diagram showing an example of a schematic configuration of an information processing system (album production system) according to the first embodiment. As shown in Fig. 3, the information processing system includes a server device 10, signages 20-1 to 20-4, and camera devices 30-1 to 30-3.

[0020] In the following description, unless there is a particular reason to distinguish between the signages 20-1 to 20-4, they will simply be referred to as "signage 20." Similarly, for other elements, the reference numeral to the left of the hyphen will represent the element.

[0021] The information processing system according to the first embodiment is operated for the purpose of revitalizing tourist destinations. The information processing system realizes the revitalization of tourist destinations by improving the satisfaction of users (tourists) who visit the destinations.

[0022] More specifically, the information processing system provides a service related to "album production" to tourists who visit tourist spots and take part in tours (cycling tours) that take them around scenic spots by bicycle or the like.

[0023] Users who participate in a cycling tour can request the creation of an album from organizations, businesses, etc. related to the tourist destination. Specifically, users can apply for a service to create an electronic album (digital photo album) using photos taken at photography points set up at various locations from the start of the cycling tour to the finish line.

[0024] Examples of organizations and businesses related to tourist destinations include tourist associations, travel agencies, tourism businesses, etc. Users can apply for album production to tourist associations or at the contract desk of a travel agency.

[0025] The photography points may be various locations, such as the starting point of a cycling tour, scenic spots along the route (coasts, cliffs, lakeside, etc.), rest areas, retail stores selling souvenirs, difficult cycling spots such as uphill sections, and the finish line.

[0026] Signage 20 and camera devices 30 are installed at each of the above-mentioned photography points. For example, in the example of Fig. 3, signage 20-1 is installed at the start point, and signage 20-2 is installed at the finish point. Also, signage 20-3 is installed by the lake, and signage 20-4 is installed next to a retail store. Furthermore, camera devices 30 are installed at various points along the cycling course.

[0027] Each signage 20 installed at the photography point photographs a predetermined area periodically or at a predetermined timing, and transmits the obtained image data to the server device 10. Similarly, a camera device 30 installed at the photography point photographs a predetermined area periodically or at a predetermined timing, and transmits the obtained image data to the server device 10.

[0028] In the following description, the signage 20 and the camera device 30 may be collectively referred to as the "photographing terminal."

[0029] Here, the photography terminals (signage 20, camera device 30) at the photography points are installed at the expense of businesses operating in tourist destinations. More specifically, the photography terminals are installed by businesses that support the revitalization of tourist destinations or businesses that manage tourist resources.

[0030] For example, the signage 20-1 is installed at the expense of a retail store operating near the starting point, or the camera devices 30 installed at various locations along the cycling course are installed at the expense of a lodging business (hotel business) operating in a tourist spot.

[0031] The server device 10 is a device that mainly controls and manages the production of the album. The server device 10 may be installed in the same building as the tourist association or the like, or may be installed on a network (on the cloud).

[0032] The devices shown in Fig. 3 are interconnected. For example, the server device 10 and the photographing terminals (signage 20, camera device 30) are connected by wired or wireless communication means and configured to be able to communicate with each other. Note that in Fig. 3, some of the connection lines connecting the server device 10 and the photographing terminals are not shown.

[0033] The configuration of the information processing system shown in Fig. 3 is an example and is not intended to be limiting. For example, the information processing system may include multiple server devices 10. Furthermore, it goes without saying that the number of signage devices 20 and camera devices 30 installed in a tourist spot (cycling course) is not limited to the configuration in Fig. 3.

[0034] [General operation] Next, the general operation of the information processing system according to the first embodiment will be described.

[0035] <Application for album production> First, a user participating in a cycling tour applies for album production to a tourist association or the like of a tourist spot. For example, the user operates terminal 40 to access a WEB page provided by server device 10.

[0036] On the web page, the user inputs information necessary for creating an album into the server device 10 (see FIG. 4). Specifically, the user registers personal information (such as name, gender, telephone number, email address, and bank account information) and biometric information into the server device 10.

[0037] Examples of biometric information include data (features) calculated from physical characteristics unique to an individual, such as a face, fingerprint, voiceprint, veins, retina, and iris pattern. Alternatively, the biometric information may be image data such as a face image or fingerprint image. The biometric information may be any information that includes the user's physical characteristics. In this disclosure, a case where biometric information related to a person's "face" (a face image or features generated from a face image) is used will be described.

[0038] 4, the user inputs requests for album production (hereinafter referred to as album production information) into the server device 10. For example, the user inputs information regarding how many photos to use in producing the album into the server device 10. The fee varies depending on the number of photos used in the album.

[0039] When the server device 10 acquires personal information, biometric information, album production information, etc. from a user, it generates a user ID for identifying the user. The server device 10 associates the generated user ID with the personal information, biometric information, album production information, etc. and stores them in an applicant information database. The applicant information database will be described in detail later.

[0040] When the server device 10 has successfully settled the album production fee using the account information (bank account information, credit card account information) input by the user, it notifies the user that the application for album production has been completed.

[0041] In the following description, a user who applies for the production of an album will be referred to as an "album production applicant" or simply as an "applicant."

[0042] <Photo collection> The server device 10 collects photos to be used for album production (materials for the album, candidates for photos to be used in the album) from photography terminals installed at various locations in the tourist spot (cycling course).

[0043] When each photographing terminal acquires image data, it transmits the acquired image data and the terminal ID to the server device 10. The terminal ID is an ID for identifying the photographing terminals installed at various locations in the tourist destination. The terminal ID can be the MAC (Media Access Control) address or IP (Internet Protocol) address of the photographing terminal.

[0044] The server device 10 extracts biometric information from image data acquired from the photographing terminal (signage 20, camera device 30). The server device 10 performs a matching process using the extracted biometric information (face image) and biometric information registered in the applicant information database, and identifies the album production applicant who appears in the image data.

[0045] The server device 10 associates the applicant identified by the matching process with information about image data in which the applicant appears (hereinafter referred to as applicant image information) and stores them in the applicant information database. The applicant image information includes an image ID that identifies the image data, the photographing point where the applicant was photographed, the photographing date and time, etc.

[0046] The server device 10 executes the above process every time it acquires image data from the photographing terminal, and collects image data in which the applicant appears.

[0047] In this way, the server device 10 extracts image data in which the user who requested the album production appears from the image data acquired from the photographing terminals installed at various locations in the tourist destination. More specifically, the server device 10 extracts image data in which the album production applicant appears from the image data taken between the start point and the finish point.

[0048] <Album production> The server device 10 presents the photos (image data) collected for the album to the album applicant when the user finishes the cycling tour, etc. For example, if the applicant appears in image data taken by the signage 20-2 installed at the finish point, the server device 10 determines that the cycling tour has ended and presents the applicant with a photo in which the applicant appears.

[0049] For example, the server device 10 sends the URL (Uniform Resource Locator) of a web page for viewing the photos collected for creating the album to the email address previously registered by the applicant (an email address that can be received by the terminal 40).

[0050] When the applicant accesses the web page at the above URL, the server device 10 displays a GUI (Graphical User Interface) that allows the applicant to select image data to be included in the album. For example, the server device 10 displays a GUI such as that shown in FIG. 5 on the applicant's terminal 40.

[0051] The server device 10 creates an album using the image data selected by the user, and transmits the created album to the terminal 40 carried by the user.

[0052] In this way, when the tourist (applicant for album creation) arrives at the finish point, the server device 10 displays a list of image data taken during the cycling tour on the user's terminal 40. The applicant selects photos to use in the album from the displayed list. The server device 10 creates an album using the selected photos and submits (delivers) it to the applicant.

[0053] <Revenue sharing> When the album is submitted to the applicant, the server device 10 performs post-processing related to the album production. Specifically, the server device 10 performs processing to give preferential treatment to the entity that installed the photography terminal that provided the image data used in the album.

[0054] As described above, when a user applies for the production of an album, the user pays an album production fee to a tourism association, etc. The tourism association, etc. distributes (returns) all or part of the album production fee to the business operator who paid for the installation costs of the photography terminal. At that time, the tourism association (server device 10) pays the distribution amount in a way that gives preferential treatment to the manager and installer of the photography terminal that captured the image data that the applicant used in the electronic album.

[0055] As a result, businesses that install photography devices that capture the image data selected by many users will receive large dividends. In other words, providing users with attractive photos leads to profits for businesses that install photography devices. If this leads to profits for businesses, each business in a tourist destination will be motivated to install photography devices in locations where better photos can be taken, or to install photography devices that can take photos in collaboration with the tourist destination's characters. If better photos are taken and users are provided with fulfilling albums, the reputation of the tourist destination will improve, leading to the revitalization of the area.

[0056] Next, details of each device included in the information processing system according to the first embodiment will be described.

[0057] [Signage] 6 is a diagram illustrating an example of a processing configuration (processing module) of the signage 20 according to the first embodiment. Referring to FIG. 6, the signage 20 includes a communication control unit 201, a message output unit 202, an image capture control unit 203, and a storage unit 204.

[0058] The communication control unit 201 is a means for controlling communication with other devices. For example, the communication control unit 201 receives data (packets) from the server device 10. The communication control unit 201 also transmits data to the server device 10. The communication control unit 201 passes data received from other devices to other processing modules. The communication control unit 201 transmits data acquired from other processing modules to other devices. In this way, other processing modules transmit and receive data to and from other devices via the communication control unit 201. The communication control unit 201 has a function as a receiving unit that receives data from other devices and a function as a transmitting unit that transmits data to other devices.

[0059] The message output unit 202 is a means for outputting a predetermined message, and displays a message on a liquid crystal display or the like according to the location (photography point) where the device itself is installed.

[0060] For example, the message output unit 202 of the signage 20-1 installed at the starting point of the cycling tour outputs a message welcoming participation in the cycling tour, or the message output unit 202 of the signage 20-2 installed at the finishing point of the cycling tour outputs a message congratulating participants on completing the cycling tour.

[0061] The photographing control unit 203 is a means for controlling a camera device (a camera device provided in the signage 20; not shown) and photographing a predetermined area. Specifically, the photographing control unit 203 detects the presence of a person in front of its own device based on the output signal of a human sensor and image data obtained from the camera device. When a person is detected, the photographing control unit 203 photographs the predetermined area while displaying a message determined for each photographing point on a liquid crystal display or the like.

[0062] The photographing control unit 203 acquires image data by photographing the predetermined area. For example, the photographing control unit 203 displays as shown in Fig. 7 and acquires image data. In Fig. 7, the photographed image data is displayed together with a message.

[0063] The photographing control unit 203 transmits the acquired image data and the terminal ID to the server device 10.

[0064] The terminal IDs are shared between the server device 10 and each photographing terminal by any method. For example, a system administrator determines a terminal ID and sets the determined terminal ID in the server device 10. The system administrator also sets the determined terminal ID in each photographing terminal.

[0065] The storage unit 204 is a means for storing information necessary for the operation of the signage 20.

[0066] [Camera equipment] A description of the configuration and operation of the camera device 30 will be omitted because the configuration and operation of the camera device 30 will be clear to those skilled in the art. The camera device 30 simply takes an image of a predetermined area periodically or at a predetermined timing, and transmits the obtained image data and terminal ID to the server device 10.

[0067] [Device] Examples of the terminal 40 include a smartphone, a mobile phone, a game console, a mobile terminal device such as a tablet, a computer (personal computer, laptop computer), etc. The terminal 40 can be any equipment or device that can accept user operations and communicate with the server device 10, etc. Furthermore, the configuration of the terminal 40 is clear to those skilled in the art, so a detailed description thereof will be omitted.

[0068] [Server device] 8 is a diagram showing an example of a processing configuration (processing module) of the server device 10 according to the first embodiment. Referring to FIG. 8, the server device 10 includes a communication control unit 301, an application control unit 302, an acquired image control unit 303, an album creation unit 304, a preferential treatment processing execution unit 305, and a storage unit 306.

[0069] The communication control unit 301 is a means for controlling communication with other devices. For example, the communication control unit 301 receives data (packets) from the signage 20. The communication control unit 301 also transmits data to the signage 20. The communication control unit 301 passes data received from other devices to other processing modules. The communication control unit 301 transmits data acquired from other processing modules to other devices. In this way, other processing modules transmit and receive data to and from other devices via the communication control unit 301. The communication control unit 301 has a function as a receiving unit that receives data from other devices and a function as a transmitting unit that transmits data to other devices.

[0070] The application control unit 302 is a means for controlling applications for digital album production from users. For example, when a user operates the terminal 40 and selects "apply for album production" on a web page provided by the server device 10, the application control unit 302 displays a GUI such as that shown in FIG. 4 on the terminal 40.

[0071] The applicant for album production operates the terminal 40 to input the information shown in Fig. 4. After completing the information input, the applicant presses the "OK" button and inputs personal information (name, sex, age, contact details, etc.), biometric information (for example, a facial image), album production information (for example, the number of photos to be used in the album), etc. into the server device 10.

[0072] When the application control unit 302 acquires the face image, it generates a feature amount from the face image.

[0073] Since existing technology can be used for the process of generating feature amounts, detailed explanations thereof will be omitted. For example, the application control unit 302 extracts the eyes, nose, mouth, etc. from the facial image as feature points. Then, the application control unit 302 calculates the positions of each feature point and the distances between each feature point as feature amounts, and generates a feature vector (vector information that characterizes the facial image) consisting of multiple feature amounts.

[0074] Furthermore, the application control unit 302 performs a settlement process for the album production fee using the account information acquired from the user. The application control unit 302 charges the payment of the album production fee to the credit card account or the like described in the account information.

[0075] The application control unit 302 generates a user ID for identifying the applicant. The user ID may be any information that can uniquely identify the user requesting album production. For example, the application control unit 302 may assign a unique value as the user ID each time an application for album production is accepted.

[0076] The application control unit 302 associates the generated user ID, biometric information (feature amount), personal information, album production information, etc. and stores them in the applicant information database (see FIG. 9). Note that the applicant information database shown in FIG. 9 is an example and is not intended to limit the items to be stored.

[0077] The acquired image control unit 303 is a means for controlling the images acquired from the photographing terminals (signage 20, camera device 30).

[0078] The acquired image control unit 303 receives image data from at least one or more photographing terminals and executes a matching process using pre-stored biometric information and biometric information extracted from the received image data. The acquired image control unit 303 determines through the matching process whether the album production applicant appears in the received image data, and stores information regarding the image data in which the album production applicant appears.

[0079] 10 is a flowchart showing an example of the operation of the acquired image control unit 303 according to the first embodiment. The operation of the acquired image control unit 303 will be described with reference to FIG.

[0080] When the acquired image control unit 303 acquires image data and a terminal ID from the photographing terminal, it attempts to extract a face image from the image data (extraction of face image; step S101).

[0081] Note that since existing technology can be used for the facial image extraction process by the acquired image control unit 303, detailed description thereof will be omitted. For example, the acquired image control unit 303 may extract a facial image (facial region) from image data using a learning model trained by a CNN (Convolutional Neural Network). Alternatively, the acquired image control unit 303 may extract a facial image using a method such as template matching.

[0082] If a face image cannot be extracted from the image data (step S102, No branch), the acquired image control unit 303 does not perform any particular process.

[0083] If a facial image can be extracted from the image data (step S102, Yes branch), the acquired image control unit 303 performs a matching process using the biometric information extracted from the image data and the biometric information stored in the applicant information database (step S103).

[0084] The acquired image control unit 303 generates feature quantities from the extracted face image. The acquired image control unit 303 sets the generated feature quantities as the object of matching, and performs matching processing (1:N matching; N is a positive integer, the same applies below) with the feature quantities registered in the applicant information database.

[0085] The acquired image control unit 303 calculates the similarity between the feature to be matched and each of the multiple feature values ​​on the registration side. The similarity can be calculated using chi-square distance, Euclidean distance, or the like. Note that the greater the distance, the lower the similarity, and the closer the distance, the higher the similarity.

[0086] The acquired image control unit 303 determines that the matching process has failed if there is no feature among the multiple feature amounts registered in the applicant information database whose similarity with the feature amount to be matched is equal to or greater than a predetermined value.

[0087] The acquired image control unit 303 determines that the matching process is successful if there is a feature among the multiple feature amounts registered in the applicant information database that has a similarity with the feature amount to be matched that is equal to or greater than a predetermined value.

[0088] If the matching process fails (step S104, No branch), the acquired image control unit 303 does not perform any particular process.

[0089] If the matching process is successful (step S104, Yes branch), the acquired image control unit 303 adds the applicant image information to the entry with the highest similarity (step S105). Specifically, the acquired image control unit 303 adds the image ID of the image data from which the facial image has been extracted, the shooting point derived based on the terminal ID received from the shooting terminal, the shooting date and time, etc., to the entry identified by the matching process as "applicant image information."

[0090] The image ID is an ID that identifies image data that the album creation applicant is photographed in. The acquired image control unit 303 stores the image ID in association with the storage location of the image data corresponding to the image ID.

[0091] Furthermore, the acquired image control unit 303 refers to table information that stores the terminal ID and the name of the photography point where the photography terminal is installed in association with each other, and acquires the photography point based on the terminal ID.

[0092] The acquired image control unit 303 repeats the above process for each person appearing in the image data. For example, if multiple album production applicants are appearing in one piece of image data, the acquired image control unit 303 adds applicant image information for each of the multiple album production applicants to the corresponding entry in the applicant information database.

[0093] The album production unit 304 is a means for producing an album related to the album production applicant. The album production unit 304 allows the album production applicant to select image data to be used in the album from at least one image data in which the album production applicant appears. The album production unit 304 produces an album using the image data selected by the album production applicant.

[0094] The album production unit 304 accesses the applicant information database periodically or at a predetermined timing to identify applicants who have completed the cycling tour. For example, the album production unit 304 determines that an applicant photographed by the signage 20-2 installed at the finish line has completed the cycling tour.

[0095] For example, if the photographing point "Finish Point" corresponding to signage 20-2 is stored in the applicant image information field, album production unit 304 determines that the applicant of the corresponding entry has completed the cycling tour.

[0096] The album production unit 304 guides the applicant who has completed the cycling tour to a web page for selecting image data to be used in the electronic album. Specifically, the album production unit 304 transmits the URL of the web page to the terminal 40 of the applicant who has completed the cycling tour.

[0097] The applicant operates the terminal 40 to access the web page at the above URL. In response to the applicant's access, the album production unit 304 creates a web page that allows the applicant to select photos (image data) to use in the electronic album, and displays it on the terminal 40. The album production unit 304 displays the image data in which the album production applicant appears in a predetermined order on the terminal 40, allowing the album production applicant to select the image data to use in the album.

[0098] For example, the album creation unit 304 creates a web page as shown in Fig. 5. As shown in Fig. 5, the album creation unit 304 accesses the applicant information database and displays a list of image data in which the applicant appears (image data whose image ID is stored in the applicant image information field in the applicant's entry) in chronological order.

[0099] The album production unit 304 may reduce the original image data and display it as a thumbnail image on the selection screen for the adopted photo as shown in Fig. 5, and the applicant may touch the thumbnail image to enlarge the thumbnail image. In this way, the album production unit 304 may provide an interface that improves the convenience of the user on the selection screen for the adopted photo.

[0100] Furthermore, the album production unit 304 acquires the number of albums adopted by the applicant for album production by referring to the applicant information database, subtracts the number of selected images from the stored number, and displays the remaining number of images that the applicant can select.

[0101] When the applicant has finished selecting photos (when the confirm button shown in FIG. 5 is pressed), the album creation unit 304 creates an electronic album by storing the image data selected by the applicant in a file in a predetermined format. The album creation unit 304 creates an electronic album that is compatible with the application for viewing electronic albums that is installed on the terminal 40.

[0102] The album production section 304 delivers the produced album to the applicant. Specifically, the album production section 304 transmits the album to the terminal 40 possessed by the applicant.

[0103] The preferential treatment execution unit 305 is a means for performing a process of giving preferential treatment to the entity that installed the photography terminal that provided the image data used in the album. For example, the preferential treatment execution unit 305 determines the distribution destination of the album production fee paid by the album production applicant so as to give preferential treatment to the entity that installed the photography terminal that provided the image data used in the album.

[0104] In this way, the preferential treatment processing execution unit 305 controls the distribution of all or part of the album production fee received from the album production applicant to the parties involved in the information provision system. The preferential treatment processing execution unit 305 determines the distribution amount to each installer so as to give preferential treatment to the installer of the photography terminal that provided the image data used by the applicant in the electronic album.

[0105] For example, the preferential treatment processing execution unit 305 counts the number of photos adopted in the electronic album for each installation company of the photography terminal. After that, the preferential treatment processing execution unit 305 divides the album production fee proportionally according to the number of photos for each installation company, and determines the distribution amount to be paid to the installation company of the photography terminal.

[0106] For example, consider a case where three businesses, Business A, Business B, and Business C, install photography devices at a photography point, and photos taken by Business A's and Business B's photography devices are used in an album. Furthermore, suppose three photos are selected from the photography device installed by Business A, and one photo is selected from the photography device installed by Business B. In this case, 75% of the album production fee is paid to Business A, and 25% of the album production fee is paid to Business B.

[0107] Alternatively, the preferential treatment processing execution unit 305 may deduct the system operating costs to be paid to the tourist association from the photo album fee and use the remaining photo album fee as the source of funds to be distributed to each installation business. Alternatively, the preferential treatment processing execution unit 305 may distribute a predetermined percentage of the photo album fee equally to each installation business, and distribute the remaining photo album fee so that the installation business of the photography terminal that took the photo adopted by the applicant is given preferential treatment.

[0108] Note that a description will be omitted regarding the dividend payment process by the preferential treatment process execution unit 305. The preferential treatment process execution unit 305 may transfer the dividend to be paid to each business operator to the bank account or the like of each business operator at a predetermined timing (for example, at the end of the month, etc.).

[0109] The storage unit 306 is a means for storing information necessary for the operation of the server device 10. An applicant information database is constructed in the storage unit 306. The applicant information database stores biometric information of the applicant for album production.

[0110] [System Operation] Next, the operation of the information processing system according to the first embodiment will be described. Note that a description of the operation relating to an application for creating an electronic album will be omitted. Fig. 11 is a sequence diagram showing an example of the operation of the information processing system according to the first embodiment.

[0111] When the signage 20 captures an image of the user, the signage 20 transmits image data obtained by the image capture to the server device 10 (step S01).

[0112] The camera device 30 photographs a predetermined area periodically or at a predetermined timing, and transmits the obtained image data to the server device 10 (step S02).

[0113] The server device 10 extracts a facial image from the image data obtained from the photographing terminal (signage 20, camera device 30) and performs a matching process using the extracted facial image and the biometric information stored in the applicant information database (step S03).

[0114] The server device 10 identifies the applicant appearing in the image data through the matching process, and adds the applicant image information to the entry of the identified applicant (entry in the applicant information database) (step S04).

[0115] Signage 20, camera device 30, and server device 10 repeat the operations of steps S01 to S04.

[0116] When the user finishes the cycling tour, the server device 10 displays a selection screen for the applicant to select an accepted photo on the terminal 40 (selection display of accepted photo; step S11).

[0117] When the photos selected by the applicant are acquired, the server device 10 creates an album and transmits it to the applicant's terminal 40 (step S12).

[0118] <Modification 1 of the First Embodiment> In the above embodiment, it has been explained that the server device 10 (acquired image control unit 303) generates applicant image information from image data in which the album production applicant appears, and stores the generated applicant image information in the applicant information database.

[0119] The acquired image control unit 303 may extract more information by analyzing image data in which the applicant appears, and store the extracted information in the applicant information database as applicant image information.

[0120] For example, if a person in the image data is the applicant for album creation (if the matching process using biometric information is successful), the acquired image control unit 303 may digitize the facial expression of the person. More specifically, the acquired image control unit 303 may calculate a "smile score" that digitizes the degree of the applicant's smile.

[0121] The acquired image control unit 303 acquires a smile score using a learning model that outputs a smile score when a face image is input. The learning model is generated by machine learning using training data in which labels (smile scores) are assigned to image data. Any algorithm such as a support vector machine, boosting, or neural network can be used to generate the learning model. Note that known techniques can be used for the algorithms such as the support vector machine, and therefore a description thereof will be omitted.

[0122] The acquired image control unit 303 stores the calculated smile score together with the image ID and the like in the applicant information database.

[0123] Alternatively, the acquired image control unit 303 may digitize the natural facial expression of the album production applicant. For example, the acquired image control unit 303 may input image data into a learning model to calculate an "expression score" that digitizes the natural facial expression, and store the expression score together with the image ID, etc. in the applicant information database.

[0124] The acquired image control unit 303 may store the size of the applicant's facial image shown in the image data as applicant image information in the applicant information database. The acquired image control unit 303 may also calculate the area of ​​the applicant's facial region and store this area as applicant image information in the applicant information database.

[0125] The acquired image control unit 303 may calculate the number of people who appear in the same image data as the album production applicant and store the calculated number as applicant image information in the applicant information database. The acquired image control unit 303 may also store the number of face images of people other than the applicant extracted from the image data in the applicant information database.

[0126] The acquired image control unit 303 may quantify the quality of the image data as a "quality score" and store the quality score in the applicant information database as applicant image information. For example, the acquired image control unit 303 may perform a fast Fourier transform or the like on the image data to determine whether the image data is in focus, and set a low quality score for out-of-focus photos. Alternatively, the acquired image control unit 303 may calculate the brightness of the image data as the quality score, or may calculate the quality score from the focus and brightness.

[0127] <Modification 2 of the First Embodiment> In the first embodiment, the server device 10 (album production unit 304) displays the image data in the order in which they were photographed when displaying a screen for selecting photos to be used in an album to an album production applicant who has completed a cycling tour. However, the album production unit 304 may determine the order in which the image data are presented to the applicant in a manner other than the order in which they were photographed.

[0128] For example, the album creating unit 304 may arrange the image data in which the album creation applicant appears based on the attributes of the applicant (e.g., gender, age, etc.). That is, the album creating unit 304 may determine the order in which the image data are displayed in a list based on the attributes of the applicant.

[0129] For example, for a male applicant, the album production unit 304 displays image data from the start point to the finish point in order, whereas for a female applicant, the album production unit 304 displays image data from the finish point back to the start point.

[0130] Alternatively, for older applicants, the album production unit 304 displays image data in order from the start point to the finish point. On the other hand, for younger applicants, the album production unit 304 displays image data in order of predetermined photo spots (most popular photo spots).

[0131] There is a tendency for older applicants to prefer photos with a large background, while younger applicants prefer photos in which they are with friends, etc. In other words, applicant preferences are thought to be biased depending on attributes (gender, age), and the album production unit 304 determines the order in which image data is displayed to match these preferences.

[0132] The album creation unit 304 may arrange and display (present to the applicant) image data in which the album creation applicant appears based on the smile score. That is, the album creation unit 304 may determine the order of image data to be displayed based on the smile score of the album creation applicant. For example, the album creation unit 304 may display the image data in descending order of smile score (highest smile score first).

[0133] Alternatively, the album creating unit 304 may determine the order of image data to be displayed based on the number of people appearing in the photo together with the album creation applicant. For example, the album creating unit 304 may display the image data in descending order of the number of people appearing in the photo together (in descending order of the number of people).

[0134] The album creation unit 304 may determine the order of image data to be displayed based on the quality (quality score) of the image data. For example, the album creation unit 304 may display image data in order from highest quality. Alternatively, the album creation unit 304 may not present image data with a quality score lower than a predetermined value to the applicant. For example, the album creation unit 304 may discard so-called out-of-focus photos.

[0135] The album creating unit 304 may determine the display order based on the size of the applicants (size of facial images) appearing in the image data. For example, the album creating unit 304 displays the image data in descending order of facial image size (in the order in which the applicants appear in close-up).

[0136] As described above, in the first embodiment, the server device 10 collects image data of the album applicant from the photographing terminals (signage 20, camera device 30) installed at various locations in the tourist destination. When the album applicant completes the cycling tour, the server device 10 provides the applicant with an interface that enables the applicant to select photos to be used in the album. After completing the album production, the server device 10 executes a process to provide preferential treatment to the installer of the photographing terminal that captured the image data selected by the album applicant. Specifically, the server device 10 pays all or a portion of the album production fee received from the user as a dividend to the installer. As a result, a large dividend is paid to a business that installs a photographing terminal that captures image data selected by many users. A business that invests in installing a photographing terminal is given an incentive according to the number of photos used in the album. In other words, providing attractive photos to users leads to profits for the business that installs the photographing terminal. Increased profits motivate businesses in tourist destinations to install photographing terminals in locations where better photos can be taken. If better photos are taken and users are provided with more comprehensive albums, the attractiveness of tourist destinations will increase, leading to their revitalization.

[0137] In addition, tourists (cycling tour participants) can feel very satisfied at the end of the cycling tour because photos of their faces are compiled into an album and they can keep a record of their sightseeing memories. Furthermore, because the camera device 30 can be installed at various locations in tourist spots with a high degree of freedom, the server device 10 can collect attractive photos with angles and timing that would be difficult for users to take themselves, and use them as material for the album.

[0138] [Second embodiment] Next, the second embodiment will be described in detail with reference to the drawings.

[0139] In the first embodiment, a case has been described in which biometric information (facial image) of the applicant for album production is registered in the server device 10. In the second embodiment, a case has been described in which biometric information of other people is registered in the server device 10 in addition to the applicant's biometric information. For example, the applicant registers facial images of tour companions, such as family members, friends, and acquaintances, in the server device 10 along with his or her own facial image.

[0140] When creating a selection screen for photographs to be used in the electronic album, the server device 10 preferentially displays, for example, image data in which the faces of the accompanying persons registered together with the applicant appear more frequently.

[0141] The configuration of the information processing system according to the second embodiment can be the same as that of the first embodiment, and therefore the description corresponding to Fig. 3 will be omitted. Also, the processing configuration of the server device 10 according to the second embodiment can be the same as that of the first embodiment, and therefore the description thereof will be omitted.

[0142] The following description will focus on the differences between the first and second embodiments.

[0143] When accepting an application for album production from a user, the application control unit 302 according to the second embodiment provides the user with an interface that enables the user to register facial images of accompanying persons. For example, the application control unit 302 displays a GUI such as that shown in FIG. 12 on the terminal 40.

[0144] When the "Register facial images of family, friends, etc." button shown in Figure 12 is pressed, the application control unit 302 displays a GUI for selecting the facial images of companions who will accompany the applicant, and acquires the facial images of the companions.

[0145] The application control unit 302 generates features from the acquired facial images of each accompanying person, and stores the features in the applicant information database in association with the applicant's user ID, biometric information, etc. (see FIG. 13). As shown in FIG. 13, the storage unit 306 stores the biometric information of the album production applicant and the biometric information of at least one accompanying person accompanying the album production applicant in association with each other.

[0146] When the album production applicant appears in image data acquired from the photography terminal, the acquired image control unit 303 according to the second embodiment counts how many people accompanying the applicant appear in the same image data.

[0147] Specifically, the acquired image control unit 303 performs a matching process using a facial image of a person other than the applicant extracted from the image data and the feature amount recorded in the applicant information database as biometric information of the applicant's companion. If the matching process is successful, the acquired image control unit 303 determines that the applicant's companion is included in the image data.

[0148] The acquired image control unit 303 repeats the above-described matching process for each face image in the image data in which the applicant appears, and counts the number of accompanying persons appearing in the same photograph as the applicant. The acquired image control unit 303 stores the number of accompanying persons as applicant image information in the applicant information database.

[0149] In this way, the acquired image control unit 303 executes a matching process using the biometric information extracted from the image data containing the album production applicant and the biometric information of the accompanying persons stored in association with the biometric information of the album production applicant. Through the matching process, the acquired image control unit 303 calculates the number of accompanying persons appearing simultaneously with the image data containing the album production applicant, and stores the calculated number of accompanying persons in association with the image data containing the album production applicant.

[0150] The album creating unit 304 according to the second embodiment may arrange the image data in which the album creation applicant appears based on the number of accompanying persons appearing in the image data. The album creating unit 304 may determine the order of the image data when presented to the album creation applicant according to the number of accompanying persons appearing in the image data. For example, the album creating unit 304 may give priority to (display first) the image data in which as many accompanying persons as possible appear.

[0151] The acquired image control unit 303 according to the second embodiment may calculate the smile scores of accompanying persons and store them as applicant image information, as in the modified example of the first embodiment. Furthermore, the album production unit 304 may arrange image data in which the album production applicant appears, based on the smile score of the album production applicant and the smile scores of the accompanying persons. For example, the album production unit 304 may preferentially display (list display) image data in descending order of the number of accompanying persons appearing and the total smile scores of the applicant and accompanying persons.

[0152] In the second embodiment, as in the modified example of the first embodiment, the order of the photographs to be presented to the album creation applicant may be determined based on the quality of the image data, etc.

[0153] As described above, in the second embodiment, by registering the biometric information of not only the applicant for album creation but also the accompanying person in the system, it is possible to collect photos that are more valuable to the applicant, and as a result, the applicant for album creation can obtain greater satisfaction.

[0154] [Third embodiment] Next, the third embodiment will be described in detail with reference to the drawings.

[0155] In the third embodiment, a case will be described in which the server device 10 generates information related to the preferences of a user (an album production applicant). More specifically, in the third embodiment, a case will be described in which information such as photo spots preferred by young people and photo spots preferred by elderly people is generated.

[0156] The configuration of the authentication system according to the third embodiment can be the same as that of the first embodiment, so a description corresponding to FIG. 3 will be omitted.

[0157] The following description will focus on the differences between the first to third embodiments.

[0158] Fig. 14 is a diagram showing an example of a processing configuration (processing module) of the server device 10 according to the third embodiment. Referring to Fig. 14, a preference information generation unit 307 is added to the configuration of the server device 10 according to the first embodiment.

[0159] When the album creating unit 304 according to the third embodiment sends an album to an applicant, it notifies the preference information generating unit 307 of the user ID of the applicant and the shooting points of the image data that the applicant has used in the album.

[0160] The preference information generating unit 307 is a means for generating information (preference information) about the user's (applicant's) preference for photography points. For example, the preference information generating unit 307 generates, for each attribute of the applicant, the number of applicants who selected photos taken at each photography point as preference information.

[0161] The preference information generation unit 307 manages the preference information using a preference information database (see FIG. 15). As shown in FIG. 15, the preference information database stores the number of applicants who have used photos taken at each shooting point in their albums, for each attribute of the applicant (for example, by age group). Note that the preference information database shown in FIG. 15 is an example and is not intended to limit the items to be stored.

[0162] When the preference information generating section 307 acquires the user ID of the user who has completed album creation from the album creating section 304, it searches the applicant information database using the user ID as a key to identify the corresponding applicant.

[0163] The preference information generation unit 307 reads the attributes (gender, age) of the specified applicant from the applicant information database. The preference information generation unit 307 reflects the attributes of the applicant and the shooting points that the applicant used in the album in the preference information database.

[0164] For example, if a teenage applicant includes in their album a photo taken at a starting point, the preference information generation unit 307 adds "1" to the setting value of the starting point field for teens in the preference information database and updates the preference information database.

[0165] 15 shows a case where the number of applicants who selected photos at each shooting point by age group is stored. The preference information database may store the number of applicants who selected photos at each shooting point by gender, or by gender and age group.

[0166] Alternatively, if the nationality of the user can be acquired when accepting an album application, the preference information generating unit 307 may generate the number of photo selectors for each nationality at each shooting point as preference information.

[0167] When the preference information generation unit 307 is requested to provide preference information by an employee of a tourist association or the like, it provides the employee with the preference information as shown in Fig. 15. For example, the preference information generation unit 307 transmits the preference information to a terminal used by the employee, prints the preference information, or displays the preference information on a liquid crystal display or the like.

[0168] By checking the preference information, staff can understand the preferences of each attribute. For example, in the example of Figure 15, it can be seen that relatively young people prefer cliffs as photo spots, and relatively older people prefer lakesides as photo spots.

[0169] Tourist destination operators can refer to the preference information to understand the applicant's preferences and use it as a reference when installing new photography devices. Alternatively, when a tourism association deploys an album production system at another tourist destination, it can refer to the preference information to decide where to install photography devices. For example, in tourist destinations visited by many elderly people, many photography devices are installed in relatively quiet places such as lakesides. Or, in tourist destinations popular with young people, many photography devices are installed in thrilling places such as cliffs.

[0170] As described above, the server device 10 according to the third embodiment generates preference information regarding the photography points of an album production applicant based on the installation location of the photography terminal that provided the image data used in the album by the album production applicant. For example, the server device 10 generates preference information for each attribute of the album production applicant. As a result, staff at tourist associations and the like can learn generalized information about tourists (e.g., places preferred by young people, places preferred by elderly people). Staff can also utilize knowledge gained from the preference information to expand the album production system disclosed herein to other regions.

[0171] Next, the hardware of each device constituting the information processing system will be described. Fig. 16 is a diagram showing an example of the hardware configuration of the server device 10.

[0172] The server device 10 can be configured by an information processing device (so-called computer), and has the configuration exemplified in Fig. 16. For example, the server device 10 includes a processor 311, a memory 312, an input / output interface 313, and a communication interface 314. The components such as the processor 311 are connected by an internal bus or the like, and are configured to be able to communicate with each other.

[0173] 16 is not intended to limit the hardware configuration of the server device 10. The server device 10 may include hardware not shown, and may not include the input / output interface 313 as necessary. Furthermore, the number of processors 311 and the like included in the server device 10 is not intended to be limited to the example shown in FIG. 16, and for example, the server device 10 may include multiple processors 311.

[0174] The processor 311 is a programmable device such as a central processing unit (CPU), a micro processing unit (MPU), or a digital signal processor (DSP). Alternatively, the processor 311 may be a device such as a field programmable gate array (FPGA) or an application specific integrated circuit (ASIC). The processor 311 executes various programs including an operating system (OS).

[0175] The memory 312 is a random access memory (RAM), a read only memory (ROM), a hard disk drive (HDD), a solid state drive (SSD), etc. The memory 312 stores an OS program, application programs, and various data.

[0176] The input / output interface 313 is an interface for a display device and an input device (not shown). The display device is, for example, a liquid crystal display. The input device is, for example, a device that accepts user operations such as a keyboard or a mouse.

[0177] The communication interface 314 is a circuit, module, etc. that communicates with other devices. For example, the communication interface 314 includes a network interface card (NIC).

[0178] The functions of the server device 10 are realized by various processing modules. The processing modules are realized, for example, by the processor 311 executing a program stored in the memory 312. The program can be recorded on a computer-readable storage medium. The storage medium can be a non-transitory medium such as a semiconductor memory, a hard disk, a magnetic recording medium, or an optical recording medium. That is, the present invention can also be embodied as a computer program product. The program can be downloaded via a network or updated using a storage medium storing the program. The processing modules can also be realized by semiconductor chips.

[0179] Note that the signage 20 and the like can also be configured using an information processing device, similar to the server device 10, and the basic hardware configuration is no different from that of the server device 10, so a description thereof will be omitted. For example, the signage 20 may be provided with a camera device for photographing users.

[0180] The server device 10, which is an information processing device, is equipped with a computer, and functions of the server device 10 can be realized by causing the computer to execute a program. The server device 10 also executes a control method for the server device 10 by the program.

[0181] [Variations] The configuration, operation, etc. of the information processing system described in the above embodiment are merely examples, and are not intended to limit the configuration, etc. of the system.

[0182] In the above embodiment, a case has been described in which a user applies for album production to a tourist association or the like. However, the application for album production is not limited to this form, and album production may also be included in a sightseeing tour package. Specifically, a business model may be created in which album production is offered as an option for a sightseeing tour, and users can obtain the album by paying an additional fee.

[0183] In the above embodiment, the production of an album for users who participated in a cycling tour was described. However, it goes without saying that the target audience for album production is not limited to participants in cycling tours. For example, the target audience for album production may be ordinary people who travel around tourist spots on foot.

[0184] In the above embodiment, the server device 10 has been described as producing an electronic album (digital photo album). However, the server device 10 may also produce an album consisting of ordinary photos (image data printed on a paper medium). In this case, the server device 10 may print the album from a terminal installed in a hotel or the like, or may commission a printing company to produce the album.

[0185] In the above embodiment, the server device 10 has been described as giving preferential treatment to the installation company of the photography terminal that provided the photos used in the album by paying a larger share of the album production costs. However, the method of giving preferential treatment to the installation company is not limited to the distribution of the album production costs, and other methods may also be used. For example, the server device 10 may give preferential treatment to the installation company by posting an advertisement for the installation company on the homepage of the tourism association.

[0186] In the above embodiment, the server device 10 displays a list of image data on the terminal 40 of the album production applicant. However, the server device 10 may display the list of image data on the signage 20 or a terminal installed in a hotel. For example, the list of image data may be displayed on the signage 20-2 installed at the finish line.

[0187] In the above embodiment, the case where the album creation applicant selects image data to be used in the album has been described. However, the server device 10 may select image data to be used in the album and create the album. For example, the server device 10 may create an album that is likely to be accepted by the album creation applicant based on the user's attributes, smile score, number of accompanying persons, etc., and present it to the user. If the user rejects the presented album, the server device 10 may present the user with an album created based on different criteria. Alternatively, if the user rejects the presented album, the server device 10 may provide an interface that allows the user to modify the presented album. That is, the server device 10 may display a list of images selected and unselected for the presented album to the user, and display a GUI on the terminal 40 that allows the user to select whether to include or exclude the listed images in the album.

[0188] In the above embodiment, it has been explained that the album production applicant registers the number of photos to be used in the album as album production information in the system. Here, the album production applicant may register different options (requests) in addition to the number of photos in the system. For example, the applicant may input the album appearance, whether or not to decorate the photos, the album format, etc. as album production information into the server device 10.

[0189] Alternatively, the server device 10 may not acquire the album production information from the album production applicant. For example, the server device 10 may set the number of photos to be used in the album to a predetermined number.

[0190] When substantially the same photograph is obtained from the photographing terminal, the server device 10 (obtained image control unit 303) may keep one photograph and delete the others. For example, when the server device 10 obtains a plurality of image data showing the same person from the same photographing terminal, it may determine that substantially the same image data has been obtained, keep one representative image data and delete the other image data.

[0191] In the above embodiment, the album production fee is paid in advance, but the album production fee may be paid later. Alternatively, the server device 10 may refund the album production fee if the album creation applicant is unable to prepare the desired number of photos.

[0192] In the above embodiment, an album is created when the user finishes the cycling tour. However, the timing of album creation is not limited to the end of the cycling tour. For example, the album may be created when the last camera device 30 installed on the cycling course takes a photo, or when a predetermined date and time arrives. Alternatively, the user may complete the procedure at a terminal installed at a predetermined location or point (e.g., a hotel or airport), and the album may be created when a request for album creation is made from the terminal. Alternatively, the server device 10 may start album creation for an applicant who has requested album creation, even if the applicant is in the middle of a cycling tour. In other words, the user can check the images taken for the album and apply for album creation, even if the applicant is in the middle of a cycling tour.

[0193] In the above embodiment, it was explained that a user who wishes to have an album created must apply for album creation in advance and register their biometric information in advance. However, the server device 10 can also provide the album creation service to users who have not applied in advance. Specifically, the server device 10 acquires a facial image captured by a predetermined terminal (a kiosk terminal installed in a rest area, etc.) and manages (stores) the facial image captured by the predetermined terminal as the facial image of the person for whom the album is to be created. The server device 10 then compares the facial image captured by the predetermined terminal with the facial image captured by the photographing terminal, and if they match, stores the facial image as the facial image of the person for whom the album is to be created. For example, if the server device 10 finds a facial image (the facial image of the person for whom the album is to be created) that matches a facial image captured by a signage 20-2 or the like installed at the finish line of a cycling tour, it displays a list of the facial images of the target person on the signage 20-2. If a user who has checked the images displayed on signage 20-2 wishes to purchase an album, the user can obtain the album by selecting the photos to be used in the album on signage 20-2 and completing the necessary procedures such as payment. After a facial image is captured at a predetermined terminal (kiosk terminal), server device 10 stores the facial image captured by the photographing terminal in association with the facial image captured by the kiosk terminal, thereby making it possible to provide the album production service even to users who have not applied in advance.

[0194] Alternatively, the server device 10 may manage (store) the facial images of each user captured by the photographing terminal as the facial images of the person to whom the album is to be created, without any prior procedures. Each time a new facial image is extracted from image data obtained from the photographing terminal, the server device 10 manages the user corresponding to the new facial image as the person to whom the album is to be created. As described above, if the server device 10 stores a facial image (the facial image of the person to whom the album is to be created) that matches a facial image captured by the signage 20-2 or the like installed at the finish line of the cycling tour, the server device 10 displays a list of the facial images of the person on the signage 20-2. The user can purchase the album by completing the necessary procedures on the signage 20-2. The server device 10 prevents resource waste by deleting the facial images of the person to whom the album is to be created periodically or at a predetermined timing (for example, when the date changes).

[0195] The server device 10 performs biometric authentication on the facial images of users taken at each photographing terminal and sorts each photograph into groups with matching facial image similarities. That is, the server device 10 classifies and stores facial images (photos including faces) taken at each photographing terminal for each user. Furthermore, when a user inputs a request to purchase an album at a predetermined terminal (a terminal capable of handling album purchase procedures) installed at a finish line or the like, the predetermined terminal takes a facial image of the person wishing to purchase the album and transmits the acquired facial image to the server device 10. The server device 10 identifies a group corresponding to the acquired facial image based on the similarity of the acquired facial image obtained by biometric authentication. The server device 10 presents the user with a list of photos belonging to the identified group. The user selects all or some of the photos from the presented list. The server device 10 may create an album using the selected photos.

[0196] In the above embodiment, the applicant information database is configured inside the server device 10, but the database may be configured on an external database server or the like. That is, some of the functions of the server device 10 may be implemented on another server. More specifically, the above-described "album production unit (album production means)", "preferential treatment processing execution unit (preferential treatment processing execution means)", etc. may be implemented on any of the devices included in the system.

[0197] The form of data transmission and reception between the devices (server device 10, signage 20, etc.) is not particularly limited, but the data transmitted and received between these devices may be encrypted. Biometric information of users and other information is transmitted and received between these devices, and in order to appropriately protect this information, it is desirable to transmit and receive encrypted data.

[0198] In the flow charts (flowcharts, sequence diagrams) used in the above explanation, multiple steps (processes) are described in order, but the execution order of the steps executed in the embodiments is not limited to the order described. In the embodiments, the order of the illustrated steps can be changed to the extent that the content is not affected, such as by executing each process in parallel.

[0199] The above-described embodiments have been described in detail to facilitate understanding of the present disclosure, and it is not intended that all of the above-described configurations are required. Furthermore, when multiple embodiments are described, each embodiment may be used alone or in combination. For example, it is possible to replace part of the configuration of one embodiment with the configuration of another embodiment, or to add the configuration of another embodiment to the configuration of one embodiment. Furthermore, it is possible to add, delete, or replace part of the configuration of one embodiment with another configuration.

[0200] From the above explanation, it is clear that the present invention has industrial applicability, and the present invention can be suitably applied to an information processing system that provides an album production service to users.

[0201] Some or all of the above embodiments can be described as, but are not limited to, the following supplementary notes. [Appendix 1] a storage unit for storing biometric information of an applicant for album production; an acquired image control unit that receives image data from at least one or more photographing terminals, determines whether or not the photo album production applicant appears in the received image data through a matching process using the stored biometric information and biometric information extracted from the received image data, and stores information regarding the image data in which the photo album production applicant appears; an album production unit that allows the album production applicant to select image data to be used in the album from at least one image data in which the album production applicant is photographed, and produces the album using the image data selected by the album production applicant; a preferential treatment processing execution unit that performs processing to give preferential treatment to an installation entity of the photography terminal that provided the image data used in the album; A server device comprising: [Appendix 2] The server device described in Appendix 1, wherein the preferential treatment processing execution unit determines the distribution destination of the album production fee paid by the album production applicant so as to give preferential treatment to the entity that installed the photography terminal that provided the image data used in the album. [Appendix 3] The server device according to claim 1 or 2, wherein the album production unit arranges image data in which the album production applicant appears in a predetermined order, and enables the album production applicant to select image data to be used in the album. [Appendix 4] The server device according to Supplementary Note 3, wherein the album production section arranges image data in which the album production applicant appears based on attributes of the album production applicant. [Appendix 5] the acquired image control unit calculates a smile score indicating the degree of smile of the photo album production applicant appearing in the image data, and stores the calculated smile score in association with the image data in which the photo album production applicant appears; 5. The server device according to claim 3, wherein the album production unit arranges image data in which the album production applicant appears based on the smile score. [Appendix 6] the storage unit stores biometric information of the album production applicant and biometric information of at least one or more accompanying persons accompanying the album production applicant in association with each other; the acquired image control unit calculates the number of accompanying persons appearing in the image data of the photo album applicant by performing a matching process using biometric information extracted from the image data of the photo album applicant and biometric information of accompanying persons stored in association with the biometric information of the photo album applicant, and stores the image data of the photo album applicant in association with the calculated number of accompanying persons; The server device according to any one of appendixes 3 to 5, wherein the album production section arranges the image data in which the album production applicant appears based on the number of accompanying persons. [Appendix 7] The server device according to Supplementary Note 6, wherein the album production unit arranges image data in which the album production applicant appears based on the smile score of the album production applicant and the smile scores of the accompanying persons. [Appendix 8] A server device as described in any one of Appendices 1 to 7, further comprising a preference information generation unit that generates preference information regarding the photography points of the album production applicant based on the installation location of the photography terminal to which the album production applicant provided the image data used in the album. [Appendix 9] 9. The server device according to claim 8, wherein the preference information generating unit generates the preference information for each attribute of the album production applicant. [Appendix 10] The server device according to any one of Supplementary Notes 1 to 9, wherein the photographing terminal is a signage or camera device installed at a tourist spot. [Appendix 11] The server device according to any one of Supplementary Notes 1 to 10, wherein the biometric information is a face image or a feature amount generated from the face image. [Appendix 12] At least one photography device installed at a photography point in a tourist spot; a server device; Including, The server device a storage unit for storing biometric information of an applicant for album production; an acquired image control unit that receives image data from the at least one photographing terminal, determines whether the photo album production applicant appears in the received image data by performing a matching process using the stored biometric information and biometric information extracted from the received image data, and stores information regarding the image data in which the photo album production applicant appears; an album production unit that allows the album production applicant to select image data to be used in the album from at least one image data in which the album production applicant is photographed, and produces the album using the image data selected by the album production applicant; a preferential treatment processing execution unit that performs processing to give preferential treatment to an installation entity of the photography terminal that provided the image data used in the album; A system comprising: [Appendix 13] A server device including a storage unit for storing biometric information of an album production applicant, receiving image data from at least one or more photographing terminals, determining whether or not the photo album production applicant is photographed in the received image data through a matching process using the stored biometric information and biometric information extracted from the received image data, and storing information regarding the image data in which the photo album production applicant is photographed; allowing the applicant for album production to select image data to be used in the album from at least one image data in which the applicant for album production is photographed, and creating an album using the image data selected by the applicant for album production; A control method for a server device that performs processing to give preferential treatment to the entity that installed the photography terminal that provided the image data used in the album. [Appendix 14] A computer installed in a server device, which has a storage unit for storing biometric information of an applicant for album production, receiving image data from at least one or more photographing terminals, determining whether or not the photo album production applicant is included in the received image data through a matching process using the stored biometric information and biometric information extracted from the received image data, and storing information regarding the image data in which the photo album production applicant is included; A process of allowing the applicant for album production to select image data to be used in the album from at least one image data in which the applicant for album production is photographed, and creating an album using the image data selected by the applicant for album production; A process of giving preferential treatment to the entity that installed the photographing terminal that provided the image data used in the album; A computer-readable storage medium that stores a program for executing the above.

[0202] The disclosures of the above-cited prior art documents are incorporated herein by reference. Although the embodiments of the present invention have been described above, the present invention is not limited to these embodiments. Those skilled in the art will understand that these embodiments are merely illustrative and that various modifications are possible without departing from the scope and spirit of the present invention. In other words, the present invention naturally includes various modifications and alterations that may be made by those skilled in the art in accordance with the entire disclosure, including the claims, and the technical concepts thereof. [Explanation of symbols]

[0203] 10 Server device 20 Signage 20-1 Signage 20-2 Signage 20-3 Signage 20-4 Signage 30 Camera equipment 30-1 Camera equipment 30-2 Camera equipment 30-3 Camera equipment 40 terminals 100 Server device 101 Storage section 102 Acquired image control unit 103 Album Production Department 104 Preferential Treatment Processing Department 201 Communication control unit 202 Message output section 203 Shooting control unit 204 Storage section 301 Communication Control Unit 302 Application control section 303 Acquired image control unit 304 Album Production Department 305 Preferential Treatment Processing Department 306 Storage section 307 Preference information generation unit 311 processor 312 memory 313 Input / Output Interface 314 Communication Interface

Claims

1. a storage unit for storing biometric information of an applicant for album production; an acquired image control unit that receives image data from at least one or more photographing terminals, determines whether or not the photo album production applicant appears in the received image data through a matching process using the stored biometric information and biometric information extracted from the received image data, and stores information regarding the image data in which the photo album production applicant appears; an album production section that allows the album production applicant to select image data to be used in the album from at least one image data in which the album production applicant is photographed, and produces the album using the image data selected by the album production applicant; a preferential treatment processing execution unit that performs processing to give preferential treatment to an installation entity of the photography terminal that provided the image data used in the album; Equipped with The preferential treatment processing execution unit is a server device that gives preferential treatment to the entity that installed the photography terminal that provided the image data used in the album by posting an advertisement about the entity that installed the photography terminal that provided the image data used in the album on a homepage.

2. The server device according to claim 1, wherein the preferential treatment processing execution unit determines a distribution destination of the album production fee paid by the album production applicant so as to give preferential treatment to the entity that installed the photography terminal that provided the image data used in the album.

3. 3. The server device according to claim 1, wherein the album production section arranges the image data in which the album production applicant appears in a predetermined order, and enables the album production applicant to select image data to be used in the album.

4. 4. The server device according to claim 3, wherein said album production section arranges image data in which said album production applicant appears based on attributes of said album production applicant.

5. the acquired image control unit calculates a smile score indicating the degree of smile of the photo album production applicant appearing in the image data, and stores the calculated smile score in association with the image data in which the photo album production applicant appears; 5. The server device according to claim 3, wherein the album creating section arranges image data in which the applicant for album creation appears based on the smile score.

6. the storage unit stores biometric information of the album production applicant and biometric information of at least one or more accompanying persons accompanying the album production applicant in association with each other; the acquired image control unit calculates the number of accompanying persons appearing in the image data of the photo album applicant by performing a matching process using biometric information extracted from the image data of the photo album applicant and biometric information of accompanying persons stored in association with the biometric information of the photo album applicant, and stores the image data of the photo album applicant in association with the calculated number of accompanying persons; 6. The server device according to claim 3, wherein the album creating section arranges the image data in which the applicant for album creation appears based on the number of accompanying persons.

7. The server device according to claim 6 , wherein the album production section arranges the image data in which the album production applicant appears based on a smile score of the album production applicant and a smile score of the accompanying person.

8. A server device as described in any one of claims 1 to 7, further comprising a preference information generation unit that generates preference information regarding the photography points of the album production applicant based on the installation location of the photography terminal to which the album production applicant provided the image data used in the album.

9. 9. The server device according to claim 8, wherein said preference information generating section generates said preference information for each attribute of said album production applicant.

10. The server device according to claim 1 , wherein the photographing terminal is a signage or camera device installed at a tourist spot.

11. The server device according to claim 1 , wherein the biometric information is a face image or a feature amount generated from the face image.

12. At least one photography device installed at a photography point in a tourist spot; a server device; Including, The server device a storage unit for storing biometric information of an applicant for album production; an acquired image control unit that receives image data from the at least one or more photographing terminals, determines whether the photo album production applicant appears in the received image data by performing a matching process using the stored biometric information and biometric information extracted from the received image data, and stores information regarding the image data in which the photo album production applicant appears; an album production section that allows the album production applicant to select image data to be used in the album from at least one image data in which the album production applicant is photographed, and produces the album using the image data selected by the album production applicant; a preferential treatment processing execution unit that performs processing to give preferential treatment to an installation entity of the photography terminal that provided the image data used in the album; Equipped with The preferential treatment processing execution unit gives preferential treatment to the entity that installed the photography terminal that provided the image data used in the album by posting an advertisement about the entity that installed the photography terminal that provided the image data used in the album on a homepage.

13. A server device including a storage unit for storing biometric information of an album production applicant, receiving image data from at least one or more photographing terminals, determining whether or not the photo album production applicant is photographed in the received image data through a matching process using the stored biometric information and biometric information extracted from the received image data, and storing information regarding the image data in which the photo album production applicant is photographed; allowing the applicant for album production to select image data to be used in the album from at least one image data in which the applicant for album production is photographed, and producing the album using the image data selected by the applicant for album production; A control method for a server device that performs processing to give preferential treatment to an entity that installed the photography terminal that provided image data used in the album, The process of giving preferential treatment to the entity that installed the photographing terminal is a control method for a server device, in which an advertisement about the entity that installed the photographing terminal that provided the image data used in the album is posted on a homepage, thereby giving preferential treatment to the entity that installed the photographing terminal that provided the image data used in the album.

14. A computer installed in a server device, which has a storage unit for storing biometric information of an applicant for album production, receiving image data from at least one or more photographing terminals, determining whether or not the photo album production applicant is included in the received image data through a matching process using the stored biometric information and biometric information extracted from the received image data, and storing information regarding the image data in which the photo album production applicant is included; a process of allowing the applicant for album production to select image data to be used in the album from at least one image data in which the applicant for album production is photographed, and producing the album using the image data selected by the applicant for album production; A process of giving preferential treatment to the entity that installed the photographing terminal that provided the image data used in the album; A program for executing The process of giving preferential treatment to the entity that installed the photographing terminal is a program that gives preferential treatment to the entity that installed the photographing terminal that provided the image data used in the album by posting an advertisement about the entity that installed the photographing terminal that provided the image data used in the album on a homepage.

Images