Server device, authentication terminal, system, control method of server device, and program

Abstract

To provide a server device that contributes to enabling creation of growth records using image data.SOLUTION: A server device includes storage means, authentication means, data accumulation means, and control means. The storage means stores biometric information of a plurality of target persons for whom data is to be accumulated. The authentication means authenticates, on receipt of biometric information of a to-be-authenticated person from an authentication terminal, the to-be-authenticated person using the received biometric information and the stored biometric information, and transmits a result of the authentication to the authentication terminal. The data accumulation means acquires image data including the to-be-authenticated person who has been successfully authenticated from the authentication terminal, and accumulates the acquired image data. The control means creates a growth record of one of the target persons for whom data is to be accumulated, using the accumulated image data, and provides the created growth record to users who have predetermined relationship with the one target person.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a server device, an authentication terminal, a system, a method for controlling a server device, and a program. [Background technology]

[0002] There are technologies that use images to recognize dangers to children and extract memorable scenes of children.

[0003] For example, Patent Document 1 describes an image analysis system that allows users to view memorable scenes of children. The image analysis system in Patent Document 1 includes an image acquisition unit, a state recognition unit, and at least one of a danger recognition unit and a scene extraction unit. The image acquisition unit acquires an image of a specific child within a specified facility. The state recognition unit recognizes at least one of the child's behavior and facial expression based on the acquisition results of the image acquisition unit. The danger recognition unit recognizes the danger of the child based on the recognition results of the state recognition unit. The scene extraction unit recognizes memorable scenes of the child based on the recognition results of the state recognition unit and extracts the scenes from the acquisition results. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Publication No. 2019-125870 Summary of the Invention [Problem to be solved by the invention]

[0005] The system disclosed in Patent Document 1 uses images of children to recognize dangers to children and extract memorable scenes of children. However, the use of images is not limited to the recognition of dangers.

[0006] The main object of the present invention is to provide a server device, an authentication terminal, a system, a method for controlling a server device, and a program that contribute to enabling the creation of a growth record using image data. [Means for solving the problem]

[0007] According to a first aspect of the present invention, there is provided a server device comprising: a storage means for storing biometric information for each of a plurality of data storage subjects; an authentication means for, upon receiving biometric information for a subject to be authenticated from an authentication terminal, authenticating the subject to be authenticated using the received biometric information and the stored biometric information and notifying the authentication terminal of the authentication result; a data storage means for acquiring image data of the subject to be authenticated who has been determined to have been successfully authenticated from the authentication terminal and storing the acquired image data; and a control means for using the stored image data to create a growth record for one of the plurality of data storage subjects and providing the created growth record to a user who has a predetermined relationship with the one data storage subject.

[0008] According to a second aspect of the present invention, there is provided an authentication terminal comprising: an authentication control means for receiving an authentication result of a person to be authenticated by transmitting biometric information of the person to be authenticated to a server device that stores biometric information of each of a plurality of data storage subjects; and a data acquisition means for acquiring image data of the person to be authenticated that has been determined to have been successfully authenticated, if the authentication result of the person to be authenticated is successful, and transmitting the acquired image data to the server device.

[0009] According to a third aspect of the present invention, there is provided a system including an authentication terminal and a server device, wherein the server device comprises: a storage means for storing biometric information for each of a plurality of data storage subjects; an authentication means for, upon receiving biometric information for a subject to be authenticated from the authentication terminal, authenticating the subject to be authenticated using the received biometric information and the stored biometric information and notifying the authentication terminal of the authentication result; a data storage means for acquiring image data of the subject to be authenticated who has been determined to have been successfully authenticated from the authentication terminal and storing the acquired image data; and a control means for using the stored image data to create a growth record for one of the plurality of data storage subjects and providing the created growth record to a user who has a predetermined relationship with the one data storage subject.

[0010] According to a fourth aspect of the present invention, there is provided a control method for a server device, comprising: a storage step of storing biometric information for each of a plurality of data storage subjects; an authentication step of, upon receiving biometric information for a subject to be authenticated from an authentication terminal, authenticating the subject to be authenticated using the received biometric information and the stored biometric information and notifying the authentication terminal of the authentication result; a data storage step of acquiring image data of the subject to be authenticated who has been determined to have been successfully authenticated from the authentication terminal and storing the acquired image data; and a control step of using the stored image data to create a growth record for one of the plurality of data storage subjects and providing the created growth record to a user who has a predetermined relationship with the one data storage subject.

[0011] According to a fifth aspect of the present invention, there is provided a program that causes a computer mounted on a server device to execute the following steps: a storage process that stores biometric information for each of a plurality of data storage subjects; an authentication process that, upon receiving biometric information for a subject to be authenticated from an authentication terminal, authenticates the subject using the received biometric information and the stored biometric information and notifies the authentication terminal of the authentication result; a data storage process that acquires image data from the authentication terminal that depicts the subject to be authenticated who has been determined to have been successfully authenticated and stores the acquired image data; and a control process that uses the stored image data to create a growth record for one of the plurality of data storage subjects and provide the created growth record to a user who has a predetermined relationship with the one data storage subject. [Effects of the Invention]

[0012] According to each aspect of the present invention, a server device, an authentication terminal, a system, a method for controlling a server device, and a program are provided that contribute to enabling the creation of a growth record using image data. Note that the effects of the present invention are not limited to those described above. The present invention may achieve other effects instead of or in addition to the effects described above. [Brief explanation of the drawings]

[0013] [Figure 1] FIG. 1 is a diagram for explaining an outline of an embodiment. [Figure 2] FIG. 2 is a flowchart illustrating the operation of one embodiment. [Figure 3] FIG. 3 is a diagram illustrating an example of a schematic configuration of an information processing system according to an embodiment of the present disclosure. [Figure 4] FIG. 4 is a diagram for explaining the operation of the information processing system according to the embodiment of the present disclosure. [Figure 5] FIG. 5 is a diagram for explaining the operation of the information processing system according to the embodiment of the present disclosure. [Figure 6] FIG. 6 is a diagram for explaining the operation of the information processing system according to the embodiment of the present disclosure. [Figure 7]FIG. 7 is a diagram illustrating an example of a processing configuration of a server device according to an embodiment of the present disclosure. [Figure 8] FIG. 8 is a diagram illustrating an example of a display on a terminal according to an embodiment of the present disclosure. [Figure 9] FIG. 9 is a diagram illustrating an example of a user management database according to an embodiment of the present disclosure. [Figure 10] FIG. 10 is a flowchart illustrating an example of the operation of the authentication unit according to an embodiment of the present disclosure. [Figure 11] FIG. 11 is a diagram illustrating an example of a display on a terminal according to an embodiment of the present disclosure. [Figure 12] FIG. 12 is a diagram illustrating an example of a display on a terminal according to an embodiment of the present disclosure. [Figure 13] FIG. 13 is a diagram illustrating an example of a display on a terminal according to an embodiment of the present disclosure. [Figure 14] FIG. 14 is a diagram illustrating an example of a display on a terminal according to an embodiment of the present disclosure. [Figure 15] FIG. 15 is a diagram illustrating an example of a display on a terminal according to an embodiment of the present disclosure. [Figure 16] FIG. 16 is a diagram illustrating an example of a processing configuration of an authentication terminal according to an embodiment of the present disclosure. [Figure 17] FIG. 17 is a sequence diagram illustrating an example of the operation of the information processing system according to an embodiment of the present disclosure. [Figure 18] FIG. 18 is a diagram illustrating an example of a display of a user terminal according to an embodiment of the present disclosure. [Figure 19] FIG. 19 is a diagram for explaining the operation of the information processing system according to an embodiment of the present disclosure. [Figure 20] FIG. 20 is a diagram for explaining the operation of the information processing system according to the embodiment of the present disclosure. [Figure 21] FIG. 21 is a diagram illustrating an example of a hardware configuration of a server device according to the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0014] First, an overview of one embodiment will be described. Note that the reference numerals in the drawings are added to each element for convenience as an example to facilitate understanding, and the description of this overview is not intended to be limiting in any way. Furthermore, unless otherwise specified, the blocks shown in each drawing represent functional units, not hardware units. Connection lines between blocks in each drawing include both bidirectional and unidirectional lines. Unidirectional arrows are used to schematically indicate the flow of main signals (data) and do not exclude bidirectionality. Note that in this specification and drawings, elements that can be similarly described may be assigned the same reference numerals to avoid redundant explanation.

[0015] A server device 100 according to one embodiment includes a storage unit 101, an authentication unit 102, a data storage unit 103, and a control unit 104 (see FIG. 1). The storage unit 101 stores biometric information for each of a plurality of data storage subjects (step S1 in FIG. 2). When the authentication unit 102 receives biometric information for a person to be authenticated from an authentication terminal, it authenticates the person to be authenticated using the received biometric information and the stored biometric information, and notifies the authentication terminal of the authentication result (step S2). The data storage unit 103 acquires image data of a person to be authenticated who has been determined to have been successfully authenticated from the authentication terminal, and stores the acquired image data (step S3). The control unit 104 uses the stored image data to create a growth record for one of the plurality of data storage subjects, and provides the created growth record to a user who has a predetermined relationship with the one data storage subject (step S4).

[0016] The server device 100 authenticates a person to be authenticated who appears in front of the authentication terminal and transmits the authentication result to the authentication terminal. The authentication terminal acquires image data of the person to be authenticated who has been determined to have been successfully authenticated and transmits the acquired image data to the server device 100. The server device 100 stores the received image data and uses the stored image data to create a growth record of the person for whom data is to be stored (e.g., a child), and provides the created growth record to the user (e.g., the child's guardian). In other words, the server device 100 makes it possible to create a growth record using image data.

[0017] Specific embodiments will be described in more detail below with reference to the drawings.

[0018] [First embodiment] The first embodiment will be described in more detail with reference to the drawings.

[0019] The information processing system according to the first embodiment stores image data of users' children and the like, and provides various services using the stored image data.

[0020] [System Configuration] As shown in FIG. 3, the information processing system according to the first embodiment includes a server device 10 and an authentication terminal 20.

[0021] The server device 10 is a server that provides the above services. The server device 10 is managed and operated by a local government or a business operator entrusted with the business by the local government. The server device 10 may be installed in a building such as a city hall, or may be installed on a network (on the cloud).

[0022] The authentication terminal 20 is a terminal that serves as an interface when collecting image data of data accumulation subjects (data collection subjects; for example, children). The authentication terminal 20 is installed in various places such as schools, parks, zoos, tourist attractions, city halls, community centers, libraries, stations, and commercial facilities. For example, the authentication terminal 20 is a signage or tablet equipped with a camera, speaker, microphone, etc.

[0023] The devices shown in Fig. 3 are interconnected. Specifically, the server device 10 and the authentication terminal 20 are connected by wired or wireless communication means and are configured to be able to communicate with each other.

[0024] 3 is an example and is not intended to limit the configuration. For example, the information processing system may include multiple server devices 10. The multiple server devices 10 may achieve load balancing and redundancy.

[0025] [General operation] Next, the general operation of the information processing system according to the first embodiment will be described.

[0026] <User registration> In order to enjoy the various services described above, users (for example, parents of children) are required to register as users.

[0027] A user operates a terminal 30 such as a smartphone to access the server device 10. The server device 10 acquires the name, sex, date of birth, address, login information (ID, password), contact information (e.g., telephone number, email address), target person information, etc. from a predetermined website (site for user registration) (see FIG. 4).

[0028] Subject information is information about the data collection subject (e.g., a child; hereinafter, sometimes simply referred to as the subject). Subject information includes the subject's name, gender, date of birth, biometric information, etc.

[0029] Examples of biometric information include data (features) calculated from physical characteristics unique to an individual, such as a face, fingerprint, voiceprint, veins, retina, and iris pattern. Alternatively, the biometric information may be image data such as a face image or fingerprint image. The biometric information may be any information that includes the user's physical characteristics. In the embodiment disclosed herein, a case where biometric information related to a person's "face" (a face image or features generated from a face image) is used will be described.

[0030] If a user wishes to store data on multiple subjects, the subject information for each of the multiple subjects is registered in the system. For example, if a parent wishes to store data on each of their multiple children (e.g., siblings), the subject information for each of the multiple children is registered in the server device 10.

[0031] When the server device 10 acquires the subject information, the server device 10 generates a subject ID for identifying each subject. For example, in the above example, the server device 10 generates a subject ID for each of the siblings.

[0032] Furthermore, the server device 10 generates a user ID for identifying the user (account holder; for example, a parent). After generating the user ID, the server device 10 associates the user ID, login information, name, target person information (for example, target person ID, name, biometric information), etc., and stores them in a user management database to generate an account. The user management database will be described in detail later.

[0033] <Image data storage> The authentication terminal 20 plays images (audio, video) that a young child is likely to be interested in. When the authentication terminal 20 detects a child (person to be authenticated) who is interested in such images, the authentication terminal 20 sets the detected child as the person to be authenticated. The authentication terminal 20 acquires biometric information of the person to be authenticated.

[0034] Upon acquiring the biometric information, the authentication terminal 20 transmits the biometric information of the person to be authenticated to the server device 10. Specifically, the authentication terminal 20 transmits an "authentication request" including the acquired biometric information to the server device 10 (see FIG. 5).

[0035] The server device 10 executes a matching process using the biometric information included in the authentication request and the biometric information (biometric information that is part of the subject information) stored in the user management database. By executing the matching process, the server device 10 identifies the person to be authenticated (for example, a child detected by the authentication terminal 20) from among multiple data storage subjects.

[0036] If the matching process fails, the server device 10 transmits a negative response indicating authentication failure to the authentication terminal 20. If the matching process is successful, the server device 10 transmits an affirmative response indicating authentication success to the authentication terminal 20. At that time, the server device 10 transmits an affirmative response including the subject ID of the person to be authenticated identified by the matching process to the authentication terminal 20.

[0037] Upon receiving the authentication success (positive response), the authentication terminal 20 captures image data such as a still image or a video of the subject, and transmits a "registration data notification" including the captured image data, the subject ID, and the terminal ID to the server device 10 (see FIG. 6).

[0038] The terminal ID is an ID for identifying the authentication terminal 20 installed at each location. The MAC (Media Access Control) address or IP (Internet Protocol) address of the authentication terminal 20 can be used as the terminal ID.

[0039] The terminal ID is shared by any method between the server device 10 and each authentication terminal 20. For example, a system administrator determines a terminal ID and sets the determined terminal ID in the authentication terminal 20. The system administrator also inputs the terminal ID and information about the authentication terminal 20 (for example, the installation location of the authentication terminal 20) into the server device 10.

[0040] Upon receiving the registration data notification, the server device 10 searches the user management database using the target ID as a key to identify the corresponding account and data storage target. The server device 10 also identifies the location where the image data was taken based on the terminal ID.

[0041] The server device 10 stores the acquired image data in the specified account together with the date and time of shooting, the location of shooting, and the like.

[0042] <Provision of services> By logging in to their own accounts, users (account holders) can receive various services using image data stored in the server device 10 (image data showing data storage targets).

[0043] For example, the user can view the image data of the data storage target.

[0044] Alternatively, the user can obtain an electronic album created using the stored image data. The server device 10 organizes the image data based on the date and time the image data was taken, the location where the image data was taken, and so on, and creates an album.

[0045] Alternatively, the user can obtain a growth record of the data storage subject created using the stored image data. Specifically, the server device 10 creates a growth record of the data storage subject's changes in height and weight.

[0046] Alternatively, the user can obtain a posture diagnosis result of the data storage subject created using the stored image data. Specifically, the server device 10 determines whether the posture of the data storage subject is good or bad based on the image data and notifies the user of the determination result. For example, the server device 10 presents the user with a determination result such as "good posture" or "your shoulders are hunched."

[0047] Next, details of each device included in the information processing system according to the first embodiment will be described.

[0048] [Server device] 7 is a diagram illustrating an example of a processing configuration (processing module) of the server device 10 according to the embodiment of the present disclosure. Referring to FIG. 7, the server device 10 includes a communication control unit 201, a user registration control unit 202, an authentication unit 203, a data accumulation unit 204, a service provision control unit 205, and a storage unit 206.

[0049] The communication control unit 201 is a means for controlling communication with other devices. For example, the communication control unit 201 receives data (packets) from the authentication terminal 20. The communication control unit 201 also transmits data to the authentication terminal 20. The communication control unit 201 passes data received from other devices to other processing modules. The communication control unit 201 transmits data acquired from other processing modules to other devices. In this way, other processing modules transmit and receive data to and from other devices via the communication control unit 201. The communication control unit 201 has a function as a receiving unit that receives data from other devices and a function as a transmitting unit that transmits data to other devices.

[0050] The user registration control unit 202 is a means for controlling user registration.

[0051] When a user operates terminal 30 to access a site for user registration, user registration control unit 202 displays a GUI on terminal 30. Using the GUI, user registration control unit 202 acquires the user's (account holder's) name, gender, date of birth, address, login information (ID, password), contact information (e.g., telephone number, email address), etc.

[0052] Furthermore, the user registration control unit 202 acquires the subject information (such as name, sex, date of birth, and biometric information) of at least one or more data storage subjects. For example, the user registration control unit 202 acquires the subject information by displaying a GUI such as that shown in Fig. 8 on the terminal 30. Note that when the "additional registration button" is pressed in Fig. 8, the user registration control unit 202 acquires the subject information of the second and subsequent data storage subjects.

[0053] Here, when the user registration control unit 202 acquires a facial image as biometric information, it generates feature quantities from the facial image. The feature quantity generation process by the user registration control unit 202 can use existing technology, so a detailed description thereof will be omitted. For example, the user registration control unit 202 extracts the eyes, nose, mouth, etc. from the facial image as feature points. The user registration control unit 202 then calculates the positions of the feature points and the distances between the feature points as feature quantities (generating a feature vector consisting of multiple feature quantities).

[0054] When target person information and the like is acquired from a user (account holder), the user registration control unit 202 generates a user ID to identify the user. The user ID may be any information that can uniquely identify the user. For example, the user registration control unit 202 may assign a unique value each time user information is acquired and use this as the user ID.

[0055] Furthermore, the user registration control unit 202 generates a subject ID for identifying each data storage subject registered by the user. The subject ID may be any information that can uniquely identify the subject.

[0056] When the user ID and the subject ID are generated, the user registration control unit 202 adds a new entry to the user management database and generates an account. The user registration control unit 202 stores the user ID, name, sex, subject information (e.g., subject ID, name, biometric information), etc. in the added entry (see FIG. 9).

[0057] As shown in Fig. 9, image data is managed for each data storage target. In addition, the image data field stores the date and time of shooting, the location of shooting, specific data information (for example, the location where the file is stored), etc. for each image data.

[0058] 9 is an example and is not intended to limit the items to be stored in the user management database, etc. For example, biometric information of the account holder may be registered in the user management database.

[0059] The authentication unit 203 is a means for authenticating a person to be authenticated (a person to be data stored; for example, a child) detected by the authentication terminal 20.

[0060] When the authentication unit 203 receives the biometric information of the person to be authenticated from the authentication terminal 20, it authenticates the person to be authenticated using the received biometric information and the biometric information stored in the user management database, and notifies the authentication terminal 20 of the authentication result.

[0061] 10 is a flowchart showing an example of the operation of the authentication unit 203 according to an embodiment of the present disclosure. The operation of the authentication unit 203 will be described with reference to FIG.

[0062] When receiving an authentication request, the authentication unit 203 executes a matching process using the biometric information included in the request and the biometric information stored as subject information in each account of the user management database (step S101).

[0063] More specifically, the authentication unit 203 generates features from the facial image included in the authentication request. Since existing technology can be used for the feature generation process, a detailed description thereof will be omitted. For example, the authentication unit 203 extracts the eyes, nose, mouth, etc. from the facial image as feature points. The authentication unit 203 then calculates the positions of the feature points and the distances between the feature points as feature amounts (generating a feature vector consisting of multiple feature amounts).

[0064] The authentication unit 203 sets the generated feature as the target for matching and performs a matching process (1:N matching; N is a positive integer, same below) between the generated feature and the feature of the data storage target stored in the user management database.

[0065] The authentication unit 203 calculates the similarity between the feature to be matched and each of the multiple feature values ​​on the registration side. The similarity can be calculated using chi-square distance, Euclidean distance, or the like. Note that the greater the distance, the lower the similarity, and the closer the distance, the higher the similarity.

[0066] The authentication unit 203 determines that the matching process has failed if there is no feature among the multiple features stored in the user management database as biometric information of the data storage target that has a similarity with the feature to be matched that is greater than or equal to a predetermined value.

[0067] The authentication unit 203 determines that the matching process is successful if there is a feature among the multiple feature amounts stored in the user management database that has a similarity with the feature amount to be matched that is equal to or greater than a predetermined value. In this case, the entry with the biometric information with the highest similarity is identified as the entry of the person to be authenticated (the person whose data is to be stored and detected by the authentication terminal 20).

[0068] If the matching process fails (step S102, No branch), the authentication unit 203 sets the authentication result to "authentication failure" (step S103).

[0069] If the matching process is successful (step S102, Yes branch), the authentication unit 203 sets the authentication result to "authentication success" (step S104).

[0070] The authentication unit 203 transmits the authentication result (authentication success, authentication failure) to the authentication terminal 20 (step S105).

[0071] If the authentication fails, the authentication unit 203 transmits a negative response to that effect to the authentication terminal 20.

[0072] If the authentication is successful, the authentication unit 203 transmits an affirmative response indicating that fact to the authentication terminal 20. Furthermore, if the authentication is successful, the authentication unit 203 transmits an affirmative response including the subject ID of the data storage subject identified by the matching process to the authentication terminal 20.

[0073] The data storage unit 204 is a means for controlling the storage of data of data storage targets. The data storage unit 204 acquires image data of an individual who has been determined to have been successfully authenticated from the authentication terminal 20, and stores the acquired image data.

[0074] The data storage unit 204 processes the registration data notification received from the authentication terminal 20 .

[0075] When receiving the registration data notification, the data storage unit 204 searches the user management database using the subject ID included in the notification as a key, and identifies the corresponding entry (data storage subject).

[0076] Furthermore, the data storage unit 204 identifies the location where the image data was taken based on the terminal ID included in the registration data notification. For example, the data storage unit 204 refers to table information that stores terminal IDs and shooting locations in association with each other, and identifies the shooting location corresponding to the terminal ID.

[0077] The data storage unit 204 stores (adds to the image data field) the photographing date and time, the photographing location, information on the acquired image data, and the like in the image data field of the identified entry.

[0078] The service provision control unit 205 is a means (control means) that provides various services to users (account holders) regarding image data stored in their own accounts.

[0079] For example, the service provision control unit 205 uses the accumulated image data to create a growth record of one of the multiple data accumulation subjects, and provides the created growth record to a user (e.g., a guardian) who has a predetermined relationship with the one data accumulation subject.

[0080] When a user logs in to an account, the service provision control unit 205 displays a GUI such as that shown in Fig. 11 on the terminal 30. The service provision control unit 205 acquires the type of service desired by the user using the GUI such as that shown in Fig. 11.

[0081] <Viewing image data> When the user wishes to view the stored data (when the data view button is pressed), the service provision control unit 205 displays at least one image data item stored in the user's account on the terminal 30. For example, as shown in Fig. 12, the service provision control unit 205 displays each image data item, the shooting date and time, the shooting location, etc., on the terminal 30 in the order in which the image data items were taken.

[0082] The service provision control unit 205 may provide the user with an interface that accepts designation of the time and location of the image data to be viewed. The service provision control unit 205 may extract image data taken during a designated period or at a designated location from multiple image data, and present the extracted image data to the user.

[0083] <Creating an album> When the user desires to create an album (when the album creation button is pressed), the service provision control unit 205 creates an electronic album using image data stored in the user's account.

[0084] The service provision control unit 205 selects image data to be included in the album from the image data stored in the account. For example, the service provision control unit 205 may select image data randomly, or may select image data so that the image data are obtained at different times or at different locations.

[0085] The service provision control unit 205 creates an album by arranging the selected image data according to a predetermined layout. The service provision control unit 205 displays the created album on the terminal 30. For example, the service provision control unit 205 displays a screen such as that shown in FIG. 13 on the terminal 30.

[0086] The service provision control unit 205 may allow the user to modify the album created. For example, the service provision control unit 205 may provide an interface that enables deletion of image data used in the album, addition of image data to be used in the album, etc. Alternatively, the service provision control unit 205 may provide an interface that changes or modifies the image data itself.

[0087] Alternatively, the service provision control unit 205 may allow the user to select an album layout from a plurality of album layouts (for example, the arrangement of image data, background decoration, etc.).

[0088] It should be noted that the creation of an electronic album is obvious to those skilled in the art and is different from the gist of the present disclosure, so a detailed explanation will be omitted.

[0089] In this way, the service provision control unit 205 uses the stored image data to create an album for one data storage target (for example, a child), and provides the created album to a user (for example, the child's guardian).

[0090] <Creating a growth record> When the user wishes to create a growth record (when the growth record creation button is pressed), the service provision control unit 205 creates a growth record of the data storage target using image data stored in the user's account.

[0091] Specifically, the service provision control unit 205 creates a growth record of the changes in height and weight of the data accumulation target person.

[0092] The service provision control unit 205 estimates the height and / or weight of a person appearing in image data (still image data, video data). For example, the service provision control unit 205 inputs the image data into a learning model to estimate the height and / or weight of a person appearing in the image data.

[0093] The learning model is obtained by machine learning using a large amount of training data in which labels (estimated values ​​of height and / or weight) are assigned to image data (image data containing people). Any algorithm such as a support vector machine, boosting, or neural network can be used to generate the learning model. Since well-known techniques can be used for the algorithms such as the support vector machine, a description thereof will be omitted.

[0094] If the height and weight can be estimated from the image data, the service provision control unit 205 calculates the age of the data storage target at the time the image data was acquired based on the image data and the data storage target's date of birth.

[0095] The service provision control unit 205 generates a growth record (time-series changes in height and weight) of the data accumulation subject using the height and weight estimated from the image data and the calculated age. The service provision control unit 205 displays the generated growth record (growth record graph) on the terminal 30. For example, the service provision control unit 205 displays a screen such as that shown in FIG. 14 on the terminal 30.

[0096] <Posture diagnosis> When the user requests a posture diagnosis (when the posture diagnosis button is pressed), the service provision control unit 205 performs a posture diagnosis of the data storage target person using image data stored in the user's account.

[0097] Specifically, the service provision control unit 205 inputs the latest image data into the learning model and obtains a determination result regarding the posture of the person appearing in the image data. If a determination result cannot be obtained from the latest image data, the service provision control unit 205 obtains a determination result by inputting the image data immediately before the latest image data into the learning model. The service provision control unit 205 repeats this process and obtains a determination result regarding the posture of the data storage target person based on as recent image data as possible.

[0098] Alternatively, the service provision control unit 205 may input a plurality of image data into a learning model to determine changes in posture.

[0099] The service provision control unit 205 acquires a determination result such as "good posture," "posture that puts strain on the neck," "shoulders are bent," or "posture is gradually getting worse." The service provision control unit 205 displays the determination result on the terminal 30. For example, the service provision control unit 205 displays a screen such as that shown in FIG. 15 on the terminal 30.

[0100] The service provision control unit 205 may digitize the posture of the data storage target person and display a graph (time-series data) of the digitized posture on the terminal 30. The service provision control unit 205 can obtain a score (numerical value) for the posture of the data storage target person using a learning model.

[0101] In this way, the service provision control unit 205 uses the stored image data to perform posture diagnosis on one data storage subject (for example, a child), and provides the diagnosis result to the user (for example, the child's guardian).

[0102] Here, if multiple data storage targets are registered in a user's account, the service provision control unit 205 may use a GUI or the like to allow the user to select a target from among the multiple data storage targets for viewing data, creating albums, etc.

[0103] Furthermore, the service provision control unit 205 may allow the user to download data generated in each service. Specifically, when the download button shown in Figures 12 to 15 is pressed, the service provision control unit 205 transmits image data, an album (electronic album), etc. displayed on the terminal 30 to the terminal 30.

[0104] Alternatively, the service provision control unit 205 may allow the user to select the image data or the like to be downloaded.

[0105] The service provision control unit 205 may also display the name of the data storage target who has viewed the data or created an album, together with the image data, album, and the like.

[0106] The storage unit 206 is a means for storing information necessary for the operation of the server device 10. The storage unit 206 stores the biometric information of each of a plurality of data storage subjects.

[0107] [Authentication terminal] 16 is a diagram illustrating an example of a processing configuration (processing module) of the authentication terminal 20 according to an embodiment of the present disclosure. Referring to FIG. 16, the authentication terminal 20 includes a communication control unit 301, an authentication control unit 302, a data acquisition unit 303, and a storage unit 304.

[0108] The communication control unit 301 is a means for controlling communication with other devices. For example, the communication control unit 301 receives data (packets) from the server device 10. The communication control unit 301 also transmits data to the server device 10. The communication control unit 301 passes data received from other devices to other processing modules. The communication control unit 301 transmits data acquired from other processing modules to other devices. In this way, other processing modules transmit and receive data to and from other devices via the communication control unit 301. The communication control unit 301 has a function as a receiving unit that receives data from other devices and a function as a transmitting unit that transmits data to other devices.

[0109] The authentication control unit 302 is a means for controlling the authentication of a user (person to be authenticated). The authentication control unit 302 receives the authentication result of the person to be authenticated by transmitting the biometric information of the person to be authenticated to the server device 10, which stores the biometric information of each of a plurality of data storage subjects.

[0110] The authentication control unit 302 controls the display, speaker, etc. to play videos of dances, animations, etc. that children like. More specifically, the authentication control unit 302 plays a video (first video) before acquiring the biometric information of the person to be authenticated.

[0111] In principle, the authentication control unit 302 continues to play the above video while the authentication terminal 20 is running. The authentication control unit 302 detects a user who appears in front of the authentication terminal 20, attracted by the video that is constantly being played, and controls the authentication of the detected user.

[0112] The authentication control unit 302 controls the camera periodically or at a predetermined timing to acquire image data. The authentication control unit 302 determines whether the acquired image data contains a human face image, and if a face image is included, extracts the face image from the acquired image data.

[0113] Note that since existing technology can be used for the facial image extraction process by the authentication control unit 302, detailed description will be omitted. For example, the authentication control unit 302 may extract a facial image (face area) from image data using a learning model trained by a CNN (Convolutional Neural Network). Alternatively, the authentication control unit 302 may extract a facial image using a method such as template matching.

[0114] If the facial image is successfully extracted, the authentication control unit 302 transmits an authentication request including the biometric information (extracted facial image) to the server device 10.

[0115] The authentication control unit 302 receives a response (positive response, negative response) to the authentication request from the server device 10.

[0116] If a negative response indicating authentication failure is received, the authentication control unit 302 does not perform any particular process.

[0117] When an affirmative response indicating successful authentication is received, the authentication control unit 302 passes the subject ID included in the affirmative response to the data acquisition unit 303 .

[0118] The data acquisition unit 303 is a means for acquiring image data showing a person who has been successfully authenticated (a person to be authenticated who has been determined to have been successfully authenticated; a person whose data is to be stored).

[0119] When the target person ID is acquired from the authentication control unit 302, the data acquisition unit 303 acquires image data of the person to be authenticated. The data acquisition unit 303 controls a camera to acquire still image data or video data. For example, the data acquisition unit 303 acquires data of several still images or video data of several seconds.

[0120] The data acquisition unit 303 may acquire image data showing the person to be authenticated who has been determined to have been successfully authenticated while playing back a video (second video) different from the video (first video) that was previously played back.

[0121] The data acquisition unit 303 transmits the acquired image data to the server device 10. Specifically, the data acquisition unit 303 transmits to the server device 10 a “registration data notification” including the acquired image data, the subject ID, and the terminal ID.

[0122] In this way, when the authentication result of the person to be authenticated is successful, data acquisition unit 303 acquires image data showing the person to be authenticated who has been determined to have been successfully authenticated, and transmits the acquired image data to server device 10.

[0123] The storage unit 304 is a means for storing information necessary for the operation of the authentication terminal 20 .

[0124] [Device] Examples of the terminal 30 include a smartphone, a mobile phone, a game console, a mobile terminal device such as a tablet, a computer (personal computer, laptop computer), etc. The terminal 30 can be any equipment or device that can accept user operations and communicate with the server device 10, etc. Furthermore, the configuration of the terminal 30 is clear to those skilled in the art, so a detailed description thereof will be omitted.

[0125] [System Operation] Next, the operation of the information processing system according to the first embodiment will be described.

[0126] 17 is a sequence diagram showing an example of the operation of the information processing system according to the embodiment of the present disclosure. The operation of the information processing system according to the first embodiment will be described with reference to FIG.

[0127] When a person to be authenticated (for example, a child) is detected, authentication terminal 20 acquires biometric information of the person to be authenticated, and transmits an authentication request including the acquired biometric information to server device 10 (step S01).

[0128] The server device 10 executes authentication processing using the biometric information included in the received authentication request and the biometric information stored in the user management database (step S02).

[0129] The server device 10 transmits the authentication result (authentication success, authentication failure) to the authentication terminal 20 (step S03). If the authentication is success, the server device 10 transmits to the authentication terminal 20 the subject ID of the data storage subject identified by the matching process.

[0130] When the authentication success is received, the authentication terminal 20 acquires image data showing the person to be authenticated (step S04).

[0131] The authentication terminal 20 transmits a "registration data notification" including the acquired image data to the server device 10 (step S05).

[0132] The server device 10 stores the image data included in the registration data notification in the user's account (step S06).

[0133] Next, a modified example of the first embodiment will be described.

[0134] <Variation 1> In the above embodiment, the image data of the data storage target person is stored in the server device 10. However, the image data may be stored in the terminal 30 of the account holder instead of or in addition to the server device 10.

[0135] For example, when processing a registration data notification received from the authentication terminal 20, the server device 10 may send the image data and its accompanying information (photograph date and time, photo location, etc.) contained in the registration data notification to the account holder's email address, etc.

[0136] Alternatively, when the server device 10 processes the authentication request, it may send an affirmative response including the email address of the account holder to the authentication terminal 20. The authentication terminal 20 may send the image data to the server device 10 and also to the terminal 30 (the email address received from the server device 10).

[0137] When image data is stored in the terminal 30, the terminal 30 may use the stored image data to create an album, create a growth record, etc. In other words, the terminal 30 may have the function of the service provision control unit 205 of the server device 10.

[0138] <Variation 2> The terminal 30 that receives the image data of the data storage target from the server device 10 or the authentication terminal 20 may display the image data together with the date and time of the photo shoot, the location of the photo shoot, etc. in a pop-up display. The user (guardian) who sees the pop-up display can know the location of the child, etc., and feel at ease.

[0139] <Variation 3> When acquiring the biometric information of the person to be authenticated, the authentication terminal 20 may measure the height of the person to be authenticated using an infrared sensor or the like. The authentication terminal 20 may transmit an authentication request including the measured height to the server device 10. Alternatively, the authentication terminal 20 may instruct the person to be authenticated to stand in a predetermined position and acquire image data in which the person to be authenticated is photographed. The server device 10 may estimate the height of the person to be authenticated using image data captured while the person to be authenticated is standing in a predetermined position.

[0140] Alternatively, the authentication terminal 20 may be linked to a scale embedded in the floor or the like to measure the weight of the person to be authenticated. At this time, the authentication terminal 20 may display or not display the measured weight. The authentication terminal 20 may send an authentication request including the measured weight to the server device 10.

[0141] As described above, when the authentication terminal 20 according to the first embodiment detects a person to be authenticated in front of it, it requests the server device 10 to authenticate the detected person. That is, the authentication terminal 20 requests the server device 10 to determine whether the person to be authenticated is a person to be stored. If the person to be authenticated is a person to be stored, the authentication terminal 20 photographs the person to be authenticated and acquires image data. The authentication terminal 20 transmits the acquired image data to the server device 10. The server device 10 stores the acquired image data. The server device 10 provides various services using the stored image data. In particular, the server device 10 generates a growth record of the person to be stored (e.g., a child) and provides it to the user (e.g., a guardian). The server device 10 stores the child's photographs and other data as memories, and also creates a growth record that allows guardians to see the child's growth.

[0142] Furthermore, the authentication terminal 20 plays videos of dances, animations, etc. to obtain better image data. Furthermore, by installing the authentication terminal 20 at tourist spots, users (parents) can obtain photos and videos of fun memories with their children. As a result, the attractiveness of tourist spots is improved, and the value of tourist spots is increased.

[0143] In this way, the information processing system according to the first embodiment provides a signage service that connects to the neighborhood association portal (server device 10) within the child's range of activity. As a result, residents (guardians, residents) can connect with the local government through the signage (authentication terminal 20), which increases the appeal of the local government.

[0144] [Second embodiment] In the above embodiment, the operation, configuration, etc. of the information processing system are described assuming that information about data storage targets is stored in the server device 10. However, information about data storage targets, etc. may also be stored in a smartphone or the like carried by the data storage target.

[0145] In this case, the target person's smartphone may store at least a certificate regarding the reception of the service (service reception certificate) in the digital wallet.

[0146] A user accesses the server device 10 and creates an account. When the account is created, the smartphone carried by the subject person requests the server device 10 to issue a service enjoyment certificate. Upon receiving the request, the server device 10 generates a service enjoyment certificate that includes all or part of the information of the created account. For example, the server device 10 generates a service enjoyment certificate that includes subject information (e.g., subject ID, name, gender, date of birth, biometric information), etc.

[0147] The server device 10 transmits the generated service enjoyment certificate to the smartphone or the like. After transmitting the service enjoyment certificate, the server device 10 deletes the target person information and the like from the account. The smartphone or the like stores the received service enjoyment certificate in a digital wallet.

[0148] When the user stands in front of the authentication terminal 20, the authentication terminal 20, which is a device used by the service provider, may request the smartphone to provide a service enjoyment certificate.

[0149] In response to the request, the smartphone transmits the service receiving certificate to the authentication terminal 20.

[0150] The authentication terminal 20 provides a service using the service receipt certificate obtained from the smartphone. Specifically, the authentication terminal 20 performs authentication processing using biometric information obtained from the service receipt certificate and biometric information (a facial image obtained by photographing) obtained from the user in front of the user. If the authentication processing is successful, the authentication terminal 20 photographs the person to be authenticated (the person in front of the person whose data is to be stored) and acquires the image data. The authentication terminal 20 transmits the acquired image data and the target ID obtained from the service receipt certificate to the server device 10 (transmits a registration data notification).

[0151] As described above, the information processing system according to the second embodiment may realize a self-sovereign identity system in which a user manages and controls the information necessary for receiving a service. That is, a user may receive a service from a service provider while proactively managing his or her own identity information. In response to a request from the service provider, the user may provide the service provider with information required by the service provider. In this case, the certificate provided to the service provider may be a credential certificate. Furthermore, the service provider does not need to store and manage information that requires careful handling, such as the user's biometric information, when providing the service. As a result, the information management costs of the service provider are reduced.

[0152] For an explanation of digital wallets, certificate issuance, certificate usage, etc., please refer to the following.

[0153] <Digital Wallet> A digital wallet is an electronic information storage service that guarantees information security, including data integrity, reliability, and availability.

[0154] A user installs an application to realize a digital wallet on their user terminal 90. By opening a digital wallet on the user terminal 90, the user can store various digital content on the user terminal 90, such as electronic money, identification documents such as a student ID, passport or driver's license, various ticket information such as airline tickets or boarding passes, and certificates related to biometric information. Alternatively, the user may store service receipt certificates, information to be provided to others, etc. in the digital wallet.

[0155] For example, the user terminal 90 of a user stores digital content such as that shown in Fig. 18. The digital content stored in the user terminal 90 includes official identification documents such as passports and driver's licenses, employment certificates issued by companies and universities, graduation certificates, biometric certificates related to biometric information, and the like.

[0156] The user terminal 90 may perform identity verification using an identification card issued by a public institution such as a government agency. For example, the user terminal 90 may perform identity verification of the user when opening a digital wallet, as necessary.

[0157] For example, the user terminal 90 performs identity verification using an identification card such as a passport that contains the biometric information of the holder.

[0158] Examples of biometric information include data (features) calculated from physical characteristics unique to an individual, such as a face, fingerprint, voiceprint, veins, retina, and iris pattern. Alternatively, biometric information may be image data such as a face image or fingerprint image. The biometric information may be any information that includes the user's physical characteristics.

[0159] The user terminal 90 acquires information about the holder (issuer) of the identification card from the user's identification card. For example, the user terminal 90 acquires information about the holder of the passport from an IC (Integrated Circuit) chip in the passport.

[0160] Specifically, the user terminal 90 acquires basic information of the passport holder (the so-called four basic pieces of information: name, sex, date of birth, and address) and biometric information (facial image) of the passport holder. The user terminal 90 may store the acquired basic information in a digital wallet and manage it so that it can be provided to others.

[0161] Furthermore, the user terminal 90 acquires biometric information of the user (the person who opened the digital wallet). For example, the user terminal 90 acquires a facial image by photographing the user.

[0162] The user terminal 90 performs a matching process (authentication process) using the biometric information acquired from the identification card and the user's biometric information. If the authentication process (one-to-one authentication) is successful, the user terminal 90 opens a digital wallet. The user terminal 90 confirms through a matching process (authentication process) using the biometric information that the person in whose name the identification card was issued and the user using the digital wallet of the user terminal 90 are the same person.

[0163] If identity verification is successful, the user terminal 90 stores the biometric information obtained from the identification card or the biometric information obtained by photographing the user. The user terminal 90 may acquire the user's biometric information when the user terminal 90 is started up or when the digital wallet is started up, and perform identity verification using the acquired biometric information and the stored biometric information.

[0164] <Certificate issuance> A user acquires digital content to be stored in a digital wallet. For example, the user operates user terminal 90 to request a certificate issuer to issue a certificate.

[0165] Specifically, the digital wallet application requests a certificate issuer to issue a certificate. The certificate issuer then issues VCs (Verifiable Credentials), whose contents can be verified online, as the certificate. The certificate issuer then issues a credential certificate.

[0166] Prior to requesting the issuance of a credential certificate, the user's user terminal 90 generates a pair of a public key and a private key. The user terminal 90 also generates a decentralized identifier (DID). The user terminal 90 registers the generated DID (user ID; holder ID) and public key in the blockchain (step S1001 in FIG. 19).

[0167] Furthermore, the user's user terminal 90 presents the user ID and requests the certificate issuer (issuer server 91 managed by the certificate issuer) to issue a credential certificate. Specifically, the user terminal 90 transmits a "certificate issuance request" including information about the certificate to be issued, information identifying the user, the user ID, etc. to the certificate issuer's issuer server 91 (step S1002).

[0168] The issuer server 91 generates and stores the issuer's DID (issuer ID), private key, and public key in advance.

[0169] Upon receiving a certificate issuance request, the certificate issuer determines whether the user requesting the issuance of a credential certificate (VC) is eligible to receive the certificate. If the user is eligible to receive a credential certificate, the issuer server 91 generates a credential certificate (VC) that includes the issuer ID and the user ID.

[0170] Specifically, the issuer server 91 generates a credential certificate (VC) that includes metadata including the type of credential certificate, the name of the issuing organization, the date and time of issue, etc., a qualification information body, and the issuer's public key information, electronic signature, etc. The qualification information body contains specific information to be certified by the issuer.

[0171] The issuer server 91 transmits the generated credential certificate to the user terminal 90 of the user (user who will become the certificate holder; person requesting issuance of the certificate) (certificate issuance; step S1003).

[0172] Furthermore, the issuer server 91 registers the issuer ID and the generated public key and the like in the block chain (step S1004).

[0173] The user terminal 90 stores the received credential certificates (VCs) in the digital wallet. For example, when the user terminal 90 requests the issuer to issue a biometric information certificate, it stores the credential certificates (VCs) that certify the validity of the biometric information in the digital wallet. Alternatively, when the user terminal 90 requests the issue of an employment certificate from the user's employer, it stores the credential certificates (VCs) related to the user's employment in the digital wallet. Alternatively, the user terminal 90 stores a service enjoyment certificate related to the service to be enjoyed in the digital wallet.

[0174] If information different from the certificate issued by another party is stored in the digital wallet, the user terminal 90 can acquire the information different from the certificate using a GUI (Graphical User Interface) and store it in the digital wallet. Also, the digital wallet may store a certificate based on a so-called public key infrastructure.

[0175] <Certificate usage> The user presents the certificate or the like required by the service provider to the service provider. The service provider provides the service to the user using a provider device 92 (see FIG. 20). The provider device 92 may be a server, a gate device, a kiosk terminal, a tablet, a signage, or the like, depending on the type of service provided by the service provider.

[0176] The provider device 92 transmits a "certificate request" to the user terminal 90 (step S1011). The certificate request includes information about at least one certificate or the like required for the service provider to provide the service.

[0177] The user terminal 90 and the provider device 92 communicate with each other using an internet line, a mobile line, etc. Alternatively, the user terminal 90 and the provider device 92 communicate with each other using a short-range wireless communication means such as Bluetooth (registered trademark) or NFC (Near Field Communication).

[0178] In response to receiving the certificate provision request, the user terminal 90 transmits the credential certificates (VCs) stored in the digital wallet to the provider device 92. Specifically, the user terminal 90 selects a specified credential certificate from among multiple credential certificates stored in the digital wallet. Then, the user terminal 90 signs the selected credential certificate using a private key corresponding to the user's DID (user ID). The user terminal 90 transmits at least one signed credential certificate to the provider device 92 (step S1012).

[0179] In addition, before sending the credential certificate to the provider device 92, the user terminal 90 may present the user with information about the certificate requested by the service provider and obtain consent (user consent) to provide the certificate to the service provider.

[0180] The provider device 92 acquires the issuer ID and the user ID from the received credential certificate. Furthermore, the provider device 92 acquires the public key corresponding to the acquired issuer ID and the public key corresponding to the acquired user ID from the blockchain (step S1013).

[0181] Thereafter, the provider device 92 verifies at least one credential certificate received from the user terminal 90. Specifically, the provider device 92 verifies the signature of the holder and the signature of the issuer attached to the credential certificate. By verifying these signatures, the provider device 92 confirms that the credential certificate obtained from the user (credential certificate holder) has not been tampered with and that it has been issued by a trustworthy issuer.

[0182] If the provider device 92 successfully verifies the acquired credential certificate, it provides the service to the user.

[0183] If the service provider requests the provision of information other than the credential certificate, the terminal 30 may read the requested information from the digital wallet and transmit it to the provider device 92 .

[0184] Next, the hardware of each device constituting the information processing system will be described. Fig. 21 is a diagram showing an example of the hardware configuration of the server device 10.

[0185] The server device 10 can be configured by an information processing device (so-called computer), and has the configuration exemplified in Fig. 21. For example, the server device 10 includes a processor 311, a memory 312, an input / output interface 313, and a communication interface 314. The components such as the processor 311 are connected by an internal bus or the like, and are configured to be able to communicate with each other.

[0186] However, the configuration shown in Fig. 21 is not intended to limit the hardware configuration of the server device 10. The server device 10 may include hardware not shown, and may not include the input / output interface 313 as necessary. Furthermore, the number of processors 311 and the like included in the server device 10 is not intended to be limited to the example shown in Fig. 21, and for example, the server device 10 may include multiple processors 311.

[0187] The processor 311 is a programmable device such as a central processing unit (CPU), a micro processing unit (MPU), or a digital signal processor (DSP). Alternatively, the processor 311 may be a device such as a field programmable gate array (FPGA) or an application specific integrated circuit (ASIC). The processor 311 executes various programs including an operating system (OS).

[0188] The memory 312 is a random access memory (RAM), a read only memory (ROM), a hard disk drive (HDD), a solid state drive (SSD), etc. The memory 312 stores an OS program, application programs, and various data.

[0189] The input / output interface 313 is an interface for a display device and an input device (not shown). The display device is, for example, a liquid crystal display. The input device is, for example, a device that accepts user operations such as a keyboard or a mouse.

[0190] The communication interface 314 is a circuit, module, etc. that communicates with other devices. For example, the communication interface 314 includes a network interface card (NIC).

[0191] The functions of the server device 10 are realized by various processing modules. The processing modules are realized, for example, by the processor 311 executing a program stored in the memory 312. The program can be recorded on a computer-readable storage medium. The storage medium can be a non-transitory medium such as a semiconductor memory, a hard disk, a magnetic recording medium, or an optical recording medium. That is, the present invention can also be embodied as a computer program product. The program can be downloaded via a network or updated using a storage medium storing the program. The processing modules can also be realized by semiconductor chips.

[0192] The authentication terminal 20 and the like can also be configured using an information processing device, similar to the server device 10, and the basic hardware configuration is the same as that of the server device 10, so a description thereof will be omitted. The authentication terminal 20 includes devices such as a touch panel, a camera, a speaker, and a microphone.

[0193] The server device 10, which is an information processing device, is equipped with a computer, and functions of the server device 10 can be realized by causing the computer to execute a program. The server device 10 also executes a control method for the server device 10 by the program.

[0194] [Variations] The configuration, operation, etc. of the information processing system described in the above embodiment are merely examples, and are not intended to limit the configuration, etc. of the system.

[0195] The server device 10 may allow not only the account holder but also the data storage target to view the image data stored in the account. For example, the authentication terminal 20 acquires biometric information of the data storage target who wishes to view the data, and transmits it to the server device 10. If the biometric authentication is successful, the server device 10 transmits the image data of the data storage target to the authentication terminal 20. The data storage target (for example, a child) can view the image data together with friends, etc.

[0196] When acquiring image data of a person to be authenticated, authentication terminal 20 may play different images of the same person to be authenticated, rather than playing the same image multiple times.

[0197] When processing an authentication request, server device 10 may transmit attribute information of the person to be authenticated (person to be data stored) to authentication terminal 20. Authentication terminal 20 may play a video according to the received attribute information. For example, data acquisition unit 303 may play a video according to the gender or age of the person to be authenticated. In this way, authentication control unit 302 acquires attribute information of the person to be authenticated who has been determined to have been successfully authenticated from server device 10. Data acquisition unit 303 may select a video to be played according to the attribute information of the person to be authenticated who has been determined to have been successfully authenticated.

[0198] If multiple data storage targets are shown in the image data, the server device 10 may transmit the target IDs of each of the multiple data storage targets to the authentication terminal 20. In this case, the authentication terminal 20 may transmit a registration data notification to the server device 10, including the acquired image data, the multiple target IDs, and the terminal ID. Furthermore, if the multiple target IDs are not target IDs stored in the same account, the server device 10 may notify the account holder of information about targets stored in other accounts. For example, consider a case where child A and child B appear together in the image data, and both children are data storage targets, with child A being the child of guardian C and child B being the child of guardian D. In this case, the server device 10 transmits information about child B (e.g., name) to the terminal 30 of guardian C, and transmits information about child A to the terminal 30 of guardian D.

[0199] In the above embodiment, it has been described that the authentication terminal 20 requests the server device 10 to authenticate the person to be authenticated, and transmits image data to the server device 10 after receiving notification of successful authentication. However, the authentication terminal 20 may omit sending the authentication request and transmit image data of the person to be authenticated to the server device 10. If the server device 10 is successful in matching the acquired image data with the biometric information stored in the user management database, the server device 10 may store the acquired image data in an account. If the matching process fails, the server device 10 may discard the acquired image data.

[0200] When the authentication terminal 20 detects a person to be authenticated in front of it, it may use image data of the detected person to determine whether the person is under a predetermined age. If the person to be authenticated is under a predetermined age, the authentication terminal 20 may send an authentication request including the biometric information of the person to be authenticated to the server device 10. That is, the authentication terminal 20 may omit the authentication request for adults who are unlikely (or unlikely to be) registered as data storage targets. In other words, the authentication terminal 20 may use the acquired image data to narrow down the biometric information for which authentication is requested. The authentication terminal 20 may estimate the age of the person to be authenticated by inputting the acquired image data into a learning model.

[0201] In the above embodiment, the case where the services of data browsing, album creation, growth record creation, and posture diagnosis are provided using the accumulated image data has been described. However, other services may be provided using the accumulated image data. For example, the server device 10 may perform a health check, physical condition diagnosis, etc., of the data accumulation subject. In this case, the service provision control unit 205 inputs the latest accumulated image data into a learning model to obtain the health condition and physical condition of the data accumulation subject. The service provision control unit 205 displays the obtained health condition, etc. on the terminal 30.

[0202] In the above embodiment, the server device 10 creates an album for each data storage target. However, the service provision control unit 205 may create an album for multiple data storage targets stored in the same account. For example, if two siblings are registered as data storage targets, the service provision control unit 205 may create one album using image data for each of the two siblings.

[0203] When a poor posture diagnosis result is obtained during posture diagnosis, the server device 10 may provide the user with advice on how to improve their posture.

[0204] In the above embodiment, a case has been described in which a user performs user registration using the terminal 30. However, user registration may also be performed via the authentication terminal 20. For example, a parent and a child may operate the authentication terminal 20 together to perform user registration.

[0205] When presenting a growth record to a user, server device 10 may provide an interface that presents the user with image data that served as the basis for generating the growth record. For example, when a user presses a point on a graph (or a plot of data that constitutes the graph) displayed on terminal 30, server device 10 may pop up image data that was used to calculate the height and weight of the pressed point. For example, when a user presses a point on the graph that corresponds to a height of 80 cm in a height growth record, server device 10 displays on terminal 30 image data that was taken when the data accumulation subject was 80 cm tall.

[0206] When the server device 10 quantifies the posture of the data storage subject and displays a graph of the quantified posture on the terminal 30, the server device 10 may also provide an interface that presents the user with the image data that formed the basis of the posture diagnosis results (quantified posture).

[0207] When playing back a video different from the video that was being played back before authenticating the data storage target, the authentication terminal 20 may allow the data storage target (person to be authenticated) to select the video to be played back on the authentication terminal 20. The authentication terminal 20 may provide an interface that displays options for the song to be played, background, etc., and accepts the selection of the person to be authenticated.

[0208] In the above embodiment, the case where the user management database is configured inside the server device 10 has been described, but the database may also be configured on an external database server or the like. That is, some of the functions of the server device 10 may be implemented on another server. More specifically, it is sufficient that the above-described "data provision control unit (data provision control means)" and the like are implemented on any of the devices included in the system.

[0209] The form of data transmission and reception between each device (for example, the server device 10, the authentication terminal 20) is not particularly limited, but the data transmitted and received between these devices may be encrypted. Biometric information and the like is transmitted and received between these devices, and in order to appropriately protect this information, it is desirable that encrypted data be transmitted and received.

[0210] In the flow charts (flowcharts, sequence diagrams) used in the above explanation, multiple steps (processes) are described in order, but the execution order of the steps executed in the embodiments is not limited to the order described. In the embodiments, the order of the illustrated steps can be changed to the extent that the content is not affected, such as by executing each process in parallel.

[0211] The above-described embodiments have been described in detail to facilitate understanding of the present disclosure, and it is not intended that all of the above-described configurations are required. Furthermore, when multiple embodiments are described, each embodiment may be used alone or in combination. For example, it is possible to replace part of the configuration of one embodiment with the configuration of another embodiment, or to add the configuration of another embodiment to the configuration of one embodiment. Furthermore, it is possible to add, delete, or replace part of the configuration of one embodiment with another configuration.

[0212] The above explanation makes clear the industrial applicability of the present invention, and the present invention can be suitably applied to information processing systems that provide growth record creation services, etc., using accumulated image data.

[0213] Some or all of the above embodiments can be described as, but are not limited to, the following supplementary notes.

[0214] [Appendix 1] a storage means for storing biometric information of each of a plurality of data accumulation subjects; an authentication means for receiving biometric information of a person to be authenticated from an authentication terminal, authenticating the person to be authenticated using the received biometric information and the stored biometric information, and notifying the authentication terminal of the authentication result; a data storage means for acquiring image data of the person to be authenticated who has been determined to have been successfully authenticated from the authentication terminal and storing the acquired image data; a control means for creating a growth record of one of the plurality of data storage subjects using the stored image data, and providing the created growth record to a user who has a predetermined relationship with the one data storage subject; A server device comprising:

[0215] [Appendix 2] The server device according to claim 1, wherein the control means uses the stored image data to create an album for the one data storage target person and provides the created album to the user.

[0216] [Appendix 3] The server device according to claim 1 or 2, wherein the control means uses the stored image data to perform a posture diagnosis of the one data storage subject and provides the diagnosis result to the user.

[0217] [Appendix 4] an authentication control means for receiving an authentication result of a person to be authenticated by transmitting biometric information of the person to be authenticated to a server device that stores biometric information of each of a plurality of data storage subjects; a data acquisition means for acquiring image data of the person to be authenticated whose authentication result is successful, and transmitting the acquired image data to the server device, when the authentication result of the person to be authenticated is successful; An authentication terminal comprising:

[0218] [Appendix 5] 5. The authentication terminal according to claim 4, wherein the authentication control means plays back the first video before acquiring biometric information of the person to be authenticated.

[0219] [Appendix 6] The authentication terminal described in Appendix 5, wherein the data acquisition means acquires image data showing the person to be authenticated who has been determined to have been successfully authenticated while playing back a second image different from the first image.

[0220] [Appendix 7] the authentication control means acquires attribute information of the person to be authenticated who has been determined to have been successfully authenticated from the server device; 7. The authentication terminal according to claim 6, wherein the data acquisition means selects a video to be played back in accordance with the attribute information of the person to be authenticated who has been determined to have been successfully authenticated.

[0221] [Appendix 8] An authentication terminal; a server device; Including, The server device a storage means for storing biometric information of each of a plurality of data accumulation subjects; an authentication means for receiving biometric information of a person to be authenticated from the authentication terminal, authenticating the person to be authenticated using the received biometric information and the stored biometric information, and notifying the authentication terminal of the authentication result; a data storage means for acquiring image data of the person to be authenticated who has been determined to have been successfully authenticated from the authentication terminal and storing the acquired image data; a control means for creating a growth record of one of the plurality of data storage subjects using the stored image data, and providing the created growth record to a user who has a predetermined relationship with the one data storage subject; A system comprising:

[0222] [Appendix 9] The system described in Appendix 8, wherein the control means uses the stored image data to create an album for the one data storage subject and provides the created album to the user.

[0223] [Appendix 10] The system described in Appendix 8 or 9, wherein the control means uses the stored image data to perform a posture diagnosis of the one data storage subject and provides the diagnosis result to the user.

[0224] [Appendix 11] a storage step of storing biometric information of each of a plurality of data accumulation subjects; an authentication step of receiving biometric information of a person to be authenticated from an authentication terminal, authenticating the person to be authenticated using the received biometric information and the stored biometric information, and notifying the authentication terminal of the authentication result; a data storage step of acquiring image data of the person to be authenticated who has been determined to have been successfully authenticated from the authentication terminal and storing the acquired image data; a control step of creating a growth record of one of the plurality of data storage subjects using the stored image data, and providing the created growth record to a user who has a predetermined relationship with the one data storage subject; A method for controlling a server device, comprising:

[0225] [Appendix 12] A control method for a server device described in Appendix 11, wherein the control process uses the accumulated image data to create an album for the one data accumulation target person and provides the created album to the user.

[0226] [Appendix 13] A control method for a server device described in Appendix 11 or 12, wherein the control step uses the stored image data to perform a posture diagnosis of the one data storage subject and provides the diagnosis result to the user.

[0227] [Appendix 14] The computer installed in the server device a storage process for storing biometric information of each of a plurality of data accumulation subjects; an authentication process in which, when biometric information of a person to be authenticated is received from an authentication terminal, the person to be authenticated is authenticated using the received biometric information and the stored biometric information, and an authentication result is notified to the authentication terminal; a data storage process of acquiring image data of the person to be authenticated who has been determined to have been successfully authenticated from the authentication terminal and storing the acquired image data; a control process for creating a growth record of one of the plurality of data storage subjects using the stored image data, and providing the created growth record to a user who has a predetermined relationship with the one data storage subject; A program that executes the following.

[0228] [Appendix 15] The program described in Appendix 14, wherein the control process uses the stored image data to create an album for the one data storage target, and provides the created album to the user.

[0229] [Appendix 16] The program described in Appendix 14 or 15, wherein the control process uses the stored image data to perform a posture diagnosis of the one data storage subject and provides the diagnosis result to the user.

[0230] Furthermore, some or all of the configurations described in Supplementary Notes 2 and 3, which are dependent on Supplementary Note 1, may also be dependent on Supplementary Notes 8, 11, and 14 in the same dependent relationship as Supplementary Notes 2 and 3. Furthermore, not limited to Supplementary Notes 1, 8, 11, and 14, some or all of the configurations described as Supplements may be made dependent on various hardware, software, various recording means for recording software, or systems, within the scope of each of the above-mentioned embodiments.

[0231] The disclosures of the above-cited prior art documents are incorporated herein by reference. Although the embodiments of the present invention have been described above, the present invention is not limited to these embodiments. Those skilled in the art will understand that these embodiments are merely illustrative and that various modifications are possible without departing from the scope and spirit of the present invention. In other words, the present invention naturally includes various modifications and alterations that may be made by those skilled in the art in accordance with the entire disclosure, including the claims, and the technical concepts thereof. [Explanation of symbols]

[0232] 10 Server device 20 Authentication Terminal 30 devices 90 User terminal 91 Issuer Server 92 Provider device 100 Server device 101 Memory means 102 Authentication Methods 103 Data storage means 104 Control Means 201 Communication control unit 202 User registration control unit 203 Authentication Department 204 Data Storage Unit 205 Service provision control section 206 Memory section 301 Communication Control Unit 302 Authentication control section 303 Data Acquisition Department 304 Storage section 311 processor 312 memory 313 Input / Output Interface 314 Communication Interface

Claims

1. a storage means for storing biometric information of each of a plurality of data accumulation subjects; an authentication means for receiving biometric information of a person to be authenticated from an authentication terminal, authenticating the person to be authenticated using the received biometric information and the stored biometric information, and notifying the authentication terminal of the authentication result; a data storage means for acquiring image data of the person to be authenticated who has been determined to have been successfully authenticated from the authentication terminal and storing the acquired image data; a control means for creating a growth record of one of the plurality of data storage subjects using the stored image data, and providing the created growth record to a user who has a predetermined relationship with the one data storage subject; A server device comprising:

2. 2. The server device according to claim 1, wherein said control means creates an album for said one data storage subject using said stored image data, and provides said created album to said user.

3. 3. The server device according to claim 1, wherein the control means performs a posture diagnosis of the one data storage subject using the stored image data, and provides the diagnosis result to the user.

4. an authentication control means for receiving an authentication result of a person to be authenticated by transmitting biometric information of the person to be authenticated to a server device that stores biometric information of each of a plurality of data storage subjects; a data acquisition means for acquiring image data of the person to be authenticated whose authentication result is successful, and transmitting the acquired image data to the server device, when the authentication result of the person to be authenticated is successful; An authentication terminal comprising:

5. 5. The authentication terminal according to claim 4, wherein the authentication control means reproduces the first video before acquiring biometric information of the person to be authenticated.

6. The authentication terminal according to claim 5 , wherein the data acquisition means acquires image data showing the person to be authenticated who has been determined to have been successfully authenticated, while playing back a second image different from the first image.

7. the authentication control means acquires attribute information of the person to be authenticated who has been determined to have been successfully authenticated from the server device; The authentication terminal according to claim 6 , wherein the data acquisition means selects a video to be played back in accordance with the attribute information of the person who has been determined to have been successfully authenticated.

8. An authentication terminal; a server device; Including, The server device a storage means for storing biometric information of each of a plurality of data accumulation subjects; an authentication means for receiving biometric information of a person to be authenticated from the authentication terminal, authenticating the person to be authenticated using the received biometric information and the stored biometric information, and notifying the authentication terminal of the authentication result; a data storage means for acquiring image data of the person to be authenticated who has been determined to have been successfully authenticated from the authentication terminal and storing the acquired image data; a control means for creating a growth record of one of the plurality of data storage subjects using the stored image data, and providing the created growth record to a user who has a predetermined relationship with the one data storage subject; A system comprising:

9. a storage step of storing biometric information of each of a plurality of data accumulation subjects; an authentication step of receiving biometric information of a person to be authenticated from an authentication terminal, authenticating the person to be authenticated using the received biometric information and the stored biometric information, and notifying the authentication terminal of the authentication result; a data storage step of acquiring image data of the person to be authenticated who has been determined to have been successfully authenticated from the authentication terminal and storing the acquired image data; a control step of creating a growth record of one of the plurality of data storage subjects using the stored image data, and providing the created growth record to a user who has a predetermined relationship with the one data storage subject; A method for controlling a server device, comprising:

10. The computer installed in the server device a storage process for storing biometric information of each of a plurality of data accumulation subjects; an authentication process in which, when biometric information of a person to be authenticated is received from an authentication terminal, the person to be authenticated is authenticated using the received biometric information and the stored biometric information, and an authentication result is notified to the authentication terminal; a data storage process of acquiring image data of the person to be authenticated who has been determined to have been successfully authenticated from the authentication terminal and storing the acquired image data; a control process for creating a growth record of one of the plurality of data storage subjects using the stored image data, and providing the created growth record to a user who has a predetermined relationship with the one data storage subject; A program that executes the following.

Images