Information processing device, information processing system, facial recognition device, information processing method, and program

Abstract

The present invention provides an information processing device that can determine which booth a person (for example, a job seeker) visited when they were subjected to facial recognition at a venue. [Solution] The information processing device 30 includes a face image acquisition unit 31 that registers face information in advance and acquires a first face image of a person who is a subject of face recognition and visits a booth set up at the venue; an authentication result acquisition unit 32 that acquires the result of face recognition of the person based on the face information and face information extracted from the first face image; and a recording unit 33 that records the result of face recognition and the location where face recognition was performed as movement information of the person being recognized, in association with the person being recognized.

Description

Technical Field

[0001] The present disclosure relates to an information processing apparatus, an information processing system, a face authentication apparatus, an information processing method, and a program.

Background Art

[0002] A technique for an educational institution to grasp the employment activity status of students is known (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the above Patent Document 1, it is impossible to grasp which booth a face authentication target person (for example, a job hunting student) who visited a booth installed at the venue visited, and there is room for improvement in this regard.

[0005] An object of the present disclosure is to provide an information processing apparatus, an information processing system, an information processing method, and a program that can grasp which booth a face authentication target person (for example, a job hunting student) who visited a booth installed at the venue visited in view of the above problems.

Means for Solving the Problems

[0006] The information processing apparatus of the present disclosure includes a face image acquisition unit that registers face information in advance and acquires a first face image of a face authentication target person who visited a booth installed at the venue, and an authentication result acquisition unit that acquires a face authentication result of the face authentication target person based on the face information and the face information extracted from the first face image, and a recording unit that records, as the movement line information of the face authentication target person, the face authentication result and the position where the face authentication was performed in association with the face authentication target person.

[0007] The information processing system disclosed herein includes: a camera that has pre-registered facial information and captures a first facial image of a person who visits a booth set up at a venue; a facial image acquisition unit that acquires the first facial image; a facial recognition device that performs facial recognition of the person based on the facial information and facial information extracted from the first facial image; an authentication result acquisition unit that acquires the result of facial recognition of the person; and a recording unit that records the result of facial recognition and the location where the facial recognition was performed as movement information of the person, in association with the person.

[0008] The facial recognition device described herein performs facial recognition of the person to be recognized.

[0009] The information processing method disclosed herein comprises: a face image acquisition step of acquiring a first face image of a person who has registered face information in advance and has visited a booth set up at a venue; an authentication result acquisition step of acquiring the result of face authentication of the person based on the face information and face information extracted from the first face image; and a recording step of recording the result of face authentication and the location where the face authentication was performed as movement information of the person who is to be authenticated, in association with the person who is to be authenticated.

[0010] The program disclosed herein is a program that causes a computer to execute the following steps: a face image acquisition step of acquiring a first face image of a person who has registered face information in advance and has visited a booth set up at the venue; an authentication result acquisition step of acquiring the result of face authentication of the person based on the face information and face information extracted from the first face image; and a recording step of recording the result of face authentication and the location where the face authentication was performed as movement information of the person, in association with the person. [Effects of the Invention]

[0011] This disclosure provides an information processing device, an information processing system, a facial recognition device, an information processing method, and a program that can determine which booth a person (e.g., a job seeker) visited when they came to a booth set up at a venue. [Brief explanation of the drawing]

[0012] [Figure 1] This is a schematic diagram of the information processing device 30. [Figure 2] This is a flowchart illustrating an example of the operation of the information processing device 30. [Figure 3] This is a block diagram showing the overall configuration of Information Processing System 1 related to this disclosure. [Figure 4] This is an example of a venue map image that includes booth images symbolizing the movement of job-seeking students and the layout of the booths. [Figure 5] This is a sequence diagram illustrating an example of the operation of Information Processing System 1. [Figure 6] This is a sequence diagram of another example of operation of Information Processing System 1. [Figure 7] This is a sequence diagram of another example of operation of Information Processing System 1. [Figure 8] This is a block diagram illustrating the hardware configuration of the computer 900 that implements the information processing device 30. [Modes for carrying out the invention]

[0013] Embodiments of the present disclosure will be described in detail below with reference to the drawings. In each drawing, the same or corresponding elements are denoted by the same reference numerals. For clarity of explanation, redundant explanations will be omitted where necessary.

[0014] <Embodiment 1> Embodiment 1 of this disclosure will be described below with reference to the drawings.

[0015] Figure 1 is a schematic diagram of the information processing device 30.

[0016] As shown in FIG. 1, the information processing apparatus 30 includes a face image acquisition unit 31 that registers face information in advance and acquires a first face image of a face authentication target person who has visited a booth installed at the venue, an authentication result acquisition unit 32 that acquires a face authentication result of a job hunting student who is a face authentication target person based on the face information and the face information extracted from the first face image, and a recording unit 33 that records, as the movement line information of the job hunting student who is the face authentication target person, the face authentication result and the position where the face authentication was performed in association with the job hunting student who is the face authentication target person.

[0017] Next, an example of the operation of the information processing apparatus 30 will be described.

[0018] FIG. 2 is a flowchart of an example of the operation of the information processing apparatus 30.

[0019] First, the face image acquisition unit 31 acquires a first face image of a face authentication target person who has registered face information in advance and visited a booth installed at the venue (step S1).

[0020] Next, the authentication result acquisition unit 32 acquires a face authentication result of a job hunting student who is a face authentication target person based on the face information and the face information extracted from the first face image (step S2).

[0021] Next, the recording unit 33 records, as the movement line information of the job hunting student who is the face authentication target person, the face authentication result and the position where the face authentication was performed in association with the job hunting student who is the face authentication target person (step S3).

[0022] As described above, according to the first embodiment, it is possible to grasp which booth a face authentication target person (for example, a job hunting student) who has visited a booth installed at the venue has visited.

[0023] <Embodiment 2> Subsequently, Embodiment 2 will be described. Embodiment 2 is a specific example of Embodiment 1 described above.

[0024] (Overview of the Information Processing System 1) As a prerequisite, it is assumed that the administrator (university career center staff) has registered the faculty and name of the person to be facially recognized (hereinafter referred to as "job seeker") in advance. Furthermore, it is assumed that the job seeker has registered their own facial information using a facial registration website on their smartphone or similar device. These procedures can be carried out using publicly available technologies.

[0025] When job seekers visit a booth set up at the venue, they perform facial recognition using an authentication terminal 20 installed at each booth. This facial recognition may utilize existing services (for example, GPS-linked services). At that time, the results of the facial recognition and the location where the facial recognition was performed are recorded as information about the job seeker's movement in a storage unit 37 that is built into or attached to the information processing device 30, and are associated with the job seeker.

[0026] University career center staff can access the recorded movement information (or processed information including movement information) using university terminals 60 (information processing devices), etc., to confirm who visited which booth. Furthermore, based on the recorded movement information (or processed information including movement information), it is possible to retrospectively analyze not only who visited which booth, but also the nature of their movement. In addition, by linking faculty information, grade information, etc., to the "who" part, it becomes possible to analyze by faculty or by grade, for example. Moreover, based on the recorded movement information (or processed information including movement information), it is possible to analyze the quality of the booth layout set up at the venue, and use this to improve the layout of each booth when setting up booths in the future. Furthermore, the movement path information (or processed information including movement path information, based on this information) may be displayed in the form of map information (see Figure 4), or it may be displayed in a tabular format (not shown) with the user name, facial recognition result, and location (or booth) where facial recognition was performed on a single row.

[0027] (Configuration of Information Processing System 1) Figure 3 is a block diagram showing the overall configuration of the information processing system 1 related to this disclosure.

[0028] Information processing system 1 includes a registration terminal 10, an authentication terminal 20, an information processing device 30, a facial recognition device 40, and a booth terminal 50.

[0029] The venue is, for example, a place where job seminars or job-hunting events are held. Booths B1, B2, etc. are company booths set up by companies, etc., for job-seeking students. There are multiple booths B1, B2, etc. set up in the venue. This disclosure is not limited to venues where job-hunting seminars or job-hunting events are held, but is also applicable to exhibitions and academic conferences (in the form of venues where booths are set up). Furthermore, it is applicable to people other than job-seeking students (for example, company employees).

[0030] The registration terminal 10, authentication terminal 20, information processing device 30, facial recognition device 40, and booth terminal 50 communicate with each other via network N. Network N is a wired or wireless communication line. For example, a wireless LAN (Local Area Network) or an internet connection can be used as network N. The type of communication is not limited.

[0031] The registration terminal 10 is used to register the facial information of job seekers in advance (before going to the venue). The registration terminal 10 is an information processing device equipped with a camera 11, a display 12, and a communication unit 13 (communication function), such as a smartphone owned by the job seeker. Before going to the venue, the job seeker takes an image of their face with the camera 11, accesses a designated site via the communication unit 13, and registers the captured image of their face (facial information extracted from the image, etc.). The registration terminal 10 may also be equipped with a satisfaction input unit 14 for job seekers to input their satisfaction level with the booths they visited. The satisfaction input unit 14 is, for example, a touch panel located on the display 12.

[0032] The authentication terminal 20 is used to perform facial recognition on job-seeking students who visit the booths. Multiple authentication terminals 20 are provided at each of the booths. The authentication terminal 20 is an information processing device, such as a tablet (general-purpose tablet), equipped with a camera 21, a display 22, a location detection unit 23 (such as GPS), and a communication unit 24. The camera 21 has pre-registered facial information and captures a first facial image of job-seeking students who visit the booths set up at the venue.

[0033] The authentication terminal 20 transmits the facial image of the job seeker captured by the camera 21 and the location detected by the location detection unit 23 (the location where facial recognition was performed) via the network N, receives the authentication result sent back via the network N, and displays the authentication result on the display 22.

[0034] The information processing device 30 is, for example, a server device (a physical server device or a virtual server device). The information processing device 30 includes a face image acquisition unit 31, an authentication result acquisition unit 32, a recording unit 33, a map image generation unit 34, a communication unit 35, and a satisfaction level acquisition unit 36.

[0035] The facial image acquisition unit 31 acquires the first facial image of a job seeker who has pre-registered facial information and who has visited a booth set up at the venue.

[0036] The authentication result acquisition unit 32 acquires the facial authentication result of the person to be facially authenticated based on the facial information and the facial information extracted from the first facial image.

[0037] The recording unit 33 records the results of facial recognition and the location where facial recognition was performed as movement information of job seekers in the storage unit 37, associating them with the job seekers. The movement information recorded in the storage unit 37 includes items such as username (user ID, etc.), facial recognition results, location where facial recognition was performed, booth (booth name, etc.), and satisfaction level (booth satisfaction level). Furthermore, faculty information, academic performance information, etc. may also be stored in the storage unit 37, linked to the username (user ID, etc.).

[0038] The map image generation unit 34 generates a map image of the venue, including the movement patterns of job seekers and booth images symbolizing the booths, based on the movement information and map images of job seekers stored in the storage unit 37. Figure 4 is an example of a map image of the venue, including the movement patterns of job seekers and booth images symbolizing the booths. In Figure 4, the thick arrow indicated by the symbol L1 represents the movement patterns of job seekers. On the other hand, the rectangles indicated by the symbols B1 to B9 in Figure 4 represent booth images symbolizing the booths. The booth images are stored in the storage unit 37 together with the map image of the venue.

[0039] The communications unit 35 transmits a map image of the venue to a designated terminal that requested the map image. The designated terminal is, for example, a university terminal operated by a university career center staff member, but is not limited to this.

[0040] The satisfaction level acquisition unit 36 ​​acquires the satisfaction level of the booths entered by job seekers via the satisfaction level input unit 14 from registered terminals, etc., via the network N. The recording unit 33 records the booths and the satisfaction level of those booths (the satisfaction level acquired by the satisfaction level acquisition unit 36) in the storage unit 37, associating them with the job seekers who are the subject of facial recognition.

[0041] The facial recognition device 40 performs facial recognition of job seekers visiting the booth by executing predetermined processing based on facial information previously registered by the registration terminal 10 and facial information extracted from the first facial image captured by the authentication terminal 20. A known facial recognition process may be used for this facial recognition process.

[0042] Booth terminals 50 are installed near the entrance of each booth B1, B2, etc. Booth terminals 50 have the same configuration and functions as authentication terminals 20.

[0043] Next, an example of the operation of the information processing system 1 with the above configuration will be described.

[0044] Figure 5 is a sequence diagram of an example of the operation of the information processing system 1.

[0045] The following assumes that job seekers have already registered their facial information in advance (before going to the venue) using registration terminal 10, etc.

[0046] The following describes an example of what happens when a job-seeking student arrives at the venue, visits a booth of interest, uses the authentication terminal 20 to perform facial recognition at that booth, and then receives an explanation from a representative of the company that operates the booth (e.g., an employee).

[0047] First, a first facial image of the job seeker visiting the booth is captured (step S10). The first image is captured by an authentication terminal 20 (camera 21) installed in the booth where the job seeker visited. This captured first facial image is transmitted to the information processing device 30 along with its location (step S11). The location is the position where the facial recognition was performed. The location is detected, for example, by an authentication terminal 20 (location detection unit 23) installed in the booth where the job seeker visited.

[0048] Next, the information processing device 30 acquires the first image and location transmitted from the authentication terminal 20 (step S12) and sends a facial recognition request to the facial recognition device 40 (step S13). This facial recognition request includes the first facial image acquired in step S12.

[0049] Next, the facial recognition device 40 performs facial recognition processing (step S14). Specifically, the facial recognition device 40 performs facial recognition of job seekers visiting the booth by performing predetermined processing based on facial information previously registered by the registration terminal 10 and facial information extracted from the first facial image transmitted in step S13.

[0050] Next, the facial recognition device 40 transmits the facial recognition result to the information processing device 30 (step S15).

[0051] Next, the information processing device 30 records the result of facial recognition and the location where the facial recognition was performed (the location obtained in step S12) in association with the job seeker (step S16). This is accomplished by the recording unit 33. The recording unit 33 records the result of facial recognition and the location where the facial recognition was performed in association with the job seeker as movement information in the storage unit 37. The information processing device 30 also transmits the result of facial recognition to the authentication terminal 20 (step S17).

[0052] Next, the authentication terminal 20 displays the facial recognition result on the display 22 (step S18).

[0053] The processes described in steps S10 to S18 are repeated each time a job seeker visits a booth set up at the venue. As a result, for each job seeker, the results of facial recognition and multiple combinations of the locations where facial recognition occurred (movement information) are recorded in the storage unit 37.

[0054] Figure 6 is a sequence diagram of another example of operation of the information processing system 1.

[0055] The following assumes that job seekers have already registered their facial information in advance (before going to the venue) using registration terminal 10, etc.

[0056] The following describes examples of actions taken by job-seeking students who arrive at the venue and approach a booth but do not visit it due to reasons such as the booth being crowded.

[0057] First, a second facial image of the job seeker approaching the booth is captured (step S20). The second image is captured by a booth terminal 50 (camera) located near the entrance of the booth that the job seeker is approaching.

[0058] Next, it is determined whether or not predetermined conditions are met (step S21). The predetermined conditions are for determining whether or not a job seeker showed interest in a booth, even if they did not visit it. For example, the predetermined conditions may include whether or not the job seeker spoke with a specific person (a person related to the company that set up the booth (e.g., an employee)) for a certain period of time, or whether or not the job seeker remained in the same place for a predetermined period of time while facing the booth. Whether or not these predetermined conditions are met can be determined, for example, by performing predetermined image processing on the second image captured in step S20.

[0059] Next, if the determination in step S21 is found to satisfy the predetermined conditions (step S21: YES), the second face image captured in step S20 is transmitted to the information processing device 30 along with its position (step S22). The position is the location where the face recognition was performed. The position is detected, for example, by a booth terminal 50 (position detection unit) installed in the booth that the job seeker approached.

[0060] Next, the information processing device 30 acquires the second image and location transmitted from the authentication terminal 20 (step S23) and sends a facial recognition request to the facial recognition device 40 (step S24). This facial recognition request includes the second facial image acquired in step S23.

[0061] Next, the facial recognition device 40 performs facial recognition processing (step S25). Specifically, the facial recognition device 40 performs facial recognition of job seekers approaching the booth (job seekers who may be interested in the booth but are not visiting) by performing predetermined processing based on the facial information previously registered by the registration terminal 10 and the facial information extracted from the second facial image transmitted in step S22.

[0062] Next, the facial recognition device 40 transmits the facial recognition result to the information processing device 30 (step S26).

[0063] Next, the information processing device 30 records the result of facial recognition and the location where the facial recognition was performed (the location obtained in step S23) in association with the job seeker (step S27). This is done by the recording unit 33. The recording unit 33 records the result of facial recognition and the location where the facial recognition was performed in association with the job seeker as movement information in the storage unit 37. The information processing device 30 also transmits the result of facial recognition to the authentication terminal 20 (step S28).

[0064] Next, the authentication terminal 20 displays the facial recognition result on the display 22 (step S29).

[0065] The processes described in steps S20 to S29 are repeated each time a job seeker approaches a booth set up in the venue. As a result, for each job seeker, the results of facial recognition and multiple combinations of the locations where facial recognition occurred (movement information) are recorded in the storage unit 37. Note that the processes described in steps S20 to S29 may be executed in parallel with the processes described in steps S10 to S18.

[0066] Figure 7 is a sequence diagram of another example of operation of the information processing system 1.

[0067] The following assumes that, for each job seeker, the results of facial recognition and the combination of the locations where facial recognition occurred (movement information) are recorded in the memory unit 37.

[0068] First, a map image display operation is performed on a designated terminal (step S30). The designated terminal is, for example, a university terminal operated by a university career center staff member. The map image display operation is, for example, an operation performed by a university career center staff member on the designated terminal via an input device such as a keyboard or mouse connected to the terminal (for example, pressing a specific key). At that time, if the user wants to display the movement patterns of a specific job seeker, they may input information that identifies that specific job seeker. On the other hand, if the user wants to display the movement patterns of all job seekers, they may input information to that effect.

[0069] When a map image display operation is performed, the designated terminal sends a map image request to the information processing device 30 (step S31). The map image request includes, for example, information that identifies a specific job seeker, or information indicating a desire to display the movement patterns of all job seekers.

[0070] Next, the information processing device 30 generates a map image (step S32). This is achieved by the map image generation unit 34. Based on the movement information and map images of job seekers stored in the storage unit 37, the map image generation unit 34 generates a map image of the venue that includes the movement information of job seekers and booth images symbolizing the booths. For example, if the map image request includes information that identifies a specific job seeker, the map image generation unit 34 generates a map image of the venue (see Figure 4) that includes the movement information and booth images symbolizing the booths of the specific job seeker, based on the movement information and map images of the specific job seeker stored in the storage unit 37. On the other hand, if the map image request includes information indicating a desire to display the movement information of all job seekers, the map image generation unit 34 generates a map image of the venue (see Figure 4) that includes the movement information and booth images symbolizing the booths of all job seekers, based on the movement information and map images of all job seekers stored in the storage unit 37.

[0071] Next, the information processing device 30 transmits the map image generated in step S32 to a predetermined terminal that requested the map image (step S33).

[0072] Next, the designated terminal displays the map image transmitted in step S33 (see, for example, Figure 4) on its display (step S34).

[0073] As explained above, according to Embodiment 2, it is possible to determine which booth a person who is subject to facial recognition (for example, a job seeker) visited when they came to a booth set up at the venue.

[0074] Next, I will explain some variations.

[0075] In the above embodiment 2, an example was described in which facial recognition of job-seeking students visiting each booth is performed using authentication terminals 20 provided in each of the multiple booths, but the invention is not limited to this.

[0076] For example, facial recognition of job seekers visiting each booth could be performed using gateless facial recognition devices (not shown) installed in each of the multiple booths. Alternatively, beacons could be installed in each of the multiple booths, and the data could be recorded by communicating between these beacons and the smartphones or other devices carried by the job seekers.

[0077] <Example Hardware Configuration> Each functional component of the information processing device 30 may be implemented by hardware (e.g., hardwired electronic circuits) or by a combination of hardware and software (e.g., a combination of an electronic circuit and a program to control it). The case in which each functional component of the information processing device 30 is implemented by a combination of hardware and software will be explained further below.

[0078] Figure 8 is a block diagram illustrating the hardware configuration of a computer 900 that implements the information processing device 30. The computer 900 may be a dedicated computer designed to implement the information processing device 30, or it may be a general-purpose computer. The computer 900 may also be a portable computer such as a smartphone or tablet device.

[0079] For example, by installing a predetermined application on the computer 900, the various functions of the information processing device 30 are realized on the computer 900. The above application consists of a program for realizing the functional components of the information processing device 30.

[0080] Computer 900 includes a bus 902, a processor 904, memory 906, a storage device 908, an input / output interface 910, and a network interface 912. The bus 902 is a data transmission path for the processor 904, memory 906, storage device 908, input / output interface 910, and network interface 912 to send and receive data to and from each other. However, the method of connecting the processor 904 and other components to each other is not limited to bus connection.

[0081] The processor 904 is a variety of processors such as a CPU (Central Processing Unit), GPU (Graphics Processing Unit), FPGA (Field-Programmable Gate Array), or quantum processor (quantum computer control chip). The memory 906 is the main memory, implemented using RAM (Random Access Memory), etc. The storage device 908 is the auxiliary storage, implemented using a hard disk, SSD (Solid State Drive), memory card, or ROM (Read Only Memory), etc.

[0082] The input / output interface 910 is an interface for connecting the computer 900 with input / output devices. For example, input devices such as keyboards and output devices such as display devices are connected to the input / output interface 910.

[0083] The network interface 912 is an interface for connecting computer 900 to a network. This network may be a LAN (Local Area Network) or a WAN (Wide Area Network).

[0084] The storage device 908 stores programs that implement each functional component of the information processing device 30 (programs that implement the aforementioned applications). The processor 904 reads these programs into memory 906 and executes them to implement each functional component of the information processing device 30.

[0085] Each processor executes one or more programs containing a set of instructions for causing the computer to perform the algorithms described with reference to the drawings. These programs, when loaded into the computer, contain a set of instructions (or software code) for causing the computer to perform one or more of the functions described in the embodiments. The programs may be stored in various types of non-transitory computer-readable medium or tangible storage medium. Examples, but not limited to, include non-transitory computer-readable medium or tangible storage medium, such as RAM, ROM, flash memory, SSD or other memory technologies, CD-ROM, DVD (Digital Versatile Disc), Blu-ray® disc or other optical disc storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage devices. The programs may also be transmitted over various types of transient computer-readable medium or communication medium. Examples, but not limited to, include transient computer-readable medium or communication medium, such as electrical, optical, acoustic or other forms of propagating signals.

[0086] Although the present disclosure has been described above with reference to embodiments, the present disclosure is not limited to the embodiments described above. Various modifications to the structure and details of the present disclosure are possible, as can be understood by those skilled in the art within the scope of the present disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate.

[0087] Each drawing is merely illustrative to illustrate one or more embodiments. Each drawing may be associated with one or more other embodiments rather than with only one specific embodiment. As those skilled in the art will understand, various features or steps described with reference to any one drawing can be combined with features or steps shown in one or more other drawings, for example, to create embodiments not explicitly shown or described. Not all features or steps shown in any one drawing to illustrate an exemplary embodiment are necessarily required, and some features or steps may be omitted. The order of steps shown in any of the drawings may be changed as appropriate.

[0088] Some or all of the above embodiments may also be described as follows, but are not limited to the following:

[0089] (Note 1) A facial image acquisition unit that acquires the first facial image of a person who has registered their facial information in advance and has come to a booth set up at the venue for facial recognition, A certification result acquisition unit that acquires the results of facial recognition of the person to be facially recognized based on the facial information and the facial information extracted from the first facial image, An information processing device comprising: a recording unit that records the results of the facial recognition and the location where the facial recognition was performed, as movement information of the person subject to facial recognition, in association with the person subject to facial recognition.

[0090] (Note 2) The facial image acquisition unit acquires a second facial image of a person subject to facial recognition who approaches the booth installed at the venue. The information processing device described in Appendix 1, which, when certain conditions are met, obtains the result of facial authentication of the person to be facially authenticated based on the facial information and the facial information extracted from the second facial image.

[0091] (Note 3) The information processing apparatus according to Appendix 1, further comprising a map image generation unit that generates a map image of the venue including the movement of the person to be facially recognized and an image of a booth symbolizing the booth, based on the movement information of the person to be facially recognized.

[0092] (Note 4) The information processing device described in Appendix 3 further comprises a communication unit for transmitting a map image of the venue to a designated terminal.

[0093] (Note 5) The system further includes a satisfaction acquisition unit that acquires the satisfaction level of the booth entered by the person subject to facial recognition, The recording unit is an information processing device according to Appendix 1, which records the booth and the satisfaction level of the booth in association with the person subject to facial recognition.

[0094] (Note 6) A camera that captures the first facial image of a person who has registered their facial information in advance and visits a booth set up at the venue for facial recognition, A face image acquisition unit that acquires the first face image, A facial recognition device that performs facial recognition of the person to be facially recognized based on the facial information and facial information extracted from the first facial image, A certification result acquisition unit that acquires the facial recognition result of the person to be facially recognized, An information processing system comprising: a recording unit that records the results of the facial recognition and the location where the facial recognition was performed, as movement information of the person subject to facial recognition, in association with the person subject to facial recognition.

[0095] (Note 7) The aforementioned cameras are installed in each booth set up at the venue. The facial recognition device, the authentication result acquisition unit, and the recording unit are part of the information processing system described in Appendix 6, which is provided in the server device.

[0096] (Note 8) A facial recognition device that performs facial recognition of the person to be recognized as described in Appendix 1.

[0097] (Note 9) A facial image acquisition step involves registering facial information in advance and acquiring the first facial image of a person who visits a booth set up at the venue for facial recognition, and A step to obtain an authentication result, which obtains the result of facial authentication of the person to be facially authenticated based on the facial information and the facial information extracted from the first facial image, An information processing method comprising a recording step of recording the result of the facial recognition and the location where the facial recognition was performed as movement information of the person subject to facial recognition, in association with the person subject to facial recognition.

[0098] (Note 10) A facial image acquisition step involves registering facial information in advance and acquiring the first facial image of a person who visits a booth set up at the venue for facial recognition, and A step to obtain an authentication result, which obtains the result of facial authentication of the person to be facially authenticated based on the facial information and the facial information extracted from the first facial image, A program that causes a computer to perform a recording step, which records the result of the facial recognition and the location where the facial recognition was performed, as correspondence to the person being recognized, as movement information of the person being recognized.

[0099] Some or all of the elements (e.g., configuration and function) described in Appendices 2-5 that are dependent on Appendice 1 may also be dependent on Appendices 6, 8, 9, and 10 in the same way as those described in Appendices 2-5. Some or all of the elements described in any appendice may be applicable to various hardware, software, recording means, systems, and methods for recording software. [Explanation of Symbols]

[0100] 1… Information processing system 10…Registered terminals 11…Camera 12…Display 13… Communications Department 14…Satisfaction level input section 20…Authentication terminal 21... Camera 22…Display 23...Position detection unit 24... Communications Department 30…Information Processing Equipment 31…Facial Image Acquisition Unit 32…Certification Result Acquisition Section 33…Records Department 34…Map Image Generation Unit 35... Communications Department 36…Satisfaction Acquisition Department 37...Storage section 40…Facial recognition device 50... Booth terminals 900... Computer 902... Bus 904… Processor 906...Memory 908…Storage device 910… Input / Output Interface 912…Network Interface B1... Booth B2... Booth N... Network

Claims

1. A facial image acquisition unit that acquires the first facial image of a person who has registered their facial information in advance and has come to a booth set up at the venue for facial recognition, A certification result acquisition unit that acquires the results of facial recognition of the person to be facially recognized based on the facial information and the facial information extracted from the first facial image, An information processing device comprising: a recording unit that records the results of the facial recognition and the location where the facial recognition was performed, as movement information of the person subject to facial recognition, in association with the person subject to facial recognition.

2. The aforementioned facial image acquisition unit acquires a second facial image of a person subject to facial recognition who approaches the booth installed at the venue. The information processing apparatus according to claim 1, wherein, if predetermined conditions are met, the authentication result acquisition unit acquires the result of face authentication of the person to be face authenticated based on the face information and the face information extracted from the second face image.

3. The information processing apparatus according to claim 1, further comprising a map image generation unit that generates a map image of the venue including the movement of the person to be facially recognized and an image of a booth symbolizing the booth, based on the movement information of the person to be facially recognized.

4. The information processing apparatus according to claim 3, further comprising a communication unit for transmitting a map image of the venue to a predetermined terminal.

5. The system further includes a satisfaction acquisition unit that acquires the satisfaction level of the booth entered by the person subject to facial recognition, The information processing apparatus according to claim 1, wherein the recording unit records the booth and the satisfaction level of the booth in association with the person subject to facial recognition.

6. A camera that captures the first facial image of a person who has registered their facial information in advance and visits a booth set up at the venue for facial recognition, A face image acquisition unit that acquires the first face image, A facial recognition device that performs facial recognition of the person to be facially recognized based on the facial information and facial information extracted from the first facial image, A certification result acquisition unit that acquires the facial recognition result of the person to be facially recognized, An information processing system comprising: a recording unit that records the results of the facial recognition and the location where the facial recognition was performed, as movement information of the person subject to facial recognition, in association with the person subject to facial recognition.

7. The aforementioned cameras are installed in each booth set up at the venue. The information processing system according to claim 6, wherein the facial recognition device, the authentication result acquisition unit, and the recording unit are provided in a server device.

8. A facial recognition device that performs facial recognition of the person to be recognized according to claim 1.

9. A facial image acquisition step involves registering facial information in advance and acquiring the first facial image of a person who visits a booth set up at the venue for facial recognition, and A step to obtain an authentication result, which obtains the result of facial authentication of the person to be facially authenticated based on the facial information and the facial information extracted from the first facial image, An information processing method comprising a recording step of recording the result of the facial recognition and the location where the facial recognition was performed as movement information of the person subject to facial recognition, in association with the person subject to facial recognition.

10. A facial image acquisition step involves registering facial information in advance and acquiring the first facial image of a person who visits a booth set up at the venue for facial recognition, and A step to obtain an authentication result, which obtains the result of facial authentication of the person to be facially authenticated based on the facial information and the facial information extracted from the first facial image, A program that causes a computer to perform a recording step, which records the result of the facial recognition and the location where the facial recognition was performed, as correspondence to the person being recognized, as movement information of the person being recognized.

Images