Information processing system, information processing method, and computer program

Abstract

An information processing device 1 comprises: a display D; a left side camera L that is located on the left side of the display D and captures images of a target from the left side; a right side camera R that is located on the right side of the display D and captures images of the target from the right side; an upper side camera U that is located on the upper side of the display D and captures images of the target from above; and a monitoring camera M that is located on the upper side of the display D and monitors the target from above.

Description

Information processing device, information processing system, information processing method, and recording medium

[0001] The present disclosure relates to the technical fields of an information processing device, an information processing system, an information processing method, and a recording medium.

[0002] Patent Literature 1 describes an information processing device that reads information from an object, the information processing device having an inclined reading surface, a reading unit that reads information from an object facing the reading surface, and a protrusion formed on at least a part of the upper edge of the peripheral portion of the reading surface. Patent Literature 2 describes a technology in which multiple displays are arranged behind a half mirror with a predetermined gap between them, a camera lens is arranged in this gap, and the line of sight for viewing the display and the line of sight for capturing images by the camera are approximately the same line of sight, and a display suitable for matching is displayed on the person in front of the half mirror, while a facial image suitable for matching is captured by an imaging device. Patent Literature 3 describes an information processing device that has a reading unit that reads a user's medium and acquires information including the user's biometric information from the medium, and a biometric information acquisition unit that acquires the user's biometric information from the user while reading the medium. Patent Literature 4 describes a technology that is hygienic and allows a user to perform input, and that includes a display that displays an operation screen, a contact sensor that detects operations on the operation screen, a non-contact sensor that detects operations on the operation screen, and a control unit that selectively uses the contact sensor and the non-contact sensor to accept input to the operation screen. Patent Literature 5 describes a technology that inputs a transmission image obtained by irradiating an object to be inspected with electromagnetic waves into a model, outputs a first certainty factor indicating that the object is a specific object, and determines that the object is a specific object if the first certainty factor changed based on inspection results obtained by performing one or more inspections on the object is equal to or greater than a preset first certainty factor threshold, thereby detecting the specific object.

[0003] JP 2019-153148 A JP 2019-149204 A WO 2020 / 075306 JP 2022-103098 A WO 2021 / 166727

[0004] An object of this disclosure is to provide an information processing device, an information processing system, an information processing method, and a recording medium that aim to improve upon the techniques described in prior art documents.

[0005] One aspect of the information processing device includes a display, a left camera provided on the left side of the display for capturing an image of an object from the left side, a right camera provided on the right side of the display for capturing an image of the object from the right side, an upper camera provided above the display for capturing an image of the object from above, and a surveillance camera provided above the display for monitoring the object from above.

[0006] One aspect of the information processing system includes a plurality of information processing devices each having a display, a left camera located to the left of the display and capturing an image of an object from the left side, a right camera located to the right of the display and capturing an image of the object from the right side, an upper camera located above the display and capturing an image of the object from above, and a surveillance camera located above the display and monitoring the object from above, and the display included in an information processing device in which the number of objects included in images captured by the surveillance camera exceeds a predetermined number outputs information indicating an information processing device in which the number of objects included in images captured by the surveillance camera is less than a predetermined number.

[0007] One aspect of the information processing method determines the height of a subject's face, and if the height of the subject's face is lower than a predetermined height, instructs a left camera located on the left side of the display and imaging the subject from the left side, and a right camera located on the right side of the display and imaging the subject from the right side, to image the subject's face; if the height of the subject's face is higher than the predetermined height, instructs an upper camera located above the display and imaging the subject from above, to image the subject's face.

[0008] One aspect of the recording medium has recorded thereon a computer program for causing a computer to execute an information processing method that determines the height of a subject's face, and if the height of the subject's face is lower than a predetermined height, instructs a left camera located on the left side of a display that images the subject from the left side and a right camera located on the right side of the display that images the subject from the right side to capture the subject's face, and if the height of the subject's face is higher than the predetermined height, instructs an upper camera located above the display that images the subject from above to capture the subject's face.

[0009] FIG. 1 is an external view showing the appearance of an information processing device in a first embodiment. FIG. 2 is an external view showing the appearance of an information processing device in a second embodiment. FIG. 3 is a block diagram showing the configuration of an information processing device in the second embodiment. FIG. 4 is a flowchart showing the flow of information processing operations of the information processing device in the second embodiment. FIG. 5 is a block diagram showing the configuration of an information processing device in a third embodiment. FIG. 6 is an external view showing the appearance of an information processing device in the third embodiment. FIG. 7 is a block diagram showing the configuration of an information processing device in a fourth embodiment. FIG. 8 is an external view showing the appearance of an information processing device in the fourth embodiment. FIG. 9 is a block diagram showing the configuration of an information processing device in a fifth embodiment. FIG. 10 is a flowchart showing the flow of information processing operations of the information processing device in the fifth embodiment. FIG. 11 is an external view showing the appearance of an information processing device in a sixth embodiment. FIG. 12 is a block diagram showing the configuration of an information processing device in the sixth embodiment. FIG. 13 is a flowchart showing the flow of information processing operations of the information processing device in the sixth embodiment. FIG. 14 is a block diagram showing the configuration of an information processing device in a seventh embodiment. FIG. 15 is a flowchart showing the flow of information processing operations of the information processing device in the seventh embodiment. FIG. 16 is a block diagram showing the configuration of an information processing device in an eighth embodiment. Fig. 17 is a flowchart showing the flow of information processing operations of the information processing apparatus in the eighth embodiment Fig. 18 is a block diagram showing the configuration of an information processing system in the ninth embodiment.

[0010] Hereinafter, embodiments of an information processing device, an information processing system, an information processing method, and a recording medium will be described with reference to the drawings. [1: First Embodiment]

[0011] A first embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described below. Hereinafter, the first embodiment of the information processing device, the information processing system, the information processing method, and the recording medium will be described using an information processing device 1 to which the first embodiment of the information processing device, the information processing system, the information processing method, and the recording medium is applied. [1-1: Appearance of the information processing device 1]

[0012] 1 is an external view showing the appearance of an information processing device 1 according to a first embodiment. As shown in FIG. 1, the information processing device 1 includes a display D, a left camera L, a right camera R, an upper camera U, and a monitoring camera M.

[0013] The left camera L is provided on the left side of the display D and captures an image of the subject from the left side. The left camera L is provided on the left side as seen from the subject facing the display D. The right camera R is provided on the right side of the display D and captures an image of the subject from the right side. The right camera R is provided on the right side as seen from the subject facing the display D. The upper camera U is provided above the display D and captures an image of the subject from above. The monitoring camera M is provided above the display D and monitors the subject from above. The upper camera U and the monitoring camera M are provided above as seen from the subject facing the display D. Note that while FIG. 1 illustrates a case in which the monitoring camera M is provided above the upper camera U, the upper camera U may also be provided above the monitoring camera M. [1-2: Technical Effects of the Information Processing Device 1]

[0014] The information processing device 1 in the first embodiment is equipped with a left camera L, a right camera R, and an upper camera U, so that the subject can be imaged from the left, right, and upper sides, and an appropriate image of the subject can be obtained. The information processing device 1 images the subject from various angles, improving the possibility of capturing a facial image suitable for facial recognition. Furthermore, the information processing device 1 is equipped with a surveillance camera M, so that an image capturing the subject and the situation around the subject can be obtained. [2: Second Embodiment]

[0015] Next, a second embodiment of the information processing device, the information processing system, the information processing method, and the recording medium will be described. Hereinafter, the second embodiment of the information processing device, the information processing system, the information processing method, and the recording medium will be described using an information processing device 2 to which the second embodiment of the information processing device, the information processing system, the information processing method, and the recording medium is applied. [2-1: Appearance of the information processing device 2]

[0016] 2 is an external view showing the appearance of an information processing device 2 in the second embodiment. The information processing device 2 may be installed in facilities such as airports, train stations, theme parks, etc. The information processing device 2 may perform a specifying operation to identify a target person, a guiding operation to guide the identified target person to a destination, an enabling operation to allow the identified target person to take a predetermined action, etc.

[0017] 2 , the information processing device 2 includes a support body B and a top plate UB. The support body B includes a display D, a left camera L, a right camera R, an upper camera U, a monitoring camera M, a left side plate member LB, a right side plate member RB, a reception unit IN, a speaker S, and a microphone Mic. However, the support body B does not necessarily have to include at least one of the left side plate member LB, the right side plate member RB, the reception unit IN, the speaker S, and the microphone Mic. The calculation device 21, the storage device 22, and the communication device 23, which will be described later, may be housed in the support body B.

[0018] The display D may be tilted relative to the vertical plane so that the bottom is closer to the subject than the top so that the subject can look down and view the displayed content. Alternatively, the display D may be installed vertically. Alternatively, if the subject's face is positioned low, for example, if the subject is short or in a wheelchair, the display D may be tilted relative to the vertical plane so that the top is closer to the subject than the bottom so that the subject can look up and view the displayed content. The information processing device 2 may identify the position of the subject's face based on information acquired from at least one of the left camera L, right camera R, upper camera U, surveillance camera M, and microphone Mic, and may be able to change the tilt angle of the display D depending on the position of the subject's face. For example, the display D may display a guidance screen that provides instructions on how to use the information processing device 2.

[0019] The left camera L is provided on the left side of the display D and captures an image of the subject from the left side. The right camera R is provided on the right side of the display D and captures an image of the subject from the right side. The left camera L and the right camera R are each positioned with their imaging surfaces facing inward so as to capture an image of the subject facing the display D. The left camera L may be provided so that its imaging direction faces diagonally forward to the right. The right camera R may be provided so that its imaging direction faces diagonally forward to the left.

[0020] The upper camera U is provided above the display D and captures an image of the subject from above. The upper camera U may be provided so that the image capture direction faces diagonally downward and forward. At least one of the left camera L, right camera R, and upper camera U may have an angle of view that allows the face of the subject to be captured.

[0021] Illumination may be provided on both sides of the display D. In this case, the illumination may ensure sufficient brightness when at least one of the left camera L, the right camera R, and the upper camera U captures an image of a subject operating the information processing device 2. The information processing device 2 may perform face authentication using an image of the face captured by at least one of the left camera L, the right camera R, and the upper camera U, to authenticate the subject.

[0022] The surveillance camera M is provided above the display D. The surveillance camera M may be provided above the upper camera U. The surveillance camera M may capture images while changing the angle of view. The surveillance camera M may capture images of a situation relatively close to the information processing device 2. The surveillance camera M may acquire captured images that can determine the state of the information processing device 2 and its surroundings, the state of a subject operating the information processing device 2, etc. The surveillance camera M may also capture images of a situation relatively far from the information processing device 2. The surveillance camera M may acquire captured images that can determine the state of a subject located relatively far from the information processing device 2.

[0023] A filter F may be provided above the display D. The filter F may prevent the subject from seeing the upper camera U, the surveillance camera M, and the speaker S. The upper camera U and the surveillance camera M can capture an image of the subject through the filter F.

[0024] The left side plate member LB is provided to the left of the left side camera L and prevents people other than the subject from viewing the display content of the display D and from appearing in the captured images taken by the right side camera R and the upper side camera U. The right side plate member RB is provided to the right of the right side camera R and prevents people other than the subject from viewing the display content of the display D and from appearing in the captured images taken by the left side camera L and the upper side camera U.

[0025] The top plate UB is provided below the display D, protrudes toward the subject facing the display D, and has a reading unit Re on its upper surface. The reading unit Re acquires readable information from a medium presented by the subject. The reading unit Re may acquire information by reading a medium held over by the subject. The reading unit Re may include, for example, an image scanner, a non-contact integrated circuit (IC) reader, an optical character reader (OCR) device, etc. The reading unit Re may be implemented as at least one of a passport reader and a code reader. The code reader may be, for example, at least one of a two-dimensional code reader and a one-dimensional code reader. The code read by the code reader may be, for example, a code for customs declaration. The reading unit Re may include, for example, a passport reader on the left side and a code reader on the right side. The passport reader may have an alignment unit for aligning the passport.

[0026] The reception unit IN detects a pointing action of the subject in the space between the display D and the subject, and receives it as an instruction input to the information processing device 2. The reception unit IN may be able to detect a position on the display D at which the subject is pointing, without the subject touching the display D. The reception unit IN may detect a pointing action of the subject in the space between the display D and the subject, associate the pointing action of the subject with the display content of the display D, and receive an instruction input to the information processing device 2. The reception unit IN may realize an input action to the information processing device 2, like operating a touch panel, without the subject touching the information processing device 2.

[0027] The reception unit IN may be realized by infrared rays. For example, the reception unit IN may include an infrared light irradiation mechanism that irradiates infrared rays, a position detection mechanism that detects a position where the irradiated infrared rays are blocked, and a determination mechanism that determines that the detected position on the screen has been selected.

[0028] The reception unit IN may be realized by laser light instead of infrared light. The reception unit IN may also analyze the position and movement from the captured image and realize an input operation to the information processing device 2. The reception unit IN may also use a capacitance method to detect a change in capacitance in the space between the display D and the subject, and detect the subject's pointing operation.

[0029] The speaker S outputs sound toward the target person. The speaker S may output sound with directionality. The speaker S may output sound in such a way that information intended for the target person cannot be heard by anyone other than the target person.

[0030] The microphone Mic inputs the voice uttered by the subject. The microphone Mic may collect the voice with directionality. The microphone Mic may collect the voice so as not to pick up voices other than those of the subject. Alternatively, the microphone Mic may input voices and sounds uttered by persons other than the subject, in addition to the voice uttered by the subject. [2-2: Configuration of the information processing device 2]

[0031] 3 is a block diagram showing the configuration of an information processing device 2 in the second embodiment. As shown in FIG. 3, the information processing device 2 includes a calculation device 21 and a storage device 22. The information processing device 2 may further include a communication device 23, an input device 24, and an output device 25. However, the information processing device 2 does not necessarily have to include at least one of the communication device 23, the input device 24, and the output device 25. The calculation device 21, the storage device 22, the communication device 23, the input device 24, and the output device 25 may be connected via a data bus 26.

[0032] The arithmetic device 21 includes, for example, at least one of a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), and an FPGA (Field Programmable Gate Array). The arithmetic device 21 reads a computer program. For example, the arithmetic device 21 may read a computer program stored in the storage device 22. For example, the arithmetic device 21 may read a computer program stored in a computer-readable, non-transitory recording medium using a recording medium reading device (e.g., an input device 24 described later) not shown in the drawings that is included in the information processing device 2. The arithmetic device 21 may acquire (i.e., download or read) the computer program from a device (not shown) located outside the information processing device 2 via the communication device 23 (or another communication device). The arithmetic device 21 executes the read computer program. As a result, logical functional blocks for executing the operations to be performed by the information processing device 2 are realized within the arithmetic device 21. In other words, the arithmetic device 21 can function as a controller for realizing logical functional blocks for executing the operations (in other words, processing) to be performed by the information processing device 2.

[0033] 3 shows an example of logical functional blocks realized within the arithmetic device 21 to execute information processing operations. As shown in FIG. 3, a height determination unit 211 and an image capture instruction unit 212, which is a specific example of an "image capture instruction means" described in the appendix below, are realized within the arithmetic device 21. However, at least one of the height determination unit 211 and the image capture instruction unit 212 does not have to be realized within the arithmetic device 21. Details of the operations of the height determination unit 211 and the image capture instruction unit 212 will be described later in detail with reference to FIG. 4.

[0034] The storage device 22 can store desired data. For example, the storage device 22 may temporarily store a computer program executed by the arithmetic device 21. The storage device 22 may temporarily store data that the arithmetic device 21 temporarily uses when the arithmetic device 21 is executing a computer program. The storage device 22 may store data that the information processing device 2 stores long-term. The storage device 22 may include at least one of a RAM (Random Access Memory), a ROM (Read Only Memory), a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and a disk array device. In other words, the storage device 22 may include a non-temporary recording medium.

[0035] The communication device 23 is capable of communicating with devices external to the information processing device 2 via a communication network (not shown). The communication device 23 may be a communication interface based on standards such as Ethernet (registered trademark), Wi-Fi (registered trademark), Bluetooth (registered trademark), or USB (Universal Serial Bus).

[0036] The input device 24 is a device that accepts information input to the information processing device 2 from outside the information processing device 2. In the second embodiment, the information processing device 2 includes the above-mentioned reading unit Re, receiving unit IN, and microphone Mic as the input device 24. Furthermore, for example, the input device 24 may include an operation device (for example, at least one of a keyboard, a mouse, and a touch panel) that can be operated by an operator of the information processing device 2. Furthermore, for example, the input device 24 may include a reading device that can read information recorded as data on a recording medium that can be externally attached to the information processing device 2.

[0037] The output device 25 is a device that outputs information to the outside of the information processing device 2. The output device 25 may output information as an image. That is, the output device 25 may include a display device (a so-called display) that can display an image showing the information to be output. The output device 25 may also output information as sound. That is, the output device 25 may include an audio device (a so-called speaker) that can output sound. That is, in the second embodiment, the information processing device 2 includes the above-mentioned display D and speaker S as the output device 25. Furthermore, for example, the output device 25 may output information on paper. That is, the output device 25 may include a printing device (a so-called printer) that can print desired information on paper. [2-3: Information Processing Operation Performed by the Information Processing Device 2]

[0038] The information processing device 2 may transition each of the mechanisms, including the display D, left camera L, right camera R, upper camera U, display D, reception unit IN, reading unit Re, speaker S, and microphone Mic, from a standby state to an operable state depending on the size of the subject appearing in the image captured by the surveillance camera M. Alternatively, the information processing device 2 may transition each of the mechanisms to an operable state when it detects that the image captured by the surveillance camera M includes a subject facing straight ahead. Alternatively, the information processing device 2 may further include a distance sensor, and transition each of the mechanisms to an operable state when it detects that the subject has approached the information processing device 2 to within a predetermined distance. The information processing device 2 may transition each of the mechanisms to an operable state when it determines that a subject wishing to use the information processing device 2 has appeared. [Facial Image Acquisition Operation]

[0039] The operation of acquiring a face image performed by the information processing device 2 in the second embodiment will be described with reference to Fig. 4. Fig. 4 is a flowchart showing the flow of the operation of acquiring a face image performed by the information processing device 2 in the second embodiment.

[0040] As shown in FIG. 4 , the height determination unit 211 determines the height of the subject's face (step S20). The height determination unit 211 may make the determination based on information acquired from at least one of the left camera L, right camera R, upper camera U, surveillance camera M, and microphone Mic. The height determination unit 211 may determine the height of the subject's face by detecting the head. The height determination unit 211 may determine the height of the subject's face by detecting the upper limit of the subject's outline. The height determination unit 211 may determine the height of the subject's face by detecting the location of the sound picked up by the microphone Mic. The information processing device 2 may have a mechanism that allows the angle of the display D and the angle of the top panel UB having a passport reader, etc. to be freely adjusted using the height determination result.

[0041] If the height of the subject's face is lower than a predetermined height (step S20: L), the imaging instruction unit 212 instructs the left camera L and the right camera R to capture an image of the subject's face (step S21). The case where the height of the subject's face is lower than the predetermined height corresponds to, for example, when the subject is short, when the subject uses a wheelchair, etc.

[0042] If the height of the subject's face is higher than a predetermined height (step S20: H), the imaging instruction unit 212 instructs the upper camera U to capture an image of the subject's face (step S22). The case where the height of the subject's face is higher than a predetermined height corresponds to, for example, a case where the subject is tall. That is, the imaging instruction unit 212 instructs the camera to operate according to the height of the subject's face, making it easier to acquire a face image suitable for face matching. [Facial Recognition Operation]

[0043] The facial image of the subject acquired by capturing an image using at least one of the left camera L, right camera R, and upper camera U may be compared with the facial image acquired by the reading unit Re. The facial image of the subject acquired by capturing an image using at least one of the left camera L, right camera R, and upper camera U may be referred to as a captured facial image. The facial image acquired by the reading unit Re may be referred to as a read facial image. The read facial image may be a facial image obtained by scanning a photo on the subject's passport.

[0044] The information processing device 2 may request the management device C to compare the captured face image with the read face image. The information processing device 2 may transmit the captured face image, the read face image, and the comparison request to the management device C. The information processing device 2 may have a feature extraction function. In this case, the information processing device 2 may transmit the feature extracted from the captured face image, the feature extracted from the read face image, and the comparison request to the management device C.

[0045] Alternatively, the information processing device 2 itself may be equipped with a face matching mechanism. In this case, the information processing device 2 may transmit matching information indicating the result of face matching of the subject person who uses the information processing device 2 to the management device C.

[0046] The reading unit Re may read identification information that can identify the subject. For example, the reading unit Re may read identification information from a passport. The management device C may be able to use a registration information database in which the subject's identification information and facial image are registered. In this case, the information processing device 2 may transmit the identification information read by the reading unit Re and the captured facial image to the management device C and request facial authentication of the subject from the management device C. The management device C may perform facial authentication of the subject by comparing the captured facial image with a registered facial image registered in the registration information database. The facial authentication may be performed by the management device C, the information processing device 2, or a cloud side (not shown).

[0047] Facial authentication may be performed when a captured facial image suitable for facial authentication is successfully acquired and at least one of a read facial image and identification information is successfully acquired.

[0048] The information processing device 2 may receive authentication information indicating the authentication result of the requested face authentication from the management device C. The authentication information may indicate that matching of the captured face image with the read face image or the registered face image has been successful, and that identity verification of the subject using the information processing device 2 has been successful. Alternatively, the authentication information may indicate that matching of the captured face image with the read face image or the registered face image has failed, and that identity verification of the subject using the information processing device 2 has failed. For example, the display D may display authentication information indicating the result of face authentication of the subject. A case in which matching of the captured face image with the read face image or the registered face image has been successful may include a case in which a matching score indicating the similarity between each face image exceeds a predetermined threshold, and each face image indicates a high similarity.

[0049] The information processing device 2 may transmit the information read by the reading unit Re, the information received by the receiving unit IN, and the voice information collected by the microphone Mic to the management device C as information from the authenticated subject.

[0050] The subject may, for example, display a customs declaration code on a portable terminal device and have the reading unit Re read it. Declaration information may be obtained from the customs declaration code read by the reading unit Re. The declaration information includes information that the subject must declare in a customs declaration when entering the country. The declaration information may include information necessary for a customs declaration, such as the subject's name, current address or place of stay in the country of entry, occupation, date of birth, passport number, flight name, place of departure, date of entry, and items to be declared in a customs declaration. When the reading unit Re reads the customs declaration code, the information processing device 2 may display a declaration content confirmation screen for the subject on the display D.

[0051] Furthermore, the information processing device 2 may display determination information indicating the determination result of the declaration content on the display D. The display D may display a declaration content confirmation screen that allows the subject to check the declaration content and correct it as necessary. Furthermore, for example, if there is an error in the declaration content and human assistance is required, the display D may display a guidance screen that guides the subject to a manned booth, thereby guiding the subject to a manned booth.

[0052] Furthermore, for example, the information processing device 2 may support multiple languages, such as Japanese, English, Chinese, and Korean, similar to the customs declaration application available on the terminal device. The information processing device 2 may be able to set the language to be used based on language information read from a declaration code displayed on a terminal device carried by the person making the customs declaration. In this case, the information processing device 2 may be able to input and output in the language to be used that is set from among multiple languages. [Guidance Operation]

[0053] The information processing device 2 may receive guidance information to be output to the target person from the management device C. The information processing device 2 may control at least one of the display D and the speaker S to output the guidance information to the target person. The guidance information may include information indicating a place where the target person should go. The place where the target person should go may include a place where the next thing to be done will be done. The guidance information may include information such as the thing that the target person should do and the time limit for the thing to be done. The guidance information may include places where the target person is allowed to enter and places where the target person is prohibited from entering. The display D may display a guidance screen for the target person.

[0054] For example, the management device C may have information associating a subject with a place where the subject should go. For example, at an airport, if the subject is scheduled to board an aircraft and has not yet completed the boarding procedures, the place where the subject should go may be an automatic check-in machine. Also, if the subject has not yet checked in their baggage, the place where the subject should go may be a baggage counter. Also, if the subject is before security screening, the place where the subject should go may be a security checkpoint. Also, if the subject has completed security screening, the place where the subject should go may be a boarding gate.

[0055] 2, the support B may take various forms such as a pole, a support table, a counter, etc., which are installed with their longitudinal direction vertical. [2-4: Technical Effects of the Information Processing Device 2]

[0056] The information processing device 2 in the second embodiment is equipped with a display D and a speaker S, and is therefore able to provide appropriate information to the subject. Furthermore, the information processing device 2 is equipped with a left camera L, a right camera R, an upper camera U, a monitoring camera M, a reception unit IN, and a microphone Mic, and is therefore able to appropriately acquire information from the subject. The information processing device 2 changes the camera used for imaging depending on the height of the subject's face, and is therefore able to appropriately image the subject's face. This allows the information processing device 2 to capture an image of a quality suitable for face authentication. [3: Third Embodiment]

[0057] Next, a third embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described. Hereinafter, the third embodiment of the information processing device, the information processing system, the information processing method, and the recording medium will be described using an information processing device 3 to which the third embodiment of the information processing device, the information processing system, the information processing method, and the recording medium is applied. [3-1: Configuration of Information Processing Device 3]

[0058] As shown in FIG. 5 , the information processing device 3 in the third embodiment includes a calculation device 21 and a storage device 22, similar to the information processing device 2 in the second embodiment. Furthermore, the information processing device 3 in the third embodiment may include a communication device 23, an input device 24, and an output device 25, similar to the information processing device 2 in the second embodiment. However, the information processing device 3 does not have to include at least one of the communication device 23, the input device 24, and the output device 25. The information processing device 3 in the third embodiment differs from the information processing device 2 in the second embodiment in that the calculation device 21 further includes a change unit 313. Other features of the information processing device 3 may be the same as other features of the information processing device 2 in the second embodiment. Therefore, hereinafter, differences from the embodiments already described will be described in detail, and descriptions of other overlapping parts will be omitted as appropriate. [3-2: Appearance of Information Processing Device 3]

[0059] 6 is a side view of the information processing device 3. The table top UB may be inclined at a predetermined angle or more with respect to the horizontal plane. The inclination of the table top UB with respect to the horizontal plane may be, for example, 15°. The inclination of the table top UB with respect to the horizontal plane may be, for example, in the range of 0° to 25°.

[0060] If the top plate UB is inclined at a predetermined angle or more with respect to the horizontal plane, when an object is left on the top plate UB, the object will naturally move downward, making it possible to make the target person aware that the object is still placed there. For example, if a document such as a passport or a display screen of a smartphone is read by the reading unit Re, and then the reception unit IN is operated and the document is left behind, the document will fall from the top plate, making it possible to make the target person aware that the document has been left behind.

[0061] As shown by arrow 6A in Fig. 6, the support part J to which the table top UB is attached to the support body B may be movable up and down relative to the support body B. Also, as shown by arrow 6B in Fig. 6, the inclination of the table top UB relative to the horizontal plane may be changeable around the position of the support part J. Also, as shown by arrow 6C in Fig. 6, the distance between the opposing surface FP of the table top UB facing the subject and the support part J may be changeable. The table top UB may have an arm and a plate part, and the depth may be changed by moving the plate part along the arm. [3-3: Attitude Change Operation of Information Processing Device 3]

[0062] The change unit 313 changes at least one of the height, angle, and depth of the tabletop UB according to the height of the subject's face. The height of the subject's face may be determined by the height determination unit 211. The height determination unit 211 may make the determination based on information acquired from at least one of the left camera L, the right camera R, the upper camera U, the monitoring camera M, and the microphone Mic. The change unit 313 may determine a height suitable for operation at the subject's hand according to the height of the subject's face.

[0063] When the height suitable for the operation at the subject's hands is relatively low, the change unit 313 may change the height of the support portion J of the top board UB to be relatively low. The change unit 313 may change the height of the top board UB so that the position of the top board UB is lower than at least the height of the subject's face. When the height suitable for the operation at the subject's hands is relatively low, the change unit 313 may increase the inclination of the top board UB.

[0064] If the height suitable for operation at the subject's hands is relatively high, the change unit 313 may change the height of the support portion J of the top board UB to be relatively high. If the height suitable for operation at the subject's hands is relatively high, the change unit 313 may decrease the inclination of the top board UB. The change unit 313 may change the height, inclination, and depth of the top board UB to make it easier for the subject to use. The change unit 313 may change the height, inclination, and depth of the top board UB depending on the condition of the subject, particularly at their hands.

[0065] In particular, if the subject uses a wheelchair, the change unit 313 may change the height of the support portion J of the table top UB to be higher than the armrests of the wheelchair. In this case, the change unit 313 may make the table top UB horizontal and change the depth so that it protrudes significantly.

[0066] Furthermore, if an object remains on the tabletop UB even though the subject has moved away from the information processing device 3, the change unit 313 may increase the inclination of the tabletop UB to notify the subject that the object has been left behind. For example, the tabletop UB may be equipped with a mechanism for detecting weight, and if a weight greater than a predetermined value is detected for a predetermined period of time or longer, it may determine that an object has been left behind on the tabletop UB and increase the inclination of the tabletop UB to notify the subject that the object has been left behind. [3-4: Technical Effects of the Information Processing Device 3]

[0067] In the information processing device 3 of the third embodiment, the table top UB is inclined at a predetermined angle or more with respect to the horizontal plane, so that the subject can be made aware that an object is still placed on the table top UB. Furthermore, the information processing device 3 changes at least one of the angle, height, and depth of the table top UB according to the height of the subject's face, so that the subject can use the information processing device 3 in a comfortable position. [4: Fourth embodiment]

[0068] Next, a fourth embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described. Hereinafter, the fourth embodiment of the information processing device, the information processing system, the information processing method, and the recording medium will be described using an information processing device 4 to which the fourth embodiment of the information processing device, the information processing system, the information processing method, and the recording medium is applied. [4-1: Configuration of Information Processing Device 4]

[0069] As shown in FIG. 7 , the information processing device 4 of the fourth embodiment includes a calculation device 21 and a storage device 22, similar to the information processing device 2 of the second embodiment and the information processing device 3 of the third embodiment. Furthermore, the information processing device 4 of the fourth embodiment may include a communication device 23, an input device 24, and an output device 25, similar to the information processing device 2 of the second embodiment and the information processing device 3 of the third embodiment. However, the information processing device 4 does not necessarily include at least one of the communication device 23, the input device 24, and the output device 25. The information processing device 4 of the fourth embodiment differs from the information processing device 2 of the second embodiment and the information processing device 3 of the third embodiment in that the calculation device 21 further includes a change unit 413. Other features of the information processing device 4 may be the same as those of the information processing device 2 of the second embodiment or the information processing device 3 of the third embodiment. Therefore, the following will describe in detail the differences from the previously described embodiments, and will omit appropriate descriptions of other overlapping features. [4-2: Attitude Change Operation of Information Processing Device 4]

[0070] The change unit 413 changes at least one of the angle, height, and depth of at least one of the display D, the left camera L, the right camera R, the upper camera U, and the monitoring camera M according to the height of the face of the subject. The height of the face of the subject may be determined by the height determination unit 211. As in the third embodiment, the height determination unit 211 may make the determination based on information acquired from at least one of the left camera L, the right camera R, the upper camera U, the monitoring camera M, and the microphone Mic.

[0071] If the height of the face of the subject is relatively low, the change unit 413 may change the height of at least one of the display D, the left camera L, the right camera R, the upper camera U, and the monitoring camera M to be relatively low. If the height of the face of the subject is relatively low, the change unit 413 may change the inclination of the display D to be close to vertical.

[0072] If the height of the face of the subject is relatively high, the change unit 413 may change the height of at least one of the display D, the left camera L, the right camera R, the upper camera U, and the monitoring camera M to be relatively high. If the height of the face of the subject is relatively high, the change unit 413 may tilt the display D so that the upper side of the display D is positioned further back.

[0073] If the subject uses a wheelchair, the change unit 413 may change the depth of the display D so that the display D moves forward. The change unit 413 may change the height, inclination, or depth of the display D so that the subject can easily view the display D.

[0074] The inclination of the display D may be, for example, in the range of 0° to 30° with respect to the vertical plane. The height of the central part of the display D may be, for example, in the range of 1180 mm to 1250 mm. The change unit 413 may change the height of the display D so that the target person can look down on the display D.

[0075] In the fourth embodiment, the display D, the left camera L, the right camera R, and the upper camera U may be provided in the same housing. The housing in which the display D, the left camera L, the right camera R, and the upper camera U are provided may be referred to as a display housing DH. In other words, the positions or angles of the display D, the left camera L, the right camera R, and the upper camera U may be changed integrally. In this case, the imaging angles of the left camera L, the right camera R, and the upper camera U may each be changed independently.

[0076] 8, in the fourth embodiment, the angle formed between the display housing DH and the top plate UB may be fixed. For example, when the height of the subject's face is relatively low, the change unit 313 and the change unit 413 may change the attitude of the display housing DH and the top plate UB so that the display D is tilted close to vertical, as illustrated in FIG. 8(a). When the height of the subject's face is relatively high, the change unit 313 and the change unit 413 may change the attitude of the display housing DH and the top plate UB so that the top plate UB is tilted close to horizontal, as illustrated in FIG. 8(b). [4-3: Facial Image Acquisition Operation of Information Processing Device 4]

[0077] In the fourth embodiment, similarly to the second embodiment, the imaging instruction unit 212 may issue an instruction so that a camera corresponding to the height of the subject's face is operated. Alternatively, all of the left camera L, right camera R, and upper camera U may be caused to capture images, and the captured image to be used may be selected according to the subject's height and facial orientation. Alternatively, the camera to be operated may be selected according to the tilt of the subject's face. For example, even if the subject is short, the upper camera U may capture images if the subject is facing up. For example, if the subject is short and has their face tilted to the left, the number of images captured by the left camera L may be increased.

[0078] Furthermore, the captured image obtained from at least one of the left camera L, the right camera R, and the upper camera U may be corrected so as to be equivalent to an image captured from the front. When captured images are obtained from more than one of the left camera L, the right camera R, and the upper camera U, they may be combined to generate a single facial image for use in subsequent processing. Furthermore, for example, the captured images captured by the left camera L and the right camera R and the captured image captured by the upper camera U may be weighted according to the height of the subject's face and used in subsequent processing. [4-4: Technical Effects of Information Processing Device 4]

[0079] The information processing device 4 in the fourth embodiment changes at least one of the height and angle of the left camera L, the right camera R, the upper camera U, and the monitoring camera M, so that an appropriate captured image can be obtained. Since at least one of the height and angle of the display D is changed, the subject can easily view the display D. Also, an appropriate captured image can be easily obtained. [5: Fifth Embodiment]

[0080] Next, a fifth embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described. Hereinafter, the fifth embodiment of the information processing device, the information processing system, the information processing method, and the recording medium will be described using an information processing device 5 to which the fifth embodiment of the information processing device, the information processing system, the information processing method, and the recording medium is applied. [5-1: Configuration of Information Processing Device 5]

[0081] As shown in FIG. 9 , the information processing device 5 of the fifth embodiment includes a calculation device 21 and a storage device 22, similar to the information processing device 2 of the second embodiment to the information processing device 4 of the fourth embodiment. Furthermore, the information processing device 5 of the fifth embodiment may include a communication device 23, an input device 24, and an output device 25, similar to the information processing device 2 of the second embodiment to the information processing device 4 of the fourth embodiment. However, the information processing device 5 does not necessarily include at least one of the communication device 23, the input device 24, and the output device 25. The information processing device 5 of the fifth embodiment differs from the information processing device 2 of the second embodiment to the information processing device 4 of the fourth embodiment in that the calculation device 21 further includes a possession presence determination unit 514 and an output control unit 515. Other features of the information processing device 5 may be the same as at least one other feature of the information processing device 2 of the second embodiment to the information processing device 4 of the fourth embodiment. Therefore, the following will describe in detail the differences from the already-described embodiments, and will omit appropriate descriptions of other overlapping features. [5-2: Information Processing Operation Performed by Information Processing Device 5]

[0082] Next, the information processing operation performed by the information processing device 5 in the fifth embodiment will be described with reference to Fig. 10. Fig. 10 is a flowchart showing the flow of the information processing operation performed by the information processing device 5 in the fifth embodiment.

[0083] The belongings presence determination unit 514 monitors the subject's belongings that are present within a predetermined range including the information processing device 5. The belongings presence determination unit 514 may monitor the subject's belongings based on information acquired from at least one of the left camera L, right camera R, upper camera U, monitoring camera M, and reading unit Re. For example, at least one of the left camera L, right camera R, upper camera U, and monitoring camera M can capture images of objects on the tabletop UB. The belongings presence determination unit 514 can detect the presence of objects on the tabletop UB based on information acquired from at least one of the left camera L, right camera R, upper camera U, and monitoring camera M. Furthermore, the monitoring camera M can capture images of objects on the floor around the information processing device 5. The belongings presence determination unit 514 can detect the presence of objects on the floor around the information processing device 5 based on information acquired from the monitoring camera M.

[0084] As shown in FIG. 10 , the belongings presence determination unit 514 determines whether the subject's belongings have been present within a predetermined range including the information processing device 5 for a predetermined period of time (step S50). The belongings presence determination unit 514 may determine whether the subject's belongings have been present within a predetermined range including the information processing device 5 for a predetermined period of time after the subject has disappeared from the vicinity of the information processing device 5. If it is determined that the subject's belongings have been present within a predetermined range including the information processing device 5 for a predetermined period of time (step S50: Yes), the output control unit 515 outputs information indicating the subject and the subject's belongings (step S51). The output control unit 515 may identify an individual from, for example, information on a passport read by the reading unit Re. In this case, the output control unit 515 may associate information identifying the identified individual with a captured image of the corresponding belongings and transmit the associated information to the management device C. The output control unit 515 may also transmit, to the identified individual's contact information, information indicating that the belongings captured in the captured image have been left behind, along with the captured image of the corresponding belongings. [5-3: Technical Effects of Information Processing Device 5]

[0085] The information processing device 5 in the fifth embodiment can use information acquired from at least one of the left camera L, the right camera R, the upper camera U, the monitoring camera M, and the reading unit Re to determine whether an item has been left behind near the information processing device 5, identify the owner of the item, and provide information regarding the item being left behind. [6: Sixth Embodiment]

[0086] Next, a sixth embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described. Hereinafter, the sixth embodiment of the information processing device, the information processing system, the information processing method, and the recording medium will be described using an information processing device 6 to which the sixth embodiment of the information processing device, the information processing system, the information processing method, and the recording medium is applied. [6-1: Appearance of the information processing device 6]

[0087] As shown in FIG. 11 , the information processing device 6 in the sixth embodiment further includes an odor sensor Sen and a gas output unit Air. The odor sensor Sen detects a predetermined odor. The predetermined odor may be the odor of a predetermined item. The predetermined item may be an item whose import or export is prohibited or regulated. The odor sensor Sen detects the odor of at least one of the subject and the subject's belongings. The odor sensor Sen may be provided on the facing surface FP, which is the frontmost surface of the tabletop UB. It may also be provided in a location relatively close to the subject.

[0088] The gas output unit Air outputs gas. The gas output unit Air may output air. The gas output unit Air may be provided at multiple locations in the information processing device 6. [6-2: Configuration of the information processing device 6]

[0089] As shown in FIG. 12 , the information processing device 6 of the sixth embodiment includes a calculation device 21 and a storage device 22, similar to the information processing device 2 of the second embodiment to the information processing device 5 of the fifth embodiment. Furthermore, the information processing device 6 of the sixth embodiment may include a communication device 23, an input device 24, and an output device 25, similar to the information processing device 2 of the second embodiment to the information processing device 5 of the fifth embodiment. However, the information processing device 6 does not have to include at least one of the communication device 23, the input device 24, and the output device 25. The information processing device 6 of the sixth embodiment differs from the information processing device 2 of the second embodiment to the information processing device 5 of the fifth embodiment in that the calculation device 21 further includes an output control unit 615, a suspicious person determination unit 616, an odor sensor control unit 617, and a gas output control unit 618. Other features of the information processing device 6 may be the same as at least one other feature of the information processing device 2 of the second embodiment to the information processing device 5 of the fifth embodiment. Therefore, in the following, only the differences from the embodiments already described will be described in detail, and the description of other overlapping parts will be omitted as appropriate. [6-3: Information Processing Operation Performed by Information Processing Device 6]

[0090] Next, the information processing operation performed by the information processing device 6 in the sixth embodiment will be described with reference to Fig. 13. Fig. 13 is a flowchart showing the flow of the information processing operation performed by the information processing device 6 in the sixth embodiment.

[0091] As shown in FIG. 13 , the suspicious person determination unit 616 determines whether the subject is a suspicious person (step S60). The suspicious person determination unit 616 may monitor the behavior of the subject based on information acquired from at least one of the left camera L, the right camera R, the upper camera U, the monitoring camera M, the reading unit Re, the receiving unit IN, and the microphone Mic. The suspicious person determination unit 616 may determine that the subject is a suspicious person when the movement of a predetermined part of the subject behaves in a predetermined manner. The predetermined part of the subject may include the subject's head, eyes and the surrounding area, mouth and mouth area, arms, palms, etc. The suspicious person determination unit 616 may determine that the subject is a suspicious person when suspicious behavior is detected.

[0092] If the suspicious person determination unit 616 determines that a person is suspicious (step S60: Yes), the odor sensor control unit 617 enables operation of the odor sensor Sen (step S61). If the suspicious person determination unit 616 determines that a person is suspicious, the odor sensor control unit 617 may start operation of the odor sensor Sen. Alternatively, if the suspicious person determination unit 616 determines that a person is suspicious, the odor sensor control unit 617 may lower the sensitivity threshold of the odor sensor Sen to make it easier to detect a predetermined odor.

[0093] When the operation of the odor sensor Sen is enabled, the gas output control unit 618 causes the gas output unit Air to output gas (step S62). When the suspicious person determination unit 616 determines that a person is suspicious, the gas output control unit 618 may cause the gas output unit Air to spray gas onto at least one of the target person and the target person's belongings, making them more likely to vaporize due to the sprayed gas. The odor sensor Sen may detect a predetermined item by analyzing the gas sprayed onto the gas output unit Air and collected.

[0094] After step S61, the output control unit 615 determines whether the odor sensor Sen has detected a predetermined odor (step S63). If the odor sensor Sen has detected a predetermined odor (step S63: Yes), the output control unit 615 outputs information indicating this (step S64). The output control unit 615 may associate the type of item with information about the subject and output this to, for example, the management device C. The information about the subject may be a facial image of the subject, and identification information such as the subject's name.

[0095] In addition, if a person is determined to be suspicious in step S60, and a predetermined time has passed since the start of detection of a specified odor, and the specified odor has not been detected, the odor sensor control unit 617 may disable the operation of the odor sensor Sen.

[0096] Furthermore, at least one of the operations of step S60, step S61, and step S62 may not be performed. For example, the operation of the odor sensor Sen may be enabled even if the subject is not determined to be a suspicious person, or the operation of the odor sensor Sen may always be enabled. Furthermore, the gas output unit Air may output gas even if the subject is not determined to be a suspicious person. Alternatively, the information processing device 6 may not have a gas output unit Air.

[0097] 13, the operations of steps S61 and S62 are performed when the suspicious person determination unit 616 determines that a person is suspicious, but if the degree of suspiciousness is low, only the operation of step S61 may be performed, and the operation of step S62 may not be performed. For example, if the degree of suspiciousness exceeds the first threshold but does not exceed the second threshold, only the operation of step S61 may be performed, and if the degree of suspiciousness exceeds the second threshold, both the operations of step S61 and step S62 may be performed. [6-4: Technical Effects of Information Processing Device 6]

[0098] The information processing device 6 in the sixth embodiment can detect a predetermined target person by smell while the target person is performing various procedures. The information processing device 6 can detect smell when there is a target person who is determined to be a suspicious person. In other words, if the target person does not require smell detection, unnecessary detection processing is not performed. The information processing device 6 sprays gas, making it easier to detect smell. [7: Seventh Embodiment]

[0099] Next, a seventh embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described. Hereinafter, the seventh embodiment of the information processing device, the information processing system, the information processing method, and the recording medium will be described using an information processing device 7 to which the seventh embodiment of the information processing device, the information processing system, the information processing method, and the recording medium is applied. [7-1: Configuration of Information Processing Device 7]

[0100] As shown in FIG. 14 , the information processing device 7 of the seventh embodiment includes a calculation device 21 and a storage device 22, similar to the information processing device 2 of the second embodiment to the information processing device 6 of the sixth embodiment. Furthermore, the information processing device 7 of the seventh embodiment may include a communication device 23, an input device 24, and an output device 25, similar to the information processing device 2 of the second embodiment to the information processing device 6 of the sixth embodiment. However, the information processing device 7 does not necessarily include at least one of the communication device 23, the input device 24, and the output device 25. The information processing device 7 of the seventh embodiment differs from the information processing device 2 of the second embodiment to the information processing device 6 of the sixth embodiment in that the calculation device 21 further includes a person presence determination unit 719 and a communication unit 720. Other features of the information processing device 7 may be the same as at least one other feature of the information processing device 2 of the second embodiment to the information processing device 6 of the sixth embodiment. Therefore, the following will describe in detail the differences from the already-described embodiments, and will omit appropriate descriptions of other overlapping features. [7-2: Information Processing Operation Performed by Information Processing Device 7]

[0101] Next, the information processing operation performed by the information processing device 7 in the seventh embodiment will be described with reference to Fig. 15. Fig. 15 is a flowchart showing the flow of the information processing operation performed by the information processing device 7 in the seventh embodiment.

[0102] The person presence determination unit 719 monitors the presence of a target person within a predetermined range including the information processing device 7. The person presence determination unit 719 may monitor the presence of a target person based on information acquired from at least one of the left camera L, the right camera R, the upper camera U, the monitoring camera M, the reading unit Re, the receiving unit IN, and the microphone Mic.

[0103] 15 , when it is determined that the subject has been present within a predetermined range including the information processing device 7 for a predetermined time period longer than the predetermined time period (step S70: Yes), the communication unit 720 transmits information indicating this to the management device C (step S71). The case where the subject has been present within a predetermined range including the information processing device 7 for a predetermined time period longer than the predetermined time period may correspond to the case where the subject has not performed any operation for a predetermined time period since standing in front of the information processing device 7. The determination in step S70 may also be positive when a predetermined time period has elapsed since the subject operated the reception unit IN. The determination in step S70 may also be positive when the subject did not operate the reception unit IN even though a facial image of the subject was acquired. The determination in step S70 may also be positive when the subject did not allow the reading unit Re to read their passport.

[0104] The communication unit 720 receives information from the management device C and assists the operation of at least one of the subject and the information processing device 7 in accordance with the received information (step S72). The communication unit 720 may control at least one of the display D and the speaker S to output information to assist the subject. For example, the communication unit 720 may highlight a portion of the display D corresponding to a portion of the reception unit IN that the subject should operate. At least one of the display D, the left camera L, the right camera R, the upper camera U, the reading unit Re, and the speaker S may operate in accordance with the operation of an administrator of the management device C. For example, the left camera L, the right camera R, and the upper camera U may capture a facial image of the subject in accordance with the operation of the administrator of the management device C. The administrator may also input input items to be received via the reception unit IN, etc., on behalf of the subject. For example, the administrator may input the subject's name on behalf of the subject. The administrator may also select the subject's language on behalf of the subject. [7-3: Technical Effects of the Information Processing Device 7]

[0105] The information processing device 7 in the seventh embodiment assists the subject in operating the information processing device 7, thereby preventing the subject from staying in the device. [8: Eighth Embodiment]

[0106] Next, an eighth embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described. Hereinafter, the eighth embodiment of the information processing device, the information processing system, the information processing method, and the recording medium will be described using an information processing device 8 to which the eighth embodiment of the information processing device, the information processing system, the information processing method, and the recording medium is applied.

[0107] Although not shown, the information processing device 8 includes a moving means T that is enabled when desired. The moving means T may be a means suitable for moving on a plane. The moving means T may be one or more wheels. The moving means T may also be a belt conveyor. [8-1: Configuration of the information processing device 8]

[0108] As shown in FIG. 16 , the information processing device 8 of the eighth embodiment includes a calculation device 21 and a storage device 22, similar to the information processing device 2 of the second embodiment to the information processing device 7 of the seventh embodiment. Furthermore, the information processing device 8 of the eighth embodiment may include a communication device 23, an input device 24, and an output device 25, similar to the information processing device 2 of the second embodiment to the information processing device 7 of the seventh embodiment. However, the information processing device 8 does not necessarily include at least one of the communication device 23, the input device 24, and the output device 25. The information processing device 8 of the eighth embodiment differs from the information processing device 2 of the second embodiment to the information processing device 7 of the seventh embodiment in that the calculation device 21 further includes a self-propelled control unit 821. Other features of the information processing device 8 may be the same as at least one other feature of the information processing device 2 of the second embodiment to the information processing device 7 of the seventh embodiment. Therefore, the following will describe in detail the differences from the previously described embodiments, and will omit appropriate descriptions of other overlapping features. [8-2: Information Processing Operation Performed by Information Processing Device 8]

[0109] Next, the information processing operation performed by the information processing device 8 in the eighth embodiment will be described with reference to Fig. 17. Fig. 17 is a flowchart showing the flow of the information processing operation performed by the information processing device 8 in the eighth embodiment.

[0110] As shown in Fig. 17, the self-propelled control unit 821 monitors whether or not it is desired (step S80). If it is desired, it may be when it is necessary to move to a different location and perform a guidance operation at the new location, or when it is necessary to perform a guidance operation while moving. If it is desired, it may be, for example, when it is necessary to ensure the safety of a target person at the location where the information processing device 8 is installed, such as in the event of a disaster. If it is desired, it may be transmitted from the management device C. When a disaster occurs, the management device C may detect the location of the disaster, a crowd, etc., and transmit information to the information processing device 8.

[0111] If desired (step S80, Yes), the transportation means T is enabled (step S81). When information indicating a desired case is received from the management device C, control of the operation of the transportation means T by the self-propelled control unit 821 may be enabled.

[0112] The self-propelled control unit 821 causes the information processing device 8 to self-propel by the transportation means T when desired. The self-propelled control unit 821 may receive an operation instruction from the management device C. In other words, the information processing device 8 may be remotely operated by the management device C via the self-propelled control unit 821.

[0113] The information processing device 8 may move to the target person who needs guidance by a transportation means T. The target person may be guided by output from at least one of a display D and a speaker S. Guidance of the optimal evacuation route may be output.

[0114] The information processing device 8 may notify the user of crowded places, dangerous places to enter, or places to avoid, or may guide the user to a dangerous place, or may move in front of a dangerous place and notify the user that entry is prohibited.

[0115] The output control unit 815 may output the optimal evacuation route on the display D. The information processing device 8 may use the transportation means T to move close to a target person in the vicinity of the information processing device 8 and notify the target person of the optimal evacuation route. [8-3: Technical Effects of the Information Processing Device 8]

[0116] The information processing device 8 in the eighth embodiment can notify necessary information at an appropriate location. [9: Ninth Embodiment]

[0117] Next, a ninth embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described. Hereinafter, the ninth embodiment of the information processing device, the information processing system, the information processing method, and the recording medium will be described using an information processing system SYS to which the ninth embodiment of the information processing device, the information processing system, the information processing method, and the recording medium is applied. [9-1: Configuration of the information processing system SYS]

[0118] As shown in Fig. 18, the information processing system SYS includes a plurality of information processing devices 9 and a management device C. The information processing device 9 may be the same as any of the information processing devices 1 to 8. The management device C may include a congestion determination unit C1 and a communication unit C2. Fig. 18 includes information processing devices 9a, 9b, and 9c, each of which includes a display D and a monitoring camera M. [9-2: Information Processing Operation Performed by the Information Processing System SYS]

[0119] The congestion determination unit C1 may calculate congestion information. The congestion information is information indicating the degree of congestion near each information processing device 9. The congestion determination unit C1 may calculate the congestion information from the number of detected subjects included in images captured by the surveillance camera M. The congestion determination unit C1 may calculate the congestion information from the number of detected faces of subjects included in images captured by the surveillance camera M. If the number of subjects included in images captured by the surveillance camera M exceeds a predetermined number, the congestion determination unit C1 may determine that it is preferable to guide subjects who wish to use the information processing device 9 (e.g., information processing device 9a) to another information processing device 9. Furthermore, if the number of subjects included in images captured by the surveillance camera M is less than a predetermined number, the congestion determination unit C1 may determine that it is preferable to guide subjects who wish to use the information processing device 9 to an information processing device (e.g., information processing device 9c) equipped with the surveillance camera M. The communication unit C2 may output to each of the information processing devices 9 information indicating an information processing device 9 in which the number of subjects contained in the image captured by the surveillance camera M exceeds a predetermined value, and information indicating an information processing device 9 in which the number of subjects captured by the surveillance camera M is less than a predetermined value.

[0120] For example, the congestion determination unit C1 may determine that the number of subjects included in the captured image captured by the monitoring camera Ma exceeds a predetermined number, and that it is preferable to guide the subject who is trying to use the information processing device 9a to another information processing device 9. Alternatively, the congestion determination unit C1 may determine that the number of subjects included in the captured image captured by the monitoring camera Mc is less than a predetermined number, and that it is preferable to guide the subject who wants to use the information processing device 9a to the information processing device 9c. In this case, the communication unit C2 may output, to at least the information processing device 9a and the information processing device 9c, information indicating the information processing device 9a in which the number of subjects included in the captured image exceeds a predetermined number, and information indicating the information processing device 9c in which the number of subjects captured by the monitoring camera M is less than a predetermined number. The information processing device 9a may display, on the display Da, information guiding the subject to the information processing device 9c that is not congested. The information processing device 9c may display, on the display Dc, information indicating that the information processing device 9c itself is not congested. [9-3: Technical Effects of the Information Processing System SYS]

[0121] For example, after an airplane lands, many subjects use the information processing device 9. In such a case, the information processing system SYS in the ninth embodiment calculates the degree of congestion in front of the information processing device 9, and shares the degree of congestion among the multiple information processing devices 9. An information processing device 9 with many information processing devices 9 lined up outputs the locations of information processing devices 9 where subjects are not lined up to the subjects and a manager, thereby reducing the waiting time of the subjects. [10: Addendum]

[0122] The following supplementary notes are further disclosed regarding the above-described embodiments: [Supplementary Note 1] An information processing device comprising: a display; a left camera provided to the left of the display for capturing an image of an object from the left side; a right camera provided to the right of the display for capturing an image of the object from the right side; an upper camera provided above the display for capturing an image of the object from above; and a monitoring camera provided above the display for monitoring the object from above. [Supplementary Note 2] The information processing device according to Supplementary Note 1 further comprises: a left side plate member provided to the left of the left side camera, which prevents people other than the target from viewing the display content on the display and prevents people other than the target from appearing in the captured images taken by the right side camera and the upper camera; a right side plate member provided to the right of the right side camera, which prevents people other than the target from viewing the display content on the display and prevents people other than the target from appearing in the captured images taken by the left side camera and the upper camera; a top plate provided below the display, which protrudes towards the target facing the display and has a reader on its top surface; a receiving means which detects pointing actions of the target in the space between the display and the target and receives input of instructions for the information processing device; a speaker which outputs sound towards the target; and a microphone which inputs sound made by the target. [Supplementary Note 3] The information processing device according to Supplementary Note 1 or 2, further comprising an imaging instruction means for determining a height of the face of the target, and instructing the left camera and the right camera to capture an image of the face of the target if the height of the face of the target is lower than a predetermined height, and instructing the upper camera to capture an image of the face of the target if the height of the face of the target is higher than the predetermined height. [Supplementary Note 4] The information processing device according to Supplementary Note 2, wherein the tabletop is inclined at an angle of at least a predetermined angle with respect to a horizontal plane. [Supplementary Note 5] The information processing device according to Supplementary Note 2 or 4, further comprising a change means for determining the height of the face of the target, and changing at least one of the height, angle, and depth of the tabletop.[Supplementary Note 6] The information processing device according to Supplementary Note 1 or 2, further comprising: a change unit that determines the height of the target's face and changes at least one of the height, angle, and depth of at least one of the display, the left camera, the right camera, the upper camera, and the surveillance camera. [Supplementary Note 7] The information processing device according to Supplementary Note 2, further comprising: a possession information output unit that outputs information indicating the target and information indicating the target's possessions when it is determined that the target's possessions have been present within a predetermined range including the information processing device for more than a predetermined time. [Supplementary Note 8] The information processing device according to Supplementary Note 1 or 2, further comprising: an odor sensor that detects a predetermined odor; and odor information output unit that, when the odor sensor detects the predetermined odor, outputs information indicating that fact. [Supplementary Note 9] The information processing device according to Supplementary Note 8, further comprising: a determination unit that determines whether the target is a suspicious person; and an odor sensor control unit that enables operation of the odor sensor when the determination unit determines that the target is a suspicious person. [Supplementary Note 10] The information processing device according to Supplementary Note 8, further comprising: a determination means for determining whether the target is a suspicious person; and a gas output means for outputting a gas when the determination means determines that the target is a suspicious person. [Supplementary Note 11] The information processing device according to Supplementary Note 1 or 2, further comprising: an assist means for assisting the operation of at least one of the target and the information processing device when it is determined that the target has been present within a predetermined range including the information processing device for more than a predetermined time. [Supplementary Note 12] The information processing device according to Supplementary Note 1 or 2, further comprising: a transportation means that becomes effective when desired; and self-propelled by the transportation means when desired.[Supplementary Note 13] An information processing system including a plurality of information processing devices each including: a display; a left camera provided on the left side of the display for capturing an image of an object from the left side; a right camera provided on the right side of the display for capturing an image of the object from the right side; an upper camera provided above the display for capturing an image of the object from above; and a surveillance camera provided above the display for monitoring the object from above, wherein the display provided in an information processing device in which the number of objects included in images captured by the surveillance camera exceeds a predetermined number outputs information indicating an information processing device in which the number of objects included in images captured by the surveillance camera is less than a predetermined number. [Supplementary Note 14] An information processing method comprising: determining the height of a target's face, and if the height of the target's face is lower than a predetermined height, instructing a left camera provided on the left side of a display that images the target from the left side and a right camera provided on the right side of the display that images the target from the right side to capture an image of the target's face; if the height of the target's face is higher than a predetermined height, instructing an upper camera provided above the display that images the target from above to capture an image of the target's face. [Supplementary Note 15] A recording medium having recorded thereon a computer program for causing a computer to execute an information processing method comprising: determining the height of a target's face, and if the height of the target's face is lower than a predetermined height, instructing a left camera provided on the left side of the display that images the target from the left side and a right camera provided on the right side of the display that images the target from the right side to capture an image of the target's face; if the height of the target's face is higher than a predetermined height, instructing an upper camera provided above the display that images the target from above to capture an image of the target's face. [Supplementary Note 16] The information processing device according to any one of Supplementary Notes 3, 5 to 7, and 9 to 11, wherein the determination is based on information acquired from at least one of the left camera, the right camera, the upper camera, the surveillance camera, the reader, the reception means, and the microphone.

[0123] This disclosure may be modified as appropriate within the scope of the claims and the technical idea that can be read from the entire specification. Information processing devices, information processing systems, information processing methods, and recording media that involve such modifications are also included in the technical idea of ​​this disclosure.

[0124] 1, 2, 3, 4, 6, 7, 8, 9 Information processing device D Display L Left side camera R Right side camera U Upper side camera M Surveillance camera LB Left side plate member RB Right side plate member UB Top plate Re Reading unit IN Reception unit S Speaker Mic Microphone F Filter 211 Height determination unit 212 Imaging instruction unit 313, 413 Change unit 514 Possession presence determination unit 515, 615, 815 Output control unit Sen Smell sensor Air Gas output unit 616 Suspicious person determination unit 617 Smell sensor control unit 618 Gas output control unit 719 Person presence determination unit 720 Communication unit 821 Self-propelled control unit T Transportation means SYS Information processing system C Management device C1 Congestion determination unit C2 Communication unit

Claims

1. A display and A left camera provided to the left of the display for capturing an image of an object from the left side; a right camera provided to the right of the display and configured to capture an image of the object from the right side; an upper camera provided above the display and configured to capture an image of the object from above; a surveillance camera provided above the display and configured to monitor the object from above; The information processing device includes: The display provided in the information processing device in which the number of objects included in the captured images captured by the surveillance camera exceeds a predetermined number outputs information indicating the information processing device in which the number of objects included in the captured images captured by the surveillance camera is less than a predetermined number. Information processing system.

2. Each of the plurality of information processing devices a left side plate member provided to the left of the left side camera to prevent people other than the target from viewing the display content of the display and to prevent people other than the target from being captured in an image captured by the right side camera and an image captured by the upper camera; a right side plate member provided to the right of the right side camera to prevent people other than the target from viewing the display content of the display and to prevent people other than the target from being captured in an image captured by the left side camera and an image captured by the upper camera; a top plate provided below the display, protruding toward the object facing the display, and having a reader on an upper surface; a receiving means for detecting a pointing action of the target in a space between the display and the target, and receiving an input of the instruction for the information processing device; A speaker for outputting sound toward the target; A microphone for inputting the voice emitted by the subject; The information processing system according to claim 1 , further comprising:

3. Each of the plurality of information processing devices determining a height of the subject's face; If the height of the face of the target is lower than a predetermined height, instruct the left camera and the right camera to capture an image of the face of the target; The camera further includes an imaging instruction unit that instructs the upper camera to capture an image of the face of the target when the height of the face of the target is higher than a predetermined height.

3. The information processing system according to claim 1 or 2.

4. The top plate is inclined at a predetermined angle or more with respect to the horizontal plane. The information processing system according to claim 2 .

5. Each of the plurality of information processing devices The present invention further includes a change unit that determines the height of the face of the subject and changes at least one of the height, angle, and depth of the tabletop.

5. The information processing system according to claim 2 or 4.

6. Each of the plurality of information processing devices The present invention further includes a change unit that determines a height of a face of the target and changes at least one of a height, an angle, and a depth of at least one of the display, the left camera, the right camera, the upper camera, and the surveillance camera.

3. The information processing system according to claim 1 or 2.

7. Each of the plurality of information processing devices The information processing device further includes a possession information output unit that outputs information indicating the object and information indicating the possession of the object when it is determined that the object is present within a predetermined range including the information processing device for a period exceeding a predetermined time. The information processing system according to claim 2 .

8. Each of the plurality of information processing devices An odor sensor that detects a predetermined odor; an odor information output means for outputting information indicating that the odor sensor detects the predetermined odor; The information processing system according to claim 1 or 2, further comprising:

9. Each of the plurality of information processing devices A determination means for determining whether the target is a suspicious person; an odor sensor control means for enabling the operation of the odor sensor when the determination means determines that the person is a suspicious person; The information processing system according to claim 8 , further comprising:

10. Each of the plurality of information processing devices A determination means for determining whether the target is a suspicious person; a gas output means for outputting a gas when the determination means determines that the person is a suspicious person; The information processing system according to claim 8 , further comprising:

11. When it is determined that the target is present within a predetermined range including the information processing device for a period longer than a predetermined time, an assistance unit assists in the operation of at least one of the target and the information processing device.

3. The information processing system according to claim 1 or 2.

12. Each of the plurality of information processing devices and further comprising a moving means which is activated when desired; When desired, the moving means moves the device by itself.

3. The information processing system according to claim 1 or 2.

13. Determining the height of the subject's face; If the height of the face of the target is lower than a predetermined height, instruct a left camera provided on the left side of a display for capturing an image of the target from the left side and a right camera provided on the right side of the display for capturing an image of the target from the right side to capture an image of the face of the target; When the height of the face of the target is higher than a predetermined height, an upper camera that is provided above the display and captures an image of the face of the target from above is instructed to capture an image of the face of the target. A computer implemented information processing method.

14. On the computer, Determining the height of the subject's face; If the height of the face of the target is lower than a predetermined height, instruct a left camera provided on the left side of a display for capturing an image of the target from the left side and a right camera provided on the right side of the display for capturing an image of the target from the right side to capture an image of the face of the target; When the height of the face of the target is higher than a predetermined height, an upper camera that is provided above the display and captures an image of the face of the target from above is instructed to capture an image of the face of the target. A computer program for executing an information processing method.