Information processing device, information processing system, information processing method, and recording medium

Abstract

This information processing device comprises: an acquisition means for acquiring eye information indicating the eyes of a subject from a wearable device worn by the subject; a detection means that detects a fraudulent action by the subject using the eye information; and an output means that outputs information regarding suspected fraudulent activity to the wearable device on the basis of the detection result by the detection means.

Description

Information processing device, information processing system, information processing method, and recording medium

[0001] The present disclosure relates to the technical fields of an information processing device, an information processing system, an information processing method, and a recording medium.

[0002] There are known devices that detect whether a subject's behavior is appropriate. For example, Patent Document 1 discloses a device that receives data on the wearing / detachment state of a non-transparent head-mounted display worn by an examinee, and determines whether the wearing / detachment state is appropriate for the type of question that has been asked, using the data on the wearing / detachment state during the question-asking period and the data on the wearing / detachment state during the answer period.

[0003] Japanese Patent Application Laid-Open No. 2022-059107

[0004] This disclosure aims to improve upon the related art discussed above.

[0005] One aspect of the information processing device disclosed herein includes an acquisition means for acquiring eye information indicating the eyes of a subject from a wearable device worn by the subject, a detection means for detecting fraudulent behavior of the subject using the eye information, and an output means for outputting information regarding suspected fraudulent behavior to the wearable device based on the detection results by the detection means.

[0006] Another aspect of the information processing device disclosed herein is an information processing device worn by a subject, comprising: an acquisition means for capturing an image of the subject's eyes and acquiring eye information indicating the subject's eyes; a detection means for detecting fraudulent behavior of the subject using the eye information; and a control means for performing control in accordance with the detection results by the detection means.

[0007] One aspect of the information processing system of this disclosure includes an information processing device having: an acquisition means for acquiring eye information indicating the eyes of a subject from a wearable device worn by the subject; a detection means for detecting fraudulent behavior of the subject using the eye information; and an output means for outputting an alert regarding suspected fraudulent behavior to the wearable device based on the detection result by the detection means; and the wearable device having an output means for acquiring eye information indicating the eyes of the subject and outputting it to the information processing device, a receiving means for receiving an alert regarding suspected fraudulent behavior of the subject from the information processing device, and a presentation means for presenting the alert to the subject.

[0008] One aspect of the information processing method disclosed herein is an information processing method executed by a computer, which obtains eye information indicating the eyes of a subject from a wearable device worn by the subject, uses the eye information to detect fraudulent behavior of the subject, and outputs information regarding suspected fraudulent behavior to the wearable device based on the detection results.

[0009] Another aspect of the information processing method disclosed herein is an information processing method executed by a computer, which captures an image of a target's eyes, obtains eye information indicating the target's eyes, uses the eye information to detect fraudulent behavior of the target, and performs control according to the detection results.

[0010] One aspect of the recording medium of this disclosure has recorded thereon a computer program that causes a computer to execute an information processing method that acquires eye information indicating the eyes of a subject from a wearable device worn by the subject, detects fraudulent behavior of the subject using the eye information, and outputs information regarding suspected fraudulent behavior to the wearable device based on the detection results.

[0011] Another aspect of the recording medium of this disclosure is a recording medium having a computer program recorded thereon that causes a computer to execute an information processing method that captures an image of a target's eyes, obtains eye information indicating the target's eyes, uses the eye information to detect fraudulent behavior of the target, and performs control in accordance with the detection results.

[0012] FIG. 1 is a block diagram showing a configuration of an information processing device according to the present disclosure. FIG. 2 is a flowchart showing a flow of information processing operation in an information processing device according to the present disclosure. FIG. 3 is a block diagram showing a configuration of an information processing system according to the present disclosure. FIG. 4 is a block diagram showing a configuration of an information processing device according to the present disclosure. FIG. 5 is a schematic diagram showing a configuration of an information processing device according to the present disclosure. FIG. 6 is a block diagram showing a configuration of an information processing device according to the present disclosure. FIG. 7 is a block diagram showing a configuration of an information processing device according to the present disclosure. FIG. 8 is a block diagram showing a configuration of an information processing device according to the present disclosure. FIG. 9 is a block diagram showing a configuration of an information processing device according to the present disclosure. FIG. 10 is a block diagram showing a configuration of an information processing system according to the present disclosure. FIG. 11 is a block diagram showing a flow of information processing operation in an information processing system according to the present disclosure. FIG. 12 is a block diagram showing a configuration of an information processing system according to the present disclosure. FIG. 13 is a block diagram showing a configuration of an information processing system according to the present disclosure. FIG. 14 is a block diagram showing a flow of information processing operation in an information processing system according to the present disclosure. FIG. 15 is a block diagram showing a configuration of an information processing system according to the present disclosure.

[0013] Hereinafter, embodiments of an information processing device, an information processing system, an information processing method, and a recording medium will be described with reference to the drawings. [1: First Embodiment]

[0014] A first embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described with reference to FIGS. 1 and 2. In the following, the first embodiment of the information processing device, the information processing system, the information processing method, and the recording medium will be described using an information processing device 1. [1-1: Configuration of Information Processing Device 1]

[0015] The configuration of an information processing device 1 according to this disclosure will be described with reference to FIG. 1. FIG. 1 is a block diagram showing the configuration of the information processing device 1 according to this disclosure. As shown in FIG. 1, the information processing device 1 includes an acquisition unit 111, a detection unit 112, and an output unit 113. [1-2: Information Processing Method Executed by Information Processing Device 1]

[0016] An information processing method executed by the information processing device 1 will be described with reference to Fig. 2. Fig. 2 is a flowchart showing an example of the flow of the information processing method executed by the information processing device 1.

[0017] 2, the acquisition unit 111 acquires eye information indicating the subject's eyes from a wearable device worn by the subject (step S11). The detection unit 112 uses the eye information to detect fraudulent behavior of the subject (step S12). The detection unit 112 may detect fraudulent behavior of the subject based on the eye movement of the subject indicated by the eye information. The detection operation will be described in another embodiment.

[0018] The output unit 113 outputs information regarding suspected fraudulent behavior to the wearable device based on the detection result by the detection unit 112 (step S13). This information may be an alert indicating the suspected fraudulent behavior. This information may be information notifying the subject of suspected fraudulent behavior. In other words, this information may be information that alerts the subject. This information may also be information notifying the wearable device of suspected fraudulent behavior of the subject.

[0019] In this way, the information processing device 1 executes an information processing method in which eye information indicating the subject's eyes is acquired from a wearable device worn by the subject, the eye information is used to detect the subject's fraudulent behavior, and based on the detection results, information regarding suspected fraudulent behavior is output to the wearable device.

[0020] The information processing device 1 described above may be realized by a computer reading a computer program recorded on a recording medium. In this case, the recording medium may store a computer program for causing the computer to execute an information processing method that acquires eye information indicating the eyes of a subject from a wearable device worn by the subject, detects fraudulent behavior of the subject using the eye information, and outputs information regarding suspected fraudulent behavior to the wearable device based on the detection results. [1-3: Technical Effects]

[0021] The information processing device 1 according to this disclosure detects fraudulent behavior of a target and, based on the detection result, outputs information related to the suspected fraudulent behavior to a wearable device worn by the target, so that the target can know that fraudulent behavior is suspected. [2: Second embodiment] A second embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described with reference to FIGS. 3 and 4. In the following, the second embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described using an information processing device 2 as the information processing device. The information processing device 2 is worn by the target. [2-1: Configuration of information processing device 2]

[0022] The configuration of the information processing device 2 according to this disclosure will be described with reference to Fig. 3. Fig. 3 is a block diagram showing the configuration of the information processing device 2 according to this disclosure. As shown in Fig. 3, the information processing device 2 includes an acquisition unit 211, a detection unit 212, and a control unit 214. [2-2: Information Processing Method Executed by the Information Processing Device 2]

[0023] An information processing method executed by the information processing device 2 will be described with reference to Fig. 4. Fig. 4 is a flowchart showing an example of the flow of the information processing method executed by the information processing device 2.

[0024] 4, the acquisition unit 211 captures an image of the eyes of a subject wearing the information processing device 2 and acquires eye information indicating the subject's eyes (step S21). The detection unit 212 uses the eye information to detect fraudulent behavior of the subject (step S22). The detection operation will be described in another embodiment.

[0025] The control unit 214 performs control in accordance with the detection result by the detection unit 212 (step S23). For example, the control unit 214 may present information to the target to alert them that fraudulent behavior is suspected.

[0026] In this way, the information processing device 2 executes an information processing method in which it captures an image of the target's eyes, obtains eye information indicating the target's eyes, uses the eye information to detect fraudulent behavior of the target, and performs control according to the detection results.

[0027] The information processing device 2 described above may be realized by a computer reading a computer program recorded on a recording medium. In this case, the recording medium may have recorded thereon a computer program that causes the computer to execute an information processing method that captures an image of a target's eyes, acquires eye information indicating the target's eyes, detects the target's fraudulent behavior using the eye information, and performs control according to the detection results. [2-3: Technical Effects]

[0028] The information processing device 2 according to this disclosure detects fraudulent behavior of a target and performs control in accordance with the detection result, thereby preventing the target from engaging in fraudulent behavior. [3: Third Embodiment]

[0029] A third embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described with reference to FIGS. 5 to 11. In the following, the third embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described using an information processing system Sa. [3-1: Configuration of Information Processing System Sa]

[0030] The configuration of the information processing system Sa in this embodiment will be described with reference to Fig. 5. Fig. 5 is a block diagram showing the configuration of the information processing system Sa in this embodiment.

[0031] As shown in FIG. 5 , the information processing system Sa includes a wearable device 2a and a monitoring device 1a. The wearable device 2a is a type of wearable device worn by a target user. The wearable device 2a is a device with a display function that is worn on the user's head. The information processing system Sa is configured to be able to provide the user with a world created in a virtual space on the Internet via the wearable device 2a. The information processing system Sa is configured to be able to provide the user with an exam experience, particularly at an exam venue (referred to as a "virtual exam venue") created in a virtual space on the Internet, via the wearable device 2a. In other words, the user can take the exam at the virtual exam venue via the wearable device 2a. The information processing system Sa may be applied to conducting interviews, oral exams, etc. The information processing system Sa may also be applied to conducting written exams, etc.

[0032] The monitoring device 1a is a form of information processing device. The monitoring device 1a may, for example, support a monitoring task of monitoring test takers. The monitoring device 1a may support a monitoring task of monitoring whether test takers are engaging in fraudulent behavior.

[0033] The monitoring device 1a may be, for example, a server device. The server device may be a cloud server. The monitoring device 1a may also be, for example, a personal computer. In other words, the monitoring device 1a and the wearable device 2a constitute a single information processing system. The monitoring device 1a and the wearable device 2a are configured to be able to communicate with each other.

[0034] In this embodiment, fraudulent behavior may include bringing in information that may be asked in the test and referring to that information to answer questions. A medium containing such information is called a cheat sheet. Fraudulent behavior may also include referring to someone else's answer sheet to answer questions during the test. Fraudulent behavior may also include a third party other than the test taker taking the test on their behalf. Fraudulent behavior may also include a test taker receiving information from a third party during the test to answer questions. Fraudulent behavior in this embodiment may also be called cheating.

[0035] In this embodiment, an immersive head-mounted display (so-called immersive virtual reality (VR) goggles) is given as an example of the wearable device 2a. Note that the wearable device 2a is not limited to an immersive head-mounted display, and may be, for example, a video see-through head-mounted display or an optical see-through head-mounted display (so-called augmented reality (AR) glasses).

[0036] If the wearable device 2a is a goggle type, a user wearing the wearable device 2a may commit fraud by, for example, placing a cheat sheet inside the wearable device 2a. Also, a user may commit fraud by placing a small display for fraud inside the wearable device 2a. [3-2: Configuration of the Wearable Device 2a]

[0037] The configuration of the wearable device 2a in this embodiment will be described with reference to Fig. 6 to Fig. 8. Fig. 6 and Fig. 8 are block diagrams showing the configuration of the wearable device 2a in this embodiment. Fig. 7 is a schematic diagram showing the configuration of the wearable device 2a in this embodiment.

[0038] 6 , the wearable device 2a includes a computing unit 210, a storage device 220, a communication unit 230, an input device 240, an output device 250, and cameras 271 and 272. The computing unit 210, the storage device 220, the communication unit 230, the input device 240, the output device 250, and the cameras 271 and 272 may be connected via a data bus 260.

[0039] The arithmetic device 210 may include a processor 210a. The arithmetic device 210 may include other processors in addition to the processor 210a. That is, the arithmetic device 210 may include one or more processors. The processor 210a may be a multi-core processor. When the arithmetic device 210 includes a single processor 210a that is a multi-core processor, it can be said that the arithmetic device 210 logically includes multiple processors.

[0040] The processor 210a may be, for example, at least one of a central processing unit (CPU), a graphics processing unit (GPU), a field programmable gate array (FPGA), a tensor processing unit (TPU), and a quantum processor.

[0041] The storage device 220 may include a memory 220a. The storage device 220 may include other memories in addition to the memory 220a. That is, the storage device 220 may include one or more memories. The memory 220a may be, for example, at least one of a RAM (Random Access Memory), a ROM (Read Only Memory), a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and an optical disk array. Therefore, the storage device 220 may include the memory 220a as a non-transitory recording medium.

[0042] The storage device 220 can store desired data. A computer program 221 to be executed by the arithmetic device 210 may be stored in the memory 220a of the storage device 220. The storage device 220 may temporarily store data that is temporarily used by the arithmetic device 210 when the arithmetic device 210 is executing the computer program 221.

[0043] The computer program 221 may be recorded on a computer-readable, non-transitory recording medium. In this case, the computer program 221 may be stored in the memory 220a by reading the recording medium using a recording medium reading device (not shown) included in the wearable device 2a. The recording medium may be at least one of an optical disk, a magnetic medium, a magneto-optical disk, a semiconductor memory, and any other medium capable of storing a program. The computer program 221 may be acquired (in other words, downloaded) from a device (not shown) external to the wearable device 2a via the communication device 230. The acquired computer program 221 may be stored in the memory 220a.

[0044] The communication device 230 may be capable of communicating with devices external to the wearable device 2a. The communication device 230 may perform wired communication or wireless communication. Typically, the wearable device 2a may be configured to be able to communicate with the monitoring device 1a via the communication device 230.

[0045] The input device 240 is a device capable of accepting information input to the wearable device 2a from outside. The input device 240 may include an operation device (e.g., a keyboard, a mouse, a touch panel, etc.) that can be operated by a user of the wearable device 2a. The input device 240 may include a recording medium reading device that can read information recorded on a recording medium that is detachable from the wearable device 2a, such as a USB (Universal Serial Bus) memory. Note that when information is input to the wearable device 2a via the communication device 230 (in other words, when the wearable device 2a acquires information via the communication device 230), the communication device 230 may function as an input device.

[0046] The output device 250 is a device capable of outputting information to the outside of the wearable device 2a. The output device 250 may output visual information such as text or images, auditory information such as sound, or tactile information such as vibration. The output device 250 may include, for example, at least one of a display, a speaker, a printer, and a vibration motor. The display may be, for example, at least one of a liquid crystal display and an organic electroluminescence (EL) display. The output device 250 may be capable of outputting information to a recording medium detachable from the wearable device 2a, such as a USB memory. When the wearable device 2a outputs information via the communication device 230, the communication device 230 may function as the output device.

[0047] The processor 210a of the arithmetic device 210 may execute the processing to be performed by the wearable device 2a together with the memory 220a of the storage device 220 in which the computer program 221 is stored (in other words, together with the memory 220a and the computer program 221 stored in the memory 220a). For example, the processor 210a may execute the computer program 221 to realize logical functional blocks in the arithmetic device 210 (e.g., in the processor 210a) for executing the processing to be performed by the wearable device 2a.

[0048] 7, the wearable device 2a includes a display 251 as an output device 250, a lens 252L for the left eye, a lens 252R for the right eye, and a plurality of light sources 253#1, 253#2, 253#3, and 253#4 that emit near-infrared light. Light sources 253#1 and 253#2 may be arranged around lens 252L. Light sources 253#3 and 253#4 may be arranged around lens 252R. Lenses 252L and 252R may be referred to as VR lenses.

[0049] The wearable device 2a may have a display for the left eye and a display for the right eye instead of the display 251. The number of light sources that emit near-infrared light is not limited to four, and may be five or more, or three or less.

[0050] Camera 271 may be arranged on wearable device 2a so as to be able to capture an image of the user's left eye. Camera 272 may be arranged on wearable device 2a so as to be able to capture an image of the user's right eye. Cameras 271 and 272 may be cameras capable of capturing near-infrared light. In other words, cameras 271 and 272 may be cameras equipped with image sensors sensitive to the near-infrared wavelength range.

[0051] As shown in FIG. 8 , the arithmetic device 210 may include an acquisition unit 211a, a transmission unit 215, a reception unit 216, and a control unit 214a as logically realized functional blocks or as physically realized processing circuits. At least a portion of the transmission unit 215, the reception unit 216, and the control unit 214a may be realized in a form in which logical functional blocks and physical processing circuits (i.e., hardware) are mixed. The "acquisition unit 211a" and the "control unit 214a" are components corresponding to the "acquisition unit 211" and the "control unit 214" in the second embodiment described above. The acquisition unit 211a may include an eye image acquisition unit 2111 and an eye tracking information acquisition unit 2112. The control unit 214a may include an information notification unit 2141 and an information provision unit 2142. The processes performed by the acquisition unit 211a, the transmission unit 215, the reception unit 216, and the control unit 214a will be described with reference to FIG.

[0052] Note that when the acquisition unit 211a, the transmission unit 215, the reception unit 216, and the control unit 214a are realized as functional blocks, the acquisition unit 211a, the transmission unit 215, the reception unit 216, and the control unit 214a may be realized by a single processor (e.g., processor 210a). Alternatively, the acquisition unit 211a, the transmission unit 215, the reception unit 216, and the control unit 214a may each be realized by a different processor. Alternatively, parts of the acquisition unit 211a, the transmission unit 215, the reception unit 216, and the control unit 214a may be realized by a single processor, and the remaining parts of the acquisition unit 211a, the transmission unit 215, the reception unit 216, and the control unit 214a may be realized by one or more processors different from the single processor.

[0053] The wearable device 2a may be a standalone wearable device. Alternatively, the wearable device 2a may be a PC-connected wearable device connected to a personal computer. In this case, the arithmetic unit 210, the storage unit 220, the communication unit 230, the input unit 240, and the output unit 250 may be provided in the personal computer to which the wearable device 2a is connected. The wearable device 2a may also be a hybrid wearable device (i.e., a wearable device that can operate as both a standalone type and a PC-connected type). [3-3: Configuration of Monitoring Device 1a]

[0054] The configuration of the monitoring device 1a in this embodiment will be described with reference to Figures 9 and 10. Figures 9 and 10 are block diagrams showing the configuration of the monitoring device 1a in this embodiment.

[0055] 9, the monitoring device 1a includes a computing device 110, a storage device 120, a communication device 130, an input device 140, and an output device 150. The computing device 110, the storage device 120, the communication device 130, the input device 140, and the output device 150 may be connected via a data bus 160.

[0056] The computing device 110 may include a processor 110a. The computing device 110 may include other processors in addition to the processor 110a. That is, the computing device 110 may include one or more processors. The processor 110a may be a multi-core processor. When the computing device 110 includes a single processor 110a that is a multi-core processor, the computing device 110 can be said to logically include multiple processors.

[0057] The processor 110a may be, for example, at least one of a central processing unit (CPU), a graphics processing unit (GPU), a field programmable gate array (FPGA), a tensor processing unit (TPU), and a quantum processor.

[0058] The storage device 120 may include a memory 120a. The storage device 120 may include other memories in addition to the memory 120a. That is, the storage device 120 may include one or more memories. The memory 120a may be, for example, at least one of a RAM (Random Access Memory), a ROM (Read Only Memory), a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and an optical disk array. Therefore, the storage device 120 may include the memory 120a as a non-transitory recording medium.

[0059] The storage device 120 can store desired data. A computer program 121 to be executed by the arithmetic device 110 may be stored in the memory 120a of the storage device 120. The storage device 120 may temporarily store data that is temporarily used by the arithmetic device 110 when the arithmetic device 110 is executing the computer program 121.

[0060] The computer program 121 may be recorded on a computer-readable, non-transitory recording medium. In this case, the computer program 121 may be stored in the memory 120a by reading the recording medium using a recording medium reading device (not shown) included in the monitoring device 1a. The recording medium may be at least one of an optical disk, a magnetic medium, a magneto-optical disk, a semiconductor memory, and any other medium capable of storing a program. The computer program 121 may be acquired (in other words, downloaded) from a device (not shown) external to the monitoring device 1a via the communication device 130. The acquired computer program 121 may be stored in the memory 120a.

[0061] The communication device 130 may be capable of communicating with devices external to the monitoring device 1a. The communication device 130 may perform wired communication or wireless communication. Typically, the monitoring device 1a may be configured to be able to communicate with the wearable device 2a via the communication device 130.

[0062] The input device 140 is a device capable of receiving information input to the monitoring device 1a from an external device. The input device 140 may include a recording medium reading device capable of reading information recorded on a recording medium detachable from the monitoring device 1a, such as a USB (Universal Serial Bus) memory. When information is input to the monitoring device 1a via the communication device 130 (in other words, when the monitoring device 1a acquires information via the communication device 130), the communication device 130 may function as an input device. The input device 140 may also include an operating device (e.g., a keyboard, a mouse, a touch panel, etc.) that can be operated by a user of the monitoring device 1a.

[0063] The output device 150 is a device capable of outputting information to the outside of the monitoring device 1a. The output device 150 may output visual information such as text or images, auditory information such as sound, or tactile information such as vibration, as the information. The output device 150 may include, for example, at least one of a display, a speaker, a printer, and a vibration motor. The display may be, for example, at least one of a liquid crystal display and an organic electroluminescence (EL) display. The output device 150 may be capable of outputting information to a recording medium, such as a USB memory, that is detachable from the monitoring device 1a. Note that when the monitoring device 1a outputs information via the communication device 130, the communication device 130 may function as an output device.

[0064] The processor 110a of the arithmetic device 110 may execute the processing to be performed by the monitoring device 1a together with the memory 120a of the storage device 120 in which the computer program 121 is stored (in other words, together with the memory 120a and the computer program 121 stored in the memory 120a). For example, by the processor 110a executing the computer program 121, a logical functional block for executing the processing to be performed by the monitoring device 1a may be realized within the arithmetic device 110 (for example, within the processor 110a).

[0065] 10 , the arithmetic device 110 may have an acquisition unit 111a, a detection unit 112a, an output unit 113a, an authentication unit 1020, and an examinee determination unit 1021 as logically realized functional blocks or as physically realized processing circuits. At least a portion of the acquisition unit 111a, the detection unit 112a, the output unit 113a, the authentication unit 1020, and the examinee determination unit 1021 may be realized in a form that combines logical functional blocks and physical processing circuits (i.e., hardware). The "acquisition unit 111a," "detection unit 112a," and "output unit 113a" are components that correspond to the "acquisition unit 111," "detection unit 112," and "output unit 113," respectively, in the first embodiment described above. The processes performed by the acquisition unit 111a, detection unit 112a, output unit 113a, authentication unit 1020, and examinee determination unit 1021 will be described with reference to FIG.

[0066] When the acquisition unit 111a, detection unit 112a, output unit 113a, authentication unit 1020, and examinee determination unit 1021 are realized as functional blocks, the acquisition unit 111a, detection unit 112a, output unit 113a, authentication unit 1020, and examinee determination unit 1021 may be realized by a single processor (e.g., processor 110a). Alternatively, the acquisition unit 111a, detection unit 112a, output unit 113a, authentication unit 1020, and examinee determination unit 1021 may each be realized by a different processor. Alternatively, the acquiring unit 111a, the detecting unit 112a, the output unit 113a, the authentication unit 1020, and part of the examinee determining unit 1021 may be realized by a single processor, and the remaining parts of the acquiring unit 111a, the detecting unit 112a, the output unit 113a, the authentication unit 1020, and the examinee determining unit 1021 may be realized by one or more processors different from the single processor. [3-4: Information Processing Method Executed by the Information Processing System Sa]

[0067] An information processing method executed by the information processing system Sa will be described with reference to Fig. 11. Fig. 11 is a flowchart showing an example of the flow of the information processing method executed by the information processing system Sa.

[0068] 11 , the acquisition unit 211a acquires eye information indicating the user's eyes (step S31). The eye information may include eye images including the user's eyes and gaze tracking information obtained by tracking the user's gaze. The eye image acquisition unit 2111 acquires the eye images including the user's eyes captured by the cameras 271 and 272.

[0069] The gaze tracking information acquisition unit 2112 tracks the user's gaze using the eye image and acquires gaze tracking information. The gaze tracking information acquisition unit 2112 performs gaze tracking to track the user's gaze toward the head-mounted display 251 using the eye image. The user's eyes are illuminated by a point light source emitting near-infrared light. The gaze tracking information acquisition unit 2112 may estimate and track the gaze based on the relative positional relationship between the position of near-infrared light reflected by the cornea (i.e., Purkinje image) included in the eye image and the position of the pupil included in the eye image. Alternatively, the gaze tracking information acquisition unit 2112 may estimate and track the gaze based on the relative positional relationship between the position of the inner corner or outer corner of the eye included in the eye image and the position of the iris included in the eye image. Alternatively, the gaze tracking information acquisition unit 2112 may estimate and track the gaze using a machine learning model that outputs the gaze direction when an eye image is input. Note that the gaze tracking method is not limited to the above-described method, and various other methods may be applied.

[0070] The transmitting unit 215 transmits the eye information to the monitoring device 1a (step S32). The acquiring unit 111a acquires the user's eye information from the wearable device 2a worn by the user (step S33). The authenticating unit 1020 performs iris authentication of the user using the eye image (step S34). The examinee determining unit 1021 determines whether the user is an examinee taking the test based on the results of the iris authentication (step S35). The examinee determining unit 1021 confirms the examinee's identity through iris authentication, ensuring that a third party other than the examinee cannot impersonate the examinee and take the test in their place.

[0071] If the user is not a test taker (step S35: No), for example, the wearable device 2a may transmit information indicating that the user is not a test taker to the monitoring device 1a. Furthermore, if the iris authentication fails, the wearable device 2a may request the monitoring device 1a to transmit an eye image again.

[0072] If the user is a test taker (step S35: Yes), the detection unit 112a uses the eye information to detect the test taker's fraudulent behavior. Hereinafter, a subject who is a test taker may be referred to as an "examinee." Although not shown in the flowchart illustrated in FIG. 11, the operations from step S31 to step S33 may be performed before the operation of detecting fraudulent behavior. The detection unit 112a may detect the test taker's fraudulent behavior based on the eye tracking information.

[0073] For example, if an examinee looks at a location other than the location where the test questions are displayed (i.e., the head-mounted display 251), the examinee is suspected of cheating. Therefore, the detection unit 112a may check whether the examinee is continuing to look at the head-mounted display 251 based on the eye-tracking information, and may detect cheating if the examinee looks at a location other than the head-mounted display 251 for more than a predetermined time.

[0074] The detection unit 112a may also detect the examinee's fraudulent behavior based on the speed of eye movement, which may be estimated based on estimated eye movement fluctuations over a predetermined period of time.

[0075] If the test taker's fraudulent behavior is detected (step S36: Yes), the output unit 113a outputs an alert regarding the suspected fraudulent behavior to the wearable device 2a (step S37).

[0076] The receiving unit 216 receives an alert regarding suspected fraudulent behavior by the examinee from the monitoring device 1a (step S38). The information notifying unit 2141 presents the alert to the examinee (step S39).

[0077] The information notification unit 2141 may present the examinee with information indicating the degree of suspicion of misconduct. The information notification unit 2141 may present the examinee with analog information indicating the degree of suspicion of misconduct. For example, if it is detected that the examinee is looking at something other than the head-mounted display 251, the information notification unit 2141 may enlarge the scale information displayed on the head-mounted display 251. This may notify the examinee that misconduct is suspected. For example, a mechanism may be used that issues an alert when the scale information exceeds a predetermined value. The user can change their behavior before being alerted.

[0078] If the wearable device 2a worn by the user is a video see-through device, the head-mounted display 251 may display a test image so that the user does not see an image of the real space. If the wearable device 2a worn by the user is an optical see-through device, the translucency of the display may be controlled so that the real space is not visible to the user.

[0079] Furthermore, examinees may be allowed to take the exam under the rule that they must not remove the wearable device 2a during the exam. In this case, the detection unit 112a may detect fraudulent behavior based on whether the wearable device 2a is attached. That is, the detection unit 112a may suspect fraudulent behavior if the examinee removes the wearable device 2a during the exam. [3-5: Technical Effects]

[0080] The information processing system Sa according to this disclosure can verify the identity of the examinee through iris authentication, ensuring that impersonation is not possible during the test. The information processing system Sa also presents an alert to the examinee, allowing the examinee to know that cheating is suspected and to correct their behavior. [4: Fourth Embodiment]

[0081] A fourth embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described with reference to Fig. 12 and Fig. 13. In the following, the fourth embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described using an information processing system Sb.

[0082] [4-1: Configuration of information processing system Sb]

[0083] The configuration of the information processing system Sb in this embodiment will be described with reference to FIG. 12. FIG. 12 is a block diagram showing the configuration of the information processing system Sb in this embodiment. As shown in FIG. 12, the information processing system Sb includes a monitoring device 1a and a wearable device 2b. As shown in FIG. 12, an acquisition unit 211b, a detection unit 212b, and a control unit 214b are realized in a computing unit 210 provided in the wearable device 2b. The control unit 214b may include an information provision unit 2142. [4-2: Information Processing Method Executed by Wearable Device 2b]

[0084] An information processing method executed by wearable device 2b will be described with reference to Fig. 13. Fig. 13 is a flowchart showing an example of the flow of the information processing method executed by wearable device 2b. The information processing operation illustrated in Fig. 13 may be an operation performed after it has been determined that the user is an examinee (after step S35 shown in Fig. 11 is Yes).

[0085] 13, the acquiring unit 211b acquires eye information indicating the eyes of the examinee wearing the wearable device 2b (step S41). The detecting unit 212b uses the eye information to detect fraudulent behavior by the examinee.

[0086] If the examinee's fraudulent behavior is detected (Step S42: Yes), the information providing unit 2142 controls the cameras 271 and 272 to capture multiple eye images (Step S43), and outputs the multiple eye images to the monitoring device 1a (Step S44).

[0087] The monitoring device 1a may make further determinations regarding fraudulent behavior based on the multiple eye images provided from the wearable device 2b. The monitoring device 1a may provide the eye images output from the wearable device 2b to the monitor using the monitoring device 1a. The monitor may confirm fraudulent behavior based on the multiple eye images. Furthermore, the monitor may confirm which fraudulent behavior (such as answering questions by referring to a cheat sheet or answering questions by referring to another person's answer sheet) is being performed based on the multiple eye images.

[0088] Alternatively, the wearable device 2b may capture and provide eye images based on fraudulent behavior detected by the monitoring device 1a. That is, the wearable device 2b may capture and provide eye images based on detection by the detection unit 112a included in the monitoring device 1a. [4-3: Technical Effects]

[0089] In the information processing system Sb according to this disclosure, the wearable device 2b provides multiple eye images to the monitoring device 1a, so that fraudulent behavior can be confirmed based on the multiple eye images. Furthermore, the information processing system Sb can confirm which fraudulent behavior (such as answering questions by referring to a cheat sheet or by referring to someone else's answer sheet) is being performed based on the multiple eye images. [5: Fifth Embodiment]

[0090] A fifth embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described with reference to FIGS. 14 and 15. In the following, the fifth embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described using an information processing system Sc. [5-1: Configuration of Information Processing System Sc]

[0091] The configuration of the information processing system Sc in this embodiment will be described with reference to FIG. 14. FIG. 14 is a block diagram showing the configuration of the information processing system Sc in this embodiment. As shown in FIG. 14, the information processing system Sc includes a monitoring device 1a and a wearable device 2c. As shown in FIG. 14, the wearable device 2c includes an arithmetic unit 210, a storage device 220, a communication device 230, an input device 240, an output device 250, and cameras 271 and 272, as well as an outer camera 573. The outer camera 573 captures an image of the surroundings of the wearable device 2c and acquires an ambient image. The arithmetic unit 210 included in the wearable device 2c includes an acquisition unit 211c, a detection unit 212c, and a control unit 214c. The control unit 214c may include an information provision unit 2142. [5-2: Information Processing Method Executed by Wearable Device 2c]

[0092] An information processing method executed by the wearable device 2c will be described with reference to Fig. 15. Fig. 15 is a flowchart showing an example of the flow of the information processing method executed by the wearable device 2c.

[0093] 15, the acquiring unit 211c acquires eye information indicating the eyes of the examinee wearing the wearable device 2c (step S51). The detecting unit 212c uses the eye information to detect fraudulent behavior by the examinee.

[0094] If the examinee's fraudulent behavior is detected (Step S52: Yes), the information providing unit 2142 controls the outer camera 573 to acquire multiple surrounding images (Step S53), and outputs the multiple surrounding images to the monitoring device 1a (Step S54).

[0095] The monitoring device 1a may make a determination regarding fraudulent behavior based on a plurality of surrounding images provided by the wearable device 2c. The monitoring device 1a may also provide the surrounding images output from the wearable device 2c to the monitor using the monitoring device 1a.

[0096] Alternatively, the wearable device 2c may capture and provide an image of the surroundings based on fraudulent behavior detected by the monitoring device 1a. In other words, the wearable device 2c may capture and provide an image of the surroundings based on detection by the detection unit 112a included in the monitoring device 1a.

[0097] In this embodiment, the information providing unit 2142 may also control the cameras 271 and 272 to acquire multiple eye images. In this case, the information providing unit 2142 may provide multiple surrounding images and multiple eye images to the monitoring device 1a. [5-3: Technical Effects]

[0098] In the information processing system Sc disclosed herein, the wearable device 2c provides the monitoring device 1a with surrounding images, such as video and images from an external camera, allowing the monitoring device 1a to check for fraudulent behavior based on the multiple surrounding images. Based on the multiple surrounding images provided, the monitor can check whether there are any items around the test taker that could be used for fraudulent behavior, such as cheat sheets. [6: Sixth Embodiment]

[0099] A sixth embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described with reference to FIG. 16. In the following, the sixth embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described using an information processing system Sd. [6-1: Configuration of the information processing system Sd]

[0100] The configuration of the information processing system Sd in this embodiment will be described with reference to Fig. 16. Fig. 16 is a block diagram showing the configuration of the information processing system Sd in this embodiment. As shown in Fig. 16, the information processing system Sd includes a monitoring device 1a and a wearable device 2d. As shown in Fig. 16, a computing device 210 included in the wearable device 2d includes an acquiring unit 211d, a detecting unit 212d, and a control unit 214d, as well as a learning unit 217. [6-2: Information Processing Method Executed by Wearable Device 2d]

[0101] As described in other embodiments, for example, if a test taker looks at a location other than where the test questions are displayed (i.e., the head-mounted display 251), the test taker is suspected of cheating. However, the test taker may have a habit of looking up when thinking. That is, the test taker may tend to look up when solving test questions and look at a location other than where the test questions are displayed. In the case of such a test taker, even if the test taker looks up when solving test questions, there is no need to suspect cheating. On the other hand, if a test taker who does not have a habit of looking up when thinking looks up when solving test questions, there is a need to suspect cheating. Therefore, the learning unit 217 learns the user's eye movement tendency based on eye information. The learning unit 217 may learn the user's eye movement tendency based on gaze tracking information.

[0102] The learning unit 217 may cause the detection unit 212d to learn the tendency of the user's eye movement. In this case, the detection unit 212d may detect the examinee's fraudulent behavior based on a comparison between the examinee's eye movement indicated by the eye information and the learned tendency of the user's eye movement.

[0103] The learning unit 217 may store the eye movement tendencies of the subject in the storage device 220. In this case, the detection unit 212d may detect the examinee's fraudulent behavior based on a comparison between the examinee's eye movements indicated by the eye information and the stored user's eye movement tendencies. The detection unit 212d may calculate a correlation between the user's usual eye movements and their eye movements during a test.

[0104] Furthermore, the monitoring device 1a may detect the examinee's fraudulent behavior. In this case, when the monitoring device 1a determines that the user is an examinee, the monitoring device 1a may request information indicating the examinee's eye movement tendency from the wearable device 2d. [6-3: Technical Effects]

[0105] The information processing system Sd according to this disclosure detects the examinee's fraudulent behavior based on a comparison between the examinee's eye movements indicated by the eye information and the eye movement trends of trained users, thereby preventing erroneous detection of fraudulent behavior. [7: Seventh Embodiment]

[0106] A seventh embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described with reference to FIG. 17. In the following, the seventh embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described using an information processing system Se. [7-1: Configuration of Information Processing System Se]

[0107] The configuration of the information processing system Se in this embodiment will be described with reference to Fig. 17. Fig. 17 is a block diagram showing the configuration of the information processing system Se in this embodiment. As shown in Fig. 17, the information processing system Sd includes a monitoring device 1a and a wearable device 2e. As shown in Fig. 17, an acquisition unit 211e, a detection unit 212e, and a control unit 214e are implemented in a computing device 210 provided in the wearable device 2e. [7-2: Information Processing Method Executed by Wearable Device 2e]

[0108] The detector 212e acquires audio information indicating audio around the wearable device 2e. The detector 212e may acquire the audio information indicating audio around the wearable device 2e from a microphone serving as the input device 240.

[0109] The detection unit 212e detects the examinee's fraudulent behavior based on the audio information. The detection unit 212e may detect the examinee's fraudulent behavior if it detects a predetermined sound from the audio information for a predetermined period of time or more. The predetermined sound may be, for example, the sound of turning pages in a book, the sound of typing on a keyboard, or another person's voice. For example, the sound of turning pages in a book or the sound of typing on a keyboard may be the sound of searching for an item corresponding to the answer to a question written in a book. Furthermore, another person's voice may be a voice giving instructions on the answer to a question. [7-3: Technical Effects]

[0110] The information processing system Se according to this disclosure can check for improper behavior by an examinee based on audio information indicating sounds around the wearable device 2e. [8: Eighth Embodiment]

[0111] An eighth embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described with reference to FIG. 18. In the following, the eighth embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described using an information processing system Sf. [8-1: Configuration of Information Processing System Sf]

[0112] The configuration of the information processing system Sf in this embodiment will be described with reference to FIG. 18 . FIG. 18 is a block diagram showing the configuration of the information processing system Sf in this embodiment. As shown in FIG. 18 , the information processing system Sf includes a monitoring device 1a and a wearable device 2f. As shown in FIG. 18 , the wearable device 2f includes an arithmetic unit 210, a storage device 220, a communication device 230, an input device 240, an output device 250, and cameras 271 and 272, as well as an outer camera 573 and an orientation detector 880. The orientation detector 880 detects the orientation of the wearable device 2f. The orientation detector 880 may be, for example, an acceleration sensor. As shown in FIG. 18 , an acquisition unit 211f, a detection unit 212f, and a control unit 214f ​​are implemented within the arithmetic unit 210 included in the wearable device 2f. [8-2: Information Processing Method Executed by Wearable Device 2f]

[0113] The detection unit 212f acquires posture information indicating the posture of the wearable device 2f from the posture detector 880. The detection unit 212f controls the outer camera 573 to capture an image of the surroundings of the wearable device 2f and acquire a surrounding image. The detection unit 212f detects fraudulent behavior of the examinee using at least one of the eye information, the surrounding image, and the posture information.

[0114] The detection unit 212f may detect the examinee's cheating behavior based on the correlation between the examinee's eye movement and a change in the posture of the wearable device 2f. A change in the posture of the wearable device 2f is often caused by the examinee's facial movement. For example, the detection unit 212f may suspect that the examinee is cheating if the posture of the wearable device 2f changes significantly. Furthermore, the detection unit 212f may suspect that the examinee is cheating if the posture of the wearable device 2f changes significantly and the examinee's eye movement is also significant. The detection unit 212f may detect cheating behavior by calculating information indicating the correlation between the examinee's eye movement and a change in the posture of the wearable device 2f.

[0115] The detection unit 212f may detect the examinee's fraudulent behavior based on an object (determined from the surrounding image) present in the examinee's line of sight (determined from the eye image). For example, the detection unit 212f may suspect that the examinee is engaging in fraudulent behavior if an object such as paper or a book containing information related to the answer to a question is present in the examinee's line of sight. The detection unit 212f may detect fraudulent behavior by synergizing information indicating the examinee's eye movements with at least one of the surrounding image and information indicating changes in the posture of the wearable device 2f. [8-3: Technical Effects]

[0116] The information processing system Sf according to this disclosure can detect fraudulent behavior by synergistically utilizing information indicating the examinee's eye movements with at least one of an ambient image and information indicating a change in the posture of the wearable device 2f. [9: Ninth Embodiment]

[0117] A ninth embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described with reference to Figs. 19 and 20. In the following, an 89th embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described using the information processing system Sg. [9-1: Configuration of the information processing system Sg]

[0118] The configuration of the information processing system Sg in this embodiment will be described with reference to Fig. 19. Fig. 19 is a block diagram showing the configuration of the information processing system Sg in this embodiment. As shown in Fig. 19, the information processing system Sg includes a monitoring device 1g and a wearable device 2a. As shown in Fig. 19, the arithmetic unit 110 included in the monitoring device 1g implements an acquisition unit 111g, a detection unit 112g, an authentication unit 1020, an examinee determination unit 1021, a type determination unit 1022, and an image capture instruction unit 1023. [9-2: Information Processing Method Executed by the Information Processing System Sg]

[0119] An information processing method executed by the information processing system Sg will be described with reference to Fig. 20. Fig. 20 is a flowchart showing an example of the flow of the information processing method executed by the information processing system Sg.

[0120] 20, the acquisition unit 211a acquires eye information indicating the user's eyes (step S31). The eye information may include an eye image including the user's eyes and gaze tracking information obtained by tracking the user's gaze. The transmission unit 215 transmits the eye information to the monitoring device 1a (step S32). The transmission unit 215 transmits type information indicating the type of the wearable device 2a. The transmission unit 215 may transmit the model number of the wearable device 2a as the type information indicating the type of the wearable device 2a. The transmission unit 215 may transmit the serial number of the wearable device 2a.

[0121] The acquisition unit 111g acquires the user's eye information from the wearable device 2a worn by the user (step S33). The type determination unit 1022 acquires type information indicating the type of the wearable device 2a. Note that the type information may be sent and received at any time before the start of the test.

[0122] The authentication unit 1020 performs iris authentication of the user using the eye image (step S34). The examinee determination unit 1021 determines whether the user is an examinee for the test based on the result of iris authentication (step S35).

[0123] If the user is an examinee taking the test (Step S35: Yes), the type determination unit 1022 determines the type of the wearable device 2a (Step S91). The detection unit 112g changes the method for detecting the examinee's fraudulent behavior depending on the type of wearable device 2a. The detection unit 112g may change the method for detecting the examinee's fraudulent behavior depending on the display area of ​​the wearable device 2a and whether it is a type that fits tightly to the head.

[0124] If the type of wearable device 2a is a video see-through type (step S92: Yes), the image capture instruction unit 1023 issues an instruction to the wearable device 2a to the outer camera 573 to capture an image of the surroundings and an instruction to output an image of the surroundings of the wearable device 2a to the monitoring device 1g (step S93). The information providing unit 2142 controls the outer camera 573 to acquire the surrounding image (step S94). The transmitting unit 215 transmits the surrounding image to the monitoring device 1g (step S95). The acquiring unit 111g acquires the surrounding image from the wearable device 2a (step S96).

[0125] If the wearable device 2a is a video see-through type (step S92: Yes), the detection unit 112g detects the examinee's fraudulent behavior using the surrounding image in addition to the eye information. The detection unit 112g may use the image from the outer camera to check whether the examinee is looking at a cheat sheet or the like.

[0126] The detection unit 112a may also detect the examinee's fraudulent behavior based on the speed of eye movement, which may be estimated based on estimated eye movement fluctuations over a predetermined period of time.

[0127] If the test taker's fraudulent behavior is detected (step S36: Yes), the output unit 113a outputs an alert regarding the suspected fraudulent behavior to the wearable device 2a (step S37).

[0128] The receiving unit 216 receives an alert regarding suspected fraudulent behavior by the examinee from the monitoring device 1a (step S38). The information notifying unit 2141 presents the alert to the examinee (step S39). [Modification]

[0129] If the wearable device 2a is a video see-through type, the mode of the wearable device 2a may be switchable between a mode corresponding to the video see-through type and a mode corresponding to the fully immersive type. For example, the monitoring device 1g may forcibly switch the mode of the wearable device 2a to a mode corresponding to the fully immersive type during a test. [9-3: Technical Effects]

[0130] If the wearable device 2a is opaque, no one other than the examinee can see the questions. Furthermore, it is relatively difficult for an examinee wearing an opaque wearable device 2a to commit dishonest acts such as looking at a cheat sheet.

[0131] In contrast, for example, if the wearable device 2a is a see-through type, such as AR glasses, it is relatively easy to see the cheat sheet, etc. For example, if the examinee takes the exam at his or her own home or other location and the observer cannot directly monitor the examinee, it is often relatively easy to commit fraudulent acts.

[0132] The information processing system Sg according to this disclosure can prevent cheating behavior even when the examinee uses a see-through wearable device by capturing images of the examinee's surroundings with an external camera. The information processing system Sg can control whether cheating detection is necessary and the strictness of the detection depending on the type of wearable device 2a. [10: Tenth Embodiment]

[0133] A tenth embodiment relating to an information processing device, an information processing system, an information processing method, and a recording medium will be described with reference to Fig. 21. In the following, the tenth embodiment relating to an information processing device, an information processing system, an information processing method, and a recording medium will be described using an information processing system Sh.

[0134] In the test according to this embodiment, the pass / fail status of the test is determined using a score calculated based on the examinee's gaze movement relative to the questions. The score increases when the examinee looks at the appropriate part, in the appropriate order, and at the appropriate speed. [10-1: Configuration of Information Processing System Sh]

[0135] The configuration of the information processing system Sh in this embodiment will be described with reference to Fig. 21 . Fig. 21 is a block diagram showing the configuration of the information processing system Sh in this embodiment. As shown in Fig. 21 , the information processing system Sh includes a monitoring device 1h and a wearable device 2a. As shown in Fig. 21 , the arithmetic unit 110 included in the monitoring device 1h includes an acquisition unit 111h, a detection unit 112h, an authentication unit 1020, and an examinee determination unit 1021, as well as a pass / fail determination unit 1024. The pass / fail determination unit 1024 calculates a score based on the eye information and uses the score to determine whether the examinee has passed or failed.

[0136] This test format may be applied to practical tests. For example, it may be applied to obtaining a diving license. For example, it may be applied to tests related to driving a car. In a driving test, the score may be changed depending on the places that the testee looks at when turning right. The score may be calculated depending on whether the places that the testee looks at when turning right include the oncoming lane, the area around the crosswalk, the right mirror, and the rearview mirror, in what order the testee looks, and at what speed.

[0137] It may also be applied to telemedicine testing. In the case of a doctor's test, the score may be calculated based on the patient's symptoms and the movement of the eyes to observe the appropriate area. This test format may also be applied to aptitude tests. It may also be applied to training for nurses and medical staff. [10-2: Technical Effects]

[0138] The information processing system Sh according to the present disclosure can assist in carrying out tests in which eye movements are important. [11: Eleventh Embodiment]

[0139] An eleventh embodiment relating to an information processing device, an information processing system, an information processing method, and a recording medium will be described with reference to FIG. 22. Hereinafter, the eleventh embodiment relating to an information processing device, an information processing system, an information processing method, and a recording medium will be described using an information processing system Si. As with the tenth embodiment, in the test according to the eleventh embodiment, a pass / fail is determined using a score calculated based on the movement of the examinee's gaze relative to the questions. [11-1: Configuration of the Information Processing System Si]

[0140] The configuration of the information processing system Si in this embodiment will be described with reference to FIG. 22 . FIG. 22 is a block diagram showing the configuration of the information processing system Si in this embodiment. As shown in FIG. 22 , the information processing system Si includes a monitoring device 1i and a wearable device 2a. As shown in FIG. 22 , the arithmetic unit 110 included in the monitoring device 1i includes an acquisition unit 111i, a detection unit 112i, an authentication unit 1020, an examinee determination unit 1021, and a pass / fail determination unit 1024, as well as a level determination unit 1025 and a matching unit 1026. When an examinee plays a game, the level determination unit 1025 determines the examinee's level in the game based on the score. The matching unit 1026 selects a game opponent based on the examinee's level in the game.

[0141] The games may be games that use at least eye movement, such as medical simulation games and sports games. Eye movement and speed are often important in ball games such as tennis and soccer, and shooting games. Therefore, the user's game compatibility level is calculated using the user's gaze speed (i.e., the score calculated in the tenth embodiment). The level linked to the score may be acquired through identity authentication before playing the game, allowing the user to play against people at a similar level. This can be applied to all games in which eye movement is important. [11-2: Technical Effects]

[0142] The information processing system Si according to this disclosure can support the test taker in playing a game related to eye movement, for example, by allowing the test taker to play a game related to eye movement against an appropriate opponent.

[0143] [12: Supplementary Note] The above-described embodiments can be further described as in the following supplementary notes, but are not limited to them. [Supplementary Note 1] An information processing device comprising: acquisition means for acquiring eye information indicating the eyes of a subject from a wearable device worn by the subject; detection means for detecting fraudulent behavior of the subject using the eye information; and output means for outputting information regarding suspected fraudulent behavior to the wearable device based on the detection result by the detection means. [Supplementary Note 2] An information processing device worn by a subject, comprising: acquisition means for capturing an image of the subject's eyes and acquiring eye information indicating the subject's eyes; detection means for detecting fraudulent behavior of the subject using the eye information; and control means for performing control in accordance with the detection result by the detection means. [Supplementary Note 3] An information processing device comprising: an acquisition means for acquiring eye information indicating the eyes of a subject from a wearable device worn by the subject, a detection means for detecting fraudulent behavior of the subject using the eye information, and an output means for outputting an alert regarding suspected fraudulent behavior to the wearable device based on the detection result by the detection means; and an information processing system including the wearable device comprising: an output means for acquiring eye information indicating the eyes of the subject and outputting it to the information processing device, a receiving means for receiving the alert regarding the suspected fraudulent behavior of the subject from the information processing device, and a presentation means for presenting the alert to the subject. [Supplementary Note 4] The information processing system described in Supplementary Note 3 comprises: an information processing device comprising: an acquisition means for acquiring eye information indicating the eyes of the subject from the wearable device; a detection means for detecting fraudulent behavior of the subject using the eye information, and an output means for outputting a plurality of the eye images to the information processing device based on the alert. [Supplementary Note 5] The information processing system according to Supplementary Note 3, wherein the wearable device comprises: a surroundings imaging unit that images the surroundings of the wearable device and acquires a surrounding image; and an output unit that outputs a plurality of the surrounding images to the information processing device based on the alert. [Supplementary Note 6] The information processing device according to Supplementary Note 2, wherein the detection unit detects fraudulent behavior of the target based on a comparison between the eye movement of the target indicated by the eye information and a learned tendency of the eye movement of the target.[Supplementary Note 7] The information processing device according to Supplementary Note 2, further comprising: learning means for learning the tendency of eye movement of the target based on the eye information. [Supplementary Note 8] The information processing device according to Supplementary Note 2, further comprising: audio acquisition means for acquiring audio information indicating audio around the information processing device; and the detection means for detecting fraudulent behavior of the target based on the audio information. [Supplementary Note 9] The information processing device according to Supplementary Note 8, further comprising: surroundings imaging means for capturing an image of the surroundings of the information processing device and acquiring a surrounding image; and the detection means for detecting fraudulent behavior of the target using the eye information and the surrounding image. [Supplementary Note 11] The information processing device according to Supplementary Note 2, further comprising: posture detection means for detecting a posture of the information processing device; and the detection means for detecting fraudulent behavior of the target using the eye information and posture information indicating the posture of the information processing device detected by the posture detection means. [Supplementary Note 12] The information processing device of Supplementary Note 1, comprising: authentication means for performing iris authentication on the subject using the eye information; and examinee determination means for determining whether the subject is a test taker based on the result of the iris authentication. [Supplementary Note 13] The information processing device of Supplementary Note 12, comprising: type determination means for determining the type of the wearable device before the start of the test, wherein the detection means changes a method for detecting fraudulent behavior of the subject depending on the type. [Supplementary Note 14] The information processing device of Supplementary Note 13, comprising: if the type determination means determines that the wearable device is a video see-through device, instruction means for instructing surrounding image capture means for capturing an image of the surroundings around the wearable device and acquiring a surrounding image, and for instructing the surrounding image to be output outside the device. [Supplementary Note 15] The information processing device of Supplementary Note 12, wherein pass / fail is determined using a score calculated based on the movement of the subject's gaze relative to the questions, and the score becomes higher if the subject looks at the appropriate parts, in the appropriate order, and at the appropriate speed.[Supplementary Note 16] The information processing device according to Supplementary Note 15, comprising level determination means for determining the level of the examinee in the game based on the score when the examinee plays the game. [Supplementary Note 17] An information processing method executed by a computer, comprising: acquiring eye information indicating the eyes of a subject from a wearable device worn by the subject; detecting fraudulent behavior of the subject using the eye information; and outputting information related to suspected fraudulent behavior to the wearable device based on the detection results. [Supplementary Note 18] An information processing method executed by a computer, comprising: capturing an image of the eyes of a subject, acquiring eye information indicating the eyes of the subject, detecting fraudulent behavior of the subject using the eye information, and performing control according to the detection results. [Supplementary Note 19] A recording medium having recorded thereon a computer program for causing a computer to execute an information processing method, comprising: acquiring eye information indicating the eyes of the subject from a wearable device worn by the subject; detecting fraudulent behavior of the subject using the eye information; and outputting information related to suspected fraudulent behavior to the wearable device based on the detection results. [Supplementary Note 20] A recording medium having recorded thereon a computer program that causes a computer to execute an information processing method, which comprises capturing an image of a target's eyes, acquiring eye information indicating the target's eyes, detecting fraudulent behavior of the target using the eye information, and performing control in accordance with the detection result.

[0144] This disclosure may be modified as appropriate within the scope that does not contradict the gist or idea of ​​the invention that can be read from the claims and the entire specification, and information processing devices, information processing methods, and recording media that involve such modifications are also included in the technical idea of ​​this disclosure.

[0145] 1, 2 Information processing device Sa, Sb, Sc, Sd, Se, Sf, Sg, Sh, Si Information processing system 1a, 1g, 1h, 1i Monitoring device 2a, 2b, 2c, 2d, 2e, 2f Wearable device 251 Head mounted display 111, 111a, 111g, 111h, 111i Acquisition unit 112, 112a, 112g, 112h, 112i Detection unit 113, 113a, 113g, 113h, 113i Output unit 211, 211a, 211b, 211c, 211d, 211e, 211f Acquisition unit 212, 212b, 212c, 212d, 212e, 212f Detection unit 2111 Eye image acquisition unit 2112 Eye-tracking information acquisition unit 214, 214a, 214b, 214c, 214d, 214e, 214f ​​Control unit 2141 Information notification unit 2142 Information provision unit 215 Transmission unit 216 Reception unit 217 Learning unit 880 Posture detector 1020 Authentication unit 1021 Examinee determination unit 1022 Type determination unit 1023 Imaging instruction unit 1024 Pass / fail determination unit 1025 Level determination unit 1026 Matching unit 271, 272 Camera 573 Out camera

Claims

1. An information processing device comprising: an acquisition means for acquiring eye information indicating the eyes of a subject from a wearable device worn by the subject; a detection means for detecting fraudulent behavior of the subject using the eye information; and an output means for outputting information regarding suspected fraudulent behavior to the wearable device based on the detection results by the detection means.

2. An information processing device worn by a subject, comprising: an acquisition means for capturing an image of the subject's eyes and acquiring eye information indicating the subject's eyes; a detection means for detecting fraudulent behavior of the subject using the eye information; and a control means for performing control in accordance with the detection results by the detection means.

3. An information processing device comprising: an acquisition means for acquiring eye information indicating the eyes of a subject from a wearable device worn by the subject; a detection means for detecting fraudulent behavior of the subject using the eye information; and an output means for outputting an alert regarding suspected fraudulent behavior to the wearable device based on the detection results by the detection means; and an information processing system including the wearable device comprising: an output means for acquiring eye information indicating the eyes of the subject and outputting it to the information processing device; a receiving means for receiving an alert regarding suspected fraudulent behavior of the subject from the information processing device; and a presentation means for presenting the alert to the subject.

4. The information processing system according to claim 3, wherein the wearable device comprises: an eye image acquisition means for capturing an image of the subject's eyes and acquiring an eye image including the subject's eyes; and an output means for outputting a plurality of the eye images to the information processing device based on the alert.

5. The information processing system according to claim 3, wherein the wearable device comprises: a surroundings imaging means for capturing images of the surroundings of the wearable device and acquiring surrounding images; and an output means for outputting a plurality of surrounding images to the information processing device based on the alert.

6. The information processing device according to claim 2, wherein the detection means detects fraudulent behavior of the subject based on a comparison between the eye movements of the subject indicated by the eye information and the learned eye movement trends of the subject.

7. The information processing device according to claim 2, further comprising: learning means for learning the tendency of the target's eye movements based on the eye information.

8. The information processing device according to claim 2, further comprising: a sound acquisition means for acquiring sound information indicating sounds around the information processing device; and a detection means for detecting fraudulent behavior of the target based on the sound information.

9. The information processing device according to claim 8, wherein the detection means detects fraudulent behavior of the target when a predetermined sound is detected from the audio information for a predetermined period of time or longer.

10. An information processing device according to claim 2, further comprising a surrounding imaging means for capturing an image of the surroundings of the information processing device and acquiring a surrounding image, and wherein the detection means detects fraudulent behavior of the target using the eye information and the surrounding image.

11. An information processing device according to claim 2, further comprising a posture detection means for detecting the posture of the information processing device, wherein the detection means detects fraudulent behavior of the target using the eye information and posture information indicating the posture of the information processing device detected by the posture detection means.

12. An information processing device as described in claim 1, comprising: an authentication means for performing iris authentication of the subject using the eye information; and an examinee determination means for determining whether the subject is an examinee for a test based on the results of the iris authentication.

13. The information processing device according to claim 12, further comprising a type determination means for determining the type of the wearable device before the start of the test, wherein the detection means changes the method for detecting fraudulent behavior of the subject depending on the type.

14. An information processing device as described in claim 13, further comprising: an instruction means for instructing a surrounding imaging means that captures an image of the surroundings of the wearable device and acquires a surrounding image to capture the surroundings, and an instruction means for instructing the surrounding image to be output outside the device, when the type determination means determines that the wearable device is a video see-through type device.

15. The information processing device of claim 12, wherein the test determines whether the subject passes or fails using a score calculated based on the subject's eye movements relative to the questions, and the score is higher when the subject looks at the appropriate parts, in the appropriate order, and at the appropriate speed.

16. The information processing device according to claim 15, further comprising a level determination means for determining the level of the examinee in the game based on the score when the examinee plays the game.

17. An information processing method executed by a computer, comprising: acquiring eye information indicating the eyes of a subject from a wearable device worn by the subject; detecting fraudulent behavior of the subject using the eye information; and outputting information regarding suspected fraudulent behavior to the wearable device based on the detection results.

18. An information processing method executed by a computer, comprising: capturing an image of a target's eyes; acquiring eye information indicating the target's eyes; detecting fraudulent behavior of the target using the eye information; and performing control in accordance with the detection results.

19. A recording medium having recorded thereon a computer program that causes a computer to execute an information processing method that includes acquiring eye information indicating the eyes of a subject from a wearable device worn by the subject, detecting fraudulent behavior of the subject using the eye information, and outputting information regarding suspected fraudulent behavior to the wearable device based on the detection results.

20. A recording medium having recorded thereon a computer program that causes a computer to execute an information processing method that includes capturing an image of a target's eyes, acquiring eye information indicating the target's eyes, detecting fraudulent behavior of the target using the eye information, and performing control in accordance with the detection results.

Images