Information processing device, information processing method, and program

Abstract

To suppress effective application of an unintentional operation by a user.SOLUTION: The present invention is directed to an information processing apparatus which has a determination result acquiring unit for acquiring a determination result indicting whether or not a user is watching an operation region operated by a user hand, and a control unit for, based on acquisition of the determination result indicating that the user is watching the operation region, switching a stand-by mode in which an operation on the operation region is not treated as an effective one to an operation effective mode in which the operation on the operation region is treated as an effective one.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to an information processing device, an information processing method, and a program. [Background technology]

[0002] In recent years, the spread of infectious diseases has led to an increasing demand for contactless operation panels. When a contactless operation panel is installed on a terminal used by an unspecified number of people, each user can operate the terminal without touching the operation panel, thereby reducing the risk of infection via the operation panel. For example, as disclosed in Patent Document 1, a method of achieving contactless operation by using eye contact is also known. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2015-87824 Summary of the Invention [Problem to be solved by the invention]

[0004] However, with a non-contact type operation panel, there is a risk that the approach of a person's hand or body to the operation panel without the intention of operating it may be erroneously detected as an operation.

[0005] Therefore, the present invention has been made in consideration of the above problems, and an object of the present invention is to provide a new and improved information processing device, information processing method, and program that can prevent operations unintended by the user from being effectively handled. [Means for solving the problem]

[0006] In order to solve the above problem, according to one aspect of the present invention, there is provided a device including: a determination result acquisition unit that acquires a determination result indicating whether or not a user is looking at an operation area operated by the user's hand; and a control unit that, based on the acquired determination result indicating that the user is looking at the operation area, transitions an operation mode from a standby mode in which operations on the operation area are not handled effectively to an operation effective mode in which operations on the operation area are handled effectively; Equipped with An information processing device is provided in which a display surface is laminated on the operation area, and the control unit transitions the operation mode from the standby mode to the operation valid mode based on a determination result indicating that the user is looking at the operation area being obtained over a first period of time or more in the standby mode, makes the screen displayed by the display surface in the operation valid mode brighter than the screen displayed by the display surface in the standby mode, transitions the operation mode to a pause mode in which operations on the operation area are temporarily not treated as valid based on a determination result indicating that the user is not looking at the operation area being obtained over a second period of time in the operation valid mode, transitions the operation mode to the operation valid mode based on a determination result indicating that the user is looking at the operation area being obtained within a third period of time in the pause mode, and transitions the operation mode to the standby mode based on a determination result indicating that the user is looking at the operation area not being obtained within the third period of time in the pause mode.

[0011] In the pause mode, the control unit may cause a guidance display on the display surface to guide the user to view the operation area before the third time period elapses.

[0012] The control unit may further include a detection information acquisition unit that acquires detection information of an operation on the operation area, and the control unit may control an operation according to the detection information acquired in the operation-enabled mode.

[0013] In the standby mode, the control unit may disable a function of detecting an operation by the user's hand in the operation area.

[0014] The operation area may be one of a plurality of areas obtained by dividing an operation surface.

[0015] In order to solve the above problem, according to another aspect of the present invention, a method for controlling a touch panel includes: acquiring a determination result indicating whether a user is looking at an operation area operated by the user's hand; based on a determination result indicating that the user is looking at the operation area being acquired for a first time period or more, transitioning the operation mode from a standby mode in which operations on the operation area are not handled effectively to an operation valid mode in which operations on the operation area are handled effectively; making a screen displayed by a display surface superimposed on the operation area in the operation valid mode brighter than a screen displayed by the display surface in the standby mode; transitioning an operation mode to a pause mode in which operations on the operation area are temporarily not handled validly, based on a determination result indicating that the user is not looking at the operation area being acquired over a second period of time or more in the operation valid mode; transitioning the operation mode to the operation valid mode, based on a determination result indicating that the user is looking at the operation area being acquired within a third period of time in the pause mode, and transitioning the operation mode to the standby mode, based on a determination result indicating that the user is looking at the operation area not being acquired within the third period of time in the pause mode; A computer-implemented information processing method is provided, including:

[0016] In order to solve the above-mentioned problems, according to another aspect of the present invention, a computer is made to function as a determination result acquisition unit that acquires a determination result indicating whether or not a user is looking at an operation area operated by the user's hand, and a control unit that, based on the acquisition of a determination result indicating that the user is looking at the operation area, transitions the operation mode from a standby mode in which operations on the operation area are not handled effectively to an operation effective mode in which operations on the operation area are handled effectively, and the control unit: transitioning the operation mode from the standby mode to the operation valid mode based on a determination result indicating that the user is looking at the operation area being acquired over a first period of time or more in the standby mode, making a screen displayed by a display surface superimposed on the operation area brighter in the operation valid mode than a screen displayed by the display surface in the standby mode, transitioning the operation mode to a pause mode in which operations on the operation area are temporarily not treated as valid based on a determination result indicating that the user is not looking at the operation area being acquired over a second period of time or more in the operation valid mode, transitioning the operation mode to the operation valid mode based on a determination result indicating that the user is looking at the operation area being acquired over a third period of time in the pause mode, and transitioning the operation mode to the standby mode based on a determination result indicating that the user is looking at the operation area not being acquired over the third period of time in the pause mode. Programs are offered. [Effects of the Invention]

[0017] According to the present invention described above, it is possible to prevent an operation unintended by a user from being effectively handled. [Brief explanation of the drawings]

[0018] [Figure 1] 1 is an explanatory diagram showing the configuration of a control system according to an embodiment of the present invention; [Figure 2] FIG. 2 is an explanatory diagram showing the configuration of a control server 20 according to one embodiment of the present invention. [Figure 3]FIG. 2 is an explanatory diagram showing the display screen of the non-contact type operation panel 14 in the standby mode. [Figure 4] 10 is an explanatory diagram showing the display screen of the non-contact type operation panel 14 when the operation mode is transitioned from the standby mode to the operation valid mode. FIG. [Figure 5] 10 is an explanatory diagram showing the display screen of the non-contact type operation panel 14 in the operation valid mode. FIG. [Figure 6] FIG. 10 is an explanatory diagram showing the display screen of the non-contact type operation panel 14 in the pause mode. [Figure 7] 4 is a flowchart illustrating the operation of the control server 20 according to one embodiment of the present invention. [Figure 8] FIG. 2 is a block diagram showing the hardware configuration of a control server 20. DETAILED DESCRIPTION OF THE INVENTION

[0019] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. In this specification and drawings, components having substantially the same functional configurations are designated by the same reference numerals, and redundant description will be omitted.

[0020] In addition, in this specification and drawings, multiple components having substantially the same functional configuration may be distinguished by adding different letters to the same reference numeral. However, when there is no need to particularly distinguish between multiple components having substantially the same functional configuration, the multiple components will be given only the same reference numeral.

[0021] <Control system configuration> One embodiment of the present invention relates to a control system that accepts contactless operations by a user. The control system according to one embodiment of the present invention can be used to provide a variety of services to an unspecified number of users. For example, the control system according to one embodiment of the present invention can be used for a cash processing service, a route guidance service, a seat reservation service, a ticket issuing service, or the like. First, the configuration of such a control system will be described with reference to FIG. 1.

[0022] Fig. 1 is an explanatory diagram showing the configuration of a control system according to one embodiment of the present invention. As shown in Fig. 1, the control system according to one embodiment of the present invention includes a plurality of user-operated terminals 10, a communication device 18, and a control server 20. Fig. 1 shows an example in which two user-operated terminals 10 are connected to one control server 20, but only one user-operated terminal 10 may be connected to one control server 20, or three or more user-operated terminals 10 may be connected to one control server 20.

[0023] (User-operated terminal) The user-operated terminal 10 is an information processing terminal operated by a user. The user-operated terminal 10 may be a tablet-type mobile terminal as shown in Fig. 1, a freestanding information terminal such as an ATM or ticket vending machine, an information display terminal for signage, a printer, or a display operation terminal installed in an elevator.

[0024] 1, the user-operated terminal 10 has a non-contact type operation panel 14 and a camera 16. The non-contact type operation panel 14 functions as an operation surface (operation area) that detects non-contact operations by the user's hand, and as a display surface that is stacked on the operation surface and displays various screens. The user-operated terminal 10 transmits detection information of operations on the non-contact type operation panel 14 to the control server 20, receives the display screen from the control server 20 via the communication device 18, and causes the non-contact type operation panel 14 to display the display screen.

[0025] The function of the operation surface may be realized by a method using infrared rays, a capacitance method, or any other method capable of detecting a non-contact operation. Although this specification mainly describes an example in which the operation surface is capable of detecting a non-contact operation, the operation surface may be capable of detecting a contact operation in addition to a non-contact operation, or may be capable of detecting a contact operation without detecting a non-contact operation.

[0026] The camera 16 is an example of an imaging unit that captures an image of a subject. For example, the camera 16 captures an image of the face of a user standing in front of the user-operated terminal 10, thereby acquiring a facial image of the user. The user-operated terminal 10 transmits the facial image of the user acquired by the camera 16 to the control server 20 via the communication device 18 in real time. The position of the camera 16 in the user-operated terminal 10 is not limited to the example shown in FIG. 1 . Furthermore, a plurality of cameras 16 may be provided in one user-operated terminal 10.

[0027] (Communication equipment) The communication device 18 communicates with the user-operated terminal 10 and the control server 20. For example, the communication device 18 receives operation detection information and a user's facial image from the user-operated terminal 10, and transmits the operation detection information and the user's facial image to the control server 20. The communication device 18 also receives display screens, control information, and the like from the control server 20, and transmits the display screens, control information, and the like to the user-operated terminal 10.

[0028] There are no particular limitations on the communication method between the communication device 18 and the user-operated terminal 10, and the communication method between the communication device 18 and the control server 20. For example, each communication method may be a wireless communication method such as a wireless LAN or a cellular method, or a wired communication method.

[0029] (control server) The control server 20 is an information processing device that controls the operation of the user-operated terminal 10. In particular, the control server 20 according to one embodiment of the present invention determines whether the user is looking at the non-contact operation panel 14 based on a facial image of the user received from the user-operated terminal 10, and controls the transition of the operation mode based on the determination result. The detailed configuration of the control server 20 will be described below with reference to FIG. 2.

[0030] <Detailed configuration of the control server> 2 is an explanatory diagram showing the configuration of the control server 20 according to one embodiment of the present invention. As shown in FIG. 2, the control server 20 according to one embodiment of the present invention includes a communication unit 220 and a control unit 230.

[0031] (Communication unit 220) The communication unit 220 communicates with a plurality of user-operated terminals 10 via the communication device 18. For example, the communication unit 220 functions as a detection information acquisition unit that acquires operation detection information from the user-operated terminal 10. The communication unit 220 also receives a face image of the user from the user-operated terminal 10.

[0032] (control unit 230) The control unit 230 controls the overall operation of the control server 20 and the user-operated terminal 10. In particular, the control unit 230 according to an embodiment of the present invention has the functions of an image processing unit 232, a mode control unit 234, and a display control unit 236.

[0033] The image processing unit 232 is an example of a determination result acquisition unit that acquires a determination result indicating whether or not the user is looking at the non-contact operation panel 14. For example, the image processing unit 232 may detect the direction of the user's face and line of sight based on the user's facial image, and determine that the user is looking at the non-contact operation panel 14 when the user's line of sight is directed within a predetermined range.

[0034] The mode control unit 234 controls transition of the operation modes among a plurality of operation modes of the user-operated terminal 10 or the control server 20. The plurality of operation modes include a standby mode, an operation-validated mode, and a pause mode. The standby mode and the pause mode are operation modes in which operations on the non-contact type operation panel 14 are not handled validly, and the operation-validated mode is an operation mode in which operations on the non-contact type operation panel 14 are handled validly.

[0035] The fact that an operation on the contactless operation panel 14 is not treated validly may mean that the operation performed on the contactless operation panel 14 is not reflected in the subsequent operation of the user-operated terminal 10. For example, in the standby mode and the pause mode, the function of detecting an operation on the contactless operation panel 14 may be disabled, the user-operated terminal 10 may stop transmitting operation detection information, or the control server 20 may discard the operation detection information received by the communication unit 220. On the other hand, in the operation-validation mode, the function of detecting an operation on the contactless operation panel 14 may be enabled, the user-operated terminal 10 may transmit operation detection information, and the control server 20 may perform processing to respond to the operation detection information received by the communication unit 220.

[0036] The mode control unit 234 controls the transition of the operation mode among the plurality of operation modes based on the determination result acquired by the image processing unit 232. For example, the mode control unit 234 transitions the operation mode from the standby mode to the operation valid mode based on the determination result indicating that the user is looking at the non-contact type operation panel 14 being acquired. As a more restrictive condition, the mode control unit 234 may transition the operation mode from the standby mode to the operation valid mode based on the determination result indicating that the user is looking at the non-contact type operation panel 14 being acquired for a first time period or longer. The first time period is preferably a time period of one second or less, but may be a time period of more than one second.

[0037] Furthermore, based on the fact that a determination result indicating that the user is not looking at the non-contact type operation panel 14 is acquired in the operation valid mode, the mode control unit 234 transitions the operation mode to a pause mode in which operations on the non-contact type operation panel 14 are temporarily not handled validly. As a more restrictive condition, based on the fact that a determination result indicating that the user is not looking at the non-contact type operation panel 14 is acquired for a second time period or more in the operation valid mode, the mode control unit 234 may transition the operation mode to a pause mode in which operations on the non-contact type operation panel 14 are temporarily not handled validly.

[0038] Furthermore, the mode control unit 234 transitions the operation mode to the operation enabled mode based on the fact that a determination result indicating that the user is looking at the non-contact type operation panel 14 is obtained within a third time period in the pause mode, and transitions the operation mode to the standby mode based on the fact that the time period during which the user is not looking at the non-contact type operation panel 14 reaches the third time period in the pause mode.

[0039] The display control unit 236 controls the display on the non-contact type operation panel 14. The display control unit 236 functions as a detection information acquisition unit that acquires detection information of operations on the non-contact type operation panel 14, and generates a screen according to the detection information. The display control unit 236 also changes the display on the non-contact type operation panel 14 in accordance with the transition of the operation mode by the mode control unit 234. Specific examples of the display on the non-contact type operation panel 14 will be described below with reference to FIGS. 3 to 6.

[0040] FIG. 3 is an explanatory diagram showing the display screen of the contactless operation panel 14 in standby mode. In the example shown in FIG. 3, the display screen of the contactless operation panel 14 in standby mode includes a number input area 51 for inputting a number, a call button 52 for connecting a call with an operator, and a help button 53 for outputting operation guidance. Also, as shown in FIG. 3, the display screen of the contactless operation panel 14 in standby mode is dimmed overall. In this standby mode, as described above, operations on the contactless operation panel 14 are no longer valid, but the camera 16 continues to capture images in front of the user-operated terminal 10. Note that FIG. 3 merely shows an example of elements included on the display screen; the display screen may include other elements or have a layout different from that shown in FIG. 3. Also, the display screen may not be displayed on the contactless operation panel 14 in standby mode.

[0041] 4 is an explanatory diagram showing the display screen of the contactless operation panel 14 when the operation mode transitions from the standby mode to the operation-enabled mode. When the operation mode transitions from the standby mode to the operation-enabled mode, the mode control unit 234 causes the contactless operation panel 14 to display a message indicating that the system has responded to the user. In the example shown in FIG. 4, the message is message 54 saying "Starting to accept operations."

[0042] 5 is an explanatory diagram showing the display screen of the non-contact type operation panel 14 in the operation-validating mode. As shown in FIG. 5, the mode control unit 234 causes the screen displayed by the non-contact type operation panel 14 in the operation-validating mode to be brighter than the screen displayed by the non-contact type operation panel 14 in the standby mode. In this operation-validating mode, as described above, operations on the non-contact type operation panel 14 are treated as valid, and the camera 16 continues to capture images in front of the user-operated terminal 10.

[0043] FIG. 6 is an explanatory diagram showing the display screen of the contactless operation panel 14 in the pause mode. In the pause mode, the mode control unit 234 causes the contactless operation panel 14 to display a prompting message to prompt the user to look at the contactless operation panel 14 before the third time period has elapsed. In the example shown in FIG. 6, the prompting message is a message 56 that reads, "Please look at the screen to resume accepting operations. Less than 5 seconds remaining." The mode control unit 234 also causes the background of the screen displayed by the contactless operation panel 14 in the pause mode to be darker than the screen displayed by the contactless operation panel 14 in the operation-validation mode. In this standby mode, as described above, operations on the contactless operation panel 14 are no longer valid, but the camera 16 continues to capture images in front of the user-operated terminal 10.

[0044] <Operation> The configuration of the control server 20 according to one embodiment of the present invention has been described above. Next, the operation of the control server 20 according to one embodiment of the present invention will be summarized with reference to FIG.

[0045] 7 is a flowchart showing the operation of the control server 20 according to an embodiment of the present invention. As shown in FIG. 7, after the control server 20 has been started up, the control server 20 operates in standby mode (S304). When the communication unit 220 receives a user's facial image from the user-operated terminal 10 (S308 / Yes), the image processing unit 232 determines whether the user is looking at the non-contact type operation panel 14 (S312). When the user has been looking at the non-contact type operation panel 14 for a first time period or longer (S316 / Yes), the mode control unit 234 transitions the operation mode to the operation-enabled mode (S320).

[0046] The image processing unit 232 determines whether the user continues to look at the non-contact type operation panel 14 (S324). The mode control unit 234 maintains the operation enabled mode while the user is looking at the non-contact type operation panel 14 (S328 / Yes), and transitions the operation mode to the pause mode when the user stops looking at the non-contact type operation panel 14 (S328 / No, S332).

[0047] Thereafter, the image processing unit 232 continues to determine whether the user is looking at the non-contact type operation panel 14 (S336). If the user is looking at the non-contact type operation panel 14 (S340 / Yes), the mode control unit 234 transitions the operation mode to the operation enabled mode (S320). On the other hand, if the user is not looking at the non-contact type operation panel 14 (S340 / No), the processing from S336 is repeated until the time during which the user is not looking at the non-contact type operation panel 14 reaches a third time (S344 / No). If the time during which the user is not looking at the non-contact type operation panel 14 reaches the third time (S344 / Yes), the mode control unit 234 transitions the operation mode to the standby mode (S304).

[0048] <Action and effect> According to the embodiment of the present invention described above, various operational effects can be obtained. For example, according to the embodiment of the present invention, the mode control unit 234 transitions the operation mode from the standby mode to the operation-validating mode based on the acquisition of a determination result indicating that the user is looking at the non-contact type operation panel 14. Operations performed on the non-contact type operation panel 14 while the user is not looking at the non-contact type operation panel 14 may be operations unintended by the user. However, according to the above configuration, operations performed on the non-contact type operation panel 14 while the user is not looking at the non-contact type operation panel 14 are not treated as valid. Therefore, according to the embodiment of the present invention, it is possible to prevent operations unintended by the user from being treated as valid.

[0049] As a more restrictive condition, the mode control unit 234 transitions the operation mode from the standby mode to the operation valid mode based on the fact that a determination result indicating that the user is looking at the non-contact type operation panel 14 has been acquired for a first time period or more. With this configuration, it is possible to prevent the operation mode from transitioning to the operation valid mode even when the user's line of sight simply passes over the non-contact type operation panel 14.

[0050] Furthermore, the mode control unit 234 makes the screen displayed by the non-contact type operation panel 14 in the operation valid mode brighter than the screen displayed by the non-contact type operation panel 14 in the standby mode. With this configuration, the user can easily intuitively understand that operations on the non-contact type operation panel 14 are valid in the operation valid mode.

[0051] Furthermore, the mode control unit 234 may transition the operation mode to a pause mode in which operations on the contactless operation panel 14 are temporarily not handled effectively, based on the fact that a determination result indicating that the user is not looking at the contactless operation panel 14 has been acquired for a second time period or more in the operation-effective mode. According to this configuration, it is possible to not handle effectively operations performed on the contactless operation panel 14 while the user is not aware of the contactless operation panel 14, such as when the user moves away from the user-operated terminal 10 or temporarily takes their eyes off the user-contactless operation panel 14.

[0052] Furthermore, the mode control unit 234 transitions the operation mode to the operation-enabled mode when a determination result indicating that the user is looking at the non-contact operation panel 14 is acquired within a third time in the pause mode, and transitions the operation mode to the standby mode when the time during which the user is not looking at the non-contact operation panel 14 reaches the third time in the pause mode. When the time during which the user is not looking at the non-contact operation panel 14 reaches the third time in the pause mode, it is considered that the user has moved away from the user-operated terminal 10, and therefore transitioning the operation mode to the standby mode allows the next user to start using the user-operated terminal 10.

[0053] In the pause mode, before the third time period has elapsed, the mode control unit 234 causes the non-contact type operation panel 14 to display a guidance display that guides the user to look at the non-contact type operation panel 14. This configuration can prevent the user from feeling that the transition from the pause mode to the standby mode has occurred suddenly.

[0054] <Modification> An embodiment of the present invention has been described above. Below, several modified examples of the above-described embodiment will be described. Note that each modified example described below may be applied alone to the above-described embodiment, or may be applied in combination with the above-described embodiment. Furthermore, each modified example may be applied in place of the configuration of the above-described embodiment, or may be applied in addition to the configuration of the above-described embodiment.

[0055] For example, in the above embodiment, an example was described in which the operation mode transitions to an operation-enabled mode in which operations on the entire non-contact operation panel 14 are valid based on whether the user is looking at any part of the non-contact operation panel 14. In this regard, for each operation area included in multiple operation areas obtained by dividing the non-contact operation panel 14, a determination may be made as to whether the user is looking at that operation area and whether the operation mode transitions to an operation-enabled mode in which operations on that operation area are valid. With this configuration, when the user is looking at a certain operation area, the operation modes for the other operation areas may become standby mode or pause mode. Therefore, it is possible to more reliably distinguish between operations intended by the user and unintended operations.

[0056] The control server 20 may also extract features from a facial image of a user and store the extracted features. When a user looks at the non-contact type operation panel 14 in the pause mode, the control server 20 may determine, based on the stored features, whether the user is the same as the user who had been operating the non-contact type operation panel 14 up until that point, and transition the operation mode to the operation-enabled mode if the identity is confirmed. This configuration makes it possible to prevent the user using the user-operated terminal 10 from being replaced when the pause mode is entered.

[0057] The control server 20 may also store the face images and operation detection information of the users. With this configuration, it becomes possible to verify after the fact whether the operation performed by each user was the operation intended by that user.

[0058] <Hardware configuration> The above describes the embodiments of the present invention. The information processing, such as the analysis of facial images and the control of operation modes, is realized by the cooperation of software and the hardware of the control server 20, which will be described below.

[0059] 8 is a block diagram showing the hardware configuration of the control server 20. The control server 20 includes a CPU (Central Processing Unit) 201, a ROM (Read Only Memory) 202, a RAM (Random Access Memory) 203, and a host bus 204. The control server 20 also includes a bridge 205, an external bus 206, an interface 207, an input device 208, a display device 209, an audio output device 210, a storage device (HDD) 211, a drive 212, and a network interface 215.

[0060] The CPU 201 functions as an arithmetic processing unit and a control unit, and controls the overall operation of the control server 20 in accordance with various programs. The CPU 201 may also be a microprocessor. The ROM 202 stores programs used by the CPU 201, calculation parameters, etc. The RAM 203 temporarily stores programs used in the execution of the CPU 201, parameters that change as appropriate during the execution, etc. These are interconnected by a host bus 204 that includes a CPU bus, etc. The functions of the image processing unit 232, mode control unit 234, display control unit 236, etc. described above can be realized by the cooperation of the CPU 201, ROM 202, RAM 203, and software.

[0061] The host bus 204 is connected to an external bus 206, such as a PCI (Peripheral Component Interconnect / Interface) bus, via a bridge 205. Note that the host bus 204, bridge 205, and external bus 206 do not necessarily need to be configured separately, and these functions may be implemented on a single bus.

[0062] The input device 208 is composed of input means such as a mouse, keyboard, touch panel, buttons, microphone, sensors, switches, and levers that allow the user to input information, and an input control circuit that generates an input signal based on the user's input and outputs it to the CPU 201. By operating the input device 208, the user of the control server 20 can input various data to the control server 20 and instruct processing operations.

[0063] The display device 209 includes, for example, a display device such as a liquid crystal display (LCD) device, a projector device, an OLED (Organic Light Emitting Diode) device, a lamp, etc. The audio output device 210 includes an audio output device such as a speaker and a headphone.

[0064] The storage device 211 is a data storage device configured as an example of a storage unit of the control server 20 according to this embodiment. The storage device 211 may include a storage medium, a recording device that records data on the storage medium, a reading device that reads data from the storage medium, and a deletion device that deletes data recorded on the storage medium. The storage device 211 is configured, for example, with an HDD (Hard Disk Drive) or an SSD (Solid Storage Drive), or a memory with equivalent functions. This storage device 211 drives the storage and stores programs executed by the CPU 201 and various data.

[0065] The drive 212 is a reader / writer for a storage medium, and is built into or externally attached to the control server 20. The drive 212 reads information recorded on a removable storage medium 24, such as an attached magnetic disk, optical disk, magneto-optical disk, or semiconductor memory, and outputs the information to the RAM 203 or the storage device 211. The drive 212 can also write information to the removable storage medium 24.

[0066] The network interface 215 is, for example, a communication interface configured with a communication device for connecting to a network, etc. The network interface 215 may be a wireless LAN (Local Area Network) compatible communication device or a wired communication device that performs wired communication.

[0067] <Supplementary information> Although the preferred embodiments of the present invention have been described in detail above with reference to the accompanying drawings, the present invention is not limited to these examples. It is clear that a person skilled in the art to which the present invention pertains can conceive of various modifications and alterations within the scope of the technical ideas set forth in the claims, and it is understood that these also naturally fall within the technical scope of the present invention.

[0068] For example, the steps in the processing of the control server 20 in this specification do not necessarily have to be processed in chronological order according to the order shown in the sequence diagram or flowchart. For example, the steps in the processing of the control server 20 may be processed in an order different from the order shown in the flowchart, or may be processed in parallel.

[0069] It is also possible to create a computer program that causes hardware such as a CPU, ROM, and RAM built into the user-operated terminal 10 and the control server 20 to perform functions equivalent to those of the above-described components of the user-operated terminal 10 and the control server 20. A non-transitory storage medium storing the computer program is also provided. [Explanation of symbols]

[0070] 10 User-operated terminals 14. Contactless operation panel 16 Camera 18. Communications Equipment 20 Control Server 220 Communications Department 230 Control Unit 232 Image Processing Unit 234 Mode control section 236 Display control unit

Claims

1. a determination result acquisition unit that acquires a determination result indicating whether a user is looking at an operation area operated by the user's hand; a control unit that transitions the operation mode from a standby mode in which operations on the operation area are not treated as valid to an operation valid mode in which operations on the operation area are treated as valid, based on the acquisition of a determination result indicating that the user is looking at the operation area; Equipped with a display surface is laminated on the operation area; the control unit transitions the operation mode from the standby mode to the operation valid mode based on a determination result indicating that the user is looking at the operation area being acquired for a first time period or more in the standby mode; making the screen displayed on the display surface in the operation-enabled mode brighter than the screen displayed on the display surface in the standby mode; transitioning the operation mode to a pause mode in which operations on the operation area are temporarily not treated as valid, based on a determination result indicating that the user is not looking at the operation area being acquired for a second time period or more in the operation valid mode; An information processing device that transitions the operation mode to the operation valid mode based on a determination result indicating that the user is looking at the operation area in the pause mode being obtained within a third time period, and transitions the operation mode to the standby mode based on a determination result indicating that the user is looking at the operation area in the pause mode not being obtained within the third time period.

2. The information processing device according to claim 1 , wherein the control unit, in the pause mode, causes a prompting display on the display surface to prompt the user to look at the operation area before the third time period has elapsed.

3. the control unit further includes a detection information acquisition unit that acquires detection information of an operation on the operation area; The information processing device according to claim 1 , wherein the control unit controls an operation according to the detection information acquired in the operation-enabled mode.

4. 4. The information processing device according to claim 1, wherein the control unit disables a function of detecting an operation by the user's hand in the operation area in the standby mode.

5. 5. The information processing device according to claim 1, wherein the operation area is one of a plurality of areas obtained by dividing an operation surface.

6. Obtaining a determination result indicating whether or not a user is looking at an operation area operated by the user's hand; transitioning an operation mode from a standby mode in which operations on the operation area are not handled effectively to an operation effective mode in which operations on the operation area are handled effectively, based on the fact that a determination result indicating that the user is looking at the operation area has been acquired for a first time period or more; making a screen displayed on a display surface stacked on the operation area in the operation valid mode brighter than a screen displayed on the display surface in the standby mode; transitioning the operation mode to a pause mode in which operations on the operation area are temporarily not handled as valid, based on a determination result indicating that the user is not looking at the operation area being acquired for a second time period or more in the operation valid mode; an information processing method executed by a computer, comprising: transitioning an operation mode to the operation valid mode based on a determination result indicating that the user is looking at the operation area being obtained within a third time period in the pause mode; and transitioning the operation mode to the standby mode based on a determination result indicating that the user is looking at the operation area being not obtained within the third time period in the pause mode.

7. Computer, a determination result acquisition unit that acquires a determination result indicating whether a user is looking at an operation area operated by the user's hand; a control unit that transitions the operation mode from a standby mode in which operations on the operation area are not treated as valid to an operation valid mode in which operations on the operation area are treated as valid, based on the acquisition of a determination result indicating that the user is looking at the operation area; It functions as The control unit transitioning the operation mode from the standby mode to the operation valid mode based on a determination result indicating that the user is looking at the operation area being acquired for a first time period or more in the standby mode; a screen displayed on a display surface stacked on the operation area in the operation-enabled mode being brighter than a screen displayed on the display surface in the standby mode; transitioning the operation mode to a pause mode in which operations on the operation area are temporarily not treated as valid, based on a determination result indicating that the user is not looking at the operation area being acquired for a second time period or more in the operation valid mode; A program that transitions the operation mode to the operation valid mode based on a determination result indicating that the user is looking at the operation area being obtained within a third time period in the pause mode, and transitions the operation mode to the standby mode based on a determination result indicating that the user is looking at the operation area being not obtained within the third time period in the pause mode.

Images