Information Processing System

Abstract

To provide an information processing system which identifies and processes each of a plurality of pieces of information based on user's touchless operation.SOLUTION: A touchless device 200 comprises: a housing generally formed like a box and has an operation space formed in a part thereof by an opening; a display 260 which emits an optical signal based on an image according to image information inputted from a control unit, into the housing; a retroreflective material which transmits the optical signal incident from the display toward the operation space and forms an aerial image generated by the transmitted optical signal, in the operation space; an optical touch sensor 280 which detects a position of an object on the basis of light emitted toward the inside of the operation space; a non-contact IC reader 290 which reads information of a non-contact IC card disposed on the housing; and a barcode reading camera 300 which outputs information of a barcode recorded on the object inserted into the operation space. The control unit performs processing of payment based on at least one of operation information generated on the basis of the position of the object, the information of the IC card, and the information of the barcode.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to an information processing system that processes information operated by a user. [Background technology]

[0002] In recent years, amid the COVID-19 pandemic, there has been an increased need to avoid touching touch panels used by an unspecified number of users, and there is a demand for terminals used by users at retail stores and other places for payments and other purposes to be able to be operated without directly touching the touch panel.

[0003] An electronic device that can be operated by gestures without contact has been proposed (see Patent Document 1). This electronic device has a structure that allows processing based on a user's gesture operation detected by a proximity sensor. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2018-50175 A Summary of the Invention [Problem to be solved by the invention]

[0005] According to the conventional technology, it is possible to operate electronic devices by gestures without touching a touch panel display, but when an operation screen including operation buttons is displayed in space, it is difficult for a user to operate a row of small operation buttons because a proximity sensor is used. Moreover, the conventional technology does not take into consideration the processing of multiple pieces of information.

[0006] An object of the present invention is to identify and process each of a plurality of pieces of information based on a non-contact operation by a user. [Means for solving the problem]

[0007] In order to solve the above problems, the present invention includes a controller that generates image information related to an image of an operation screen including a plurality of operation buttons and processes input information; a housing that is configured in a substantially box shape and has an operation space formed in a part of the housing by an opening; and a display that is disposed within the housing and receives the image information from the controller, displays an image according to the received image information on a screen, and emits an optical signal according to the image into the housing. A retroreflective material disposed within the housing; A light receiving unit is disposed in the housing, and receives the optical signal from the display. The light is reflected toward the retroreflective material, and the light reflected by the retroreflective material is The optical signal is transmitted toward the operation space, and an image based on the transmitted optical signal is formed in the operation space as an aerial image. Reflective or transmissive materials and irradiating light toward the inside of the operation space, and detecting a position of the object present in the operation space. 1. The reflected light reflected by the object is incident, and the reflected light is detected based on the incident reflected light. The first An optical sensor for detecting the position of an object, a card reader arranged on the housing and for reading card information of a card arranged on the housing, and a Second and a barcode reader that photographs a barcode recorded on an object as a subject and outputs information of the image obtained by photographing as barcode information, wherein the controller generates operation information for identifying an operated operation button among the plurality of operation buttons based on a detection result of the optical sensor, acquires at least one of the generated operation information, the card information output by the card reader, or the barcode information output by the barcode reader as the input information, and executes a payment process based on the acquired input information. the display further includes an auxiliary transparent plate disposed between the reflective or transparent member and the operation space within the housing, and transmitting the optical signal transmitted through the reflective or transparent member toward the operation space; and a retaining section disposed detachably on the outside of the housing at a position facing an end of the auxiliary transparent plate, and receiving objects that have fallen onto the auxiliary transparent plate, the reflective or transparent member being disposed at an angle with respect to a screen of the display, and the auxiliary transparent plate being disposed approximately parallel to the reflective or transparent member with the end facing downward. It is characterized by: Also, in the present invention, there is provided a controller that generates image information relating to an image of an operation screen including a plurality of operation buttons and processes input information; a housing configured in a substantially box shape and having an operation space formed in a part thereof by an opening; a display that is disposed within the housing and receives the image information from the controller, displays an image according to the received image information on a screen, and emits an optical signal according to the image into the housing; a retroreflective material that is disposed within the housing; a reflective or transparent member that is disposed within the housing and receives the optical signal from the display, reflects the received optical signal toward the retroreflective material, transmits the light reflected by the retroreflective material toward the operation space, and forms an image according to the transmitted optical signal as an aerial image in the operation space; and an optical sensor that irradiates light toward the operation space, receives reflected light reflected by a first object present in the operation space, and detects the position of the first object present in the operation space based on the received reflected light. a card reader disposed on the housing for reading card information of a card disposed on the housing; and a barcode reader disposed on the housing for photographing a barcode recorded on a second object inserted into the operation space as a subject and outputting image information obtained by photographing as barcode information, wherein the controller generates operation information for identifying an operated operation button among the plurality of operation buttons based on a detection result of the optical sensor, imports at least one of the generated operation information, the card information output by the card reader, or the barcode information output by the barcode reader as the input information, and executes a payment process based on the imported input information, and further comprises a speaker disposed on the housing and connected to the controller, wherein the controller generates an audio signal indicating a touch operation sound based on a detection result of the optical sensor, and causes the speaker to sound with the generated audio signal. Effect of the Invention

[0008] According to the present invention, it is possible to identify and process each of a plurality of pieces of information based on a non-contact operation by a user. [Brief description of the drawings]

[0009] [Figure 1] 1 is a block diagram showing an example of the configuration of an information processing system according to a first embodiment of the present invention. [Diagram 2] FIG. 2 is a perspective view showing a state where a non-contact IC reader is disposed on the upper surface of the touchless device according to the first embodiment of the present invention. [Diagram 3] 1A and 1B are diagrams showing a non-contact IC reader disposed on the upper surface of a touchless device according to a first embodiment of the present invention, in which (a) is a right side cross-sectional view of the touchless device, and (b) is a front cross-sectional view of the touchless device. [Figure 4] FIG. 11 is a perspective view showing a state where a non-contact IC reader is disposed on the front surface of a touchless device according to a second embodiment of the present invention. [Diagram 5] 11A and 11B are diagrams showing a non-contact IC reader disposed on the front surface of a touchless device according to a second embodiment of the present invention, where (a) is a right side cross-sectional view of the touchless device, and (b) is a front cross-sectional view of the touchless device. [Figure 6] FIG. 11 is a perspective view showing a touchless device according to a third embodiment of the present invention, with a non-contact IC reader disposed on the rear surface thereof. [Figure 7] 11A and 11B are diagrams showing a non-contact IC reader disposed on the rear surface of a touchless device according to a third embodiment of the present invention, where (a) is a right side cross-sectional view of the touchless device, and (b) is a front cross-sectional view of the touchless device. [Figure 8] FIG. 11 is a block diagram showing a configuration example of an information processing system according to a fourth embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the drawings. EXAMPLES

[0011] Fig. 1 is a block diagram showing a configuration example of an information processing system according to a first embodiment of the present invention. In Fig. 1, a system including a control unit 100, a touchless device 200, and a power supply unit 330 is configured as, for example, an information processing system.

[0012] The control unit 100 is configured, for example, by a computer (not shown) including a processor, a main memory device, an auxiliary memory device, an input device, an output device, and a communication device, and functions as a controller that comprehensively controls the touchless device 200. The processor is configured, for example, by using a CPU (Central Processing Unit) or an MPU (Micro Processing Unit). The main memory device is a device that stores computer programs and data, and is, for example, a ROM (Read Only Memory), a RAM (Random Access Memory), a non-volatile semiconductor memory, etc.

[0013] Examples of auxiliary storage devices include hard disk drives, SSDs (Solid State Drives), optical storage media (i.e., CDs (Compact Discs) and DVDs (Digital Versatile Discs)), storage systems, IC cards (Integrated Circuit Cards), SD (Secure Digital) memory cards, and other storage medium read / write devices, as well as storage areas of cloud servers. Computer programs and data stored in the auxiliary storage devices are loaded into the main storage device as needed.

[0014] Examples of input devices include keyboards, mice, touch panels, card readers, and audio input devices. Output devices (display devices) are user interfaces that provide users with various information such as processing progress and results. Examples of output devices include screen display devices (i.e., liquid crystal monitors, LCDs (Liquid Crystal Displays), or graphics cards), audio output devices (i.e., speakers, etc.), or printers, etc.

[0015] The communication device is a wired or wireless communication interface that realizes communication with other devices via a communication means such as a LAN, the Internet, etc. The communication device is, for example, a Network Interface Card (NIC), a wireless communication module, a Universal Serial Bus (USB) module, or a serial communication module.

[0016] The touchless device 200 includes a power supply control board 220, a power lamp 230, a power switch 240, a speaker 250, an airborne display 260, a USB (Universal Serial Bus) HUB board 270, an optical touch sensor 280, a non-contact IC card reader 290, a barcode reading camera 300, a camera illumination board 310, and an illumination control board 320. The speaker 250 is connected to a control unit 100, which is a higher-level device, via an audio signal interface 101. The airborne display 260 is connected to the control unit 100 via an HDMI (High Definition Multimedia Interface) (registered trademark) interface 102. The USB HUB board 270 is connected to the control unit 100 via a USB interface 103. An optical touch sensor 280, a non-contact IC (Integrated Circuit) card reader 290, a barcode reading camera 300, and an illumination control board 320 are connected to the USB HUB board 270 via USB interfaces 271-274, respectively.

[0017] The power supply control board 220 is supplied with DC power from a power supply unit 330 such as an AC adapter. The power supply control board 220 supplies the DC power supplied from the power supply unit 330 to the USB HUB board 270 and the aerial display 260. A power lamp 230 that indicates that power is being supplied and a power switch 240 that controls the power supply are connected to the power supply control board 220. A required number of camera lighting boards 310 are connected to the lighting control board 320 for lighting irradiation when shooting with the barcode reading camera 300.

[0018] The control unit 100 generates image information related to an image of an operation screen including a plurality of operation buttons, and transfers the generated image information to the aerial display 260. The aerial display 260 is, for example, composed of a liquid crystal display (liquid crystal display device) having a plurality of liquid crystal display elements, and when it receives image information transferred from the control unit 100, it displays an image according to the received image information on the screen, and also emits an optical signal based on the image toward an operation space (a space formed in a housing described later) for operation by a user, as described later, to form an aerial image within the operation space.

[0019] The optical touch sensor 280 is an optical sensor that irradiates light into the operation space, receives the reflected light reflected by an object present in the operation space, and detects the position of the object present in the operation space based on the reflected light. Specifically, the optical touch sensor 280 has, for example, an infrared projector and an infrared image sensor, and is arranged around the operation space. In this case, the infrared light irradiated from the image sensor into the operation space is reflected by an object (user's finger) present in the operation space, and the reflected infrared light is incident on the image sensor. For example, when the user's finger is inserted into the operation space, the optical touch sensor 280 detects the position (coordinates) of the finger and transfers a detection signal to the control unit 100 via the USB·HUB board 270.

[0020] The non-contact IC card reader 290 is a card reader that is arranged in a housing that is the touchless device main body and reads card information of a card arranged in the housing. Specifically, the non-contact IC card reader 290 forms a magnetic field in the operation space or in the storage section (card storage section), detects information recorded on a card inserted in the operation space or the storage section by a change in the magnetic field, and transfers the detected information as card information to the control section 100 via the USB·HUB board 270.

[0021] The barcode reading camera 300 is a barcode reader that is disposed in a housing that is the main body of the touchless device, photographs a barcode recorded on an object inserted into the operational space as a subject, and outputs image information obtained by photographing as barcode information. Specifically, the barcode reading camera 300 photographs a barcode recorded on an object inserted into the operational space as a subject, and transfers the photographed image information as barcode information to the control unit 100 via the USB·HUB board 270.

[0022] When optical touch sensor 280 detects that an operation button in the aerial image has been touched in the air at a coordinate position corresponding to the operation button, control unit 100 generates an audio signal indicating an operation sound in response to the detection signal from optical touch sensor 280, and transfers the generated audio signal to speaker 250. As a result, speaker 250 sounds an operation sound indicating that the operation button in the aerial image has been touched in the air.

[0023] When generating image information on an image of an operation screen including a plurality of operation buttons, the control unit 100 manages the positions of the operation buttons belonging to the operation screen in association with the detection positions of the optical touch sensor 280. In this case, when the optical touch sensor 280 detects an object inserted in the operation space, for example, a user's finger, the control unit 100 discriminates the detection signal from the optical touch sensor 280, generates operation information (operation information indicating which operation button was operated) that identifies the operated operation button among the plurality of operation buttons on the operation screen based on the position of the object (finger) detected by the optical touch sensor 280, and executes processing, for example, a payment process by shopping, according to the generated operation information. In addition, when the control unit 100 receives card information or barcode information, it executes processing, for example, a payment process by shopping, based on the received card information or barcode information.

[0024] Next, a configuration example in which a non-contact IC reader is disposed on the upper surface of a touchless device will be described with reference to Figs.

[0025] Fig. 2 is a perspective view of a non-contact IC reader disposed on the upper surface of the touchless device according to the first embodiment of the present invention. Fig. 3 is a view of a non-contact IC reader disposed on the upper surface of the touchless device according to the first embodiment of the present invention, in which (a) is a right side cross-sectional view of the touchless device, and (b) is a front cross-sectional view of the touchless device.

[0026] 2 and 3, the main body of the touchless device 200 is composed of a housing including a front part 201, a rear part 202, a left side part 203, a right side part 204, a top part 205, and a bottom part 206. This housing is formed in a box shape of a substantially rectangular parallelepiped. The left side part 203 and the right side part 204 are each formed with an inclination at the upper side, and the touchless device 200 as a whole is configured so that the front side is low and the rear side is high. That is, the top part 205 is formed as an inclined surface. The top part 205 is formed with an opening 207 of a substantially rectangular shape, and the area of ​​the opening 207 is configured as an operation space for a user to operate. That is, an operation space is formed by the opening 207 in the main body of the touchless device 200.

[0027] An aerial display 260 is disposed on the inside of the front part 201, facing the rear part 202. On the rear part 202, from the top side to the bottom side, a camera illumination plate 310, a speaker 250, a barcode reading camera 300, an illumination control board 320, a USB HUB board 270, a power switch 240, a power control board 220, and a retention part 360 are disposed. The camera illumination plate 310 is disposed in a position where it irradiates light toward the opening 207 of the upper part 205. The barcode reading camera 300 is disposed with its lens facing the opening 207 of the upper part 205 in order to photograph a subject present in the opening 207 of the upper part 205. A non-contact IC card reader 290 is disposed around the opening 207 of the upper part 205, and an optical touch sensor 280 is disposed on the upper side of the non-contact IC card reader 290.

[0028] A control board 210 is disposed on the bottom surface portion 206, and a substantially rectangular shaped Retroreflective material330 is deployed. Retroreflective material The central portion of 330 is curved upward, and is disposed from the front surface portion 201 to the rear surface portion 202. Retroreflective material Above 330, a rectangular shape is formed Reflective or transmissive materials 340 is deployed. Reflective or transmissive materials One end of 340 is fixed to the front side of the upper surface portion 205, and the other end is fixed to the bottom side of the rear surface portion 202, and as a whole, it is configured as an inclined plate with the front side being higher and the rear side being lower. For example, the reflective or transmissive member 340 is disposed at an angle of approximately 45 degrees with respect to the aerial display 260 disposed along the approximately vertical direction. Reflective or transmissive materials Above 340 is an acrylic plate 350 formed in a substantially rectangular shape. Reflective or transmissive materials The acrylic plate 350 is disposed approximately parallel to the upper surface 205. One end of the acrylic plate 350 is fixed to the front side of the upper surface 205, and the other end is fixed to the bottom side of the rear surface 202, and is configured as an inclined plate whose front side is higher and whose rear side is lower as a whole. In this case, the acrylic plate 350 is disposed approximately parallel to the upper surface 205. Reflective or transmissive materials 340 and the operation space, Reflective or transmissive materials The acrylic plate 350 is configured as an auxiliary transparent plate that transmits the optical signal transmitted through the acrylic plate 340 toward the operation space. Reflective or transmissive materials The purpose of the placement is to prevent dust and other foreign matter from adhering to 340 and to prevent the user's fingers from touching it, as well as to prevent the light from reflecting off it.

[0029] At this time, the acrylic plate 350 is subjected to abrasion resistance processing for the purpose of preventing reflection and breakage and scratches. Dust and the like that falls onto the acrylic plate 350 slides down to the bottom of the acrylic plate 350 and accumulates in the retention section 360. The retention section 360 is detachably arranged at a position facing the end (bottom) of the acrylic plate 350 on the outside of the housing, and is configured as a container for storing objects that have fallen onto the acrylic plate 350. Dust and the like that accumulates in the retention section 360 is discharged to the outside of the touchless device 200 by periodically removing a part (screw) of the retention section 360. By periodically performing the task of removing a part of the retention section 360, the inside of the retention section 360 can be periodically cleaned. A side reflector 370 formed in a substantially rectangular shape is fixed to the inside of the left side section 203 and the right side section 204. The side reflector 370 is configured as a reflector for widening the viewing angle of the user.

[0030] Non-contact IC card reader 290 includes an antenna (not shown) arranged around opening 207, reads information recorded on non-contact IC card 500 arranged above non-contact IC card reader 290 in a non-contact manner, and transfers the read information to control unit 100 via USB hub board 270. At this time, non-contact IC card reader 290 can read information recorded on non-contact IC card 500 in a non-contact manner regardless of where non-contact IC card 500 is arranged around opening 207.

[0031] When the aerial display 260 receives image information transferred from the control unit 100, it displays an image according to the received image information on the screen and emits an optical signal based on the image toward the operation space for the user to operate. At this time, part of the light emitted from the aerial display 260 is reflected by the arrow A. Retroreflective material Heading towards 330, Retroreflective material The remaining light is reflected at 330, as shown by arrows B and C. Reflective or transmissive materials After reflecting at 340, Retroreflective material Heading towards 330, Retroreflective material Reflects at 330. Retroreflective material The light reflected at 330 is as shown by arrow D. Reflective or transmissive materials After passing through 340 and acrylic plate 350, the light is focused as aerial image 400 in an operation space formed between optical touch sensor 280 and non-contact IC card reader 290, which is the space above opening 207 in top surface portion 205. At this time, aerial image 400 is displayed in the operation space as an image including an operation screen and operation buttons. In addition, the viewing angle of the user is limited, so that aerial image 400 displayed in the operation space can be prevented from being viewed by anyone other than the user.

[0032] The user can operate the operation button without contact while viewing the operation screen and operation buttons in aerial image 400 displayed in the operation space. When the user operates the operation button without contact, optical touch sensor 280 at a position corresponding to the operation button detects that the operation button has been operated, and transfers a detection signal to control unit 100. Control unit 100 identifies the detection signal from optical touch sensor 280 and executes processing according to the operation of the operation button, for example, processing for payment for shopping.

[0033] In this embodiment, when a user operates an operation button in aerial image 400 displayed in the operation space, optical touch sensor 280 detects that the operation button has been operated and transfers this detection result (operation information) to control unit 100. Control unit 100 generates operation information based on the detection result of optical touch sensor 280, and executes processing, for example, payment processing by shopping, according to the generated operation information (operation information specifying the operated operation button). In addition, when a user places a card in the operation space or near the operation space, non-contact IC card reader 290 reads information of the card placed in the operation space or near the operation space, and transfers the read card information to control unit 100. Control unit 100 executes payment processing based on the card information. In addition, when a user places an object to be read (an object on which a barcode is printed) in the operation space or near the operation space, barcode reading camera 300 reads information of the object to be read placed in the operation space or near the operation space, and transfers the read barcode information to control unit 100. The control unit 100 executes the payment process based on the barcode information.

[0034] According to this embodiment, a plurality of pieces of information based on a user's non-contact operations can be identified and processed. That is, a plurality of pieces of information based on a user's non-contact operations can be identified and processed by the information processing system without the user touching the touchless device 200. Therefore, by disposing the touchless device 200 in a retail store or the like, it is possible to contribute to reducing the spread of viruses. EXAMPLES

[0035] In this embodiment, a non-contact IC reader is disposed on the front of the touchless device, and the configuration of the information processing system is the same as that in Fig. 1. Below, a configuration example when a non-contact IC reader is disposed on the front of the touchless device will be described with reference to Figs. 4 and 5.

[0036] Fig. 4 is a perspective view of a non-contact IC reader disposed on the front surface of a touchless device according to Example 2 of the present invention. Fig. 5 is a view of a non-contact IC reader disposed on the front surface of a touchless device according to Example 2 of the present invention, in which (a) is a right side cross-sectional view of the touchless device, and (b) is a front cross-sectional view of the touchless device.

[0037] In this embodiment, a storage section 510 formed in a rectangular shape and configured to be capable of storing a contactless IC card 500 is attached to the front part 201 of the touchless device 200 as a front side storage section, and a contactless IC card reader 290 is arranged on the front part 201 of the touchless device 200 instead of being arranged on the top part 205 of the touchless device 200. The other configurations are similar to those of the embodiment shown in Figures 2 and 3, and the same parts are given the same symbols and their explanations are omitted.

[0038] At this time, the non-contact IC card reader 290 is disposed outside the touchless device 200 relative to the aerial display 260, and disposed between the non-contact IC card 500 stored in the storage section 510 and the aerial display 260 in the touchless device 200. When the non-contact IC card 500 is stored in the storage section 510, the non-contact IC card reader 290 reads information recorded in the non-contact IC card 500 in a non-contact manner, and transfers the read information to the control section 100 via the USB·HUB board 270. At this time, the non-contact IC card reader 290 can read information recorded in the non-contact IC card 500 in a non-contact manner regardless of where the non-contact IC card 500 is placed in the storage section 510. Also, even when a contact IC card is stored in the storage section 510, the non-contact IC card reader 290 can read and process information recorded in the contact IC card.

[0039] According to this embodiment, it is possible to achieve the same effects as in the first embodiment, and also, even if a contact IC card is stored in the storage section 510, it is possible to read and process information recorded on the contact IC card. EXAMPLES

[0040] In this embodiment, a non-contact IC reader is disposed on the rear surface of a touchless device, and the configuration of the information processing system is the same as that in Fig. 1. Below, a configuration example when a non-contact IC reader is disposed on the rear surface of a touchless device will be described with reference to Figs. 6 and 7.

[0041] Fig. 6 is a perspective view of a touchless device according to a third embodiment of the present invention, in which a non-contact IC reader is disposed on the rear surface of the touchless device. Fig. 7 is a view of a touchless device according to a third embodiment of the present invention, in which (a) is a right side cross-sectional view of the touchless device, and (b) is a front cross-sectional view of the touchless device.

[0042] In this embodiment, a storage section 520 capable of storing a non-contact IC card 500 is formed as a rear storage section on the upper side of the rear section 202 of the touchless device 200, and a non-contact IC card reader 290 is arranged near the storage section 520 on the rear section 202 of the touchless device 200 instead of being arranged on the top section 205 of the touchless device 200. Other configurations are similar to those of the embodiment shown in Figures 2 and 3, and the same parts are given the same reference numerals and their explanations are omitted. The speaker 250 is arranged on the surface of the storage section 520.

[0043] At this time, the storage section 520 has an opening at its top side, and the non-contact IC card 500 is stored in the storage section 520 through the opening of the storage section 520. The non-contact IC card 500 stored in the storage section 520 is disposed in a state close to the non-contact IC card reader 290. When the non-contact IC card 500 is stored in the storage section 520, the non-contact IC card reader 290 reads information recorded in the non-contact IC card 500 in a non-contact manner, and transfers the read information to the control section 100 via the USB·HUB board 270. At this time, the non-contact IC card reader 290 can read information recorded in the non-contact IC card 500 in a non-contact manner regardless of where the non-contact IC card 500 is disposed in the storage section 520. Also, even when a contact IC card is stored in the storage section 520, the non-contact IC card reader 290 can read and process information recorded in the contact IC card.

[0044] According to this embodiment, it is possible to achieve the same effects as in the first embodiment, and also, even if a contact IC card is stored in the storage section 520, it is possible to read and process information recorded on the contact IC card. EXAMPLES

[0045] FIG. 8 is a block diagram showing a configuration example of an information processing system according to a fourth embodiment of the present invention. In FIG. 8, in this embodiment, a control board 210 to which DC power is supplied from a power supply control board 220 is mounted on a touchless device 200, the control board 210 and the control unit 100 are connected via a USB interface 103, a speaker 250 is connected to the control board 210 via an audio signal interface 211, an aerial display 260 is connected via an HDMI interface 212, and a USB HUB board 270 is connected to the control board 210 via the USB interface 103. The other configurations are the same as those in the embodiment shown in FIG. 1, and the same components are denoted by the same reference numerals, and their description will be omitted. Note that the specific configuration of the touchless device 200 can be adopted from those in the first to third embodiments.

[0046] The control board 210 is configured to send and receive information with the control unit 100 via the USB interface 103 and has the function of performing processing on behalf of the control unit 100, and the control board 210 is equipped with, for example, a processor, a storage device, and a communication device.

[0047] At this time, the processor of the control board 210 transmits and receives information to the control unit 100, generates an image including an operation screen and operation buttons, and transfers image information including the generated image to the aerial display 260. When the aerial display 260 receives the image information transferred from the control board 210, it emits an optical signal of an image according to the received image information toward an operation space for a user to operate, and forms an aerial image 400 in the operation space. At this time, the aerial image 400 is displayed in the operation space as an image including an operation screen and operation buttons. When the optical touch sensor 280 at the coordinate position corresponding to the operation button detects that the operation button in the aerial image has been touched in the air, the processor of the control board 210 generates an audio signal indicating an operation sound in response to the detection signal of the optical touch sensor 280, and transfers the generated audio signal to the speaker 250. As a result, the speaker 250 sounds an operation sound indicating that the operation button in the aerial image has been touched in the air.

[0048] In addition, the processor of the control board 210 discriminates the detection signal from the optical touch sensor 280, and executes processing according to the operation of the operation button, for example, payment processing.If card information is received from the non-contact IC card reader 290, the processor executes payment processing based on the received card information.If barcode information is received from the barcode reading camera 310, the processor executes payment processing based on the received barcode information.The processor can also transfer each processing result to the control unit 100.

[0049] According to this embodiment, it is possible to obtain the same effects as those of the first embodiment, and also possible to have the processor of the control board 210 take over the processing of the control unit 100.

[0050] The present invention is not limited to the above-described embodiments, and includes various modified examples and equivalent configurations within the spirit of the appended claims. For example, the control unit (controller) 100 can be disposed in the touchless device 200, and the touchless device 200 including the control unit 100 can be configured as an information processing system or an information processing device. The above-described embodiments have been described in detail to clearly explain the present invention, and the present invention is not necessarily limited to devices having all of the described configurations.

[0051] In addition, each of the configurations, functions, etc. described above may be realized in hardware, for example by designing some or all of them as an integrated circuit, or may be realized in software by a processor interpreting and executing a program that realizes each function.

[0052] Information such as programs, tables, files, etc. that realize each function can be stored in a storage device such as a memory, a hard disk, or an SSD (Solid State Drive), or in a recording medium such as an IC (Integrated Circuit) card, an SD card, or a DVD (Digital Versatile Disc). [Explanation of symbols]

[0053] 100: control unit, 200: touchless device, 210: control board, 220: power supply control board, 230: power supply lamp, 240: power supply switch, 250: speaker, 260: aerial display, 270: USB hub, 280: optical touch sensor, 290: non-contact IC reader, 300: barcode reading camera, 310: camera lighting board, 320: lighting control board, 330: Retroreflective material , 340... Reflective or transmissive materials , 350.... Acrylic plate, 360.... Retention section, 370.... Side reflector, 400.... Aerial image, 500.... Contactless IC card

Claims

1. a controller for generating image information relating to an image of an operation screen including a plurality of operation buttons and for processing input information; A housing having a substantially box-like shape and an operation space formed by an opening in a part of the housing; a display disposed within the housing, which receives the image information from the controller, displays an image on a screen according to the received image information, and emits an optical signal according to the image into the housing; A retroreflective material disposed within the housing; a reflective or transmissive member that is disposed within the housing, receives the optical signal from the display, reflects the received optical signal toward the retroreflective material, transmits the light reflected by the retroreflective material toward the operation space, and forms an image based on the transmitted optical signal as an aerial image in the operation space; and an optical sensor that irradiates light into the operational space, receives reflected light reflected by a first object present in the operational space, and detects a position of the first object present in the operational space based on the received reflected light; a card reader disposed on the housing for reading card information of a card disposed on the housing; a barcode reader that is disposed on the housing, captures an image of a barcode recorded on a second object inserted into the operational space as a subject, and outputs information of the image obtained by capturing the image as barcode information; The controller: generating operation information for identifying an operated operation button among the plurality of operation buttons based on a detection result of the optical sensor, acquiring at least one of the generated operation information, the card information output by the card reader, or the barcode information output by the barcode reader as the input information, and executing a payment process based on the acquired input information; an auxiliary transmission plate disposed between the reflection or transmission member and the operation space in the housing, the auxiliary transmission plate transmitting the optical signal transmitted through the reflection or transmission member toward the operation space; a retaining section that is detachably disposed at a position facing an end of the auxiliary transmission plate on the outside of the housing and that receives objects that have fallen onto the auxiliary transmission plate; The reflective or transmissive member is The display is disposed at an angle to the screen of the display, The auxiliary transmission plate is An information processing system, characterized in that the end portion is disposed downward and substantially parallel to the reflective or transmissive member.

2. 2. The information processing system according to claim 1, The card reader includes: An information processing system characterized by being positioned in the vicinity of the operational space of the casing, forming a magnetic field within the operational space, and detecting information recorded on the card inserted into the operational space by changes in the magnetic field.

3. 2. The information processing system according to claim 1, a front side storage section arranged on a front side of the housing and configured to be able to store the card; The card reader includes: An information processing system characterized by being arranged near the front storage section of the housing, forming a magnetic field within the front storage section, and detecting information recorded on the card inserted into the front storage section by changes in the magnetic field.

4. 2. The information processing system according to claim 1, a rear side storage section arranged on a rear side of the housing and configured to be able to store the card; The card reader includes: An information processing system characterized by being positioned near the rear storage section of the housing, forming a magnetic field within the rear storage section, and detecting information recorded on the card inserted into the rear storage section by changes in the magnetic field.

5. A controller for generating image information relating to an image of an operation screen including a plurality of operation buttons and for processing input information; A housing having a substantially box-like shape and an operation space formed by an opening in a part of the housing; a display disposed within the housing, which receives the image information from the controller, displays an image on a screen according to the received image information, and emits an optical signal according to the image into the housing; A retroreflective material disposed within the housing; a reflective or transmissive member that is disposed within the housing, receives the optical signal from the display, reflects the received optical signal toward the retroreflective material, transmits the light reflected by the retroreflective material toward the operation space, and forms an image based on the transmitted optical signal as an aerial image in the operation space; and an optical sensor that irradiates light into the operational space, receives reflected light reflected by a first object present in the operational space, and detects a position of the first object present in the operational space based on the received reflected light; a card reader disposed on the housing for reading card information of a card disposed on the housing; a barcode reader that is disposed on the housing, captures an image of a barcode recorded on a second object inserted into the operational space as a subject, and outputs information of the image obtained by capturing the image as barcode information; The controller: generating operation information for identifying an operated operation button among the plurality of operation buttons based on a detection result of the optical sensor, acquiring at least one of the generated operation information, the card information output by the card reader, or the barcode information output by the barcode reader as the input information, and executing a payment process based on the acquired input information; a speaker disposed on the housing and connected to the controller; The controller: An information processing system, comprising: a touch operation sound generating unit configured to generate a touch operation sound based on a detection result of the optical sensor; and a speaker configured to generate a sound based on the touch operation sound.

Images