Presentation system, presentation method, and presentation program

Abstract

A presentation system according to the present disclosure comprises an acquisition unit, a determination unit, and a presentation unit. The acquisition unit acquires device data indicating a plurality of devices that can be operated by a user. Then, the acquisition unit acquires user data identifying the field of view of the user. The determination unit uses the device data and the user data to determines which of the plurality of devices are in the field of view of the user. The presentation unit presents, on the devices determined by the determination unit, a visual pattern that enables brainwaves of the user to operate the determined devices.

Description

[Technical Field]

[0001] The present disclosure relates to a presentation system, a presentation method, and a presentation program. [Background technology]

[0002] Various UIs (User Interfaces) are used to operate devices such as computers and IoT (Internet of Things) devices. Generally, users operate GUIs (Graphical User Interfaces) using a mouse or touch screen.

[0003] UI research is creating ways to operate devices without using hands. Brain-computer interfaces allow users to operate devices using their brain. Brain-computer interfaces can be implemented using Steady State Visually Evoked Potentials (SSVEPs).

[0004] One method using SSVEP is to present behavioral options to a user, where the user's mental state is determined from observing the user's SSVEP, and behavioral options are presented based on the user's mental state. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Laid-Open No. 2010-233719 Summary of the Invention [Problem to be solved by the invention]

[0006] However, the above prior art may have difficulty in enabling a user to operate equipment in a space using the user's brain waves.

[0007] Therefore, the present disclosure provides a presentation system, a presentation method, and a presentation program that enable a user to operate equipment in a space using the user's brain waves. [Means for solving the problem]

[0008] In one aspect of the present disclosure, a presentation system includes a first acquisition unit that acquires device data indicating a plurality of devices that can be operated by a user, a second acquisition unit that acquires user data that specifies the user's field of view, a determination unit that determines, from the plurality of devices, a device that is within the user's field of view using the device data and the user data, and a presentation unit that presents, on the device determined by the determination unit, a visual pattern that enables the user's brain waves to operate the determined device. [Effects of the Invention]

[0009] The presentation system can enable a user to operate devices in a space using the user's brain waves. [Brief explanation of the drawings]

[0010] [Figure 1] FIG. 1 is a block diagram of an example environment for visual pattern presentation. [Figure 2] FIG. 2 shows an overview of one visual pattern presentation process according to the present disclosure. [Figure 3] FIG. 3 is a block diagram of an example configuration of a presentation system according to the present disclosure. [Figure 4] FIG. 4 illustrates an example of the configuration of the control unit and storage unit according to the present disclosure. [Figure 5] Figure 5 shows an example of a challenge related to visual pattern presentation. [Figure 6A] FIG. 6A illustrates an example of a visual pattern presentation process according to the present disclosure. [Figure 6B] FIG. 6B illustrates an example of a visual pattern presentation process according to the present disclosure. [Figure 7]FIG. 7 is a flowchart illustrating an example of a process for determining a device to be targeted for visual stimulus projection. [Figure 8] FIG. 8 shows an example of the hardware configuration of a computer. DETAILED DESCRIPTION OF THE INVENTION

[0011] Several embodiments of the present disclosure are described in the accompanying drawings and the following description, but the present invention is not limited to these embodiments. The various features of these embodiments can be combined in various ways, provided that these features are not mutually inconsistent. Like reference numerals refer to like elements.

[0012] The following explanation is divided into 10 sections: 1. Introduction 2. Environment for visual pattern presentation 3. Overview of visual pattern presentation processing 4. Presentation System Configuration 5. Details of visual pattern presentation processing 5-1.Example of assignment 5-2. Presentation of visual stimulus patterns in real space 5-3.Other implementation examples 6. Flowchart of visual pattern presentation process 7.Effects 8. Hardware Configuration 9. Summary of embodiments 10. Addendum

[0013] 1. Introduction SSVEP (Steady State Visually Evoked Potential) is used to operate the GUI on the display. In the SSVEP method, the target the user is looking at is estimated based on the user's brain waves. Brain waves are detected when the retina is excited by visual stimuli ranging from 3.5 Hz to 75 Hz, which is the same frequency as the visual stimuli.

[0014] The method using SSVEP does not require long-term training. In addition, the method using SSVEP has a high ITR (Information Transfer Rate) (ITR is one of the main indicators of brain-computer interfaces). For these reasons, the method using SSVEP is attracting attention as a UI for people with disabilities.

[0015] SSVEP is easier to calibrate than image analysis approaches. Furthermore, SSVEP methods can accurately estimate the focused object among several options. Furthermore, SSVEP does not have the problem of camera resolution. SSVEP is robust to factors such as user distance, user posture, individual differences (e.g., pupil size, wearing glasses), and ambient light.

[0016] SSVEP has the advantages mentioned above, and it is applied to GUI operation. For example, the GUI is a button displayed on a display. SSVEP is also applied to GUI operation in VR (Virtual Reality). For example, a button is displayed in VR.

[0017] Techniques for manipulating GUIs using SSVEP can be used to manipulate objects arranged on a plane, such as an array of buttons, but such techniques do not assume objects arranged in space.

[0018] On the other hand, as IoT technology develops, various computing devices are used in many situations. Computing devices, such as IoT devices, are used in the real world. These devices are placed in "spaces" such as rooms. As mentioned above, methods for operating GUIs using SSVEP do not consider the application of SSVEP to "objects in space." Therefore, it is difficult to apply such methods to operating devices placed in space.

[0019] To solve the above problems, the presentation system according to the present disclosure performs one or more visual pattern presentation processes described below.

[0020] [2. Environment for visual pattern presentation] First, the environment for visual pattern presentation will be described with reference to FIG.

[0021] 1 is a block diagram of an example of an environment for visual pattern presentation, Environment 1. As shown in FIG. 1, Environment 1 includes a presentation system 100, a network 200, an electroencephalograph 300, multiple devices 400, multiple cameras 500, and multiple projectors 600.

[0022] The presentation system 100 is a system that performs a process for presenting a visual pattern. In this specification, such a process is referred to as a visual pattern presentation process. An overview of one visual pattern presentation process is provided in Section 3. Various visual pattern presentation processes are then described in detail in Section 5.

[0023] The presentation system 100 includes one or more computers, such as one or more servers. An example configuration of the presentation system 100 is described in Section 4.

[0024] The network 200 is a network such as a LAN (Local Area Network), a WAN (Wide Area Network), the Internet, etc. The network 200 connects the presentation system 100, the electroencephalograph 300, the device 400, the camera 500, and the projector 600.

[0025] The electroencephalograph 300 is an electroencephalograph used by a user. The electroencephalograph 300 is, for example, a non-invasive electroencephalograph. The electroencephalograph 300 is used to measure SSVEP.

[0026] The device 400 is a variety of computer devices used by a user. The device 400 is, for example, a home IoT device such as a light, an air conditioner, a television, etc. For example, the device 400 is placed in the user's room.

[0027] The camera 500 is a camera installed in a location related to the user. The location may be, for example, the user's room. The camera 500 may be installed near the device 400.

[0028] Projector 600 is a projector installed near device 400. For example, projector 600 is attached to the ceiling of the user's room.

[0029] [3. Overview of visual pattern presentation processing] An overview of one visual pattern presentation process will now be described with reference to Figure 2. Note that this overview is not intended to limit the invention or the embodiments described in the following sections.

[0030] 2 shows an overview of one visual pattern presentation process according to the present disclosure, Scheme 10. Scheme 10 compares current uses of SSVEP with uses of SSVEP according to the present disclosure.

[0031] As shown in Figure 2, SSVEP can be used to estimate which button among multiple buttons is currently being viewed. First, a stimulus pattern is presented on each button. For example, one button flashes at frequency A, and another button flashes at frequency B. In the example shown in Figure 2, the user is focusing on the button flashing at frequency B. An electroencephalograph measures the user's brain waves. Then, a power spectrum is obtained by taking the Fourier transform of the measured brain waves. The peak of the power spectrum corresponds to the SSVEP at frequency B. In other words, the SSVEP tells us which stimulus pattern the user is viewing.

[0032] As explained above, current applications of SSVEP include GUI manipulation on a display and GUI manipulation in VR. High display resolution allows users to accurately select densely arranged buttons. The number of realistic stimulus patterns is about 10.

[0033] On the other hand, an example of an application of SSVEP according to the present disclosure is the operation of IoT devices placed in a user's room. The presentation system 100 applies SSVEP to the operation / selection of devices in a space, such as IoT devices. The presentation system 100 presents a visual stimulus pattern where and when the visual stimulus pattern is needed. For example, when the user is facing a television, the presentation system 100 projects the visual stimulus pattern onto the television using the projector 600. In this way, the presentation system 100 enables the user to operate or select devices in the space.

[0034] 4. Presentation System Configuration Next, an example of the configuration of the presentation system 100 will be described with reference to FIG.

[0035] 3 is a block diagram of an example configuration of a presentation system 100 according to the present disclosure. As shown in FIG. 3, the presentation system 100 includes a communication unit 110, a control unit 120, and a storage unit 130. The presentation system 100 may include an input unit (e.g., a keyboard, a mouse) that receives input from an administrator of the presentation system 100. The presentation system 100 may also include an output unit (e.g., a liquid crystal display, an organic EL (Electro Luminescence) display) that displays information to the administrator.

[0036] (Communication unit 110) The communication unit 110 is implemented by a network device such as a network interface card (NIC). The communication unit 110 is connected to the network 200 by wire or wirelessly. The communication unit 110 can transmit and receive data to and from the electroencephalograph 300, the device 400, the camera 500, and the projector 600 via the network 200.

[0037] (control unit 120) The control unit 120 is implemented by a data processing device and various programs stored in a storage device. The data processing device is, for example, a processor such as a central processing unit (CPU), a micro processing unit (MPU), or a general purpose graphic processing unit (GPGPU). The control unit 120 may be implemented as a controller for controlling multiple operations of the presentation system 100. For example, when one or more processors execute a program (multiple instructions) by using a random access memory (RAM) as a working area, the one or more processors perform multiple operations.

[0038] (Storage unit 130) The storage unit 130 is implemented by a semiconductor memory such as a RAM or a flash memory, a magnetic disk such as a hard disk, or an optical disk. The storage unit 130 can store various programs and various data.

[0039] As shown in Fig. 3, the control unit 120 includes an acquisition unit 121, a determination unit 122, a presentation unit 123, a measurement unit 124, and an estimation unit 125. The acquisition unit 121 is an example of a first acquisition unit and a second acquisition unit. Data processing performed by each unit will be described below. Details of each unit will also be described below with reference to Fig. 4.

[0040] (Acquisition part 121) The acquisition unit 121 acquires device data related to the device 400. The device data indicates multiple devices that the user can operate. For example, the multiple devices are IoT devices in a specific environment (for example, the user's room). The acquisition unit 121 also acquires user data related to the user. For example, the user data is images or videos captured by the camera 500. The user data may indicate the user's position and facial orientation. The acquisition unit 121 can measure the user's line of sight (i.e., the range the user is looking at) based on the user data.

[0041] (Decision unit 122) The determination unit 122 determines devices within the user's field of view. Such devices are, for example, IoT devices in the user's line of sight. The determination unit 122 can determine multiple visual patterns corresponding to multiple devices, respectively, based on, for example, predetermined conditions (e.g., specific rules) stored in a repository in the storage unit 130.

[0042] (Presentation part 123) The presentation unit 123 presents a visual pattern on the device determined by the determination unit 122. For example, a plurality of different visual stimulation patterns are presented on an IoT device in the line of sight of the user.

[0043] (Measurement section 124) The measurement unit 124 measures the user's brain waves using the electroencephalograph 300. The measurement unit 124 can measure the SSVEP based on the user's brain waves.

[0044] (Estimation part 125) The estimation unit 125 estimates the device operated by the user based on data related to the user's electroencephalogram. For example, the estimation unit 125 identifies the device operated by the user based on SSVEP.

[0045] 3, the storage unit 130 includes device data 131. The device data 131 is various data related to the device 400. Details of the device data 131 will be described below with reference to FIG.

[0046] 4 illustrates a configuration 20 that is an example of the configuration of the control unit 120 and the storage unit 130 according to the present disclosure. As illustrated in FIG. 4, the configuration 20 includes a face direction acquisition unit 21, a user position acquisition unit 22, a shooting target determination unit 23, a visual stimulus presentation unit 24, an SSVEP measurement unit 25, a gaze target estimation unit 26, an environment map 27, and an equipment DB 28. The face direction acquisition unit 21 and the user position acquisition unit 22 are examples of the acquisition unit 121. The shooting target determination unit 23 is an example of the determination unit 122. The visual stimulus presentation unit 24 is an example of the presentation unit 123. The SSVEP measurement unit 25 is an example of the measurement unit 124. The gaze target estimation unit 26 is an example of the estimation unit 125. The environment map 27 and the equipment DB 28 are examples of equipment data 131.

[0047] The face direction acquisition unit 21 acquires the direction of the user's face. The direction is expressed using, for example, an azimuth angle.

[0048] The user position acquisition unit 22 acquires the user's position. The position is expressed using coordinates, for example.

[0049] The imaging target determination unit 23 determines the visual stimulation pattern to be projected and the device onto which the visual stimulation pattern is to be projected, based on the user's position, the orientation of the user's face, the environment map 27, and the device database 28. The imaging target determination unit 23 can acquire various visual stimulation patterns from a repository in the storage unit 130.

[0050] The visual stimulus presentation unit 24 presents a visual stimulus pattern. The visual stimulus presentation unit 24 can project the visual stimulus pattern using a projector 600.

[0051] The SSVEP measurement unit 25 measures SSVEP data. The SSVEP measurement unit 25 can measure the SSVEP data using the electroencephalograph 300.

[0052] The gaze target estimation unit 26 estimates an object that the user is gazing at. For example, the gaze target estimation unit 26 estimates a device that the user is gazing at based on the SSVEP data, the visual stimulus object, and the device on which the visual stimulus object is projected.

[0053] The environment map 27 shows the environment that the user is in. The environment map 27 may also show the positions of the camera 500 and the projector 600.

[0054] The device DB 28 is a database that stores data on the devices 400. The device DB 28 stores the device names of the devices 400. The device names are associated with the spatial positions of the devices.

[0055] [5. Details of visual pattern presentation processing] One visual pattern presentation process was outlined above with reference to Figure 2. Various visual pattern presentation processes are described in detail in this section.

[0056] [5-1. Examples of assignments] Figure 5 shows an example of a problem related to visual pattern presentation, problem 30. In the example of Figure 5, a system presents a visual pattern. Problem 30 is that the system deteriorates the estimation accuracy and analysis time of SSVEP.

[0057] As shown in FIG. 5, if SSVEP is applied to the selection of devices in a space, the system is required to constantly present visual stimulus patterns for all devices that can be selected. However, preparing a large number of visual stimulus patterns used in SSVEP has adverse effects on practical use, such as a decrease in estimation accuracy and an increase in analysis time. As described above, the number of stimulus patterns is usually around 10. Therefore, the presentation system 100 presents only the necessary number of visual stimulus patterns when they are needed.

[0058] [5-2. Presentation of visual stimulus patterns in real space] 6A and 6B collectively illustrate a visual pattern presentation process 40, which is an example of a visual pattern presentation process according to the present disclosure. In the visual pattern presentation process 40, the presentation system 100 presents a visual stimulation pattern based on the position and facial orientation of a user 41. The user 41 has devices 400a, 400b, 400c, 400d, and 400e in his or her room.

[0059] 6A, the acquisition unit 121 of the presentation system 100 estimates the position and face direction of the user 41 (42). For example, the acquisition unit 121 acquires the position and head direction of the user 41 using the camera 500.

[0060] The presentation unit 123 of the presentation system 100 presents (43) the visual stimulus pattern only for options (e.g., device 400a, device 400d) that exist in the direction that the user 41 is facing. For example, the presentation unit 123 projects the visual stimulus pattern onto the device 400 that is in that direction using the projector 600.

[0061] 6B , the acquisition unit 121 detects changes in the position and facial direction of the user 41 (44). Then, the acquisition unit 121 updates the position and facial direction of the user 41 (45). The presentation unit 123 updates the device 400 to be presented (46). In this way, when the user 41 turns his / her face toward the device 400 (e.g., device 400b, device 400e) that the user 41 wants to operate and then gazes at the visual stimulation pattern, the user 41 can select the device 400 that the user 41 wants to operate.

[0062] [5-3. Other implementation examples] The visual pattern presentation process according to the present disclosure may be applied to the selection and operation of a device in a VR space. In this case, the device in the VR space corresponds to the device 400 in Figures 6A and 6B. That is, the presentation system 100 may target not only devices in the real world but also devices in the VR world.

[0063] The camera 500 may be integrated with the electroencephalograph 300. In this case, the presentation system 100 (e.g., the acquisition unit 121) may identify the device the user is gazing at based on the image captured by the camera 500. Furthermore, the presentation system 100 (e.g., the presentation unit 123) may display the visual stimulation pattern on a screen provided in the device 400. The device 400 may be connected to the screen, for example.

[0064] 6. Flowchart of visual pattern presentation process Next, a flowchart of an example of a visual pattern presentation process will be described with reference to Fig. 7. The example of the visual pattern presentation process includes a process for determining a device to be a target of visual stimulus projection. The process for determining a device to be a target of visual stimulus projection is performed, for example, by the presentation system 100 of Fig. 1.

[0065] FIG. 7 is a flowchart showing process P100, which is an example of a process for determining a device to be targeted for visual stimulus projection.

[0066] In the example of Fig. 7, the environment map 27 and the device DB 28 described above with reference to Fig. 4 are prepared in advance. The environment map 27 has already been created, and the device DB 28 has already been registered.

[0067] The acquisition unit 121 acquires the position and face direction of the user (step S101). For example, the face direction acquisition unit 21 acquires the face direction, and the user position acquisition unit 22 acquires the position of the user.

[0068] The determination unit 122 determines multiple devices onto which visual stimuli are to be projected and their respective visual stimulus patterns (step S102). For example, the imaging target determination unit 23 determines the device 400 to be the target (target) for projection of the visual stimulus and its visual stimulus pattern based on the user's position, the user's face direction, the environment map 27, and the device database 28. The determined visual stimulus pattern is projected onto the determined device 400 by the presentation unit 123 (e.g., the visual stimulus presentation unit 24). Then, SSVEP data is measured by the measurement unit 124 (e.g., the SSVEP measurement unit 25).

[0069] The estimation unit 125 identifies the device being gazed at by the user from the determined plurality of devices based on the SSVEP data (step S103). For example, the gaze target estimation unit 26 estimates the device being gazed at by the user based on the SSVEP data and the projected visual stimulation pattern.

[0070] The acquisition unit 121 determines whether the user's position and facial direction have changed (step S104). If it is determined that the user's position and facial direction have changed (step S104: Yes), the acquisition unit 121 performs step S102 again. If it is determined that the user's position and facial direction have not changed (step S104: No), the estimation unit 125 performs step S103 again.

[0071] [7. Effects] The presentation system 100 can use a projector to project a visual stimulus pattern that enables visual manipulation of options in space (e.g., the device 400). Because the presentation system 100 projects the visual stimulus pattern when it is needed, the presentation system 100 can also reduce the impact on the estimation accuracy and analysis time of the SSVEP.

[0072] [8. Hardware Configuration] 8 is a diagram showing an example of a computer hardware configuration, ie, a computer 1000. The systems and methods described in this specification are implemented by the computer 1000, for example.

[0073] Computer 1000 is an example of a computer that implements presentation system 100 by executing a program. Computer 1000 includes memory 1010 and a CPU 1020. Computer 1000 also includes a hard disk drive interface 1030, a disk drive interface 1040, a serial port interface 1050, a video adapter 1060, and a network interface 1070. These components are connected by a bus 1080.

[0074] The memory 1010 includes a ROM (Read Only Memory) 1011 and a RAM 1012. The ROM 1011 stores, for example, a boot program such as a BIOS (Basic Input Output System). The hard disk drive interface 1030 is connected to a hard disk drive 1090. The disk drive interface 1040 is connected to a disk drive 1100. A removable storage medium (for example, a magnetic disk or an optical disk) can be inserted into the disk drive 1100. The serial port interface 1050 is connected to, for example, a mouse 1110 and a keyboard 1120. The video adapter 1060 is connected to, for example, a display 1130.

[0075] The hard disk drive 1090 stores an OS 1091, an application program 1092, a program module 1093, and program data 1094. The programs executed by the computer 1000 define multiple operations of the presentation system 100. These programs may be implemented as program modules 1093 written in code executable by the computer 1000. The program modules 1093 are stored in, for example, the hard disk drive 1090. For example, the hard disk drive 1090 stores the program modules 1093 for executing processes similar to the functions of the components of the presentation system 100. The hard disk drive 1090 may be replaced with an SSD (Solid State Drive).

[0076] The hard disk drive 1090 can store a presentation program for visual pattern presentation processing. The hard disk drive 1090 may store a computer program product including a presentation program (a plurality of instructions). When executed, the presentation program performs one or more methods, such as those described above.

[0077] The setting data used in the various processes described above may be implemented as program data 1094. The setting data is stored in, for example, the memory 1010 or the hard disk drive 1090. The CPU 1020 loads the program module 1093 or the program data 1094 stored in the memory 1010 or the hard disk drive 1090 into the RAM 1012 as needed. Then, the CPU 1020 performs the various processes described above.

[0078] The program module 1093 and the program data 1094 may be stored in a removable storage medium instead of the hard disk drive 1090. The CPU 1020 may load the program module 1093 and the program data 1094 via the disk drive 1100 or the like. Alternatively, the program module 1093 and the program data 1094 may be stored in another computer connected to the computer 1000 via a network (such as a LAN or WAN). In this case, the CPU 1020 may load the program module 1093 and the program data 1094 via the network interface 1070.

[0079] 9. Summary of Embodiments As described above, the presentation system 100 includes an acquisition unit 121, a determination unit 122, and a presentation unit 123. In at least one embodiment, the acquisition unit 121 acquires device data indicating a plurality of devices that the user can operate. Then, the acquisition unit 121 acquires user data that specifies the user's field of view. In at least one embodiment, the determination unit 122 determines, from the plurality of devices, a device that is within the user's field of view, using the device data and the user data. In at least one embodiment, the presentation unit 123 presents, on the device determined by the determination unit 122, a visual pattern that enables the user's brain waves to operate the determined device.

[0080] In some embodiments, the determination unit 122 determines, from the plurality of devices, a plurality of devices within the user's field of view, and determines a plurality of visual patterns corresponding to the plurality of devices, each visual pattern enabling the user's brain waves to operate the corresponding device. In some embodiments, the presentation unit 123 presents each visual pattern on the corresponding device.

[0081] In some embodiments, the presentation unit 123 projects a visual pattern onto the device determined by the determination unit 122 using a projector located near the device determined by the determination unit 122.

[0082] In some embodiments, the acquisition unit 121 acquires, as the device data, the positions of multiple devices that can be operated by the user.

[0083] In some embodiments, the acquisition unit 121 acquires the user's position and the direction of the user's face as the user data.

[0084] In some embodiments, the acquisition unit 121 acquires the user's position and the direction of the user's face using a camera installed at a specific location associated with the user.

[0085] [10. Addendum] Finally, the above description is supplemented with other embodiments. Various embodiments have been described above with reference to the drawings. These embodiments are exemplary, and the above description is not intended to limit the present disclosure to these embodiments. The features described in this specification can be implemented in various ways, including modifications and improvements based on the knowledge of those skilled in the art.

[0086] (various variations) In this specification, some processes have been described as being performed automatically. Some of these processes may be performed manually. Some other processes have been described as being performed manually. All or part of these other processes may be performed automatically using known methods.

[0087] Various implementations of the presentation system 100 are described herein or illustrated in the drawings. Some implementations relate to information including various data, data processing procedures, specific names, or parameters. Such implementations may be arbitrarily modified unless otherwise specified. For example, the various data are not limited to the data illustrated in the drawings.

[0088] Components of the system are shown in the drawings. The illustrated components conceptually illustrate the functions of the system. The components are not necessarily physically configured as shown in the drawings. The components may be integrated or distributed, and the specific form of the system is not limited to the illustrated form. All or part of the system may be functionally or physically integrated or distributed depending on various loads and usage conditions.

[0089] (Terms that represent components) The term "module," "section," "-er suffix," or "-or suffix" can be read as "unit," "means," "circuit," etc. For example, a communication module, a control module, and a storage module can be read as a communication unit, a control unit, and a storage unit, respectively.

[0090] (Configuration of control unit) The configuration of control unit 120 shown in Fig. 3 is exemplary, and data processing described with respect to a particular unit may not necessarily be performed by that particular unit. For example, presentation unit 123 may perform the data processing described with respect to determination unit 122. Furthermore, control unit 120 may include other units not shown in Fig. 3. The other units may perform the data processing described with respect to control unit 120.

[0091] (Data Processing Device) The data processing device described for the control unit 120 is not limited to the specific hardware described above, and may be, for example, various types of computers or integrated circuits such as an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or a GPGPU (General Purpose Graphic Processing Unit). [Explanation of symbols]

[0092] 1 Environment 100 Presentation System 110 Communications Department 120 control section 121 Acquisition Department 122 Decision Section 123 Presentation section 124 Measurement Unit 125 Estimation part 130 Storage section 131 Equipment Data 200 Network 300 Electroencephalograph 400 equipment 500 cameras 600 projector

Claims

1. a first acquisition unit that acquires device data indicating a plurality of devices that can be operated by a user; a second acquisition unit that acquires the position of the user and the direction of the user's face; a determination unit that determines, from the plurality of devices, a device that is within the user's field of view using the device data, the user's position, and the user's face direction; a presentation unit that projects, on the device determined by the determination unit, a visual pattern that enables the user's brain waves to operate the device, using a projector located near the device determined by the determination unit; and a detection unit that detects changes in the position and the orientation of the face of the user; an update unit that updates the position and the face direction of the user; A presentation system comprising:

2. the determination unit determines, from the plurality of devices, a plurality of devices that are within the field of view of the user, and determines a plurality of visual patterns that respectively correspond to the plurality of devices, each of which enables the user's brain waves to operate a corresponding device; The presentation unit presents each of the visual patterns on the corresponding device. The presentation system of claim 1 .

3. The first acquisition unit acquires, as the device data, positions of the plurality of devices that can be operated by the user. The presentation system of claim 1 .

4. The second acquisition unit acquires the position of the user and the direction of the user's face using a camera installed in a specific location associated with the user. The presentation system of claim 1 .

5. 1. A computer-implemented presentation method comprising: a first acquisition step of acquiring device data indicating a plurality of devices that can be operated by the user; a second acquisition step of acquiring the position of the user and the direction of the user's face; a determining step of determining, from the plurality of devices, a device within the user's field of view using the device data, the user's position, and the user's face direction; a presentation step of projecting, onto the device determined by the determination step, a visual pattern that enables the user's brain waves to operate the device, using a projector located near the device determined by the determination step; a detecting step of detecting a change in the position and face orientation of the user; updating the position and facial orientation of the user; Presentation methods including.

6. A presentation program for causing a computer to function as the presentation system according to any one of claims 1 to 4.

Images