Information processing system, information processing method, and program

Abstract

To provide an information processing system capable of providing a user with information on appropriate services (concentration, relaxation, sleep, etc.) according to vital data on the user.SOLUTION: An information processing system 1000 includes at least one or more control parts. The control part acquires vital data on a user. The vital data includes any one or more pieces of data of a pulse of the user, a body temperature of the user, and a respiratory rate of the user. The control part performs control to output information on a service recommended to the user of the plurality of services that can be provided to the user on the basis of the vital data. The plurality of services includes at least two or more services of a service for enabling the user to get into a concentrated state, a service for enabling the user to get into a relaxation state, and a service for enabling the user to get into a sleeping state.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to an information processing system, an information processing method, and a program.

Background Art

[0002] Patent Document 1 discloses a meditation assistance device and a meditation assistance system.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] There is a desire to provide information on appropriate services (such as relaxation, sleep, etc.) for the user according to the user's vital data. Patent Document 1 cannot meet such a desire.

Means for Solving the Problems

[0005] According to one aspect of the present invention, an information processing system is provided. This information processing system has at least one or more control units. The control unit acquires the user's vital data. The vital data includes any one or more of the user's pulse, the user's body temperature, and the user's respiration rate. It controls to output information about the recommended service for the user among the plurality of services that can be provided to the user based on the vital data. The plurality of services includes any two or more of the service for the user to enter a concentrated state, the service for the user to enter a relaxation state, and the service for the user to enter a sleep state.

Brief Description of the Drawings

[0006]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

DETAILED DESCRIPTION OF THE INVENTION

[0007] Hereinafter, embodiments of the present invention will be described with reference to the drawings. Various characteristic matters shown in the following embodiments (including modifications. The same applies hereinafter.) can be combined with each other.

[0008] In this specification, the "unit" may include, for example, hardware resources implemented by a circuit in a broad sense and information processing of software that can be specifically realized by these hardware resources. Further, in Embodiment 1, various types of information are handled. These pieces of information are represented by the high and low levels of signal values as a set of binary bits composed of 0 or 1, and communication and calculation can be executed on a circuit in a broad sense.

[0009] Further, the circuit in a broad sense is a circuit realized by appropriately combining at least a circuit, circuitry, a processor, a memory, etc. That is, it includes an application specific integrated circuit (ASIC), programmable logic devices (for example, a simple programmable logic device (SPLD), a complex programmable logic device (CPLD), and a field programmable gate array (FPGA)), etc.

[0010] <Embodiment 1> 1. System Configuration FIG. 1 is a diagram showing an example of the system configuration of the information processing system 1000. The information processing system 1000 includes, as a system configuration, a capsule 110, an information processing device 100, a mixed reality headset type device 130, and a chair 140. The chair 140 is an example of a chair. The capsule 110 is a dome-shaped capsule, and the chair 140 is installed inside. The capsule 110 is provided with an air conditioner 160 or the like that adjusts the temperature and humidity inside the capsule 110 based on a control signal or the like from the information processing device 100.

[0011] Chair 140 is a chair on which user 120 can sit, and is a chair capable of changing the inclination of the backrest and / or the headrest based on a control signal or the like from information processing device 100. The mixed reality headset type device 130 is a device worn by user 120. Assume that user 120 wears the mixed reality headset type device 130 and sits on chair 140 inside capsule 110. Information processing device 100 performs wireless communication with the mixed reality headset type device 130 and executes the information processing of Embodiment 1 described later. Examples of information processing device 100 include a server device or a PC (Personal Computer), etc. However, this does not limit Embodiment 1. Information processing device 100 may be any device as long as it can execute the information processing shown below. Information processing device 100 may be inside capsule 110 or outside capsule 110.

[0012] The mixed reality headset type device 130 is a goggle-type wearable device, and displays a real space, a virtual space, a space in which the real space and the virtual space are fused, etc. on the display according to the operation mode. The mixed reality headset type device 130 has a plurality of cameras, sensors, and microphones.

[0013] Here, the information processing system described in the claims may be composed of a plurality of devices or may be composed of one device. When the information processing system described in the claims is composed of one device, an example of that device is information processing device 100. When the information processing system described in the claims is composed of a plurality of devices, an example of the plurality of devices is information processing device 100 and the mixed reality headset type device 130.

[0014] 2. Hardware Configuration (1) Hardware Configuration of Information Processing Device 100 Figure 2 is a diagram showing an example of the hardware configuration of information processing device 100. The information processing apparatus 100 includes, as its hardware configuration, a control unit 210, a storage unit 220, and a communication unit 230. The control unit 210 is a CPU (Central Processing Unit) or the like, and controls the entire information processing apparatus 100.

[0015] The storage unit 220 is any one of an HDD (Hard Disk Drive), a ROM (Read Only Memory), a RAM (Random Access Memory), an SSD (Solid Sate Drive), or any combination thereof, and stores programs and data used when the control unit 210 executes processing based on the programs. The storage unit 220 is an example of a storage medium. In the specification, data used when the control unit 210 executes processing based on a program (for example, vital data of the measured user 120, a learned model, data to be displayed on the mixed reality headset type device 130, or an image, etc.) is described as being stored in the storage unit 220, but it may be stored in the storage unit of another device that can communicate with the mixed reality headset type device 130. That is, the data may be stored in the storage unit of any device as long as the control unit 210 can refer to and acquire it. By the control unit 210 reading out the program stored in the storage unit 220 and executing processing based on the read program, the functions of the information processing apparatus 100 and the information processing of the flowcharts shown in FIGS. 4, 7, and 8 described later are realized.

[0016] The communication unit 230 connects the information processing apparatus 100 to the Internet and controls communication with other devices. For example, the communication unit 230 performs wireless communication with the mixed reality headset type device 130 and the air conditioner 160, etc.

[0017] (2) Hardware configuration of the mixed reality headset type device 130 FIG. 3 is a diagram showing an example of the hardware configuration of the mixed reality headset type device 130. The composite reality headset-type device 130 includes, as a hardware configuration, a control unit 310, a storage unit 320, an imaging unit 330, a display unit 340, a communication unit 350, a gyro sensor 360, an acceleration sensor 370, and a vital sensor 380.

[0018] The control unit 310 is a CPU or the like, and controls the entire composite reality headset-type device 130.

[0019] The storage unit 320 is any one of an HDD, a ROM, a RAM, an SSD, or the like, or any combination thereof, and stores programs and data used when the control unit 310 executes processing based on the programs. The storage unit 320 is an example of a storage medium. In the specification, although it is described that the data used when the control unit 310 executes processing based on the program is stored in the storage unit 320, it may be stored in the storage unit of another device communicable with the composite reality headset-type device 130. That is, the data may be stored in the storage unit of any device as long as the control unit 310 can refer to and acquire it. The control unit 310 reads out the program stored in the storage unit 320 and executes processing based on the program, thereby realizing the functions of the composite reality headset-type device 130.

[0020] The imaging unit 330 is a camera and images a subject. The imaging unit 330 is composed of a plurality of cameras. A part of the plurality of cameras images the outside of the composite reality headset-type device 130, and a part of the plurality of cameras images the inside of the composite reality headset-type device 130. The cameras that image the outside are used to three-dimensionally capture the environment around the user 120. The cameras that image the inside are used for eye tracking of the user 120 and user authentication.

[0021] The display unit 340 is a display or the like, and displays a three-dimensional virtual space image generated by the control unit 310 according to the operation mode, an external captured image captured by the camera that images the outside, and the like. The communication unit 350 connects the mixed reality headset-type device 130 to a network and controls communication with other devices. For example, the communication unit 350 performs wireless communication with the mixed reality headset-type device 130 and the like.

[0022] The gyro sensor 360 is a sensor that detects changes in the rotation and orientation of the mixed reality headset-type device 130 as angular velocity and outputs an electrical signal to the control unit 310 and the like. The acceleration sensor 370 is a sensor that detects inertial force generated when the moving speed of the mixed reality headset-type device 130 changes and outputs an electrical signal as acceleration to the control unit 310 and the like.

[0023] The vital sensor 380 acquires vital data of the user 120 wearing the mixed reality headset-type device 130. Vital data is data obtained by digitizing indicators indicating that a human is alive. The vital data includes any one or more of the pulse of the user 120, the body temperature of the user 120, and the respiratory rate of the user 120. The vital sensor 380 may be a contact-type sensor or a non-contact-type sensor. Or the vital sensor 380 may be a contact-type sensor and a non-contact-type sensor.

[0024] 3. Information Processing Hereinafter, the information processing of Embodiment 1 will be described. (Overview of Processing) The control unit 210 acquires the vital data of the user 120. The control unit 210 controls to output information about a service recommended for the user 120 among a plurality of services that can be provided to the user 120 based on the vital data of the user 120. The plurality of services includes any two or more of a service for the user 120 to enter a concentrated state, a service for the user 120 to enter a relaxation state, and a service for the user 120 to enter a sleep state.

[0025] According to such processing, it is possible to provide the user 120 with information on appropriate services from among a plurality of services according to the vital data of the user 120. The user 120 can consider the presented service information, select a desired service from among the plurality of services, and receive the service.

[0026] (Details of the processing) FIG. 4 is a flowchart showing an example of information processing in the information processing apparatus 100. In step S410, the control unit 210 acquires the vital data of the user 120 sitting on the chair 140 in the capsule 110 from the composite reality headset type device 130. In Embodiment 1, for the sake of simplicity of explanation, it is described that the vital data includes the pulse of the user 120, the body temperature of the user 120, and the respiration rate of the user 120.

[0027] In step S420, the control unit 210 acquires information about the services recommended for the user 120 among the plurality of services that can be provided to the user 120 based on the vital data. More preferably, the control unit 210 estimates the physical condition of the user 120 based on the vital data. The control unit 210 acquires information about the services recommended for the user 120 among the plurality of services that can be provided to the user 120 based on the physical condition of the user 120. More specifically, the control unit 210 inputs the vital data as input data into the learned model. The learned model is a learned model that is learned with human vital data as input data and human physical condition as output data. The control unit 210 acquires information about the services recommended for the user 120 based on the physical condition of the user 120 output from the learned model.

[0028] In step S430, the control unit 210 outputs information about the recommended service acquired in step S420. More specifically, the control unit 210 controls to output information about the recommended service for the user 120 to the display unit 340 of the mixed reality headset type device 130 worn by the user 120. More preferably, the control unit 210 controls to output information about a plurality of services that can be provided to the user 120 and information about the service recommended for the user 120 among the plurality of services to the display unit 340 of the mixed reality headset type device 130 worn by the user 120. The control unit 210 controls to output the information about the service recommended for the user 120 among the information about the plurality of services in a manner distinguishable from the information about other services.

[0029] FIG. 5 is a diagram showing an example of a three-dimensional virtual space image displayed on the display unit 340 of the mixed reality headset type device 130. In the three-dimensional virtual space image 500, a service guide plate 510, a service guide plate 520, and a service guide plate 530 are displayed. Each guide plate is a virtual image. The service guide plate 510 is a guide plate for guiding a service for entering the zone state. The zone state is an example of the concentrated state. The service guide plate 520 is a guide plate for guiding a service for entering the relaxation state. The service guide plate 530 is a guide plate for guiding a service for entering the sleep state. Note that the services are examples, and other services may be included.

[0030] In the example of FIG. 5, the service guide plate 520 is highlighted compared to the other guide plates (the service guide plate 510 and the service guide plate 530). In the example of FIG. 5, as an example of the highlighting, the frame line of the guide plate is a thick line and the guide plate is filled with a predetermined pattern. Note that these highlightings are examples, and any manner may be used as long as the control unit 210 can distinguish the service promoted to the user 120 from other services. For example, a mark indicating a recommendation may be attached and displayed on the guide plate corresponding to the service, or a string such as "Recommended!" may be attached and displayed.

[0031] In step S440, the control unit 210 acquires imaging data including the hand of the user 120 within the imaging range from the composite reality headset type device 130. The control unit 210 accepts an input based on the gesture of the hand of the user 120 included in the imaging data. More specifically described, the control unit 210 receives the imaging data from the composite reality headset type device 130, and accepts the input of the user 120 regarding the selection of the service based on the gesture of the hand of the user 120 included in the imaging data.

[0032] Preferably, the control unit 210 accepts the input of the user 120 regarding the selection of the service based on the line of sight of the user 120 and the gesture of the user 120. That is, the control unit 210 determines whether the user 120 has selected one service (one service guide plate) out of a plurality of services (a plurality of service guide plates) based on the information on the line of sight of the user 120 imaged by the camera that images the inside of the composite reality headset type device 130 and the information on the gesture of the user 120 imaged by the camera that images the outside of the composite reality headset type device 130. For example, the control unit 210 determines that the user 120 has selected one service (one service guide plate) out of a plurality of services (a plurality of service guide plates) when the following conditions are satisfied. The conditions are, for example, that the viewpoint (point 540 in FIG. 5) of the user 120 in the three-dimensional virtual space is on one of the plurality of guide plates in the three-dimensional virtual space based on the information on the line of sight of the user 120, and that the finger or hand (object 550 in FIG. 5) of the user 120 in the three-dimensional virtual space has selected the same guide plate as the guide plate where the viewpoint is located based on the information on the gesture of the user 120.

[0033] The process of step S440 is an example of a process in which the control unit 210 determines whether one service out of a plurality of services has been selected based on the input of the user 120. The line of sight and / or the gesture is an example of the input of the user 120. When the control unit 210 determines that a selection operation has been performed, it advances the process to step S450. When the control unit 210 determines that no selection operation has been performed, it returns the process to step S430.

[0034] In step S450, the control unit 210 acquires information on the service selected by the user 120 based on the input of the user 120. In the example of FIG. 5, the control unit 210 acquires information for identifying a service for entering the sleep state as the information on the service selected by the user 120.

[0035] In step S460, the control unit 210 transmits a control signal corresponding to the selected service to the mixed reality headset type device 130 and the air conditioner 160. For example, a setting file in which the set temperature in the capsule 110, the image in the three-dimensional virtual space displayed on the mixed reality headset type device 130, the type of music output from the mixed reality headset type device 130, etc. are set according to the service is stored in the storage unit 220 or the like. The control unit 210 generates a control signal based on the service information acquired in step S450 and the above-described information (set temperature, image, music type) corresponding to the service described in the setting file, and transmits it to the mixed reality headset type device 130 and the air conditioner 160. Note that the set temperature for each season is described in the setting file, and the control unit 210 may determine the season from the date information and acquire the set temperature information corresponding to the season from the setting file.

[0036] For example, if a service to enter the sleep state is selected as the service and the season is winter, the control unit 210 selects, from the setting file, the set temperature of the air conditioner 160 to be 18 degrees, natural sounds such as the sound of rustling leaves in the forest as the type of music output from the composite reality headset type device 130, and an image of the starry sky as the image in the three-dimensional virtual space displayed on the composite reality headset type device 130. Then, the control unit 210 generates a control signal for instructing to set the temperature to 18 degrees, transmits it to the air conditioner 160, generates a control signal for instructing to output natural sounds, transmits it to the composite reality headset type device 130, generates a control signal for instructing to display an image of the starry sky in the three-dimensional virtual space, and transmits it to the composite reality headset type device 130. FIG. 6 is a diagram showing an example of a three-dimensional virtual space image displayed on the display unit 340 of the composite reality headset type device 130 when a service to enter the sleep state is selected.

[0037] The process of step S460 is an example of a process in which the control unit 210 controls the execution of a process related to the selected service. The process related to the service includes any one or more of a process of controlling the environment inside the capsule according to the service, a process of controlling the image display on the display unit of the mixed reality headset type device worn by the user 120 according to the service, and a process of controlling the audio output from the output unit of the mixed reality headset type device according to the service. Examples of the process of controlling the environment inside the capsule according to the service include a process of controlling the temperature inside the capsule and a process of controlling the humidity inside the capsule. Also, when a speaker is installed inside the capsule and sound is delivered to the user 120 by the speaker, the example of the process of controlling the environment inside the capsule according to the service includes a process of controlling the audio output from the speaker. Further, when an aroma cartridge is installed inside the capsule, the example of the process of controlling the environment inside the capsule according to the service may include a process of controlling the type of scent provided from the aroma cartridge. Also, when a device for irradiating light is installed inside the capsule, the example of the process of controlling the environment inside the capsule according to the service may include a process of controlling the type or intensity of the light irradiated by the device.

[0038] In step S470, the control unit 210 determines whether to end the process of the flowchart shown in FIG. 4. For example, when the control unit 210 detects a predetermined gesture by the user 120, it determines to end the process of the flowchart. When the control unit 210 determines to end the process of the flowchart shown in FIG. 4, it ends the process. When it determines not to end the process of the flowchart shown in FIG. 4, it returns the process to step S410.

[0039] According to the process of Embodiment 1, it is possible to provide the user 120 with information on an appropriate service from among a plurality of services according to the vital data of the user 120. The user 120 can consider the presented service information, select a desired service from among the plurality of services, and receive the service.

[0040] (Modification Example 1) A modification example 1 of Embodiment 1 will be described. The modification example 1 will describe the points different from Embodiment 1. The modification example 1 is not an embodiment different from Embodiment 1 but is included in Embodiment 1. The vital data of the modification example 1 includes at least any one or more of the pulse of the user 120, the body temperature of the user 120, the respiratory rate of the user 120, and the blood glucose level of the user 120. The composite reality headset type device 130 of the modification example 1 measures the blood glucose level of the user 120 non-invasively using near-infrared light (wavelength 800 to 2500 nm).

[0041] The control unit 210 of the modification example 1 may perform processing on the assumption that the vital data includes the pulse of the user 120, the body temperature of the user 120, the respiratory rate of the user 120, and the blood glucose level of the user 120.

[0042] According to the modification example 1, it is possible to estimate the physical condition of the user 120 in consideration of the blood glucose level of the user 120.

[0043] (Modification Example 2) A modification example 2 of Embodiment 1 will be described. The modification example 2 will describe the points different from Embodiment 1. The modification example 2 is not an embodiment different from Embodiment 1 but is included in Embodiment 1.

[0044] FIG. 7 is a flowchart showing an example of information processing in the information processing apparatus 100 of the modification example 2. The flowchart of FIG. 7 has the process of step S710 added compared to the flowchart of FIG. 4 of Embodiment 1, and in relation to the addition of the process of step S710, the process of step S420 is replaced with the process of step S720.

[0045] In step S710, the control unit 210 of the modification example 2 acquires a stress value which is a value indicating the degree of stress of the user 120. FIG. 8 is a flowchart showing an example of the process of step S710. In step S810, the control unit 210 displays a combination of a painting image of a first category and a painting image of a second category different from the first category in a three-dimensional virtual space image. The painting image of the first category is, for example, an image of a painting drawn by a non-depressed person. The painting image of the second category is, for example, an image of a painting drawn by a depressed person. Statistically, the painting images selected by people with a stress level equal to or higher than a predetermined value may be classified into the first category, and the painting images selected by people with a stress level lower than the predetermined value may be classified into the first category.

[0046] In step S820, the control unit 210 obtains the position of the user 120's line of sight based on the tracking information of the user 120's eyes extracted from the captured image inside the composite reality headset type device 130. The control unit 210 determines which of the painting image of the first category and the painting image of the second category has more of the line of sight positions, and stores the obtained result in a predetermined storage area such as the storage unit 220.

[0047] In step S830, the control unit 210 determines whether the processes of step S810 and step S820 have been executed a predetermined number of times. When the control unit 210 determines that the processes of step S810 and step S820 have been executed a predetermined number of times, the process proceeds to step S840. When the control unit 210 determines that the processes of step S810 and step S820 have not been executed a predetermined number of times, the process returns to step S810, and a combination of a next painting image of the first category and a painting image of a second category different from the first category is displayed in the three-dimensional virtual space image. The predetermined number of times is, for example, 5 times or the like. However, this does not limit Modification Example 2. The information on the predetermined number of times may be described in a predetermined file such as the storage unit 220.

[0048] The process of executing the processes of step S810 and step S820 a predetermined number of times is an example of a process of controlling to display a virtual space image on the display unit of the mixed reality headset type device worn by user 120, and sequentially displaying combinations of a picture image of a first category and a picture image of a second category different from the first category in the virtual space image.

[0049] FIG. 9 is a diagram showing an example in which sets of combinations of a picture image of a first category and a picture image of a second category displayed in a three-dimensional virtual space image are sequentially displayed. Image 910 is a three-dimensional virtual space image. A picture image 911 and a picture image 912 are displayed in image 910. The picture image 911 is a picture image of a first category. The picture image 912 is a picture image of a second category. Both picture images are landscape paintings. For example, the picture image 911 and the picture image 912 are displayed by the processing of the first step S810 by the control unit 210. The control unit 210 determines which of the picture image 911 and the picture image 912 has more of the user 120's line-of-sight positions, and stores the obtained result in a predetermined storage area such as the storage unit 220.

[0050] Image 920 is a three-dimensional virtual space image. After a predetermined time has elapsed since image 910 was displayed, image 920 is displayed. A picture image 921 and a picture image 922 are displayed in image 920. The picture image 921 is a picture image of a second category. The picture image 922 is a picture image of a first category. For example, the picture image 921 and the picture image 922 are displayed by the processing of the second step S810 by the control unit 210. The control unit 210 determines which of the picture image 921 and the picture image 922 has more of the user 120's line-of-sight positions, and stores the obtained result in a predetermined storage area such as the storage unit 220.

[0051] The image 930 is a three-dimensional virtual space image. After a predetermined time has elapsed since the image 920 was displayed, the image 930 is displayed. The image 930 shows a painting image 931 and a painting image 932. The painting image 931 is a painting image of the first category. The painting image 932 is a painting image of the second category. For example, the painting image 931 and the painting image 932 are displayed by the processing of the third step S810 by the control unit 210. The control unit 210 determines which of the painting image 931 and the painting image 932 the position of the user 120's line of sight is more on, and stores the obtained result in a predetermined storage area such as the storage unit 220.

[0052] In step S840, the control unit 210 obtains a stress value based on the information in a predetermined storage area such as the storage unit 220 regarding which of the painting image of the first category and the painting image of the second category in each set of painting images was looked at more. The stress value is a value indicating the degree of stress of the user 120. For example, the control unit 210 obtains the stress value of the user 120 based on the information on the number of times of which of the painting image of the first category and the painting image of the second category was looked at more and the reference information. The reference information is information in which the information on the number of times of which of the painting image of the first category and the painting image of the second category was looked at more and the stress value are associated and stored in the storage unit 220 etc. The process of step S840 is an example of a process of obtaining a value indicating the degree of stress of the user 120 based on the information on the position of the user 120's line of sight regarding the painting image of the first category and the painting image of the second category that are sequentially displayed.

[0053] Here, as another example of obtaining the stress value, the control unit 210 inputs the information on the position of the line of sight of the user 120 obtained in step S820 into the learned model. The learned model is a learned model that has been learned with information on the position of the user's line of sight regarding the picture images of the first category and the picture images of the second category as input data and a value indicating the degree of stress as output data. The control unit 210 obtains the stress value of the user 120 by obtaining data indicating the degree of stress from the learned model.

[0054] In step S720 of FIG. 7, information on the services recommended for the user 120 among the plurality of services that can be provided to the user 120 based on the vital data and the stress value is obtained. More preferably, the control unit 210 estimates the physical condition of the user 120 based on the vital data and the stress value. The control unit 210 obtains information on the services recommended for the user 120 among the plurality of services that can be provided to the user 120 based on the physical condition of the user 120. More specifically, the control unit 210 inputs the vital data and the stress value as input data into the learned model. The learned model is a learned model that has been learned with the vital data and the stress value of a person as input data and the physical condition of the person as output data. The control unit 210 obtains information on the services recommended for the user 120 based on the physical condition of the user 120 output from the learned model.

[0055] According to Modification 2, in addition to the vital data of the user 120, information on the services recommended for the user 120 among the plurality of services that can be provided to the user 120 considering the stress value can be obtained and presented to the user 120.

[0056] <Appendix> The invention may be provided in each of the following aspects.

[0057] (1) An information processing system having at least one or more control units, wherein the control unit acquires vital data of a user, and the vital data includes any one or more of the user's pulse, the user's body temperature, and the user's respiration rate, and controls to output information about a service recommended to the user among a plurality of services that can be provided to the user based on the vital data, and the plurality of services include any two or more of a service for the user to enter a concentrated state, a service for the user to enter a relaxation state, and a service for the user to enter a sleep state. Information processing system.

[0058] (2) In the information processing system according to (1) above, the control unit acquires the vital data of the user sitting on the chair inside the capsule. Information processing system.

[0059] (3) In the information processing system according to (1) or (2) above, the control unit acquires a value indicating the degree of stress of the user, and controls to output information about a service recommended to the user among a plurality of services that can be provided to the user based on the vital data and the value indicating the degree of stress of the user. Information processing system.

[0060] (4) In the information processing system according to (3) above, the control unit controls to display a virtual space image on the display unit of the composite reality headset-type device worn by the user, and sequentially displays a combination of a picture image of a first category and a picture image of a second category different from the first category in the virtual space image, and based on the information on the position of the user's line of sight with respect to the sequentially displayed picture image of the first category and the picture image of the second category, acquires a value indicating the degree of stress of the user. Information processing system.

[0061] (5) In the information processing system according to (4) above, information on the position of the user's line of sight is input into a learned model, and the learned model is a learned model that has been learned with information on the position of the user's line of sight regarding the picture image of the first category and the picture image of the second category as input data and a value indicating the degree of stress as output data, and a value indicating the degree of stress is obtained from the learned model. An information processing system.

[0062] (6) In the information processing system according to any one of (1) to (5) above, the control unit controls to output information about a service recommended for the user to a display unit of the composite reality headset-type device worn by the user. An information processing system.

[0063] (7) In the information processing system according to any one of (1) to (6) above, the control unit controls to output information on a plurality of services that can be provided to the user and information on a service recommended for the user. An information processing system.

[0064] (8) In the information processing system according to (7) above, the control unit controls to output information about a service recommended for the user among the information on the plurality of services in a distinguishable manner from the information on other services. An information processing system.

[0065] (9) In the information processing system according to any one of (1) to (8) above, the vital data includes at least any one or more of the user's pulse, the user's body temperature, the user's respiratory rate, and the user's blood glucose level. An information processing system.

[0066] (10) In the information processing system according to any one of (1) to (9) above, the control unit estimates the user's physical condition based on the vital data and outputs information about a service recommended for the user based on the user's physical condition. An information processing system.

[0067] (11) In the information processing system according to (10) above, the control unit inputs the vital data as input data into a learned model, and the learned model is a learned model that has been learned with human vital data as input data and the physical condition of a person as output data, and outputs information about recommended services for the user based on the physical condition of the user output from the learned model. An information processing system.

[0068] (12) In the information processing system according to any one of (1) to (11) above, the control unit selects one of the plurality of services based on a user input, and controls to execute processing related to the selected service. An information processing system.

[0069] (13) In the information processing system according to (12) above, the processing related to the service includes any one or more of processing for controlling the environment inside the capsule according to the service, processing for controlling image display on a display unit of the mixed reality headset-type device worn by the user according to the service, and processing for controlling audio output from an output unit of the mixed reality headset-type device according to the service. An information processing system.

[0070] (14) In the information processing system according to (12) or (13) above, the control unit acquires imaging data including the user's hand in the imaging range, and accepts the input based on the gesture of the hand included in the imaging data. An information processing system.

[0071] (15) An information processing method, which acquires a user's vital data, wherein the vital data includes any one or more of the user's pulse, the user's body temperature, and the user's respiratory rate, and controls to output information about a service recommended for the user among a plurality of services that can be provided to the user based on the vital data, and the plurality of services includes any two or more of a service for the user to enter a concentrated state, a service for the user to enter a relaxation state, and a service for the user to enter a sleep state.

[0072] (16) A program for causing a computer to function as the information processing system according to any one of (1) to (14) above. Of course, this is not all-inclusive.

[0073] For example, part or all of the processing of the information processing apparatus 100 may be executed by the mixed reality headset type apparatus 130. The control unit 210 may arbitrarily combine the above-described Embodiment 1 and a plurality of modified examples for implementation.

[0074] Finally, although various embodiments of the present invention have been described, these are presented as examples and are not intended to limit the scope of the invention. The novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the gist of the invention. The embodiments and their modifications are included in the scope and gist of the invention, and are also included in the invention described in the claims and the equivalent scope thereof.

Explanation of Reference Numerals

[0075] 100: Information processing apparatus 110: Capsule 120: User 130: Mixed reality headset type apparatus 140: Chair 160: Conditioner 210: Control Unit 220: Memory Unit 230: Communication Unit 310: Control Unit 320: Memory Unit 330: Imaging Unit 340: Display Unit 350: Communication Unit 360: Gyro Sensor 370: Acceleration Sensor 380: Vital Sensor 500: Virtual Space Image 510: Service Guide Board 520: Service Guide Board 530: Service Guide Board 550: Object 910: Image 911: Painting Image 912: Painting Image 920: Image 921: Painting Image 922: Painting Image 930: Image 931: Painting Image 932: Painting Image 1000: Information Processing System

Claims

1. An information processing system, having at least one or more control units, wherein the control unit, acquires the user's vital data, the vital data includes any one or more of the user's pulse, the user's body temperature, and the user's respiratory rate, controls to output information about a service recommended for the user among a plurality of services that can be provided to the user based on the vital data, the plurality of services includes any two or more of a service for the user to enter a concentrated state, a service for the user to enter a relaxation state, and a service for the user to enter a sleep state, An information processing system.

2. In the information processing system according to Claim 1, the control unit, acquires the vital data of the user sitting on the chair inside the capsule, An information processing system.

3. In the information processing system according to Claim 1, the control unit, acquires a value indicating the degree of stress of the user, controls to output information about a service recommended for the user among a plurality of services that can be provided to the user based on the vital data and the value indicating the degree of stress, An information processing system.

4. In the information processing system according to Claim 3, the control unit, controls to display a virtual space image on the display unit of the composite reality headset-type device worn by the user, sequentially displays a combination of a picture image of a first category and a picture image of a second category different from the first category in the virtual space image, acquires a value indicating the degree of stress of the user based on information on the position of the user's line of sight with respect to the sequentially displayed picture image of the first category and the picture image of the second category, An information processing system.

5. In the information processing system according to Claim 4, inputs the information on the position of the user's line of sight into a learned model, the learned model is a learned model learned with information on the position of the user's line of sight with respect to the picture image of the first category and the picture image of the second category as input data and a value indicating the degree of stress as output data, acquires a value indicating the degree of stress from the learned model, An information processing system.

6. In the information processing system according to claim 1, the control unit controls to output information about a service recommended for the user to a display unit of the mixed reality headset-type device worn by the user. Information processing system.

7. In the information processing system according to claim 1, the control unit controls to output information about a plurality of services that can be provided to the user and information about a service recommended for the user. Information processing system.

8. In the information processing system according to claim 7, the control unit controls to output information about a service recommended for the user among the information about the plurality of services in a distinguishable manner from the information about other services. Information processing system.

9. In the information processing system according to claim 1, the vital data includes at least any one or more of the user's pulse, the user's body temperature, the user's respiratory rate, and the user's blood glucose level. Information processing system.

10. In the information processing system according to claim 1, the control unit estimates the user's physical condition based on the vital data, and outputs information about a service recommended for the user based on the user's physical condition. Information processing system.

11. In the information processing system according to claim 10, the control unit inputs the vital data as input data into a learned model, the learned model is a learned model learned with human vital data as input data and human physical condition as output data, and outputs information about a service recommended for the user based on the user's physical condition output from the learned model. Information processing system.

12. In the information processing system according to claim 1, the control unit selects one service among the plurality of services based on the user's input, and controls to execute processing related to the selected service. Information processing system.

13. In the information processing system according to claim 12, The processing related to the service includes any one or more of the following: processing for controlling the environment inside the capsule according to the service, processing for controlling the image display on the display unit of the mixed reality headset-type device worn by the user according to the service, and processing for controlling the audio output from the output unit of the mixed reality headset-type device according to the service. An information processing system.

14. In the information processing system according to claim 12, the control unit acquires imaging data including the user's hand within the imaging range, and accepts the input based on the gesture of the hand included in the imaging data. An information processing system.

15. An information processing method, comprising: acquiring the user's vital data, wherein the vital data includes any one or more of the user's pulse, the user's body temperature, and the user's respiratory rate, controlling to output information about the services recommended for the user among the plurality of services that can be provided to the user based on the vital data, wherein the plurality of services includes any two or more of the services for the user to enter a concentrated state, the services for the user to enter a relaxation state, and the services for the user to enter a sleep state. An information processing method.

16. A program for causing a computer to function as the information processing system according to any one of claims 1 to 14. ​

Images