Information processing system, information processing device, information processing program, and information processing method

Abstract

To motivate a user to continuously measure information regarding health and / or confirm an analysis result.SOLUTION: An information processing system executes a game application. The information processing system acquires user information for calculating information regarding a user's sleep and calculates health information regarding the user's sleep and / or fatigue based on the acquired user information. The information processing system controls game progress in a game application based on health information.SELECTED DRAWING: Figure 6

Description

[Technical Field]

[0001] The present invention relates to an information processing system, an information processing device, an information processing program, and an information processing method for measuring health information of a user. [Background technology]

[0002] BACKGROUND ART Conventionally, there is a technique for measuring a user's sleep and analyzing the user's sleep based on the measurement results (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2013-168026 Summary of the Invention [Problem to be solved by the invention]

[0004] When analyzing the user's health, such as the sleep analysis described above, it is preferable that the user continues to check the measurement and analysis results.

[0005] Therefore, an object of the present invention is to provide an information processing system, an information processing device, an information processing program, and an information processing method that can motivate users to continuously measure and / or check analysis results of health-related information. [Means for solving the problem]

[0006] In order to solve the above problems, the present invention employs the following configurations (1) to (28).

[0007] (1) One example of the present invention is an information processing system that executes a game application. The information processing system includes an acquisition means, an information calculation means, and a game execution means. The acquisition means acquires user information for calculating information related to the user's sleep. The information calculation means calculates health information related to the user's sleep and / or fatigue based on the acquired user information. The game execution means controls game progress in the game application based on the health information.

[0008] (2) The game execution means may control the progress of a game story in the game application based on the health information.

[0009] (3) The game execution means may grow parameters of an object appearing in the game application in accordance with the health information.

[0010] (4) The game execution means may automatically control the progress of the game in response to the calculation of health information that satisfies a predetermined condition.

[0011] (5) The information calculation means may determine that the user has woken up or woken up. The information processing system may further include an awakening game processing means that starts accepting an instruction input to start the execution of a predetermined awakening game in response to determining that the user has woken up or gotten out of bed, and that, when the instruction input is received, executes the awakening game processing based on the user's operation input.

[0012] (6) When the awakening game is executed, the information calculation means may accept an instruction input to start execution of the awakening game, provided that the instruction input is within a predetermined period from the time when it is determined that the user has woken up or gotten out of bed.

[0013] (7) The game execution means may execute game processing relating to the progress of the game based on the result of the awakening game.

[0014] (8) The information calculation means may calculate, as health information, information relating to fatigue of the user based on an input by the user made in the wakefulness game process and the user's state relating to sleep.

[0015] (9) The acquiring means may acquire user information for a plurality of sleep periods of the user. The information calculating means may calculate health information for each of the plurality of sleep periods of the user based on the user information acquired for that sleep period. The game executing means may control progress of the game based on a result of comparing new health information for the latest sleep period with information based on health information for a previous sleep period before the current sleep period.

[0016] (10) The game execution means may control the progress of the game based on the difference between a numerical value based on new health information and a numerical value based on past health information.

[0017] (11) The game execution means may determine whether the new health information has improved by a predetermined standard or more compared with the past health information, and control the progress of the game based on the determination result.

[0018] (12) The information processing system may be capable of accessing a storage unit that stores health information relating to a plurality of users, and the game execution means may control progress of the game based on a comparison result between the health information calculated by the information calculation means and health information relating to other users stored in the storage unit.

[0019] (13) Another example of the present invention is an information processing system that executes an application. The information processing system includes an acquisition means, an information calculation means, and a display control means. The acquisition means acquires user information for calculating information related to the user's sleep. The information calculation means calculates multiple types of health information related to the user's sleep and / or fatigue based on the acquired user information. The display control means generates an image of an object in the application whose content changes depending on each of the multiple health information items, and displays the image on a predetermined display device.

[0020] (14) The information calculation means may determine that the user has woken up or woken up. The display control means may automatically display an image on the display device in response to the determination that the user has woken up or woken up.

[0021] (15) The display control means may change a first type of display mode for a specified object appearing in the application in accordance with first health information among the plurality of health information, and may change a second type of display mode for the object in accordance with second health information among the plurality of health information.

[0022] (16) The acquiring means may acquire user information for a plurality of sleep periods of the user. The information calculating means may calculate health information for each of the plurality of sleep periods of the user based on the user information acquired for that sleep period. The display control means may generate an image based on a result of comparing new health information for the latest sleep period with information based on health information for a previous sleep period before the latest sleep period.

[0023] (17) The display control means may generate an image based on a difference between a value based on the new health information and a value based on the past health information.

[0024] (18) The display control means may determine whether the new health information has improved by a predetermined standard or more compared to the past health information, and generate an image based on the determination result.

[0025] (19) The information processing system may have access to a storage unit that stores health information for a plurality of users. The display control unit may compare the health information calculated by the information calculation unit with health information for other users stored in the storage unit for each type of health information, and generate an image based on the comparison result.

[0026] (20) The application may be a game application. The information calculation means may calculate health information related to the user's sleep and / or fatigue based on the user information. The display control means may present a portion of the health information to the user as a game element, and may also present health information that is the same as or different from the portion of the health information to the user as an indicator of health.

[0027] (twenty one) The information calculation means may evaluate the user's sleep and / or fatigue and calculate health information representing the evaluation result. The information processing system may further include a presentation means for generating advice information and / or recommendation information for improving the evaluation based on the evaluation result and presenting the advice information and / or recommendation information to the user.

[0028] (twenty two) The information calculation means may calculate at least some of the following items 1 to 15 as health information. 1. Time from going to bed to falling asleep 2. Time from awakening to getting out of bed 3. The percentage of time spent in a deep sleep state from the time you fall asleep until a specified time 4. The percentage of time spent in a light sleep state from the time of awakening until a specified time 5. REM sleep cycle 6. Ratio of REM sleep time to non-REM sleep time 7.Sleep time 8. The difference between the ideal timing for falling asleep and the actual timing for falling asleep 9. The difference between ideal and actual awakening timing 10. Number of times you wake up during the night 11. Timing of waking up in the middle of the night 12. Time to wake up in the middle of the night 13. Number of times you turn over in your sleep 14. Snoring volume 15. Sleeping environment

[0029] (twenty three) The information processing system may include a sensor, a terminal device having a display device, and a server capable of communicating with the terminal device via a network. The terminal device may acquire user information from the sensor and display an image in an application on the display device. The server may store health information.

[0030] (twenty four) The information processing system may further include a notification unit that issues a notification to the user to encourage them to wake up.

[0031] (twenty five) The acquisition means may acquire the user information from a sensor that detects at least one of the user's pulse, breathing, and body movement.

[0032] (26) The information processing system may further include a sensor that detects biometric information of the user without contacting the user. The acquisition means may acquire the biometric information as the user information from the sensor.

[0033] (27) The sensor may transmit radio waves or sound waves toward a detection target, receive reflected waves, and output biological information based on the received results.

[0034] (28) The sensor may be a Doppler sensor.

[0035] Another example of the present invention may be an information processing device (e.g., a mobile terminal) or a server included in the information processing system in (1) to (28) above. Also, another example of the present invention may be an information processing program that causes a computer of the information processing device or server to function as some of the means in (1) to (28) above. Also, another example of the present invention may be an information processing method executed in the information processing system, information processing device, or server. [Effects of the Invention]

[0036] According to the present invention, it is possible to motivate a user to continuously measure and / or check the analysis results of health-related information. [Brief explanation of the drawings]

[0037] [Figure 1] FIG. 1 is a block diagram showing an example of the configuration of an information processing system according to an embodiment of the present invention. [Figure 2] FIG. 1 is a diagram showing an example of a detailed configuration of a terminal system 2. [Figure 3] FIG. 1 is a diagram showing an example of the external appearance of a terminal system 2. [Figure 4] FIG. 10 is a diagram showing an example of the flow of operations of the terminal system during a sleep period. [Figure 5] A functional block diagram showing an example of a functional configuration for calculating health information in the processing unit 11 of the mobile terminal 5. [Figure 6] FIG. 10 is a diagram showing an example of the flow of game processing in this embodiment. [Figure 7] FIG. 10 is a diagram showing an example of a game image (called an awakening game image) displayed on the mobile device when the user awakens. [Figure 8] FIG. 10 is a diagram showing an example of a game image (referred to as a simplified display image) displayed when simplified display of health information is performed. [Figure 9] FIG. 10 is a diagram showing an example of a standby image. [Figure 10] FIG. 10 is a diagram showing an example of a detailed display image. [Figure 11] FIG. 10 is a diagram showing another example of a detailed display image. [Figure 12] FIG. 10 is a diagram showing an example of a game image displayed on the mobile device when the user gets out of bed; [Figure 13] FIG. 10 is a diagram showing an example of a bedtime game image displayed on a mobile device when a user goes to bed. [Figure 14] FIG. 10 is a diagram showing an example of a replay game image; [Figure 15] 10 is a flowchart showing an example of the flow of a measurement process executed in the mobile terminal 5. [Figure 16] 10 is a flowchart showing an example of the flow of a wake-up process executed in the mobile terminal 5. [Figure 17] 1 is a flowchart showing an example of a flow of daytime processing executed on the mobile terminal 5. [Figure 18] 10 is a flowchart showing an example of a flow of a process at the time of admission executed by the mobile terminal 5. [Figure 19] A flowchart showing an example of the flow of processing executed by the server. [Figure 20] FIG. 10 is a diagram showing an example of the data structure of user data stored in a server according to the present embodiment; [Figure 21] FIG. 10 is a diagram showing an example of a game image displayed in a modified example of the embodiment. [Figure 22] FIG. 10 is a diagram showing an example of an image displayed in a modification of the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0038] [1. Information Processing System Configuration] An information processing system, an information processing device, an information processing program, and an information processing method according to this embodiment will be described below with reference to the drawings. First, the overall configuration of the information processing system according to this embodiment will be described. FIG. 1 is a block diagram showing an example of the configuration of the information processing system according to this embodiment. As shown in FIG. 1, the information processing system 1 includes a terminal system 2 and a server 3. The terminal system 2 and the server 3 can communicate with each other via a network 4 such as the Internet or a mobile communication network. Note that while FIG. 1 shows only one terminal system 2, in this embodiment, the information processing system 1 includes multiple terminal systems, each provided for a different user. The information processing system according to this embodiment is designed to enable users to manage their own health in a game-like manner.

[0039] The terminal system 2 manages the user's health. As will be described in detail later, the terminal system 2 calculates information about sleep and fatigue as health information related to the user's health and / or body while the user is sleeping. In this embodiment, the terminal system 2 has a mobile terminal 5 and a base device 6, and the mobile terminal 5 calculates the health information based on information detected by a sensor in the base device 6 (see FIG. 1). The terminal system 2 also presents the calculation results and information based on the calculation results (e.g., advice, etc.) to the user.

[0040] In this embodiment, the terminal system 2 executes a game application to incorporate gamification elements into the user's health management. That is, by executing the game application, the terminal system 2 executes a game process in which the health information is used as a game input (see FIG. 1). The terminal system 2 also uploads the health information and game result information to the server 3 (see FIG. 1).

[0041] The server 3 stores (or accumulates) information uploaded from the terminal system 2. In this embodiment, the server 3 acquires and stores information about each user (e.g., health information and game result information) from multiple terminal systems. The server 3 also provides network services to users based on the stored information. The server 3 transmits information (e.g., service information) for providing network services according to the user's sleep or fatigue state to the terminal system 2 (see FIG. 1). The service information is, for example, information about benefits granted to the user (which may be benefits in the network service or the game application). The service information may also be information about advice for the user, information about recommendations for the user, data on content to be provided to the user, etc. The server 3 may also transmit health information about other users to the terminal system 2 as needed (e.g., in response to a request from the terminal system 2).

[0042] As described above, in this embodiment, the user's health information (specifically, information on sleep and fatigue) is calculated in the terminal system 2, and a game is executed using the health information as game input. Furthermore, the server 3 provides the user (in other words, the terminal system 2) with network services based on the health information and / or game results.

[0043] Next, an example of the configuration of the terminal system 2 will be described. Fig. 2 is a diagram showing an example of the detailed configuration of the terminal system 2. Fig. 3 is a diagram showing an example of the external appearance of the terminal system 2. As shown in Figs. 1 to 3, the terminal system 2 includes a mobile terminal 5 and a base device 6. The mobile terminal 5 is carried by a user. The base device 6 is installed, for example, in the user's home.

[0044] In this embodiment, the mobile terminal 5 is a mobile information processing device, and the base device 6 is a cradle to which the mobile terminal 5 can be connected. As shown in FIG. 3, the mobile terminal 5 can be detachably connected to the base device 6. The base device 6 also has a function of charging the mobile terminal 5, and when the mobile terminal 5 and the base device 6 are connected, the base device 6 can charge the mobile terminal 5. In other embodiments, the mobile terminal 5 and the base device 6 may be detachably connected via a cable.

[0045] The communication method between the mobile terminal 5 and the base device 6 is arbitrary, and may be wired communication via a cable, or wireless communication such as radio wave communication or infrared communication. The communication between the mobile terminal 5 and the base device 6 may be performed by a direct communication method between them, or may be performed by a communication method via a network such as a LAN or the Internet.

[0046] First, the configuration of the mobile terminal 5 in this embodiment will be described. The mobile terminal 5 is a mobile information processing device, and in this embodiment, it is a multifunction device such as a mobile phone, a smartphone, or a tablet terminal. That is, the mobile terminal 5 has some of the various functions (e.g., input function, output (display) function, information processing function, network communication function, call function, camera function, etc.) that a general multifunction device has. The network communication function is a communication function via the Internet and / or a communication function via a mobile communication network. The mobile terminal 5 may be realized by installing a predetermined function in an off-the-shelf multifunction device. In this embodiment, the mobile terminal 5 is used not only as the multifunction device, but also to calculate the health information and execute the game processing. The mobile terminal 5 may also be an information processing device that can be worn by a user (a so-called wearable terminal), such as a wristwatch-type or eyeglass-type terminal.

[0047] As shown in FIG. 2, the mobile terminal 5 includes a communication unit 10. The communication unit 10 connects to the network 4 and communicates with the server 3. In this embodiment, the communication unit 10 is a communication module having a function of connecting to a mobile communication network (in other words, a mobile phone communication network) and communicating. For example, the communication unit 10 communicates using a communication method conforming to the 3G communication standard or the 4G (including LTE (Long Term Evolution)) communication standard. Note that the method by which the mobile terminal 5 communicates with the server 3 is arbitrary, and may be, for example, a method of communicating via a wireless LAN using a Wi-Fi-certified communication module. Furthermore, the mobile terminal 5 may have both a function of communicating with the server 3 via a mobile communication network and a function of communicating with the server 3 via a wireless LAN.

[0048] The mobile terminal 5 includes a processing unit 11. The processing unit 11 executes various types of information processing executed in the mobile terminal 5. The processing unit 11 is connected to the respective units 10, 12 to 19 of the mobile terminal 5. The processing unit 11 has a CPU (Central Processing Unit) and a memory. In the mobile terminal 5, the CPU uses the memory to execute an information processing program stored in the mobile terminal 5, thereby executing the various types of information processing. In this embodiment, the processing unit 11 executes, as the information processing, a process of calculating the above-mentioned health information, a game process, and a process of presenting information received from the server 3 (for example, the above-mentioned service information) to the user. Furthermore, when the mobile terminal 5 operates as a multi-function device, the processing unit 11 executes information processing for realizing each function.

[0049] The mobile terminal 5 includes an input / output interface and functions as an information processing device (in other words, an input / output terminal) for the user to input and view information. Specifically, the mobile terminal 5 includes an operation input unit 12, a display 17, and a speaker 18. The operation input unit 12 is any input device that accepts operation input by the user. In this embodiment, the operation input unit 12 includes a touch panel and buttons provided on the display 17. In other embodiments, the mobile terminal 5 may include, as the operation input unit 12, a sensor (an acceleration sensor or a gyro sensor) for detecting an operation of moving the mobile terminal 5.

[0050] The display 17, which is an example of an output device, displays various images (e.g., game images, etc.) generated in the mobile terminal 5 in response to input to the operation input unit 12, and displays various images (e.g., images related to network services) based on data received from the server 3. The speaker 18, which is an example of an output device, outputs various sounds (e.g., game sounds, etc.) generated in the mobile terminal 5 in response to input to the operation input unit 12, and outputs various sounds (e.g., voices and music related to network services) based on data received from the server 3.

[0051] The mobile terminal 5 includes a sensor for detecting information for calculating the health information. In this embodiment, the mobile terminal 5 includes a position detection unit 13 and an environment sensor .

[0052] The position detection unit 13 detects the position of the mobile terminal 5. In this embodiment, the position detection unit 13 detects the position using a Global Navigation Satellite System (GNSS). The position detection unit 13 is, for example, a Global Positioning System (GPS) sensor (for example, a GPS module). Note that the position detection method used by the position detection unit 13 is arbitrary, and the position detection unit 13 may detect the position using a beacon, for example. Furthermore, for example, the position detection unit 13 may calculate information indicating the altitude of the user (for example, information indicating which floor of a building the user is on) by calculating a change in altitude based on the detection result of a barometric pressure sensor.

[0053] The environmental sensor 14 detects the environment around the mobile terminal 5. In this embodiment, the environmental sensor 14 includes a temperature sensor and a humidity sensor. In other embodiments, the environmental sensor 14 may include an air pressure sensor, an illuminance sensor, a noise sensor, an odor sensor, etc. That is, the environmental sensor 14 may detect at least one of temperature, humidity, illuminance, air pressure, sound, and odor. In other embodiments, the microphone 15 may be used as an environmental sensor for detecting ambient noise.

[0054] The mobile terminal 5 also includes a microphone 15. The microphone 15 detects sounds around the mobile terminal 5. The microphone 15 may be used to calculate health information. For example, the mobile terminal 5 may detect the sound of the user snoring using the microphone 15 and calculate information related to sleep based on the detection result. The microphone 15 may also be used to receive voice input to the mobile terminal 5.

[0055] The mobile terminal 5 includes a camera 16. The camera 16 is provided, for example, on the same side (i.e., the inside) of the mobile terminal 5 as the surface on which the display 17 is provided (see FIG. 3). That is, the camera 16 is provided in a position where it can capture an image of the user operating the mobile terminal 5. The mobile terminal 5 may determine the facial expression of the user based on the image captured by the camera 16, and calculate the fatigue level based on the user's facial expression.

[0056] The mobile terminal 5 includes a connector 19 for electrically connecting to the base device 6. In this embodiment, when the mobile terminal 5 is attached to the base device 6 (see FIG. 3), the connector 19 comes into contact with a connector 21 of the base device 6. This enables communication between the mobile terminal 5 and the base device 6.

[0057] The mobile terminal 5 is equipped with a battery (not shown), and each part of the mobile terminal 5 operates using power supplied from the battery. As will be described in detail later, in this embodiment, the battery of the mobile terminal 5 can be charged by the base device 6.

[0058] Next, the configuration of the base device 6 in this embodiment will be described. In this embodiment, the base device 6 is placed in, for example, the user's bedroom and is used to detect biological information related to the user's sleep while the user is asleep. Here, biological information is information detected from the user's body. In this embodiment, breathing, pulse, and body movement are detected as biological information. Note that in other embodiments, the information detected as biological information is arbitrary, and any one or two of breathing, pulse, and body movement may be detected, or other information different from these three pieces of information may be detected. In addition, the base device 6 is used to present content (e.g., content that encourages the user to fall asleep) and information (e.g., information on evaluation results related to sleep) to the user while they are asleep.

[0059] The base device 6 includes a support section that detachably supports the portable terminal 5. Specifically, as shown in FIG. 3, a recess corresponding to the shape of a portion of the portable terminal 5 is provided in the housing of the base device 6 (specifically, the support section). The portable terminal 5 is attached to the base device 6 by inserting the portable terminal 5 into this recess. Note that the mechanism by which the base device 6 supports the portable terminal 5 is arbitrary.

[0060] 2, the base device 6 includes a connector 21. When the portable terminal 5 is inserted into the recess, the connector 19 of the portable terminal 5 and the connector 21 of the base device 6 are connected. As a result, communication between the portable terminal 5 and the base device 6 becomes possible, and the portable terminal 5 can be charged by the base device 6.

[0061] The base device 6 includes a Doppler sensor 24, which is an example of a sensor that detects biological information. The Doppler sensor 24 emits microwaves and receives reflected waves of the emitted microwaves, thereby detecting a moving object based on the difference between the frequency of the emitted microwaves and the frequency of the received microwaves. In this embodiment, the Doppler sensor 24 (more specifically, the emitter 24a) emits radio waves toward the front of the base device 6 (see FIG. 3). In this embodiment, the detection target of the Doppler sensor 24 is a user, and the Doppler sensor 24 detects the user's body movements. As will be described in detail later, by performing frequency analysis or other such analysis on the detected biological information (in other words, the output waveform of the Doppler sensor 24), it is possible to calculate biological information such as breathing and pulse in addition to body movements.

[0062] The base device 6 includes a power acquisition unit 23 that acquires power from an external power source. In this embodiment, the base device 6 is connected (or may be detachable) to an AC adapter and a power plug via a power cord (not shown). When the power plug is connected to an outlet of the external power source, power is supplied to the power acquisition unit 23 of the base device 6. The base device 6 operates using power from the external power source acquired by the power acquisition unit 23. The power acquisition unit 23 charges the mobile terminal 5 by sending the supplied power to the mobile terminal 5 via the connector 21. Note that in other embodiments, the base device 6 may have a battery, and may send power stored in the battery to the mobile terminal 5. Note that in this embodiment, charging is performed in a manner in which power is supplied via the connector, but in other embodiments, power may be supplied by contactless charging.

[0063] The base device 6 includes a projector 25 that projects an image onto a wall surface (including the ceiling) or a screen. The projector 25 may be any display device that displays an image on a surface (which may be uneven) away from the base device 6 by projecting the image onto the surface. In this embodiment, as shown in FIG. 3 , the projector 25 is provided on the base device 6 so that the light-emitting unit (specifically, the lens) 25a faces upward, i.e., so that the image is projected upward. That is, in this embodiment, the projector 25 projects an image onto the ceiling. In this embodiment, the projector 25 may, for example, display an image that encourages the user to fall asleep or wake up (for example, sleep-inducing content, which will be described later), or an image showing the results of sleep evaluation when the user wakes up in the morning.

[0064] In this embodiment, the base device 6 corrects the image to be projected onto the ceiling as necessary using a so-called projection mapping technique. That is, the base device 6 corrects the image so that the image displayed corresponds to the unevenness and / or color of the projection surface (i.e., the ceiling) of the projector 25. Note that the image correction method may be a conventional method. The base device 6 also includes a camera 27 for correcting the image. As shown in FIG. 3, the camera 27 is provided on the base device 6 in an orientation such that the location where the image is projected by the projector 25 is included in the imaging range. That is, the camera 27 is provided so as to face the same direction as the projector 25 (i.e., upward).

[0065] The base device 6 also includes a speaker 26. The speaker 26 is used, for example, to output sounds that encourage the user to fall asleep or wake up (for example, sleep content, which will be described later).

[0066] The base device 6 includes a control unit 22 that controls the units 23 to 27 of the base device 6. The control unit 22 is connected to the units 21, 23 to 27 of the base device 6. The control unit 22 executes various control processes executed in the base device 6. The control unit 22 has a CPU and a memory. In the base device 6, the CPU uses the memory to execute an information processing program stored in the base device 6, thereby executing the various control processes. For example, the control unit 22 controls the power acquisition unit 23 to control the charging operation of the mobile terminal 5. The control unit 22 also causes the projector 25 and / or speaker 26 to reproduce content and information to be presented to the user in the base device. The control unit 22 also transmits information detected by the Doppler sensor 24 to the mobile terminal 5.

[0067] 2, the base device 6 may have other components. For example, the base device 6 may have an environmental sensor, a display, an omnidirectional speaker, a light source (e.g., lighting), and / or an odor generating device. When the base device 6 has an environmental sensor, the mobile terminal 5 may not have an environmental sensor. The mobile terminal 5 and the base device 6 may have the same type of environmental sensor (i.e., environmental sensors that detect the same information), or may have different types of environmental sensors.

[0068] Next, the configuration of the server 3 will be described. The server 3 includes one or more information processing devices (i.e., server devices) each having a CPU and a memory. In the server 3, the CPU uses the memory to execute an information processing program stored in the server 3, thereby performing various information processing. For example, the server 3 performs processing such as storing information received from the mobile terminal 5 in a predetermined storage unit and providing the mobile terminal 5 with a network service according to the information.

[0069] In this specification, the term "server" refers not only to a single information processing device (i.e., a server device), but also to the entire group of server devices (i.e., a server system) when the server is composed of multiple server devices. While the present embodiment describes the server 3 as an integrated configuration, the server 3 may also be configured to include multiple server devices divided according to their functions and / or roles. For example, the server 3 may be configured to include a data server that accumulates health information acquired from the mobile terminal 5, and a service server that provides network services based on the health information. Furthermore, when providing a service that provides products, etc. ("products, etc." refers to both products and services, and the same applies hereinafter) as part of the network service, the server 3 may also be configured to include a shop server that provides and charges for the products, etc.

[0070] [2. Overview of the information processing system] Next, we will explain the outline of the operation of the information processing system 1. In this embodiment, the terminal system 2 calculates the health information during the period when the user is sleeping (referred to as the sleeping period). First, we will explain the operation of the terminal system 2 during the sleeping period.

[0071] (2-1: Operation of the terminal system during sleep period) FIG. 4 is a diagram showing an example of the flow of operation of the terminal system during a sleep period. In this embodiment, the base device 6 is placed in the user's bedroom, more specifically, placed around the user (for example, next to the pillow). The user attaches the mobile terminal 5 to the base device 6 when going to bed. The terminal system 2 determines that the user has gone to bed when the mobile terminal 5 is attached to the base device 6 (i.e., detects going to bed) (step S1). Furthermore, in response to the detection of going to bed, the terminal system 2 starts measurement to calculate health information of the user. As will be described in detail later, in this embodiment, information related to the user's sleep is calculated as health information based on the detection result of the Doppler sensor 24 of the base device 6. Furthermore, information detected by the environmental sensor 14 in addition to the Doppler sensor 24 is also acquired as a measurement result.

[0072] In this embodiment, the base device 6 has a function of charging the portable terminal 5. It is conceivable that the user will attach the portable terminal 5 to the base device 6 in order to charge the portable terminal 5 when going to bed. In other words, according to this embodiment, the user can be motivated to attach the portable terminal 5 to the base device 6, and therefore the possibility that the user will forget to attach the portable terminal 5 to the base device 6 can be reduced.

[0073] After going to bed, when the user falls asleep (in other words, when the user enters a sleeping state), the terminal system 2 detects that the user has fallen asleep based on the measurement results (step S2). The terminal system 2 continues measurement even after detecting that the user has fallen asleep, and determines the state of the user while sleeping based on the measurement results. Furthermore, the operation of the mobile terminal 5 and / or the base device 6 may be controlled according to the state of the user.

[0074] When the user awakens from sleep, the terminal system 2 detects that the user has awakened based on the measurement results (step S3). Upon detecting that the user has awakened, the terminal system 2 calculates health information based on the measurement results during sleep. Furthermore, the terminal system 2 evaluates the calculated health information and presents the evaluation results to the user. As will be described in detail later, in this embodiment, the evaluation results of the health information are presented as a game element (for example, the number of remaining lives of the player object) in the game app.

[0075] The user checks the evaluation result when awake, and then gets out of bed. When getting out of bed, the user detaches the mobile terminal 5 from the base device 6. The terminal system 2 determines that the user has gotten out of bed when the mobile terminal 5 is detached from the base device 6 (i.e., detects getting out of bed) (step S4). Note that the user's getting out of bed may be detected based on the measurement results instead of (or in addition to) being detected based on the attachment / detachment state of the mobile terminal 5 and the base device 6. For example, the terminal system 2 may determine that the user has gotten out of bed when the user is no longer present within the detection range of the Doppler sensor.

[0076] Furthermore, when the health information is calculated after the user wakes up, the terminal system 2 ends the measurement for calculating the health information. In other embodiments, the measurement may end in response to detection that the user has gotten out of bed.

[0077] As described above, in this embodiment, when measuring health information, the user simply attaches the mobile terminal 5 to the base device 6 when going to bed, and detaches the mobile terminal 5 from the base device 6 when getting out of bed. In this way, in this embodiment, the user can measure health information with little effort using the terminal system 2.

[0078] (2-2: Health information calculation method) A method for calculating health information in this embodiment will be described below. In this embodiment, the terminal system 2 calculates information related to sleep and information related to fatigue as health information. More specifically, the terminal system 2 calculates a sleep index and a fatigue index based on the detection results of the Doppler sensor 24. The sleep index is an index related to the user's sleep, and is an index that represents, for example, a sleep state or a sleep result. More specifically, the sleep index is a numerical value that indicates, for example, sleep time, sleep latency, wake-up time, and sleep efficiency. The fatigue index is an index related to the user's sleep, and is an index that represents, for example, the user's degree of fatigue or state of fatigue (e.g., type of fatigue, etc.). In this embodiment, the fatigue index is calculated taking the sleep index into consideration and is calculated as a numerical value that indicates the user's degree of fatigue. Hereinafter, with reference to FIG. 5, a method for calculating health information in this embodiment will be described in detail.

[0079] Fig. 5 is a functional block diagram showing an example of the functional configuration for calculating health information in processing unit 11 of mobile terminal 5. As shown in Fig. 5, processing unit 11 includes a waveform analysis unit 41, a sleep calculation unit 42, an autonomic nerve calculation unit 43, and a fatigue calculation unit 44. In the present embodiment, the configuration for calculating health information (each of units 41 to 44 shown in Fig. 5) is provided in mobile terminal 5, but in other embodiments, some or all of the configuration may be provided in base device 6.

[0080] The waveform analysis unit 41 calculates respiration, pulse, and body movement as further biological information based on the biological information (i.e., output waveform) detected by the Doppler sensor 24. It has been known that waveforms representing respiration, pulse, and body movement can be obtained by separating the output waveform of the Doppler sensor 24 according to frequency. The waveform analysis unit 41 separates the output waveform by frequency analysis or the like into a frequency band corresponding to respiration, a frequency band corresponding to pulse, and a frequency band corresponding to body movement, and outputs each separated waveform data. As shown in FIG. 5 , the output of the waveform analysis unit 41 is input to the sleep calculation unit 42 and the autonomic nerve calculation unit 43, respectively.

[0081] The sleep calculation unit 42 calculates various sleep indices based on biological information (in this embodiment, respiration, pulse, and body movement). Conventionally, methods for calculating sleep indices based on respiration, pulse, and body movement have been known. In this embodiment, the sleep calculation unit 42 calculates sleep indices indicating the following information: Time from going to bed to falling asleep (i.e., sleep latency / sleep onset latency) Time from awakening to getting out of bed -Wake-up time Number of times you wake up during the night Timing of waking up in the middle of the night Sleep efficiency Total sleep time ·Amount of sleep activity Sleep Stages REM sleep time Non-REM sleep time REM sleep cycles, The ratio of REM sleep time to non-REM sleep time ·Sleep quality The percentage of time spent in a deep sleep state from the time you fall asleep until a specified time The percentage of time spent in a light sleep state from the time of awakening until a specified time The difference between the ideal timing for falling asleep and the actual timing for falling asleep The difference between the ideal and actual awakening timing The "ideal timing to fall asleep" and the "ideal timing to wake up" are calculated based on, for example, past sleep indices related to the user.

[0082] In other embodiments, only some of the above sleep indices may be calculated, or different types of sleep indices may be calculated. For example, the number of times the patient turns over in bed may be calculated as a sleep index. The number of times the patient turns over in bed may be calculated (or estimated) based on the body movements detected by the Doppler sensor 24.

[0083] The sleep index may also be calculated based on the output of a sensor other than the Doppler sensor 24. For example, an index indicating the volume of snoring and / or an index indicating the environment during sleep may be calculated as the sleep index. The volume of snoring can be calculated based on sounds detected by, for example, the microphone 15. Indicators indicating the environment during sleep, such as temperature, humidity, illuminance, and air pressure, may be calculated based on the output of the environmental sensor 14. The sleep index may also be calculated based on the detection results of the camera 16. For example, biological information such as pulse rate and / or body movement can be calculated based on an image of the user captured by the camera 16. Therefore, the sleep calculation unit 42 may calculate the sleep index (and the fatigue index) using biological information obtained from the image captured by the camera 16 in addition to (or instead of) the biological information obtained from the detection results of the Doppler sensor 24.

[0084] The autonomic nerve calculation unit 43 calculates an index (referred to as an autonomic nerve index) indicating the degree of activity of the autonomic nerves (specifically, the sympathetic nerves and the parasympathetic nerves) based on the biological information. Specifically, the autonomic nerve calculation unit 43 performs frequency analysis on the waveform of the pulse (specifically, the RR interval) included in the biological information using the maximum entropy method and Fourier transform, and calculates a high-frequency component HF (approximately 0.15 to 0.40 [Hz]) and a low-frequency component LF (approximately 0.04 to 0.15 [Hz]) of the waveform. Here, the high-frequency component HF is known to indicate the degree of activity of the parasympathetic nerve, and the low-frequency component LF is known to indicate the degree of activity of the sympathetic nerve. It is also known that the degree of fatigue can be evaluated based on the ratio between the degree of activity of the parasympathetic nerve and the degree of activity of the sympathetic nerve (see, for example, Japanese Patent Application Laid-Open No. 2010-201113). Therefore, the autonomic nerve calculation unit 43 calculates the ratio (LF / HF) of the high-frequency component HF to the low-frequency component LF as the autonomic nerve index. As shown in FIG. 5, the output of the autonomic nerve calculation unit 43 is used as an input to a fatigue calculation unit 44.

[0085] The fatigue calculation unit 44 calculates the fatigue level based on the sleep index and the autonomic nerve index. In this embodiment, the fatigue index calculated is a fatigue level that indicates the degree (level) of fatigue with a numerical value from 0 to 100. The fatigue index can be calculated by any method, but the following method is conceivable, for example.

[0086] The first method is to calculate the fatigue level from sleep indices. Here, the sleep indices are considered to be correlated with the fatigue level. For example, the following are examples of situations that are considered to indicate a high level of fatigue: Long sleep latency. -Long periods of waking up during the night. -Frequent awakenings during the night. · Poor sleep efficiency. - Short total sleep time. Imbalance between REM and NREM sleep (e.g., the ratio of REM to NREM sleep is outside the normal range). Therefore, the fatigue calculation unit 44 calculates the fatigue level so that if the sleep index corresponds to the above example, the fatigue level is high, and if the sleep index does not correspond to the above example, the fatigue level is low. For example, the fatigue calculation unit 44 may determine whether each of the above items corresponds, calculate points according to the number of items that correspond, and calculate the fatigue level according to the total points. In this case, the fatigue calculation unit 44 may calculate points by weighting each item. Alternatively, a reference value may be set for each item (e.g., "6 hours" for total sleep time), and the points may be calculated so that the further the calculated sleep index value is from the reference value, the greater the points.

[0087] As described above, in this embodiment, sleep indices related to the user's sleep are calculated based on biological information, and a fatigue level is calculated based on the sleep indices. As described above, since there is considered to be a correlation between the sleep indices and the degree of fatigue, calculating the fatigue level based on the sleep indices can improve the accuracy of the fatigue level.

[0088] The second method is to calculate the fatigue level based on an autonomic nerve index. As described above, it is known that the balance between the activity of the sympathetic and parasympathetic nerves, i.e., the autonomic nerve index, can be used to evaluate the fatigue level. Therefore, the fatigue calculation unit 44 calculates the fatigue level so that, for example, the greater the deviation of the value of the autonomic nerve index from the reference value, the greater the fatigue level.

[0089] In this embodiment, the fatigue calculation unit 44 calculates the fatigue level using the first and second methods. Specifically, the fatigue calculation unit 44 calculates the fatigue level using each of the two methods and calculates the final fatigue level based on the calculated fatigue levels. For example, the fatigue calculation unit 44 may use the average of the two fatigue levels as the final fatigue level, or may calculate the final fatigue level by weighting one of the two fatigue levels.

[0090] In addition to the above two methods, in other embodiments, the following method may be used to calculate fatigue levels. That is, a method may be used in which fatigue levels are calculated based on the amount of sleep time over a predetermined period (e.g., one week). Conventionally, a fatigue risk management system (FRMS) has a method for calculating fatigue levels based on both sleep time and work time. In the above method, fatigue levels can be calculated based on sleep time (only) by simply setting the work time constant, for example.

[0091] The fatigue index may be calculated by any method, and the content of the fatigue index may also be any. In another embodiment, a value indicating the degree of fatigue for each type of fatigue may be calculated as the fatigue index. For example, in another embodiment, the fatigue index may be three types of values: a value indicating the degree of acute fatigue, a value indicating the degree of cumulative fatigue, and a value indicating the degree of mental fatigue.

[0092] In this embodiment, the fatigue calculation unit 44 calculates the vitality level based on the fatigue level calculated as described above. The vitality level is a numerical value calculated for the purpose of presenting the user's health state (in this embodiment, the state of sleep and the degree of fatigue) in an easy-to-understand manner for the user, and a larger numerical value indicates a better condition (in other words, a lower degree of fatigue). The method for calculating the vitality level is arbitrary, and for example, the vitality level may be calculated by subtracting the fatigue level from 100.

[0093] In this embodiment, the vitality level is presented to the user as the evaluation result of the health information. In other embodiments, the fatigue level may be presented to the user as the evaluation result, or a sleep quality level (a numerical value indicating the degree of quality of sleep) calculated from the sleep indices may be presented to the user. The vitality level, fatigue level, and sleep quality level may be referred to as health information or as an evaluation result of the health information. In other words, the health information may be a second type of health information indicating an evaluation result of the first type of health information (e.g., sleep indices).

[0094] As described above, in this embodiment, the terminal system 2 calculates the sleep index, fatigue index (i.e., fatigue level), and vitality level as health information. Some or all of this health information is transmitted from the terminal system 2 to the server 3, and is accumulated for each user in the server 3. Furthermore, the mobile terminal 5 stores the calculated health information in its own storage unit.

[0095] (2-3: Game processing) Next, the game processing executed on the terminal system 2 (specifically, the mobile terminal 5) will be described. As described above, in this embodiment, a user can measure health information through a simple procedure. However, unless the user checks the evaluation results of the measured health information (which may be advice information or recommendation information based on the evaluation results), the significance of measuring the health information is diminished and it does not lead to improvement in the user's health. For example, for a user with little interest in health, simply presenting the evaluation results does not seem very interesting, and there is a risk that interest in the evaluation results will gradually wane. As a result, the user may stop checking the evaluation results or neglect to measure their health altogether.

[0096] Therefore, in this embodiment, the terminal system 2 executes game processing to motivate the user to perform actions such as measuring health information and checking the evaluation results. That is, the terminal system 2 executes game processing based on the evaluation results and presents the user with a game result corresponding to the evaluation results. In this embodiment, the game progresses according to the evaluation results or according to the user's behavior related to the measurement (e.g., awakening, getting out of bed, and entering bed). In this manner, in this embodiment, the terminal system 2 allows the user to measure health information in a game-like manner. This motivates the user to continuously perform the above actions, and the health improvement effect is improved when the user continuously performs the above actions. Below, an example of the game processing in this embodiment will be described with reference to FIGS. 6 to 14.

[0097] 6 is a diagram showing an example of the flow of game processing in this embodiment. In this embodiment, as described above, measurements for calculating the user's health information are performed while the user is sleeping, and the game processing is mainly executed while the user is awake. FIG. 6 shows the flow of game processing executed from when the user wakes up until when the user falls asleep.

[0098] (Processing when the user wakes up) When mobile terminal 5 detects that the user has woken up, it displays the evaluation result of the health information and advice based on the evaluation result (step S11). As described above, the evaluation result of the health information is calculated in response to the user's awakening, and therefore mobile terminal 5 displays information indicating the calculated evaluation result on display 17. Mobile terminal 5 also displays information indicating advice generated based on the evaluation result on display 17.

[0099] 7 is a diagram showing an example of a game image (referred to as an awakening game image) displayed on a mobile terminal when the user awakens. In the awakening game image shown in FIG. 7, a player object 51, evaluation result information 52, and advice information 53 are displayed.

[0100] The player object 51 is a game character that moves in response to an input (health information is the input in this embodiment) from a user (also referred to as a player). As shown in Fig. 7, when the user wakes up, an image showing the player object 51 waking up is displayed on the display 17.

[0101] The evaluation result information 52 indicates the evaluation result of the health information calculated based on the biological information measured during the sleeping period. As described above, in this embodiment, a vitality level (in other words, a numerical value representing the vitality level) is calculated as the evaluation result. Here, in this embodiment, the evaluation result is presented to the user as a game element. That is, as shown in FIG. 7, a numerical value representing the vitality level ("80" in FIG. 7) is displayed as the number of remaining lives of the player object 51. Note that the evaluation result may be displayed as any game element; for example, in other embodiments, the evaluation result may be presented as the number or type of items in the game, money, or parameters of the player object (e.g., strength, etc.).

[0102] Advice information 53 indicates advice to the user regarding the evaluation results of the health information. Advice information 53 is generated based on the health information. Any method for generating advice information 53 may be used. For example, mobile terminal 5 may store in advance a table that associates conditions related to the health information with the content of advice to be presented, and use the table to identify the content of the advice. In other words, when the health information satisfies any of the conditions included in the table, mobile terminal 5 generates and displays advice information indicating the content of advice associated with the satisfied condition.

[0103] As described above, the awakening game image is displayed in response to the user waking up. As described above, in this embodiment, determining that the user has woken up is performed using a sleep index calculated based on the detection result of the Doppler sensor 24. If the mobile device 5 has an alarm function, determining that the user has woken up may also be performed when the alarm is stopped by the user. That is, the mobile device 5 may notify the user by sound and / or light at the set alarm time to encourage the user to wake up. In this case, the mobile device 5 may determine that the user has woken up in response to the user performing an operation to stop the notification. The alarm time may be set manually by the user or based on the sleep index. In another embodiment, the mobile device 5 may display the awakening game image at the alarm time instead of when the user wakes up.

[0104] The awakening game image is displayed for a predetermined time. Thereafter, the mobile device 5 displays a simplified version of the calculated health information (step S12). That is, the mobile device 5 displays part of the health information calculated based on the biological information measured during the sleep period. Note that the switching from the awakening game image in step S11 to the image in step S12 (i.e., the simplified display image described below) may be performed automatically by the mobile device 5 in response to a predetermined condition being satisfied, as described above, or may be performed in response to a user instruction. For example, the mobile device 5 may display the simplified display image in response to a user performing a predetermined operation while the awakening game image is being displayed.

[0105] Fig. 8 is a diagram showing an example of a game image (referred to as a simplified display image) displayed when simplified display of health information is performed. In the simplified display image shown in Fig. 8, simplified information 54 is displayed. Also in the simplified display image, similar to the awakening game image (see Fig. 7), a player object 51 and advice information 53 are displayed.

[0106] The simplified information 54 shows part of the calculated health information. In this embodiment, the simple information 54 displays sleep duration, which is an example of a sleep index. The content displayed by the simple information 54 is arbitrary. However, since the simple information 54 is presented immediately after the user wakes up, in this embodiment, the simple information 54 displays information that is easy for the user to understand. In other embodiments, the mobile device 5 may display, instead of (or in addition to) the sleep duration, an index indicating the above-mentioned goodness of sleep and / or sleep quality as the simple information 54.

[0107] As described above, in this embodiment, in response to detection of the user's awakening, a portion of the calculated health information is presented to the user as a game element (step S11), and health information different from the portion (which may be the same information in other embodiments) is presented to the user as an index representing health (as a sleep index in this embodiment) (step S12). This makes it possible to attract the user's interest by providing a gamified aspect to the presentation of health information, and to present the health information (i.e., sleep index) in a manner that is easy for the user to understand. Furthermore, in this embodiment, information indicating the evaluation result of the health information is presented to the user as a game element, and at least a portion of the health information that is the basis of the evaluation result (i.e., used to calculate the evaluation result) is presented to the user as a health index. Therefore, the evaluation result can be presented in a manner that attracts the user's interest, and more detailed information that is the basis of the evaluation result can be presented in a manner that is easy for the user to understand. Note that the presentation of the evaluation result as a game element and the presentation of the health information as a health index may be presented simultaneously or at different times (as in this embodiment).

[0108] In this embodiment, the advice information 53 included in the simplified display image is the same as the advice information 53 included in the awakening game image, but in other embodiments, the advice information included in these two types of images may be different from each other.

[0109] The simplified display is displayed for a predetermined time. Thereafter, the portable terminal 5 displays a standby image (in other words, a menu image) (step S13). That is, the portable terminal 5 displays a standby image including a menu image on the display 17. Note that the switching from the simplified display image in step S12 to the standby image in step S13 may be performed automatically by the portable terminal 5 in response to the predetermined condition being satisfied as described above, or may be performed in response to a user instruction. In another embodiment, the standby image may be displayed from the awakening game image (without displaying the simplified display image). The portable terminal 5 may also be configured to switch between the awakening game image, the simplified display image, and the standby image in response to a user instruction.

[0110] Fig. 9 is a diagram showing an example of a standby image. In the standby image shown in Fig. 9, a menu image 55 is displayed. Also in the standby image, like the awakening game image (Fig. 7) and the simplified display image (Fig. 8), a player object 51 is displayed.

[0111] Menu image 55 represents instructions that the user can give when the standby image is displayed. In this embodiment, menu image 55 includes a details display button 56 and a mini-game button 57. Details display button 56 is an image representing a button for giving an instruction to display details of calculated health information. Mini-game button 57 is an image representing a button for giving an instruction to start a mini-game (also called an alarm game). By making an input (e.g., a touch input) to these buttons, the user can cause mobile device 5 to display details of health information and play a mini-game.

[0112] When an input is made to the detail display button 56 while the standby image is displayed (step S13), the mobile terminal 5 displays detailed health information (step S14). That is, the mobile terminal 5 displays a detailed display image that shows more detailed information than the simplified display of the health information on the display 17. In this embodiment, for example, the image described below is displayed as the detailed display image.

[0113] Fig. 10 is a diagram showing an example of a detailed display image. The detailed display image shown in Fig. 10 shows detailed information about last night's sleep. That is, the detailed display image shown in Fig. 10 shows details of health information based on biological information measured during the previous sleep period (typically, the period from last night to this morning). Specifically, Fig. 10 shows a graph 58 in which the horizontal axis represents time and the vertical axis represents the depth of sleep. Graph 58 allows the user to know in detail the changes in the depth of sleep during the previous sleep period.

[0114] In addition to the graph 58, the detailed display image also includes explanations for characteristic points in the graph 58. For example, as shown in FIG. 10, an image showing an explanation such as "Awake" is added to a point in the graph 58 indicating an awakening during the night. In this manner, the mobile device 5 may detect characteristic points from a sleep period (also referred to as a measurement period) based on sleep indices and add an explanation image to the detected characteristic points. The characteristic points may be, for example, points where the person awakens during the night or points where a light sleep period continues for a predetermined period of time or more. The mobile device 5 also stores a table associating characteristic points with explanations, and displays an explanation image showing an explanation associated with the detected characteristic point in association with the characteristic point on the graph 58.

[0115] In another embodiment, the explanation image may present an explanation that takes into account environmental sensor information detected by the environmental sensor 14. The environmental sensor 14 detects, for example, temperature, humidity, and / or ambient sound as the environmental sensor information. For example, when the characteristic location is detected, the mobile terminal 5 may acquire environmental sensor information detected at a time (or period) corresponding to the characteristic location and generate an explanation based on the environmental sensor information. For example, the mobile terminal 5 may acquire temperature and generate and display an explanation such as, "I woke up around 2 o'clock. This may be because the temperature in the room was low." Furthermore, for example, the mobile terminal 5 may acquire ambient sound and generate and display an explanation such as, "I woke up around 2 o'clock. This may be because I heard a loud noise."

[0116] FIG. 11 is a diagram showing another example of a detailed display image. The detailed display image shown in FIG. 11 is an example of an image showing detailed information about sleep over the past week. In FIG. 11, a bar graph 61 is displayed showing changes in the user's sleep quality over the past week. The horizontal axis of the graph 61 represents the date, and the vertical axis represents the sleep quality. The sleep quality is an index showing the degree of sleep quality and is calculated based on the sleep index. The sleep quality is calculated as a numerical value ranging from 0 to 100, for example, with a higher value indicating higher quality of sleep (in other words, a better evaluation of sleep quality). The graph 61 allows the user to know in detail the changes in sleep quality over the past week.

[0117] 11 includes graph 62 based on the sleep levels of other users in addition to graph 61 of the user's own sleep level. Graph 62 represents the average sleep level of multiple other users. Graphs 61 and 62 allow the user to know changes in their own sleep level, as well as the (average) sleep levels of other users and the difference between their own sleep level and that of the other users.

[0118] The sleep quality levels of other users are stored in the server 3. The server 3 also calculates and stores the average sleep quality levels (for example, the average value for each day) of the stored sleep quality levels of other users. The mobile terminal 5 receives the average sleep quality levels for a desired period (for example, the most recent week in the example shown in FIG. 11) from the server 3 at any time, and creates and displays a graph 62 based on the received information. The users for whom the average value is calculated may be all users registered with the network service, or may be users who meet certain selection criteria. The selection criteria may be criteria related to personal information such as region (for example, country), age, gender, occupation, etc.

[0119] In this embodiment, a detailed display image such as that shown in FIGS. 10 and 11 is displayed. The mobile terminal 5 may display an image selected by the user from among multiple types of detailed display images. The detailed display image may have any content, including information not displayed in the simplified display (step S12) described above. For example, the detailed display image may display the average value of the user's sleep quality over a predetermined period (e.g., one week or one month), in addition to the detailed display images shown in FIGS. 10 and 11. Furthermore, the detailed display image may display a comparison between the user's current sleep quality and the user's past sleep quality. For example, instead of the graph 62 shown in FIG. 11, a graph showing the user's past sleep quality (e.g., the user's sleep quality one month ago) may be displayed.

[0120] The detailed display image may also represent information other than the goodness of sleep level, for example, a sleep index other than the goodness of sleep level, a fatigue index, and / or an energy level. The mobile terminal 5 may also generate and display a detailed display image relating to information designated by the user from among the health information.

[0121] In a state where the detailed display image is displayed, the mobile terminal 5 switches the display to a standby image in response to a predetermined end instruction given by the user (step S13). The predetermined end instruction is given, for example, by inputting to the menu button 59 (FIGS. 10 and 11) displayed on the detailed display image.

[0122] Furthermore, when an input is made to the mini-game button 57 while the standby image is displayed (step S13), the mobile terminal 5 starts a mini-game (step S15). A mini-game is a game that differs from games that require health information (specifically, vitality level) as input, and requires the user to perform simple game operations, calculations, etc. The content of the mini-game is arbitrary, and the mini-game may be, for example, a puzzle game, a quiz game, or a game that requires the user to perform calculations. Having the user play such a mini-game is expected to have the effect of waking up the user.

[0123] Furthermore, in this embodiment, the mobile device 5 corrects the vitality level (specifically, the vitality level calculated based on the biological information measured during the sleeping period) based on the result of the mini-game. For example, if the result of the mini-game is poor, the mobile device 5 may determine that the user woke up poorly and decrease the vitality level, whereas if the result of the mini-game is good, the mobile device 5 may determine that the user woke up well and increase the vitality level. Thus, in this embodiment, the vitality level is calculated based on the result of the mini-game. Furthermore, the result of the mini-game is reflected in the game processing. The mobile device 5 transmits information indicating the corrected vitality level to the server 3. The server 3 stores the received information indicating the corrected vitality level.

[0124] In another embodiment, the mobile device 5 may use the result of the mini-game as an input for the game processing instead of (or in addition to) correcting the vitality level based on the result of the mini-game. For example, the mobile device 5 may grant an item to the user (in other words, the player object) according to the result of the mini-game, and execute the game processing based on the vitality level and the granted item. This also allows the result of the mini-game to be reflected in the game processing, as in this embodiment.

[0125] Furthermore, the mobile device 5 may ask the user questions instead of or in conjunction with the execution of the mini-game (in other words, during the mini-game). That is, the mobile device 5 asks the user questions regarding the state of sleep and / or fatigue, and prompts the user to input answers. For example, the mobile device 5 may ask questions such as whether the user feels tired, whether they woke up feeling refreshed, whether they still feel sleepy, etc., and prompts the user to answer based on their subjective opinion. At this time, the answers may be used as the mini-game results. This allows the terminal system 2 to acquire the user's subjective evaluation regarding sleep and / or fatigue, and to calculate health information that reflects the subjective evaluation.

[0126] As described above, in this embodiment, the user can be woken up by playing a mini-game when the user wakes up, and health information that reflects the user's condition after waking up can be calculated by calculating (more specifically, correcting) health information based on the results of the mini-game.

[0127] In another embodiment, the mobile device 5 may determine whether to prompt the user to play a mini-game based on health information based on biological information measured during sleep. For example, the mobile device 5 determines whether the user wakes up well or poorly based on the health information. Specifically, the mobile device 5 may determine that the user wakes up poorly if the user wakes up from a non-REM sleep state, and may determine that the user wakes up well if the user wakes up from a REM sleep state. If the mobile device 5 determines that the user wakes up poorly, the mobile device 5 may prompt the user to play a mini-game. In the above case, for example, in the standby image, the mobile device 5 may display a message such as, "It seems you are not waking up well today. Let's play a mini-game to wake up." On the other hand, if the mobile device 5 determines that the user wakes up well, the mobile device 5 may not prompt the user to play a mini-game.

[0128] When the mini-game ends, or when the user gives an instruction to end the mini-game, the mobile terminal 5 switches the display to a standby image (step S13).

[0129] (Processing after the user leaves the bed) As shown in Fig. 6, when the mobile terminal 5 detects that the user has left the bed, it ends the display of the standby image and displays a game image at the time of getting out of bed (step S16). Fig. 12 is a diagram showing an example of a game image at the time of getting out of bed that is displayed on the mobile terminal when the user has left the bed. In the game image at the time of getting out of bed shown in Fig. 12, a player object 51 and information 64 at the time of getting out of bed are displayed. As shown in Fig. 12, when the user has left the bed, an image showing the player object 51 setting out on an adventure is displayed on the display 17.

[0130] As shown in FIG. 12, the bed exit information 64 indicates the current (i.e., at the time of getting out of bed) evaluation result (specifically, vitality level). Here, the vitality level calculated when the user wakes up may be corrected based on the results of the mini-game. In this case, the bed exit information 64 indicates the number of remaining lives corresponding to the corrected vitality level. The bed exit information 64 can notify the user of the corrected vitality level. Note that if the vitality level calculated when the user wakes up is not corrected, the bed exit information 64 indicates the same number of remaining lives as the vitality level. Note that the bed exit game image may include advice information regarding the current evaluation result.

[0131] The above-mentioned game image at the time of getting out of bed is displayed for a predetermined time. Thereafter, the portable terminal 5 displays a standby image (step S17). That is, the portable terminal 5 displays the same standby image as in step S13 on the display 17. Note that the switching from the game image at the time of getting out of bed in step S16 to the standby image in step S17 may be performed automatically by the portable terminal 5 in response to the predetermined condition being satisfied as described above, or may be performed in response to an instruction from the user.

[0132] The standby image in step S17 includes the menu image 55 similar to the standby image in step S13. The standby image in step S17 also includes an image showing the player object 51 during an adventure. For example, an image showing the player object 51 fighting an enemy or progressing through a dungeon is displayed.

[0133] When a standby image is displayed in step S17, similar to step S13, the mobile terminal 5 accepts input to display details of the health information and to play a mini-game. That is, when an input is made to the detail display button 56, the mobile terminal 5 displays details of the health information (step S18). The process of step S18 is the same as the process of step S14. Furthermore, when an input is made to the mini-game button 57, the mobile terminal 5 starts a mini-game (step S19). The process of step S19 is the same as the process of step S15.

[0134] As described above, in this embodiment, the standby image is displayed even after the user gets out of bed, and the user can view the details or play the mini-game. Therefore, the user can view the details or play the mini-game even when the mobile terminal 5 is detached from the base device 6.

[0135] As described above, the mini-game is played with the purpose of determining the user's state of awakening. Therefore, if the mini-game is played after the user is fully awake and the result of the mini-game is reflected in the vitality level, the user's state of awakening may not be accurately reflected in the vitality level.

[0136] Therefore, in this embodiment, the mobile device 5 allows the mini-game to be executed until a predetermined time has elapsed since the user got out of bed (or woke up). That is, after a predetermined time has elapsed since the user got out of bed (or woke up), the mobile device 5 does not display the mini-game button 57 in the standby image, preventing the user from executing the mini-game. This reduces the possibility that the mini-game will be executed after the user has fully woken up and the result of the mini-game will be reflected in the vitality level. Note that in another embodiment, the mobile device 5 may reflect the result of the mini-game in the vitality level until a predetermined time has elapsed since the user got out of bed (or woke up), but may not reflect the result of the mini-game in the vitality level after the predetermined time has elapsed (however, the result of the mini-game may be reflected in the game processing). In this case, the mini-game may be executable even after the predetermined time has elapsed. This also provides the same effect as above.

[0137] In the above embodiment, the terminal system 2 detects that the user has left the bed when the mobile terminal 5 is detached from the base device. The method for detecting that the user has left the bed is arbitrary and is not limited to the above method. For example, in another embodiment, the terminal system 2 may detect that the user has left the bed when the user leaves the detection range of the Doppler sensor of the base device 6. In this case, the mobile terminal 5 and the base device 6 are capable of wireless communication, and the base device 6 wirelessly notifies the mobile terminal 5 that it has detected that the user has left the bed. According to the above, the mobile terminal 5 can perform the processes of steps S11 to S15 when the mobile terminal 5 is detached from the base device 6. In this case, after detecting that the user has left the bed, the mobile terminal 5 may not execute the mini-game or may not reflect the result of the mini-game in the vitality level.

[0138] In another embodiment, the mobile terminal 5 may detect that the user has gone out, and in response to the user's going out, execute the process of step S16. The user's going out can be detected based on the detection result by the position detection unit 13. For example, the position of the user's home may be registered in advance in the mobile terminal 5, and the mobile terminal 5 may determine that the user has gone out when the position of the mobile terminal 5 detected by the position detection unit 13 is away from the home position by a predetermined distance or more.

[0139] (Daytime processing) After the user gets out of bed, the mobile terminal 5 calculates various pieces of information for correcting the health information (specifically, the vitality level) at an appropriate timing (step S20). In this embodiment, the calculated various pieces of information are transmitted to the server 3, and the vitality level is corrected by the server 3. Note that, although FIG. 6 shows that the processing of step S20 is executed after the processing of step S17, the processing of step S20 may be executed before step S17.

[0140] The information calculated in the process of step S20 is calculated based on information acquired during the user's wakefulness period. Hereinafter, the information calculated in the process of step S20 will be referred to as wakefulness information. In this embodiment, the mobile terminal 5 calculates activity information, environmental information, and emotion information as the wakefulness information.

[0141] The activity information is calculated based on the location information detected by the location detection unit 13. Specifically, the mobile terminal 5 calculates activity information indicating the distance, time, and / or method of travel (e.g., walking, train, car, etc.) traveled by the user based on the location information. The mobile terminal 5 also identifies places visited by the user based on the location information, and calculates the activity information from the identified information. For example, if it is identified that the user went to work, activity information indicating that the user worked is calculated. For example, if it is identified that the user went to a massage parlor, activity information indicating that the user received a massage is calculated.

[0142] The environmental information is calculated based on environmental sensor information detected by the environmental sensor 14. Specifically, the mobile terminal 5 acquires temperature (i.e., air temperature) information as the environmental sensor information, and calculates environmental information indicating the user's environment from the acquired information. For example, the mobile terminal 5 acquires temperature information for a period during which the user is performing a predetermined activity, and calculates environmental information indicating the average temperature for that period. The period can be identified based on the location information and / or activity information. For example, the environmental information can include information indicating the average temperature during the user's travel period and information indicating the average temperature during the user's activity (e.g., while at work).

[0143] The emotional information is calculated based on an image captured by the camera 16 and / or audio detected by the microphone 15. Specifically, the mobile terminal 5 captures an image of the user's face with the camera 16, determines the user's facial expression from the captured facial image, and calculates emotional information indicating the user's emotion from the facial expression. The specific content of the emotional information is arbitrary. For example, the emotional information may indicate one of four types of emotion, namely joy, anger, sadness, and pleasure, or may indicate the degree (also referred to as weight) of each of the four types of emotion, or may simply indicate whether the emotion is positive or negative.

[0144] Furthermore, the mobile terminal 5 acquires the user's voice using the microphone 15 and calculates emotion information indicating the user's emotion from the acquired user's voice. Any method may be used to determine an emotion based on the user's voice, and a conventional emotion determination method may be used. For example, the mobile terminal 5 calculates feature quantities (e.g., intensity, tempo, intonation, etc.) for each predetermined unit section of the acquired voice signal, and calculates an emotion index based on the calculated feature quantities. The mobile terminal 5 also stores a table indicating change patterns of each feature quantity for each type of emotion (e.g., anger, joy, and sadness). These change patterns may be created through experiments (i.e., based on results of actually detecting voices from multiple subjects and calculating feature quantities). For each type of emotion, the mobile terminal 5 compares the change patterns indicated in the table with the calculated changes in the feature quantities and identifies the user's emotion based on the comparison results. As a result, emotion information indicating the identified emotion is generated.

[0145] The awakening information calculated as described above is transmitted to the server 3 by the mobile terminal 5. The timing at which the awakening information is transmitted is arbitrary, and if multiple types of awakening information are calculated, the mobile terminal 5 may transmit each of these pieces of awakening information at different timings. The conditions for calculating the awakening information are arbitrary, and in some cases (if the conditions are not met), the awakening information may not be calculated.

[0146] The server 3 corrects the vitality level based on the received awakening information. In this embodiment, the vitality level to be corrected is the vitality level calculated when the user awakens or the vitality level corrected based on the results of the mini-game. The server 3 corrects the vitality level using the awakening information, for example, as follows.

[0147] For example, if the received activity information indicates that the user has walked for a long period of time, the user's fatigue is likely to increase. Therefore, in this case, the server 3 corrects the vitality level to decrease. Also, for example, if the received activity information indicates that the user has had a massage, the user's fatigue is likely to decrease. Therefore, in this case, the server 3 corrects the vitality level to increase. Note that the degree to which the vitality level is increased or decreased may be changed depending on the travel distance (or travel time), travel method, and / or activity content indicated by the activity information.

[0148] Furthermore, if the received environmental information indicates that the user is not comfortable (for example, if the temperature is too hot during travel), the user's fatigue is likely to increase. Therefore, in this case, the server 3 corrects the vitality level to decrease it.

[0149] Furthermore, if the received emotion information indicates a positive emotion (for example, joy or pleasure), it is believed that the user's fatigue will decrease. Therefore, in this case, the server 3 corrects the vitality level to increase. Furthermore, if the received emotion information indicates a negative emotion (for example, anger or sadness), it is believed that the user's fatigue will increase. Therefore, in this case, the server 3 corrects the vitality level to decrease.

[0150] In this way, the server 3 corrects the vitality level based on the awakening information (in this embodiment, activity information, environmental information, and emotional information) acquired while the user is awake. This makes it possible to calculate the vitality level by reflecting the user's actions, circumstances, and state while awake. In this embodiment, the vitality level corrected as described above is notified to the user as the vitality level for the day. That is, the server 3 transmits the corrected vitality level to the mobile terminal 5 at a predetermined timing. The predetermined timing is arbitrary, but in this embodiment, it is a timing corresponding to the user going to bed (details will be described later). Furthermore, in this embodiment, the game processing is executed based on the corrected vitality level, and therefore the awakening information is reflected in the game processing.

[0151] In another embodiment, the process of correcting the vitality level based on the awakening information may be executed by the mobile terminal 5. In this case, the mobile terminal 5 may transmit information indicating the corrected vitality level (and the awakening information) to the server 3, and the server 3 may store the received information in a storage unit.

[0152] After the user gets out of bed, the mobile terminal 5 may enter a standby state (for example, a state in which the display 17 of the mobile terminal 5 is turned off) or a state in which an image from an application other than the game application is displayed on the display 17. In these states, the game image is not displayed on the display 17. However, in these states, the mobile terminal 5 displays the standby image in step S17 in response to a predetermined instruction input for displaying a game image. At this time, the mobile terminal 5 may receive the vitality level at that time (if the vitality level has been corrected, the corrected vitality level) from the server 3 and display the number of remaining lives corresponding to the received vitality level. In this way, after the user gets out of bed, the mobile terminal 5 may display information indicating the corrected vitality level in response to an instruction from the user. This makes it possible to present the current vitality level to the user.

[0153] (Processing when a user enters bed) As shown in Fig. 6, when the mobile terminal 5 detects that the user has gone to bed, it displays a game image at the time of going to bed (step S21). Fig. 13 is a diagram showing an example of the game image at the time of going to bed that is displayed on the mobile terminal when the user has gone to bed. In the game image at the time of going to bed shown in Fig. 13, the player object 51 and information 64 at the time of getting out of bed are displayed. As shown in Fig. 13, when the user has left bed, an image showing the player object 51 returning from an adventure is displayed on the display 17.

[0154] The above-mentioned game image at the time of going to bed is displayed for a predetermined time. After that, the mobile terminal 5 displays a game image (referred to as a replay game image) showing a replay of the adventure of that day (step S22). Note that the switching from the game image at the time of going to bed in step S21 to the replay game image in step S22 may be performed automatically by the mobile terminal 5 in response to the predetermined condition being satisfied as described above, or may be performed in response to an instruction from the user.

[0155] In step S22, the mobile terminal 5 first requests the server 3 to transmit game result information indicating the game result. In response to this request, the server 3 transmits the game result information to the mobile terminal 5. This game result information includes information on the above-mentioned vitality level (i.e., the corrected vitality level). In addition, as will be described in detail later, in this embodiment, a benefit may be granted to the user depending on the game result. Therefore, the game result information includes information on the benefit to be granted to the user.

[0156] When the mobile terminal 5 receives the game result information from the server 3, it generates a replay game image based on the game result information and displays it on the display 17. FIG. 14 is a diagram showing an example of a replay game image. As shown in FIG. 14, the replay game image displays a replay of an adventure performed by the player object 51 during the day (in other words, while the user is awake). For example, as shown in FIG. 14, a scene in which the player object 51 fights an enemy character 65 is displayed. Note that the image displayed as the replay game image (a moving image in this embodiment) may be the same as or different from the image showing the adventure that was displayed as the standby image in step S17.

[0157] Furthermore, as shown in FIG. 14, the replay game image displays game result information 66 indicating the game result. In this embodiment, the game result information 66 indicates the amount of damage inflicted on the enemy character 65 as the game result. The amount of damage is calculated based on the vitality level indicated by the game result information. The game result is calculated so that the higher the vitality level, the better the result. In other words, the better the user's health information indicates, the better the game result will be.

[0158] In this embodiment, the amount of damage is calculated using the same calculation method as the number of remaining lives in the game image at awakening. In other words, although the way in which the amount of damage is expressed as a game element differs from the number of remaining lives, it is the same as the number of remaining lives as a numerical value indicating vitality. For example, if the user's vitality level at awakening is 80, the number of remaining lives is 80, and if the vitality level at going to bed is 80, the amount of damage is also 80. In this way, by presenting the same index of health information (specifically, vitality level) at awakening and going to bed, changes in health information during the awakening period can be presented to the user in an easy-to-understand manner. For example, if the number of remaining lives at awakening is 80 and the amount of damage at going to bed is 70, the user can recognize that their vitality level has decreased during the awakening period (i.e., their fatigue has increased).

[0159] In another embodiment, the game result information may include information indicating a correction value of the vitality level based on the awakening information. In this case, the mobile terminal 5 may display a game element indicating the correction value of the vitality level. For example, the mobile terminal 5 may display, as the game result information 66, the amount of damage corresponding to the vitality level at awakening and the amount of damage corresponding to the correction value.

[0160] In another embodiment, the vitality level based on information acquired during the sleeping period (for example, biological information from the Doppler sensor 24) and the vitality level based on information acquired during the awake period (for example, awake information) may be calculated separately. In this case, the mobile terminal 5 may display these two types of vitality levels as separate game elements.

[0161] Furthermore, the mobile terminal 5 may display a replay game image showing the player object 51 performing an action according to the awakening information (in other words, according to the correction value corresponding to the awakening information). For example, when activity information indicating that the user has traveled a long distance on foot is acquired, an image showing the player object 51 traveling a long distance may be displayed, and further, a display indicating that the number of remaining lives has decreased may be performed. For example, when environmental information indicating that the user has been in a hot environment is acquired, an image showing the player object 51 traveling in a hot place may be displayed, and further, a display indicating that the number of remaining lives has decreased may be performed. For example, when emotion information indicating a positive emotion is acquired, the expression of the player object 51 during the adventure may become a smile, and further, a display indicating that the number of remaining lives has increased may be performed.

[0162] In another embodiment, the mobile terminal 5 may display a replay game image indicating that an item according to the awakening information (in other words, according to the correction value corresponding to the awakening information) is given to the player object 51.

[0163] In this embodiment, the mobile terminal 5 progresses the story of the game according to the game result. Specifically, in the game of this embodiment, a plurality of stages are prepared, and the player object 51 advances to the next stage by defeating an enemy character appearing in the current stage (in other words, by inflicting a predetermined amount of damage). Therefore, when the cumulative value of the amount of damage due to one or more game results exceeds a predetermined amount, the mobile terminal 5 displays a replay game image showing the player object 51 defeating the enemy character 65, and further notifies the player that the player object 51 will advance to the next stage.

[0164] In this embodiment, a benefit may be awarded to the user depending on the game result. When a benefit is awarded, game result information 66 including information indicating that the benefit has been awarded is displayed, as shown in FIG. 14. In this embodiment, coins that can be used in the game (for example, with which items can be purchased) are awarded as the benefit. Although not shown in FIG. 6, it is assumed that items can be acquired using the coins in the game in this embodiment. The benefit is not limited to a benefit related to the game (for example, the coins or items), but may also be a benefit related to a network service provided by the server 3. For example, the benefit may be points that can be used in the network service, or content provided in the network service.

[0165] The server 3 determines whether to grant a bonus and, if so, what the bonus will be, based on various information (in this embodiment, health information and awakening information) received from the mobile device 5. For example, the server 3 determines whether to grant a bonus and what the bonus will be, based on the vitality level calculated based on the various information. The server transmits game result information including bonus information regarding the bonus to be granted to the mobile device 5. The bonus information may be information indicating the bonus to be granted (e.g., information indicating the game item to be granted or information indicating the number of points to be granted), information about the bonus itself (e.g., data about the content), or information indicating a notification that the use of the bonus (e.g., the content) on the mobile device 5 is permitted. As described above, the specific method for granting the content as a bonus is arbitrary, and may include a method in which content data is transmitted from the server 3 to the mobile device 5, or a method in which the content data is pre-stored in the mobile device 5 and the use of the content is permitted (in other words, unlocked) in response to the notification from the server 3.

[0166] When the mobile terminal 5 receives the game result information including the above-mentioned benefit information, the mobile terminal 5 executes a process of granting a benefit based on the benefit information. For example, the mobile terminal 5 changes parameters in the game process (specifically, parameters indicating the items and coins possessed by the player object 51) according to the granted items and coins, updates data on the number of points possessed by the user in the above-mentioned network service, and stores content data in a predetermined storage unit.

[0167] 14, the replay game image may include the advice information described above. For example, the server 3 determines the content of advice based on various information (health information and awakening information in this embodiment) received from the mobile terminal 5, and generates the advice information. The server 3 transmits game result information including the generated advice information to the mobile terminal 5. The mobile terminal 5 displays the replay game image including the advice information received from the server 3. The advice information may be generated by the mobile terminal 5.

[0168] The display of the replay game image may be stopped automatically by the mobile terminal 5 when a predetermined condition (for example, the image has been displayed for a predetermined period of time) is satisfied, or may be stopped in response to a user instruction. Also, for example, the display of the replay game image may be stopped when the user falls asleep.

[0169] In the above embodiment, the terminal system 2 detects that the user has gone to bed when the mobile terminal 5 is attached to the base device. Here, the method of detecting that the user has gone to bed is arbitrary and is not limited to the above method. For example, in another embodiment, the terminal system 2 may detect that the user has gone to bed when the user enters the detection range of the Doppler sensor 24 of the base device 6.

[0170] In the above case, in order to start detection by the Doppler sensor 24 before the user goes to bed, the Doppler sensor 24 may be configured to automatically start detection when a predetermined condition is satisfied. For example, if the mobile terminal 5 and the base device 6 are capable of wireless communication, an instruction to start detection by the Doppler sensor 24 may be sent to the base device 6 on the condition that the mobile terminal 5 enters a predetermined range of the base device 6. Note that, when the mobile terminal 5 and the base device 6 perform short-range wireless communication, the determination of whether the mobile terminal 5 has entered the predetermined range of the base device 6 may be made by determining whether the base device 6 has entered the communication range of the mobile terminal 5. For example, the above determination may be made by determining whether the mobile terminal 5 is located at the user's home based on the location detected by the location detection unit 13. In another embodiment, the mobile terminal 5 may instruct the base device 6 to start detection by the Doppler sensor 24 in response to a predetermined input instruction given by the user to the mobile terminal 5.

[0171] In another embodiment, the terminal system 2 may set an expected bedtime and start detection by the Doppler sensor 24 when the expected bedtime arrives. The expected bedtime may be specified by the user or calculated based on the user's past bedtimes and / or sleep onset times. For example, the terminal system 2 may store the sleep onset times for the past month and set the expected bedtime to a time a predetermined time before (e.g., one hour before) the average sleep onset time for the past month.

[0172] In another embodiment, the mobile terminal 5 may detect that the user has returned home and execute the process of step S21 in response to the user's return. The method for detecting the user's return may be arbitrary, and may be, for example, based on the detection result by the position detection unit 13. Specifically, the location of the user's home may be registered in the mobile terminal 5 in advance, and the mobile terminal 5 may determine that the user has returned home when the location of the mobile terminal 5 detected by the position detection unit 13 is within a predetermined distance from the home location. For example, the terminal system 2 may detect the user's return home using the Doppler sensor 24 of the base device 6. That is, the terminal system 2 may activate the Doppler sensor 24 intermittently (for example, once every predetermined time) to determine whether or not the user is present, and may determine that the user has returned home when it is determined that the user is present. For example, the terminal system 2 may have a detection unit (for example, a camera or a motion sensor such as an infrared sensor) installed at a predetermined position in the user's home and detect the user's return home based on the detection result by the detection unit.

[0173] As described above, in this embodiment, when the user goes to bed, an image showing the player object 51 returning from an adventure is displayed, and further, an image showing a replay of the adventure and the game result of that day (in this embodiment, the amount of damage inflicted on an enemy character) is displayed. In this way, when the user goes to bed, the vitality level that reflects the user's condition and / or behavior on that day can be presented to the user. Furthermore, since the vitality level is displayed as a game element when the user goes to bed, just like when the user wakes up, the user can check their health information (vitality level in this embodiment) in a game-like manner, which can motivate the user to continue checking their health information every day.

[0174] In this embodiment, the user's health information serves as game input for game processing. In other words, the user's measurement of health information serves as game input, and the game cannot progress unless the user measures their health information. This allows the user to measure their health information in a game-like manner, and motivates the user to continue measuring their health information every day.

[0175] In the series of processes of steps S11 to S22, game images are displayed on the display 17 at appropriate timings (steps S11 to S13, S16, S17, S21, and S22). Here, at the above timings, the display 17 may be turned off while the mobile terminal 5 is in a standby state, or an image from an application other than the game application may be displayed on the display 17. In this case, instead of immediately displaying the game images, the mobile terminal 5 may notify the user by sound, display, and / or vibration. Furthermore, the mobile terminal 5 may display game images on the display 17 in response to a predetermined display instruction input by the user who has received the notification.

[0176] In the above embodiment, the advice information is presented to the user at an appropriate timing (such as when the user wakes up). In other embodiments, the terminal system 2 may present the user with information other than the advice information in order to improve the content of the calculated health information (e.g., the evaluation result). That is, the terminal system 2 may present recommendation information to the user together with or instead of the advice information, or may output content. The recommendation information is information introducing products, etc., that are recommended to the user in order to improve the content of the calculated health information. The content is music and / or video that is recommended to the user in order to improve the content of the calculated health information.

[0177] Furthermore, the terminal system 2 may display on the display 17 of the mobile terminal 5 an image to be displayed before the user gets out of bed and / or an image to be displayed after the user goes to bed, and may also project and display the image using the projector 25 of the base device 6. This allows the user to check the evaluation results and the like when waking up without having to pick up the mobile terminal 5. The image to be displayed before the user gets out of bed is, for example, the above-mentioned awakening game image, simple display image, and / or standby image. The image to be displayed after the user goes to bed is, for example, the above-mentioned going-to-bed game image and / or replay game image.

[0178] As described above, the mobile terminal 5 starts measurement for calculating the user's health information in response to detection of admission to bed (step S23). Note that, in Fig. 6, the start timing of the measurement (step S23) is shown as after the display of the replay game image (step S22), but the measurement may be started at any timing according to admission to bed.

[0179] When the measurement is started, the terminal system 2 calculates sleep indices based on the measurement results as described above. Then, the terminal system 2 executes information processing according to the sleep state represented by the sleep indices (step S24). As this information processing, for example, the following processing is executed. A process of playing sleep-inducing content (specifically, music and / or video that encourages sleep) before the user falls asleep, and ending the playback once the user falls asleep. - Displaying the current time when the user wakes up A process to start playing awakening content (specifically, music and / or video that stimulates awakening) just before the user wakes up. Processing for changing the state of the mobile terminal 5 in response to the user falling asleep (for example, turning off the power, putting it into standby mode, putting it into silent mode, etc.) Processing for changing the state of the mobile terminal 5 in response to the user's awakening (for example, turning on the power, canceling silent mode, etc.) When presenting an image to the user in each of the above processes, the display 17 of the mobile terminal 5 may be used, the projector 25 of the base device 6 may be used, or both may be used.

[0180] [3. Specific examples of processing in information processing systems] Next, a specific example of processing executed in the information processing system will be described. First, with reference to Fig. 15 to Fig. 18, a specific example of processing executed in the terminal system 2 will be described. The mobile terminal 5 executes a measurement process, a wake-up process, a daytime process, and a bedtime process. In this embodiment, each of these processes is executed by the processing unit 11 executing a game program stored in the mobile terminal 5. Note that in other embodiments, part of each of these processes (e.g., the measurement process) may be realized by a program different from the game program. Furthermore, part or all of each of the above processes may be executed by another information processing device (e.g., the base device 6 and / or the server 3), or may be executed by cooperation between the mobile terminal 5 and the other information processing device.

[0181] The measurement process is a process for measuring biological information mainly during the user's sleep period and calculating health information. The waking process is a process for presenting game images and the like including the evaluation results of health information (specifically, vitality level) to the user mainly when the user wakes up. The daytime process is a process for calculating the above-mentioned waking information (specifically, activity information, environmental information, and emotional information) mainly during the daytime activity period (in other words, the period from when the user gets out of bed to when they go to bed). The bedtime process is a process for presenting game images and the like including the evaluation results of health information for one day to the user mainly when the user goes to bed. As described above, each of the above processes is generally executed in different periods, but two or more of the processes may be executed in parallel in a certain period. Each of the above processes will be described in detail below.

[0182] (3-1: Measurement processing) 15 is a flowchart showing an example of the flow of measurement processing executed in the mobile terminal 5. In this embodiment, the series of processing shown in FIG. 15 is started when it is detected that the user has entered bed, that is, when the mobile terminal 5 is attached to the base device 6. Note that in other embodiments, the series of processing may be started when communication between the mobile terminal 5 and the base device 6 is started, or when the user performs a predetermined start operation on the mobile terminal 5 or the base device 6.

[0183] In this application, the processing of each step in the flowcharts shown in the drawings is merely an example, and the processing order of each step may be changed, or another process may be executed in addition to (or instead of) the processing of each step, as long as the same results are obtained. Also, in this specification, the processing of each step in the above flowcharts is described as being executed by the CPU of each device (specifically, the mobile terminal 5, the base device 6, and the server 3), but the processing of some steps in the above flowcharts may be executed by a processor other than the CPU or a dedicated circuit.

[0184] In the measurement process, first, in step S31, the portable terminal 5 executes a start-up process. The start-up process is a process that is executed in response to the start of the series of processes shown in Fig. 15 (in this embodiment, in response to the portable terminal 5 being attached to the base device 6). In this embodiment, as the start-up process, a detection start process and a playback start process are executed (details will be described later).

[0185] In the detection start process, the mobile terminal 5 starts detection using a sensor (i.e., the Doppler sensor 24) that detects biological information for calculating health information. That is, the processing unit 11 of the mobile terminal 5 instructs the base device 6 to start the detection operation. In response to this instruction, the control unit 22 of the base device 6 causes the Doppler sensor 24 to start the detection operation.

[0186] Furthermore, in the playback start process, the mobile terminal 5 starts playing back the content for falling asleep. That is, the processing unit 11 reads out the pre-stored content for falling asleep and plays back the content for falling asleep using the display 17 and / or the speaker. Note that the content played back in the terminal system 2 (i.e., the content for falling asleep and the content for waking up) may be stored in the base device 6, may be stored in the mobile terminal 5, or may be obtained from an external device (e.g., the server 3) via the mobile terminal 5.

[0187] Furthermore, when the start process of step S31 is executed (in other words, in response to the portable terminal 5 being attached to the base device 6), the base device 6 executes a charging start process. In the charging start process, the base device 6 starts charging the portable terminal 5. Specifically, the control unit 22 instructs the power acquisition unit 23 to start charging. In response to this instruction, the power acquisition unit 23 supplies power from an external power source to the portable terminal 5 via the connector 21. It is assumed that the base device 6 is connected to the external power source (i.e., the power plug is connected to an outlet). It is also possible for the base device 6 to check the remaining battery level of the portable terminal 5 and start the charging operation if the remaining battery level is equal to or less than a predetermined level. The charging operation ends when the battery of the portable terminal 5 is charged to capacity.

[0188] In other embodiments, the process executed as the start-up process is arbitrary, and any one or two of the above three processes (i.e., detection start process, regeneration start process, and charging start process) may be executed, or another process different from the above three processes may be executed, or the start-up process may not be executed.

[0189] After the process of step S31, the processes of steps S32 to S38 described below are repeatedly executed during the sleep period. In this embodiment, the process loop of steps S32 to S38 is executed once every predetermined time.

[0190] In step S32, the mobile terminal 5 acquires the detection result (i.e., biological information) of the Doppler sensor 24. The Doppler sensor 24, which has started its detection operation through the detection start process of step S31, outputs the detection result (specifically, an output waveform) to the control unit 22. The control unit 22 transmits the detection result to the mobile terminal 5. As a result, the detection result of the Doppler sensor 24 is acquired by the mobile terminal 5. Note that the control unit 22 may transmit the information on the detection result of the Doppler sensor 24 directly to the mobile terminal 5, or may perform some processing on the detection result (for example, a process to remove noise contained in the signal of the detection result, a process to calculate the sleep index, etc.) and then transmit the information to the mobile terminal 5.

[0191] In step S33, the mobile terminal 5 calculates sleep information (e.g., various sleep indices). That is, the processing unit 11 calculates various sleep indices based on the detection results (e.g., biological information) acquired in step S32. The calculation of the sleep indices is performed by the method described above in "(2-2: Method for calculating health information)." Note that in step S33, the processing unit 11 only needs to calculate information (i.e., sleep indices) used to determine the user's sleep state in steps S34 and S35, which will be described later. In step S33, the processing unit 11 does not need to calculate sleep indices (e.g., total sleeping time), fatigue information (in other words, fatigue level), and vitality level, which can only be calculated at the end of the sleep period.

[0192] In step S34, the mobile terminal 5 executes information processing according to the user's sleeping state (step S24 shown in FIG. 6). That is, similar to step S24, the processing unit 11 determines whether the user's sleeping state has reached a predetermined state. If it is determined that the user has reached the predetermined state, the operation, operating mode, and / or settings of the mobile terminal 5 (and the base device 6) are controlled.

[0193] In step S35, the mobile terminal 5 determines whether the user has woken up. That is, the processing unit 11 determines whether the user has woken up based on the biological information acquired in step S32 and / or the sleep indices calculated in step S33. If it is determined that the user has woken up, a series of processes from steps S36 to S38 are executed. On the other hand, if it is determined that the user has not woken up, the series of processes from steps S36 to S38 are skipped and the process of step S32 is executed again. That is, the series of processes from steps S32 to S35 are repeatedly executed until it is determined that the user has woken up.

[0194] In step S36, the mobile terminal 5 calculates health information based on information (specifically, biological information) acquired during the sleeping period. The health information is calculated by the method described above in "(2-2: Method for calculating health information)". In this embodiment, in step S36, the processing unit 11 first calculates an autonomic nervous index based on the biological information acquired in step S32. The processing unit 11 also calculates sleep indices (e.g., total sleeping time) that cannot be calculated during the sleeping period based on the biological information acquired in step S32. Furthermore, the processing unit 11 calculates fatigue levels and vitality levels based on various sleep indices and autonomic nervous indices. In this way, health information including sleep indices and fatigue indices is calculated.

[0195] In step S37, the mobile terminal 5 transmits the health information calculated in step S36 to the server 3. That is, the processing unit 11 transmits the calculated health information to the server 3 via the communication unit 10. As a result, the health information for one sleeping period is transmitted to the server 3 and stored in the server 3. In this way, in the present embodiment, the mobile terminal 5 automatically transmits the information to be transmitted to the server 3. That is, the information is uploaded to the server 3 even if the user does not issue an instruction.

[0196] After step S37, the portable terminal 5 ends the measurement process. At this time, the processing unit 11 of the portable terminal 5 instructs the base device 6 to stop the detection operation. In response to this instruction, the control unit 22 of the base device 6 causes the Doppler sensor 24 to stop the detection operation.

[0197] In this embodiment, if the portable terminal 5 is detached from the base device 6 for some reason during the sleep period (for example, if the user turns over and hits the portable terminal 5), the base device 6 cannot transmit the detection results of the Doppler sensor 24 to the portable terminal 5. In this case, the base device 6 stores the detection result data that could not be transmitted to the portable terminal 5 in its own storage unit (for example, a memory). Then, the next time the portable terminal 5 is attached to the base device 6, the base device 6 transmits the detection result data stored in the storage unit to the portable terminal 5. The portable terminal 5 that has received the data calculates sleep indices based on the detection results (step S33). The portable terminal 5 does not need to execute control processing (step S34) based on the sleep indices calculated at this time because the sleep indices calculated at this time are based on past detection results.

[0198] Furthermore, if it is determined that the user is awake based on the calculated sleep indices (if the determination result in step S35 is positive), the mobile device 5 executes the processes of steps S36 to S38. In this way, even if the mobile device 5 is detached from the base device 6 while the user is asleep, the health information is calculated and transmitted to the server 3 the next time the mobile device 5 is attached to the base device 6. Therefore, for example, if the user wakes up and realizes that the mobile device 5 has been detached from the base device 6, the user may attach the mobile device 5 to the base device 6. This allows the terminal system 2 to calculate and transmit the health information to the server 3.

[0199] In another embodiment, when the mobile terminal 5 and the base device 6 are capable of wireless communication, the processing of steps S32 to S35 can be continuously executed even if the mobile terminal 5 is disconnected from the base device 6.

[0200] (3-2: Awakening Process) Fig. 16 is a flowchart showing an example of the flow of the awakening process executed in the mobile terminal 5. In this embodiment, the series of processes shown in Fig. 16 is started in response to detection that the user has awakened (Yes in step S35).

[0201] In the awakening process, first, in step S40, the mobile terminal 5 displays the above-mentioned awakening game image (step S11 shown in FIG. 6). Before step S40, the processing unit 11 calculates the evaluation result of the health information (specifically, the vitality level) in the process of step S36 in the above-mentioned measurement process (FIG. 15). The processing unit 11 generates an awakening game image based on the calculated health information and displays it on the display 17. When a predetermined time has elapsed since the above-mentioned awakening game image was displayed, the process of step S41 is executed.

[0202] In step S41, the mobile terminal 5 displays the above-mentioned simplified display image (step S12 shown in FIG. 6). That is, the processing unit 11 generates a simplified display image based on the health information calculated in the processing of step S36 above, and displays it on the display 17. When a predetermined time has elapsed since the display of the simplified display image, the processing of step S42 is executed.

[0203] In step S42, the mobile terminal 5 displays the standby image described above (step S13 shown in FIG. 6). That is, the processing unit 11 displays on the display 17 a standby image prepared in advance.

[0204] In step S43, the mobile terminal 5 determines whether or not to perform a detailed display. That is, the processing unit 11 determines whether or not an instruction input to perform a detailed display (for example, an input to the detailed display button 56) has been made while the standby image is being displayed. If the determination result in step S43 is positive, the process of step S44 is executed. On the other hand, if the determination result in step S43 is negative, the process of step S45 is executed.

[0205] In step S44, the mobile terminal 5 executes a detail display process (step S14 shown in FIG. 6). In the detail display process, the processing unit 11 creates various detail display images (FIGS. 10 and 11) based on the health information calculated in the process of step S36 above, and displays them on the display 17. Depending on the content of the detail display image, the processing unit 11 may read out past health information stored in the mobile terminal 5 and create a detail display image based on that health information. The processing unit 11 may also receive health information of other users from the server 3 and create a detail display image based on that health information. The process of step S44 above ends when the user inputs a predetermined end instruction (for example, an input to the menu button 59), and then the process of step S42 is executed again.

[0206] Meanwhile, in step S45, the mobile terminal 5 determines whether or not to execute a mini-game. That is, the processing unit 11 determines whether or not an instruction input to execute a mini-game (for example, an input to the mini-game button 57) has been made while the standby image is being displayed. If the determination result of step S45 is positive, the processes of steps S46 and S47 are executed. On the other hand, if the determination result of step S45 is negative, the process of step S48, which will be described later, is executed.

[0207] In step S46, the mobile terminal 5 executes the mini-game (step S15 shown in FIG. 6). That is, the processing unit 11 accepts a game input from the user, executes a mini-game process in accordance with the game input, and displays a game image representing the result of the mini-game on the display 17. When the mini-game ends, or when the user gives an instruction to end the mini-game, the processing of step S46 ends, and then the processing of step S47 is executed.

[0208] In step S47, the mobile terminal 5 corrects the vitality level based on the result of the mini-game, and transmits the corrected vitality level to the server 3. That is, the processing unit 11 corrects the vitality level calculated in step 36 above, based on the result of the mini-game in step S46. Furthermore, the processing unit 11 transmits information indicating the corrected vitality level to the server 3 via the communication unit 10. After step S47, the processing of step S42 is executed again.

[0209] On the other hand, in step S48, the mobile terminal 5 determines whether or not the user has left bed. That is, the processing unit 11 determines whether or not the mobile terminal 5 has been detached from the base device 6. If the determination result of step S48 is positive, the process of step S49 is executed. On the other hand, if the determination result of step S48 is negative, the process of step S43 is executed again. That is, in this case, the standby image continues to be displayed.

[0210] In step S49, the mobile terminal 5 displays the above-mentioned game image for getting out of bed. That is, the processing unit 11 generates a game image for getting out of bed based on the health information (specifically, the vitality level) calculated in the process of step S36 or step S47, and displays it on the display 17. When a predetermined time has elapsed since the display of the game image for getting out of bed, the mobile terminal 5 ends the series of processes for waking up shown in FIG.

[0211] (3-3: Daytime processing) Fig. 17 is a flowchart showing an example of the flow of daytime processing executed in the mobile terminal 5. In this embodiment, the series of processing shown in Fig. 17 is started in response to the end of the awakening processing (Fig. 16) (in other words, it is executed following the awakening processing).

[0212] In step S50, the mobile terminal 5 determines whether or not to calculate the awakening information for correcting the health information (specifically, the vitality level) (in other words, whether or not the timing for calculating the awakening information has arrived). That is, the processing unit 11 performs a process of determining whether or not the conditions for calculating any of the various types of awakening information have been met. The specific content of this determination process is arbitrary, but in this embodiment, the determination process is performed in the following manner.

[0213] Regarding the activity information, the processing unit 11 determines whether the conditions for calculating the activity information are satisfied. The calculation conditions are arbitrary, but in this embodiment, the conditions are that the user's movement has ended (first condition) and that the user has stayed at the location for which the activity information is to be calculated (second condition). If either the first condition or the second condition is satisfied, it is determined that the conditions for calculating the activity information are satisfied.

[0214] Whether the first condition is satisfied can be determined, for example, by determining whether the detected position indicated by the position information moves from one location and then stops at another location for a predetermined time or more (for example, 10 minutes or more).

[0215] Whether the second condition is satisfied is determined as follows. That is, the processing unit 11 first determines whether the detected position has stayed at a pre-registered location for a predetermined time or more (for example, 15 minutes or more) and then started moving. If it is determined that the user has not stayed at the location for the predetermined time or more or has not started moving, the processing unit 11 determines that the second condition is not satisfied. Note that the "pre-registered location" may be a location related to the user, such as the user's home or workplace, or a facility such as a sports gym, restaurant, or movie theater. If it is determined that the user has stayed at this location, activity information is calculated.

[0216] Regarding the environmental information, the processing unit 11 determines whether the conditions for calculating the environmental information are satisfied. In this embodiment, the environmental information is calculated at the same time as the activity information is calculated. Therefore, the processing unit 11 makes the above determination based on whether the activity information has been calculated.

[0217] Regarding emotion information, processing unit 11 determines whether or not the conditions for calculating emotion information are satisfied. In this embodiment, for example, the following conditions are set as the conditions for calculating emotion information. The period during which the user's voice or image is detected (for example, a period of a predetermined length or longer) has ended. The user ends the call on the mobile terminal 5. - The pre-set event period has ended The user's voice / image can be identified by registering the user's voice / image data in advance in the mobile terminal 5 and comparing the voice / image detected by the microphone 15 with the registered voice / image. The predetermined event period can be identified based on, for example, information (e.g., a meeting) registered as a schedule in the mobile terminal 5.

[0218] In step S50, the processing unit 11 acquires information for calculating the wakefulness information (specifically, position information, environmental sensor information, information on images captured by the camera 16, and information on sounds detected by the microphone 15), and performs the above-mentioned determination process based on the acquired information. If the determination result in step S50 is positive, the process of step S51 is executed. On the other hand, if the determination result in step S50 is negative, the process of step S51 is skipped and the process of step S52 is executed.

[0219] In step S51, the mobile device 5 performs a calculation process on information for which the calculation conditions are satisfied among the various types of wakefulness information. Then, the mobile device 5 transmits the calculated information to the server 3. Specifically, if the conditions related to the activity information are satisfied in step S50, the processing unit 11 calculates the activity information based on the location information. Furthermore, if the conditions related to the environment information are satisfied in step S50, the processing unit 11 calculates the environment information based on the environment sensor information. Furthermore, if the conditions related to the emotion information are satisfied in step S50, the processing unit 11 calculates the emotion information based on the image captured by the camera 16 and / or the sound detected by the microphone 15. Then, the processing unit 11 transmits the calculated information to the server 3 via the communication unit 10. Following step S51, the processing unit 11 executes the process of step S52.

[0220] In step S52, the portable terminal 5 determines whether or not to display a standby image. That is, the processing unit 11 determines whether or not the timing to display the standby image has arrived (i.e., the timing when a predetermined time has elapsed since the start of displaying the game image when getting out of bed in step S49 described above) and whether or not a predetermined instruction has been input to display the game image. Then, if it is determined that the display timing has arrived or that the instruction has been input, the processing unit 11 determines to display the standby image and executes the processing of step S53. On the other hand, if it is determined that the display timing has not arrived and that the instruction has not been input, the processing unit 11 determines not to display the standby image and executes the processing of step S56 described below.

[0221] In step S53, the mobile terminal 5 determines whether a predetermined time has elapsed since the user got up from bed. That is, the processing unit 11 determines whether a predetermined time has elapsed since the determination result in the above-mentioned step S48 became positive. If the determination result in step S53 is positive, the process of step S54 is executed. On the other hand, if the determination result in step S53 is negative, the process of step S55 is executed.

[0222] In step S54, the mobile terminal 5 displays a standby image indicating that the mini-game cannot be executed (step S17 shown in FIG. 6). That is, the processing unit 11 displays a standby image that does not include the mini-game button 57 on the display 17. When this standby image is displayed, the user cannot execute the mini-game. After step S54, the process of step S56 is executed.

[0223] In step S55, the mobile terminal 5 displays a standby image in which a mini-game can be played (step S17 shown in FIG. 6). That is, the processing unit 11 displays a standby image (FIG. 9) including a mini-game button 57 on the display 17. When this standby image is displayed, the user can play the mini-game. After step S55, the process of step S56 is executed.

[0224] In step S56, the mobile terminal 5 determines whether or not to perform detailed display. The determination process in step S56 is the same as the determination process in step S43. If a standby image is not being displayed when processing step S56, it is determined that detailed display will not be performed. If the determination result in step S56 is positive, processing in step S57 is executed. On the other hand, if the determination result in step S56 is negative, processing in step S58 is executed.

[0225] In step S57, the mobile terminal 5 executes a detailed display process (step S18 shown in FIG. 6). The detailed display process in step S57 is the same as the detailed display process in step S44. The process in step S57 ends when the user inputs a predetermined end instruction (specifically, an input to the menu button 59), and then the process in step S53 is executed again.

[0226] In step S58, the mobile terminal 5 determines whether or not to execute a mini-game. The determination process in step S58 is the same as the determination process in step S45. If the standby image is not displayed during the processing of step S58, it is determined that a mini-game will not be executed. If the determination result of step S58 is positive, the processing of step S59 is executed. On the other hand, if the determination result of step S58 is negative, the processing of step S61 is executed.

[0227] In step S59, the mobile terminal 5 executes a mini-game (step S19 shown in FIG. 6). The mini-game processing in step S59 is the same as the mini-game processing in step S46.

[0228] In the following step S60, the mobile terminal 5 corrects the vitality level based on the mini-game result, and transmits the corrected vitality level to the server 3. The process in step S60 is the same as the process in step S47. After step S60, the process of step S61 is executed.

[0229] In step S61, the mobile terminal 5 determines whether or not the user has gone to bed. That is, the processing unit 11 determines whether or not the mobile terminal 5 has been attached to the base device 6. If the determination result in step S61 is negative, the processing of step S50 is executed again. Then, the series of processes from steps S50 to S61 are repeatedly executed until it is determined that the user has gone to bed. On the other hand, if the determination result in step S61 is positive, the processing unit 11 ends the daytime processing shown in FIG. 17.

[0230] (3-4: Treatment upon admission) Fig. 18 is a flowchart showing an example of the flow of the admission process executed by the mobile terminal 5. In this embodiment, the series of processes shown in Fig. 18 is started in response to detection that the user has entered bed (Yes in step S61).

[0231] In the bedside treatment, first, in step S71, the mobile terminal 5 requests the server 3 to transmit game result information indicating the game result (specifically, the game result based on the energy level for the day). In response, the server 3 transmits the game result information regarding the user to the mobile terminal 5. The processing unit 11 receives the game result information transmitted from the server 3 via the communication unit 10 and stores it in the memory unit of the mobile terminal 5.

[0232] In the following step S72, the mobile terminal 5 displays the above-mentioned going to bed game image (step S21 shown in FIG. 6). That is, the processing unit 11 displays a previously prepared going to bed game image on the display 17. When a predetermined time has elapsed since the above-mentioned going to bed game image was displayed, the processing of step S73 is executed.

[0233] In step S73, the mobile terminal 5 displays the above-mentioned replay game image (step S22 shown in FIG. 6). That is, the processing unit 11 generates a go-to-bed game image based on the game result information received from the server 3 via the communication unit 10, and displays it on the display 17 (see FIG. 14). This allows the user to be presented with a game result based on the daily energy level, and in some cases, a bonus may be awarded to the user. When a predetermined time has elapsed since the end of the video playback of the replay game image in step S73, the mobile terminal 5 ends the go-to-bed processing shown in FIG. 18.

[0234] (3-5: Processing on the server) Next, a specific example of the processing executed by the server 3 will be described with reference to Fig. 19. As described above, the mobile terminal 5 transmits health information and the like to the server 3. The server 3 evaluates the user's health based on the received information (i.e., corrects the vitality level) and provides network services according to the evaluation results. Details of the processing executed by the server 3 will be described below.

[0235] Fig. 19 is a flowchart showing an example of the flow of processing executed by the server. The flowchart shown in Fig. 19 is executed continuously regardless of the state of the mobile terminal 5 (for example, regardless of whether the user is awake or asleep).

[0236] First, in step S81, the server 3 determines whether or not information has been received from the mobile terminal 5. As described above, the mobile terminal 5 transmits various pieces of information to the server 3 at appropriate times. Here, the information that the server 3 receives from the mobile terminal 5 includes, for example, the health information transmitted in step S37, the health information transmitted in step S47 or S60 (specifically, the corrected vitality level), and the wakefulness information calculated in step S51 (here, activity information, environmental information, and emotional information). If the server 3 receives the various pieces of information, the determination result in step S81 is positive. On the other hand, if the server 3 does not receive the various pieces of information, the determination result in step S81 is negative. If the determination result in step S81 is positive, the process of step S82 is executed. On the other hand, if the determination result in step S81 is negative, the process of step S82 is skipped, and the process of step S83, which will be described later, is executed.

[0237] In step S82, the server 3 stores (also referred to as accumulates) the information received from the mobile terminal 5 for each user. That is, the processing unit (specifically, the CPU) of the server 3 updates the user data indicating various information related to the user so that it includes the received information. Here, the user data stored in the server 3 will be described.

[0238] Fig. 20 is a diagram showing an example of the data configuration of user data stored in the server in this embodiment. Fig. 20 shows user data for one user stored in the server 3. Although not shown, the server 3 stores data similar to the user data shown in Fig. 20 for each user in the network service in a predetermined storage unit.

[0239] As shown in FIG. 20 , the user data includes user identification data, user status data, game data, and bonus data. In the server 3, a set of these five types of data is accumulated for each user. Note that the user data may include data other than these four types of data, or may not include some of these four types of data. In other embodiments, the user data may include, for example, preference data indicating the user's preferences. In addition to the user status data, the user data may also include information used to calculate the information represented by the user status data (for example, the above-mentioned location information and environmental sensor information).

[0240] The user identification data is data indicating identification information (for example, an ID or a password) for identifying a user. In this embodiment, the above identification information is set in a predetermined registration process executed when starting a network service for the user, and user identification data indicating the set identification information is stored in the server 3. Also, in this embodiment, when the mobile terminal 5 transmits information to the server 3, the mobile terminal 5 transmits the information to the server 3 including the above identification information. The server 3 identifies the user who is the sender based on the identification information included in the received information.

[0241] The user status data is data indicating various conditions of the user. In this embodiment, the user status data includes data indicating the health information, data indicating activity information, data indicating environmental information, and data indicating emotion information. These four pieces of data each include multiple pieces of information that have been acquired so far. That is, in this embodiment, the four pieces of data indicate, for example, information acquired within a predetermined storage period (e.g., one year) from the most recent piece. Therefore, when information is received in step S81, in step S82, the server 3 updates the data among the four pieces of data corresponding to the received information so that the content includes the received information. Note that, although the server 3 assumes that the storage periods for the four pieces of data are the same, the lengths of the storage periods for the four pieces of data are arbitrary and may be different from each other.

[0242] The game data is data indicating information related to game processing that uses health information as input, and includes data indicating game results, etc. The game data may also include data indicating information related to the mini-game (e.g., information regarding the results of the mini-game).

[0243] The privilege data is data indicating privileges granted to a user, for example, data indicating a history of privileges granted to the user.

[0244] Returning to the description of Fig. 19, in step S83, the server 3 determines whether or not to correct the vitality level. That is, the processing unit of the server 3 determines whether or not the information received in the last executed step S81 is awakening information. If the determination result of step S83 is positive, the process of step S84 is executed. On the other hand, if the determination result of step S83 is negative, the process of step S84 is skipped, and the process of step S85, which will be described later, is executed.

[0245] In step S84, the server 3 corrects the vitality level based on the information received in step S81. That is, the processing unit of the server 3 corrects the vitality level based on the received information by the method described above in "(Daytime processing)". After step S84, the process of step S85 is executed.

[0246] In step S85, the server 3 determines whether or not a request to transmit game result information has been received from the mobile terminal 5. If the determination result in step S85 is positive, the process of step S86 is executed. On the other hand, if the determination result in step S85 is negative, the processes of steps S86 and S87 are skipped, and the process of step S81 is executed again.

[0247] In step S86, the server 3 grants a benefit to the user as needed based on the information received in step S81. That is, the processing unit of the server 3 determines whether to grant a benefit and, if a benefit is to be granted, the content of the benefit based on the current vitality level. The current vitality level is the vitality level finally calculated for today. Specifically, if the processing of step S84 has been executed today, the current vitality level is the vitality level corrected in the last execution of the processing of step S84, and if the processing of step S84 has not been executed today, the current vitality level is the vitality level indicated by the information last received in the processing of step S81.

[0248] In the following step S87, the server 3 transmits the above-mentioned game result information to the mobile terminal 5 that transmitted the request in step S85. That is, the processing unit of the server 3 generates game result information including information indicating the current vitality level and information indicating the benefit granted in the above-mentioned step S87, and transmits it to the mobile terminal 5. After step S87, the processing of step S81 is executed again.

[0249] As described above, in this embodiment, the process of correcting the vitality level (step S84) is executed in response to reception of various types of awakening information for correcting the vitality level, and the process of granting a bonus (step S86) is executed in response to a request from the mobile terminal 5 to transmit game result information. Here, the timing at which the process of step S84 is executed and the timing at which the process of step S85 is executed are arbitrary. For example, in other embodiments, the process of step S84 may be executed in response to the request. Alternatively, the process of step S85 may be executed in response to reception of the awakening information.

[0250] The server 3 repeatedly executes the series of processes from steps S81 to S87 described above. The server 3 executes the series of processes from steps S81 to S87 described above for each of the mobile terminals owned by multiple users who receive network services.

[0251] The main information processing executed by the mobile terminal 5 and the server 3 has been described above with reference to FIGS. 15 to 19. The mobile terminal 5 and the server 3 may execute other information processing in addition to the processing illustrated in FIGS. 15 to 19. For example, the server 3 may manage a website for providing the above-described network service. By accessing this website using the mobile terminal 5, a user can view the evaluation results provided by the server 3 or purchase products or the like related to the recommended information presented by the server 3. At this time, the mobile terminal 5 accepts inputs for making various requests to the website and executes processing in accordance with the accepted inputs. Examples of such requests include a request to log in to the website, a request to view web pages within the website (including, for example, a page showing the evaluation results and a page for purchasing products or the like), and a request to purchase products or the like. The server 3 also executes processing in accordance with a request from the mobile terminal 5. For example, if the request is a request to log in to the website, the server 3 transmits information about a login image (specifically, a web page) to the mobile terminal 5. Furthermore, for example, if the request is a request to acquire a web page, the server 3 transmits information about the web page to the mobile terminal 5.

[0252] [4. Effects of this embodiment] (Effect of application processing being executed in conjunction with sleep state) In the above embodiment, the information processing system 1 that executes an application (specifically, a game application) acquires user information for calculating information related to the user's sleep (step S32). The information processing system 1 also determines the user's sleep state based on the acquired user information (steps S33, S35, S48, and S61).

[0253] Here, the "user's sleep-related state" may be, for example, the user's sleep state, such as waking up (including waking up during the night) and falling asleep, or the user's state before and after sleep, such as getting into bed and getting out of bed. Therefore, the "user information" may be information that can be used to calculate the user's sleep state, or information that can be used to calculate the user's state before and after sleep. That is, the user information may be information (specifically, biological information) detected by the Doppler sensor 24, or information indicating the attachment / detachment state of the mobile terminal 5 and the base device 6. Furthermore, the "user's sleep-related state" may be a state related to the user's actions (e.g., waking up, falling asleep, getting into bed, getting out of bed, etc.) or a state related to sleep evaluation (e.g., a state in which the above-mentioned vitality level satisfies a predetermined condition, more specifically, a state in which the calculated vitality level is such that the cumulative value of damage to enemy characters exceeds a predetermined amount).

[0254] Furthermore, the information processing system 1 executes predetermined information processing in the application in conjunction with the user's sleep state. Here, "executing information processing in conjunction with the user's sleep state" means executing information processing in response to the user's sleep state becoming a predetermined state, or executing information processing in response to the user's sleep state satisfying a predetermined condition. Note that in the above embodiment, "executing information processing in conjunction with the user's sleep state" is realized by automatically executing information processing in response to the user's sleep state becoming a predetermined state (or the user's sleep state satisfying a predetermined condition), or by executing information processing in real time.

[0255] Furthermore, in the case where "information processing is executed in conjunction with the user's sleep-related state," there may be a correlation between the state and the content of the information processing, or there may be a correlation between the result of the state and the result of the information processing. For example, as an example of the former, in the above embodiment, information processing is executed to make the player object perform an action corresponding to the user's sleep-related state. That is, in the above embodiment, processing is executed to display an image showing the player object 51 performing an action corresponding to the user's awakening, getting out of bed, and going into bed (steps S11, S16, and S21 shown in FIG. 6). Also, as an example of the latter, in the above embodiment, information processing is executed to obtain a good game result in response to obtaining a good evaluation result for the user's sleep-related state. That is, in the above embodiment, processing is executed to progress the story of the game in response to the evaluation result for the user's sleep-related state (specifically, the game result) (step S22 shown in FIG. 6).

[0256] According to the above, the information processing system 1 executes information processing in conjunction with the user's sleep-related state, so the user does not need to perform any operation to execute the information processing. This can simplify the user's operation of the information processing system 1. Therefore, it is possible to improve user convenience.

[0257] In the above embodiment, the information processing system 1 automatically starts the execution of the predetermined information processing when it is determined that the user's state has reached a predetermined state. The information processing system 1 also sequentially acquires user information in real time during a predetermined period (step S32), sequentially determines the user's sleep state based on the acquired user information (steps S33 and S36), and starts the execution of the predetermined information processing when it is determined that the user's state has reached a predetermined state (steps S40, S49, and S72). According to the above, the predetermined information processing is executed in real time when the user's state has reached a predetermined state. In the above embodiment, the predetermined period is the period from when the user goes to bed to when they get out of bed, but it may be any period. For example, in other embodiments, the predetermined period may be the period from when the user goes to bed or falls asleep to when they wake up, or may be a period specified by the user.

[0258] Here, in this specification, "automatically" means "without a user operation (or instruction)." In other words, "automatically executing information processing" means that the user does not need to perform an operation or instruction to execute the information processing (more specifically, to start the execution). Note that "automatically" does not mean that no operation (or instruction) is requested from the user. For example, the information processing system 1 may notify the user that the execution of the predetermined information processing will start, and if the user does not give an instruction not to execute the predetermined information processing within a predetermined time from the notification, the information processing system 1 may execute the predetermined information processing. Alternatively, the information processing system 1 may request the user to input predetermined information to be used in the information processing at the start of or during the execution of the predetermined information processing.

[0259] Furthermore, in this specification, "in real time" is not limited to the strict meaning of immediacy. For example, the information processing system 1 may acquire user information several seconds to several tens of seconds after the user information is detected by a sensor or the like. Furthermore, the information processing system 1 may execute predetermined information processing several seconds to several tens of seconds after the user's state becomes a predetermined state.

[0260] In the above embodiment, the information processing system 1 calculates health information related to the user's sleep and / or fatigue based on the user information (steps S33, S36), and executes the above-mentioned predetermined information processing using the health information as input to the application (steps S40, S72, S73). This allows the information processing based on the health information to be executed without the user having to perform a command operation.

[0261] Furthermore, the information processing system 1 determines parameters for an object (player character) appearing in the application based on the health information and executes the predetermined information processing (step S40). Since the parameters of the object change based on the health information, the user's health state is reflected in the state of the object. This can arouse the user's interest in health information and motivate the user to check the health information. While the application is a game application in the above embodiment, in other embodiments, it may be any application, not just a game. Furthermore, while the parameters in the above embodiment indicate the number of remaining lives of the player object and the amount of damage to an enemy character, the content indicated by the parameters may be arbitrary.

[0262] Furthermore, the information processing system 1 executes predetermined game processing in a game application (in the above embodiment, processing for calculating the amount of damage to an enemy character) based on the health information as predetermined information processing. This allows the user to measure and check health information in a game-like manner, thereby providing the user with motivation to continue performing these actions.

[0263] Furthermore, the information processing system 1 generates advice information and / or recommendation information based on the health information to improve the content indicated by the health information (vitality level in the above embodiment), and presents the information to the user (FIGS. 7 and 8, step S40). This allows useful information to be presented to the user. Furthermore, in the above embodiment, the advice information and / or recommendation information is presented in the game application (i.e., during the game). This allows the user to be motivated to continuously check the information by presenting the information during the game.

[0264] In the above embodiment, the information processing system 1 executes the following process as the above predetermined information process. -Processing the game story Game processing using game parameters (specifically, the number of remaining lives and the amount of damage done to enemy characters) based on the user's health information Processing to grant in-game benefits (items, etc.) According to the above, the game processing is executed as the predetermined processing by game input that reflects health information, so that the user can perform actions such as measuring and checking health information in a game-like manner, and the user can be motivated to continue performing these actions.

[0265] In the above embodiment, the information processing system 1 determines that the user has woken up (in other embodiments, the information processing system 1 may determine that the user has woken up), and in response to the determination that the user has woken up, starts accepting an instruction input to start playing a predetermined awakening game (i.e., a mini-game) (see FIG. 9), and when the instruction input is received, executes an awakening game process based on the user's operation input (steps S15, S19, S46, S59). In this way, the information processing system 1 can have the user play the awakening game, and playing the awakening game can be expected to have the effect of waking the user up.

[0266] Furthermore, when the awakening game is executed, the information processing system 1 reflects the result of the awakening game in the health information (step S47). This allows the information processing system 1 to calculate the health information by reflecting the state of the user after awakening.

[0267] Furthermore, the information processing system 1 reflects the results of the awakening game in the health information (steps S53 and S55) on the condition that it is within a predetermined period from the time when it is determined that the user has awakened (or, in other embodiments, the time when the user has gotten out of bed). This reduces the possibility that the health information will be calculated without correctly reflecting the user's state after awakening.

[0268] In another embodiment, the information processing system 1 may be configured to accept an instruction input to start playing the awakening game on the condition that the instruction input is within a predetermined period from the time when it is determined that the user has woken up or gotten out of bed. This allows the awakening game to be started within a predetermined period from waking up or getting out of bed. In other words, if the user wants to play the awakening game, they will wake up and start the awakening game even if they are sleepy. Therefore, according to the above, the user can be motivated to wake up. Furthermore, simply playing the awakening game can be expected to have the effect of waking the user up. The predetermined period may be, for example, a period from the time when it is determined that the user has woken up to a predetermined time elapse, or a period from the time when it is determined that the user has reached a predetermined state. Specifically, the predetermined period may be a period from the time when it is determined that the user has woken up to a time when it is determined that the user has gotten out of bed. The predetermined period may also be a period from the time when it is determined that the user has woken up or gotten out of bed to a time when it is detected that the user has left home.

[0269] Furthermore, the information processing system 1 executes game processing (e.g., game processing related to game progress) based on the health information and the results of the awakening game (step S73). This increases the interest of the game through multiple game inputs, and ultimately provides the user with a stronger motivation to continuously perform actions such as measuring and checking health information.

[0270] Furthermore, the information processing system 1 calculates information about the user's fatigue (in the above embodiment, the energy level) based on the user's input made in the awakening game processing and the user's sleep-related state (step S47). This allows the fatigue-related information to be calculated, reflecting the user's state after awakening. Note that the "user's input made in the awakening game processing" may be the input of a game operation in the awakening game as in the above embodiment, or the input of a user's response to a questionnaire during the awakening game.

[0271] In the above embodiment, the information processing system 1 includes a mobile terminal 5 equipped with a sensor (specifically, a Doppler sensor 24) and a display device (specifically, a display 17), and a server 3 capable of communicating with the mobile terminal 5 via a network. Here, the mobile terminal 5 acquires sensor information from the sensor and displays an image representing the result of the predetermined information processing on the display device. In addition, the server 3 accumulates data based on the user's sleep status (FIG. 20). This allows the user to check the result of the predetermined information processing using the mobile terminal 5, and also allows the server 3 to store the data.

[0272] (Effects of game processing being carried out based on sleep state) In the above embodiment, the information processing system 1 executing the game application acquires user information for calculating information related to the user's sleep (step S32). Furthermore, the information processing system 1 calculates health information related to the user's sleep and / or fatigue based on the acquired user information (steps S36, S47, S84). The information processing system 1 controls the game progress in the game application based on the health information (steps S40, S42, S49, S54, S55, S72, S73). As described above, the game progresses as the user measures the health information. This allows the player to measure the health information in a game-like manner, and motivates the user to continuously measure and check their health information.

[0273] Note that "controlling the game progress based on the health information" may mean causing the player object to perform an action based on the health information, as in the above embodiment (e.g., the player object waking up in response to the user's awakening, or setting off on an adventure in response to the user getting out of bed), or may mean controlling the progress of the game story in the game application (e.g., the player object advancing to the next stage) based on the health information. Furthermore, "controlling the game progress based on the health information" may also mean growing a parameter of an object appearing in the game application in response to the health information. For example, if the vitality calculated in step S36 above is equal to or greater than a predetermined value (i.e., if the vitality is higher than a predetermined standard), the mobile terminal 5 may increase a certain parameter of the player object. As a result, the player object will gradually grow as the vitality continues to achieve good results.

[0274] The information processing system 1 automatically controls the progress of the game in response to the calculation of health information that satisfies a predetermined condition. For example, in the above embodiment, the player object wakes up in response to the calculation of health information that indicates that the user has woken up. Also, for example, in the above embodiment, the player object advances to the next stage in response to the calculation of an energy level that causes the amount of damage to an enemy character to exceed a predetermined amount. This allows the game to progress without the user having to perform game operations, making it easier for the user to continue progressing in the game (in other words, measuring health information).

[0275] [5. Modifications] (Variations regarding the evaluation of health information) In the above embodiment, the evaluation result of the health information is calculated based on the health information calculated today (in other words, the health information calculated after the last sleeping period). However, in other embodiments, the evaluation result of the health information may be calculated based on the user's past health information in addition to the health information calculated today.

[0276] For example, the mobile terminal 5 may calculate the evaluation result based on the vitality level newly calculated in step S36 (i.e., the vitality level calculated today) and the past vitality level. Specifically, the mobile terminal 5 may determine whether the vitality level calculated today has improved by a predetermined standard or more (e.g., 5 points or more) compared to the past vitality level (e.g., the average vitality level of the previous month), and the determination result may be the evaluation result. Note that the evaluation result may be based on the difference between a numerical value based on new health information (e.g., today's vitality level) and a numerical value based on the past health information (e.g., the average vitality level of the previous month).

[0277] As described above, the information processing system 1 acquires user information (specifically) for multiple sleep periods of the user (in other words, daily sleep periods) and calculates health information for each of the multiple sleep periods of the user based on the user information. Furthermore, the information processing system 1 performs evaluation based on a comparison result between health information for the most recent sleep period (i.e., this morning's sleep period) and information based on health information for a sleep period prior to the sleep period. This allows evaluation to be performed based on the user's past health information, for example, whether the user's health information has improved. Furthermore, by having the user confirm whether their health information has improved, the user can be more strongly motivated to improve their health.

[0278] In another embodiment, the evaluation result of the health information may be calculated based on the health information about the user of the mobile terminal 5 and the health information about other users. For example, the mobile terminal 5 may acquire an average value of the vitality levels of the other users from the server 3, and calculate the evaluation result based on the acquired average value and the vitality level calculated in step S36 (i.e., the vitality level about the user of the mobile terminal 5). Note that the users to be targeted for calculating the evaluation result are arbitrary. For example, the targeted users may be all users registered with the network service, or may be users who satisfy predetermined selection criteria. The selection criteria may be criteria related to personal information such as region (e.g., country), age, gender, occupation, etc.

[0279] As described above, the information processing system 1 can access a storage unit (storage unit in the server 3) that stores health information about multiple users. The information processing system 1 may perform an evaluation based on the results of a comparison between the health information about the user calculated by the user's terminal system 2 and the health information about other users stored in the storage unit. This allows the evaluation to be performed based on the health information of other users, for example, whether the user of the mobile terminal 5 has a better evaluation than other users. Furthermore, by allowing the user to check the comparison results with other users, the user can be more strongly motivated to improve their health.

[0280] Furthermore, even when an evaluation result reflecting past health information and / or health information about another user is calculated as described above, game processing may be executed based on the evaluation result, as in the above embodiment. That is, the mobile device 5 may present game elements representing the evaluation result to the user, or may progress the game in accordance with the evaluation result.

[0281] Note that the mobile terminal 5 may calculate a first evaluation result that reflects past health information (and / or health information related to other users) and a second evaluation result that does not reflect the past health information (i.e., health information related to the user of the mobile terminal 5 calculated today). In this case, the mobile terminal 5 may present to the user a game element that represents the first evaluation result and a game element that represents the second evaluation result. This allows the two types of evaluation results to be presented to the user in an easy-to-understand manner.

[0282] FIG. 21 is a diagram showing an example of a game image displayed in a modified example of the embodiment. FIG. 21 shows a modified example of the game image at the time of awakening shown in FIG. 7. In the modified example shown in FIG. 21, the mobile device 5 determines whether the vitality level of the health information calculated today has improved by a predetermined standard or more compared to information based on past vitality levels (for example, the average vitality level for the previous month). If it is determined that the vitality level has improved, the mobile device 5 adds the number of remaining lives as a bonus due to the improvement in the health information. In this case, as shown in FIG. 21, the mobile device 5 displays the number of remaining lives ("5" in FIG. 21) added as the bonus in addition to the number of remaining lives corresponding to the vitality level calculated today ("80" in FIG. 21). Note that if it is determined that the vitality level has not improved, the mobile device 5 does not add the number of remaining lives as the bonus. In this case, the number of remaining lives as the bonus is not displayed. According to the above, the user's own vitality level and the bonus due to the improvement can be presented to the user in an easy-to-understand manner.

[0283] The game element representing the first evaluation result and the game element representing the second evaluation result may be the same type of game element, such as the number of remaining lives, or may be different types of game elements. For example, the mobile terminal 5 may display an item awarded according to the first evaluation result in a game image, and may display the number of remaining lives representing the second evaluation result in a game image. The two types of game elements may be displayed simultaneously or at different times.

[0284] (Modifications regarding display reflecting multiple health information) In a modification of the above embodiment, when displaying a game image, the mobile device 5 may display an image of an object that reflects multiple types of calculated health information (such as a sleep index and a fatigue index). For example, in the above embodiment, multiple types of sleep indexes are calculated as health information, and the mobile device 5 may change the color, shape, and / or pattern of the player object 51 in accordance with each of some of the sleep indexes. Specifically, if the sleep duration, the number of awakenings, and the quality of sleep are used as the sleep indices, the facial expression of the player object 51 in the awake game image may change in accordance with the sleep duration, the hairstyle of the player object 51 may change in accordance with the number of awakenings, and the clothing of the player object 51 may change in accordance with the quality of sleep. More specifically, the mobile device 5 may make the facial expression of the player object 51 brighter as the sleep duration becomes more ideal, make the player object 51's bedhead worse as the number of awakenings increases, and make the player object 51's clothing brighter as the quality of sleep increases.

[0285] As described above, the information processing system 1 may generate an image in an application whose content changes depending on each of a plurality of pieces of health information (for example, a plurality of types of sleep indices) and display the image on a predetermined display device (here, display 17). This allows the measurement results of a plurality of pieces of health information to be presented in a way that allows the user to intuitively understand them.

[0286] Furthermore, the information processing system 1 may automatically display the image on the display device when it is determined that the user has woken up or gotten out of bed. For example, the mobile terminal 5 may display the player object 51 of this modification in the game image for waking up and / or the game image for getting out of bed in the above embodiment. Here, since the user has just woken up when they wake up or get out of bed, it may be difficult for the user to understand, for example, even if numerical values ​​representing multiple pieces of health information are presented to the user. In contrast, according to this modification, by presenting the image as described above, the user can roughly grasp the calculation results of this morning's health information.

[0287] Furthermore, information processing system 1 changes a first type of display mode for a specific object appearing in an application in response to a first health information item among the plurality of health information items, and changes a second type of display mode for the object in response to a second health information item among the plurality of health information items. Note that "changing the display mode of an object" includes, for example, changing the color, shape, size, and / or pattern of all or part of the object, as well as changing the number of the object. As described above, because the display mode for a certain object is changed, a user can learn the calculation results of their own health information by looking at the object.

[0288] Note that the predetermined object does not need to be a single object, and the information processing system 1 may change the display mode for multiple objects of the same type. FIG. 22 is a diagram illustrating an example of an image displayed in a modification of the above embodiment. In the example illustrated in FIG. 22, an application for raising tropical fish is executed in the information processing system 1, and the image illustrated in FIG. 22 is displayed on the display 17. In the above example, the information processing system 1 changes the number of tropical fish corresponding to each of the multiple health information items. For example, the mobile device 5 may increase the number of first fish objects 71 as the sleep duration becomes ideal, increase the number of second fish objects 72 as the number of awakenings during sleep increases, and increase the number of second fish objects 73 as the quality of sleep increases. This allows the user to recognize the quality of each sleep index based on the number of fish objects, and to recognize the quality of health information (specifically, sleep) based on the total number of fish objects.

[0289] Furthermore, the information processing system 1 may change the display mode of different types of images (which may be images of objects or background images). For example, in the example shown in Fig. 22, the information processing system 1 may change the display mode of the fish object in accordance with the first health information, and may also change the display mode of the amount of aquatic plants, the size of the aquatic plants, and / or the transparency of the water in accordance with second health information (different from the first health information).

[0290] (Variations regarding communication with other users' terminals) In another embodiment, the terminal system 2 may be configured to notify other users' mobile terminals (referred to as other user terminals) of the user's sleep state (e.g., awake, fall asleep, get into bed, get out of bed, etc.). For example, the mobile terminal 5 may pre-register other user terminals to be notified, and notify the other user terminals that the user has woken up when the user wakes up or gets out of bed. Alternatively, the mobile terminal 5 may notify the other user terminals that the user has gone to sleep when the user falls asleep or gets into bed. This allows other users (e.g., family and friends) to automatically be notified of the user's sleep state. The notification from the mobile terminal 5 to the other user terminals may be made via the server 3 or without the server 3.

[0291] In another embodiment, the terminal system 2 may transmit information indicating the sleep status of the user to the server 3. That is, the server 3 may receive and store information indicating the sleep status of each user in the network service from each terminal system. At this time, the server 3 may provide the terminal system 2 with information based on the sleep status of other users. The terminal system 2 may obtain information about other users who have been registered as friends in advance in the server 3 from the server 3 and present the obtained information to the user. This allows the user of the terminal system 2 to know the current status (e.g., whether they are asleep or awake) of the other users registered as friends. The server 3 may also provide the terminal system 2 with information based on the status of an unspecified number of other users. For example, the server 3 may transmit information indicating the proportion of users who are awake among users in a specific area to the terminal system 2. This allows the user to know the status of multiple other users.

[0292] The information indicating the sleeping state of the other user as described above may be presented in a game application. In this case, the state of the user may be represented by the state (or behavior) of the player object 51 in the above embodiment. For example, when the user is sleeping, a game image showing the player object 51 sleeping may be displayed on the mobile terminal of the other user.

[0293] (Application Variations) In the above embodiment, an example has been described in which a game application is executed in the terminal system 2, but the type of application executed in the terminal system 2 is not limited to a game and may be any type. Furthermore, when a game application is executed, the genre and content of the game may be any type. For example, in the following game, the terminal system 2 may control the progress of the game based on health information. In a game where you raise a pet, the pet grows (the pet's parameters change) based on the user's health information. In a restaurant management game, the restaurant grows (the store gets bigger, the menu gets bigger, etc.) based on the user's health information. Actual recipes may be given to the user based on the health information. In a travel game, you can accumulate mileage points based on your health information, allowing you to travel farther. In games where you create fields, pastures, and gardens, animals and plants grow according to their health.

[0294] (Modifications regarding the functions of each device included in the information processing system 1) In the above embodiment, each process in the information processing system 1 is executed by the base device 6, the mobile terminal 5, and the server 3. Here, each process in the information processing system 1 may be executed by any of the above three configurations (the base device 6, the mobile terminal 5, and the server 3).

[0295] Although the base device 6 transmits information detected by the sensor to the mobile terminal 5, in other embodiments, the base device 6 may transmit information calculated from the detected information. For example, the base device 6 may calculate biological information of breathing and / or body movement and transmit it to the mobile terminal 5, may calculate sleep indices and transmit it to the mobile terminal 5, or may calculate health information (including evaluation results) and transmit it to the mobile terminal 5.

[0296] Furthermore, the mobile terminal 5 may transmit the information received from the base device 6 and / or the information detected by itself to the server 3 as is, or may transmit information calculated from this information to the server 3. In either case, the server 3 may calculate health information based on the information received from the mobile terminal 5.

[0297] In addition, when multiple types of health information are calculated or multiple types of evaluations are performed, as in the above embodiment, some of the multiple types of health information (including evaluation results) may be calculated by the mobile terminal 5, and the remaining health information may be calculated by the server 3.

[0298] In another embodiment, the base device 6 may communicate with the server 3 without going through the mobile terminal 5. For example, the base device 6 may have a function of communicating with the server 3 via the network 4, similar to the mobile terminal 5. In this case, the base device 6 may transmit information detected by itself directly to the server 3, or may transmit the information to both the mobile terminal 5 and the server 3. Furthermore, if the base device 6 is capable of communicating with the server 3, the mobile terminal 5 may obtain information from the base device 6 via the server 3. In other words, when obtaining information from the base device 6, the mobile terminal 5 may obtain, from the server 3, information transmitted from the base device 6 to the server 3.

[0299] (Modifications regarding sensors) In the above embodiment, the sensor for acquiring the user's biometric information is a sensor that detects the user's biometric information without coming into contact with the user. That is, the sensor in this embodiment is a non-contact (and non-wearable) sensor (specifically, a Doppler sensor). The sensor is placed in the vicinity of the user to be detected. This eliminates the need for the user to be concerned about the detection operation by the sensor, thereby reducing the burden on the user due to detection. Furthermore, if the sensor is non-wearable, there is no problem of detection not being performed because, for example, the user forgets to wear the sensor.

[0300] The non-contact (and non-wearable) sensor is not limited to the Doppler sensor 24 described above. That is, in the above embodiment, the Doppler sensor 24 transmits radio waves toward the detection target and receives reflected waves, and outputs biometric information based on the reception results (by analyzing the movement of the detection target based on the Doppler phenomenon of the received waves). In other embodiments, the present invention is not limited to this. For example, the non-contact sensor may transmit radio waves (or sound waves) toward the detection target and receive reflected waves, and output biometric information based on the reception results (received waves). Specifically, the sensor may acquire an image of the detection target based on the received waves, analyze the movement of the detection target from the image information, and output biometric information. Furthermore, the non-contact sensor may use a predetermined detection wave such as ultrasound instead of radio waves. Furthermore, the non-contact sensor may be an imaging unit (camera) placed around the user. That is, the camera may capture an image of the detection target from a remote location, and the information processing system may analyze the movement of the detection target from the captured image and output biometric information. [Industrial Applicability]

[0301] The above-described embodiment can be used in, for example, an information processing system that executes a game application, with the aim of simplifying user operations. [Explanation of symbols]

[0302] 1. Information Processing Systems 2. Terminal Systems 3 Server 4 Network 10. Communications Department 11 Processing section 12 Operation input section 13 Position detection unit 14 Environmental Sensors 15. Mike 16 Camera 17. Display 18 speakers 19 Connectors 21 Connector 22 Control Unit 23 Power acquisition section 24 Doppler sensor 25 Projector 26 Speaker 27 Camera 41 Waveform analysis section 42 Sleep calculation section 43 Autonomic nervous system calculation unit 44 Fatigue calculation section

Claims

1. An information processing system that executes a game application, an acquisition means for acquiring user information for calculating information related to the user's sleep; a first parameter calculation means for calculating a first parameter related to sleep and / or fatigue of the user based on the user information acquired during the user's sleep period; a second parameter calculation means for calculating a second parameter based on an operation input by the user to the application acquired during a wakefulness period from when the user wakes up or gets out of bed until a predetermined time has elapsed; an information processing system comprising a game execution means for controlling the progress of the game in the game application based on one value calculated from the first parameter and the second parameter;

2. 2. The information processing system according to claim 1, wherein said game execution means changes a parameter of an object appearing in said game application in accordance with said first parameter and said second parameter so that said object grows.

3. 2. The information processing system according to claim 1, wherein the game execution means changes at least one of the number, quantity, color, shape, size, and pattern of objects appearing in the game application in accordance with the first parameter and the second parameter.

4. 4. The information processing system according to claim 1, wherein the game execution means further automatically controls the progress of the game in response to calculation of the first parameter that satisfies a predetermined condition.

5. An information processing system for executing a game application, comprising: an acquisition means for acquiring user information for calculating information related to the user's sleep; a first parameter calculation means for calculating a first parameter related to sleep and / or fatigue of the user based on the user information acquired during the user's sleep period; a second parameter calculation means for executing an awakening game process based on an operation input by the user during an awakening period from when the user awakens or gets out of bed until a predetermined time has elapsed, and for calculating a second parameter based on a result of the awakening game process; an information processing system comprising a game execution means for controlling the progress of the game in the game application based on one value calculated from the first parameter and the second parameter;

6. 6. The information processing system according to claim 5, wherein the second parameter calculation means executes the awakening game process on the condition that the awakening game process is executed within a predetermined period of time from the time when it is determined that the user has woken up or gotten out of bed.

7. 7. The information processing system according to claim 5, wherein said game execution means executes game processing relating to the progress of said game based on a result of said awakening game processing.

8. the second parameter calculation means calculates, as the second parameter, a parameter related to an item of the game based on information acquired from the user during an awakening period from when the user awakens or gets out of bed until a predetermined time has elapsed; 8. The information processing system according to claim 5, wherein the game execution means controls the progress of the game in the game application based on the first parameter and the item.

9. the acquiring means acquires the user information during a plurality of sleep periods of the user, the first parameter calculation means calculates the first parameter for each of a plurality of sleep periods of the user based on the user information acquired during the sleep period; The information processing system according to claim 1, wherein the game execution means controls the progress of the game based on a comparison result between a new first parameter relating to the latest sleep period and information based on the first parameter relating to a past sleep period prior to the sleep period.

10. 10. The information processing system according to claim 9, wherein the game execution means controls the progress of the game based on a difference between a numerical value based on the new first parameter and a numerical value based on the past first parameter.

11. 11. The information processing system according to claim 9, wherein the game execution means determines whether the new first parameter has improved by a predetermined standard or more compared to the past first parameter, and controls the progress of the game based on the determination result.

12. the information processing system is capable of accessing a storage unit that stores the first parameters related to a plurality of users; 12. The information processing system according to claim 1, wherein the game execution means controls the progress of the game based on a comparison result between the first parameter calculated by the first parameter calculation means and the first parameters related to other users stored in the memory unit.

13. 13. The information processing system according to claim 1, further comprising a display control means for generating, in the application, an image of an object whose content changes depending on the first parameter, and displaying the image on a predetermined display device.

14. The first parameter calculation means determines that the user has woken up or woken up, 14. The information processing system according to claim 13, wherein the display control means automatically displays the image on the display device in response to determining that the user has woken up or woken up.

15. 15. The information processing system according to claim 13, wherein the display control means displays, on the display device, a graph showing a relationship between depth of sleep and time based on the user information after the user wakes up.

16. the first parameter calculation means performs an evaluation regarding sleep and / or fatigue of the user; 16. The information processing system according to claim 1, further comprising a presentation means for generating advice information and / or recommendation information for improving the evaluation based on the result of the evaluation and presenting the advice information and / or recommendation information to the user.

17. The first parameter calculation means (1) Time from going to bed to falling asleep, (2) Time from awakening to getting out of bed; (3) The proportion of time spent in a deep sleep state during the period from falling asleep to a predetermined time; (4) The proportion of time spent in a light sleep state during the period from the time of awakening to a predetermined time before the time of awakening; (5) REM sleep cycle, (6) The ratio of REM sleep time to non-REM sleep time, (7) Sleep time; (8) The difference between the ideal timing for falling asleep and the actual timing for falling asleep. (9) The difference between the ideal and actual awakening timing. (10) Number of times you wake up during the night, (11) Timing of awakening during the night, (12) Time spent waking up during the night, (13) Number of times you turn over in bed (14) the volume of snoring, and (15) Sleeping environment The information processing system according to claim 1 , wherein at least some of the following are calculated as the first parameters:

18. The information processing system according to claim 1 , further comprising a notification unit that notifies the user to wake up.

19. The information processing system according to claim 1 , wherein the acquisition unit acquires the user information from a sensor that detects at least one of a pulse, a respiration, and a body movement of the user.

20. An information processing device that executes a game application, an acquisition means for acquiring user information for calculating information related to the user's sleep; a first parameter calculation means for calculating a first parameter related to sleep and / or fatigue of the user based on the user information acquired during the user's sleep period; a second parameter calculation means for calculating a second parameter based on an operation input by the user to the application acquired during a wake period from when the user wakes up or gets out of bed until a predetermined time has elapsed, or for executing a wake-up game process based on an operation input by the user during a wake-up period from when the user wakes up or gets out of bed until a predetermined time has elapsed, and calculating the second parameter based on a result of the execution of the wake-up game process; an information processing device comprising: a game execution means for controlling the progress of the game in the game application based on one value calculated from the first parameter and the second parameter;

21. An information processing program executed on a computer of an information processing device that executes a game application, an acquisition means for acquiring user information for calculating information related to the user's sleep; a first parameter calculation means for calculating a first parameter related to sleep and / or fatigue of the user based on the user information acquired during the user's sleep period; a second parameter calculation means for calculating a second parameter based on an operation input by the user to the application acquired during a wake period from when the user wakes up or gets out of bed until a predetermined time has elapsed, or for executing a wake-up game process based on an operation input by the user during a wake-up period from when the user wakes up or gets out of bed until a predetermined time has elapsed, and calculating the second parameter based on a result of the execution of the wake-up game process; An information processing program that causes the computer to function as game execution means that controls game progress in the game application based on one value calculated from the first parameter and the second parameter.

22. An information processing method executed in an information processing system that executes a game application, comprising: an acquiring step of acquiring user information for calculating information related to the user's sleep; a first parameter calculation step of calculating a first parameter related to sleep and / or fatigue of the user based on the user information acquired during a sleep period of the user; a second parameter calculation step of calculating a second parameter based on an operation input by the user to the application acquired during a wakefulness period from the user waking up or getting out of bed until a predetermined time has elapsed, or executing a wakefulness game process based on the operation input by the user during a wakefulness period from the user waking up or getting out of bed until a predetermined time has elapsed, and calculating the second parameter based on a result of the execution of the wakefulness game process; an information processing method comprising a game execution step of controlling game progress in the game application based on one value calculated from the first parameter and the second parameter;

Images