Information processing device, display device, information processing system, and information processing program

Abstract

In addition to the measurement results of the user's physical balance function, it is possible to provide a suitable exercise course that takes into account other conditions. [Solution] The information processing device (100) includes an acquisition unit (112) that acquires factor information indicating at least one of the user's behavioral history and the environmental conditions of the location where the user is located, and balance function information indicating the user's physical balance function, and a generation unit (113) that generates an exercise course to propose to the user according to both the factor information and the balance function information.

Description

Technical Field

[0001] The present disclosure relates to an information processing apparatus, a display apparatus, an information processing system, and an information processing program. Background Art

[0002] Conventionally, a postural balance measurement apparatus capable of acquiring measurement data for exercise (training) aimed at improving balance function has been proposed. In the above-described apparatus, for example, a standing platform on which a user stands is moved in a horizontal direction to apply movement stimulation, and measurement data of the balance function is acquired. Patent Document 1 discloses a postural balance measurement apparatus capable of acquiring measurement data for exercise aimed at improving balance function. Prior Art Literature Patent Literature

[0003] Patent Document 1 Japanese Unexamined Patent Publication No. 2013-31538 Summary of Invention Problem to be Solved by Invention

[0004] However, in the conventional technology as described above, an exercise course (exercise program) is generated based only on the user's response to movement stimulation. Therefore, there is a problem that an exercise course that takes into account other conditions such as the user's lifestyle habits and environmental factors cannot be provided.

[0005] One aspect of the present invention has been made in view of the above problem, and an object of the present invention is to make it possible to provide a suitable exercise course that reflects other conditions in addition to the measurement result of the user's body balance function. Means for Solving the Problem

[0006] To solve the above problems, an information processing device according to one aspect of the present disclosure includes an acquisition unit that acquires factor information indicating at least one of the user's behavioral history and the environmental conditions of the location where the user is located, and balance function information indicating the balance function of the user's body, and a generation unit that generates an exercise course to propose to the user according to both the factor information and the balance function information.

[0007] To solve the above problems, an information processing system according to one aspect of the present disclosure includes an information processing device and a display device that is communicably connected to the information processing device, wherein the information processing device acquires factor information indicating at least one of the user's behavioral history and the environmental conditions of the location where the user is located, measures the user's physical balance function, generates an exercise course to propose to the user according to both the factor information and the measurement results of the balance function, and the display device displays the information output by the information processing device.

[0008] To solve the above problems, an information processing program according to one aspect of the present disclosure is an information processing program for causing a computer to function as an information processing device, wherein the computer functions as an acquisition unit that acquires factor information indicating at least one of the user's behavioral history and the environmental conditions of the location where the user is located, and balance function information indicating the balance function of the user's body, and a generation unit that generates an exercise course to propose to the user according to both the factor information and the balance function information. [Effects of the Invention]

[0009] According to one aspect of this disclosure, it is possible to provide a suitable exercise course that reflects not only the measurement results of the user's physical balance function but also other conditions. [Brief explanation of the drawing]

[0010] [Figure 1] This is a block diagram showing an example of a display device configuration. [Figure 2] This figure shows an example of the appearance of a display device. [Figure 3] This is a block diagram showing an example of the hardware configuration of an information processing device. [Figure 4] This block diagram shows an example of the functions of the control unit of an information processing device. [Figure 5] This flowchart shows an example of a process in which an information processing device generates an exercise course and allows the user to execute it. [Figure 6] This figure shows an example of a screen displaying an image that the dialogue unit displays on the display unit. [Modes for carrying out the invention]

[0011] One embodiment of this disclosure will be described in detail below.

[0012] <Display device 1> Figure 1 is a block diagram showing an example configuration of the display device 1 according to this embodiment. As shown in Figure 1, the display device 1 comprises a sensing unit 21, an operation signal receiving unit 22, an information processing device 100, a display unit 30, and an audio output unit 40. The display device 1 is typically a stationary display device, but it may also be a wall-mounted display device, a smartphone or tablet, or a PC (Personal Computer).

[0013] Furthermore, the components of the display device 1 are not limited to being configured as a single device, but may be configured as an information processing system distributed across multiple devices connected via a communication network. For example, the information processing device 100 may be configured as a smartphone or tablet, a set-top box, or a cloud server.

[0014] (Sensing unit 21) The sensing unit 21 has one or more configurations for sensing one or more users (hereinafter simply referred to as "users") using the display device 1, and for measuring environmental conditions, which are the conditions of the location where the users are located. In many cases, the location where the users are located can also be described as the area around the display device 1, the room in which the display device 1 is installed, or the region in which the display device 1 is installed. The temperature of the location where the users are located, that is, the room temperature or the temperature of the region, is an example of an environmental condition. The temperature of the region may be obtained from the Internet via wireless or wired communication by the content receiving unit, which will be described later.

[0015] Furthermore, the sensing unit 21 also operates as a detection unit that detects when a user is located within the detection range. The detection range can be set to a certain range in front of the display device 1, for example. The sensing unit 21 also includes one or more imaging units (cameras) that capture images of the user. In this case, the sensing unit 21 supplies sensing data, including imaging data showing the images captured by the imaging units, to the information processing device 100. As a result, the acquisition unit 112 acquires the sensing data from the imaging units as information corresponding to balance function information. The sensing unit 21 may also be configured to automatically capture images within the detection range in response to the detection of a user being located within the detection range. A configuration in which the sensing unit 21 does not operate the imaging units when no person is detected has the effect of reducing the amount of data processed and protecting privacy.

[0016] As another example, the sensing unit 21 is equipped with a laser scanner (LiDAR device) that detects objects by the reflection of laser light, and scans the user using the laser scanner. In this case, the sensing unit 21 supplies sensing data, including scan data indicating the data scanned by the laser scanner, to the information processing device 100.

[0017] As another example, the sensing unit 21 includes one or more microphones, and collects sound via the microphones. In this case, the sensing unit 21 supplies sensing data including audio data indicating the sound collected by the microphones to the information processing apparatus 100. Note that the sound collected by the microphones is mainly intended for human speech, but is not limited thereto, and refers to general sound that propagates through a medium such as air.

[0018] In addition, the sensing unit 21 includes one or more environmental sensors, and measures environmental conditions, which are conditions of a location where a user is positioned, by means of the environmental sensors. The environmental sensors are, for example, sensors that measure temperature, humidity, illuminance, cleanliness, noise, or the like as environmental conditions. That is, the sensing unit 21 measures the room temperature or the like of the room where the user is positioned. The sensing unit 21 supplies sensing data indicating the environmental conditions acquired by the environmental sensors to the information processing apparatus 100. The factor information in the present disclosure is information indicating at least one of a user's action history and environmental conditions of a location where the user is positioned, which will be described later. Therefore, the sensing data is an example of factor information in the present disclosure.

[0019] As another example, the sensing unit 21 may be configured to acquire, from an environmental sensor provided outside the display apparatus 1, an environmental condition measured by the environmental sensor. In this case, the sensing unit 21 supplies sensing data indicating the environmental condition acquired from the environmental sensor to the information processing apparatus 100. Note that, for communication between the sensing unit 21 and the environmental sensor, for example, BLE (Bluetooth (registered trademark) Low Energy) may be used.

[0020] As another example, the sensing unit 21 may be configured to acquire, from a vital sensor provided outside the display device 1 that senses a user's biological information, vital data measured by the vital sensor. The biological information is, for example, respiratory rate, heart rate, blood pressure, body temperature, or the like. In this case, the sensing unit 21 supplies sensing data including the vital data acquired from the vital sensor to the information processing device 100. Note that, for example, BLE may be used for communication between the sensing unit 21 and the vital sensor.

[0021] Alternatively, the sensing unit 21 may be configured to measure the balance function (equilibrium sense) of the user's body. For example, the sensing unit 21 may be configured to acquire, from a balance board (standing platform) provided outside the display device 1 on which the user stands, data indicating the balance function measured by the balance board. Further, the sensing unit 21 supplies the data indicating the balance function to the information processing device 100 as balance function information.

[0022] Furthermore, the balance function of the user's body may also include the appropriateness of the user's posture, etc. In one aspect, the sensing unit 21 is configured to supply the information processing device 100 with balance function information indicated by a captured image of an imaging unit. However, this configuration also includes a case where the captured image of the imaging unit itself is supplied to the information processing device 100 as the balance function information. For example, if the posture of the user included as a subject in the captured image during walking is poor, the sensing unit 21 may supply balance function information indicating that the balance function is low to the information processing device 100. Furthermore, as described above, this captured image may be an image obtained by automatically imaging the user detected within a detection range by the sensing unit 21. This enables, for example, a process of automatically measuring and acquiring the balance function when the user passes in front of the display device 1.

[0023] Furthermore, in order to perform sensing or measurement by the sensing unit 21 continuously and stably, it is preferable that the display device 1 be a stationary or wall-mounted type. This is because, when the display device 1 is a stationary or wall-mounted type and is fixedly installed in a predetermined location, the stability of the environment surrounding the display device 1 (image target, temperature, humidity, illuminance, cleanliness, noise, etc.) is relatively higher compared to when the display device 1 is mobile, such as a smartphone.

[0024] (Operation signal receiving unit 22) The operation signal receiving unit 22 receives operation signals from the remote control device 2 used by the user to remotely operate the display device 1. The operation signals are, for example, signals indicating the result of the user operating the user interface displayed on the display unit 30 using the remote control device 2. The operation signal receiving unit 22 supplies the received operation signals to the information processing device 100. Note that the device capable of operating the display device 1 is not limited to the remote control device 2, and it may also be operable by a keyboard or the like (not shown). Furthermore, by installing a dedicated application on a smartphone or tablet terminal owned by the user, the smartphone or tablet terminal and the display device 1 may be configured to communicate. In this case, the user can remotely operate the display device 1 using the smartphone or tablet terminal instead of the remote control device 2. At this time, the operation signal receiving unit 22 will supply the operation signals received from the smartphone or tablet terminal to the information processing device 100. In addition, the user can also remotely operate the display device 1 using voice. As explained above, the user's spoken voice acquired by the sensing unit 21 is supplied to the information processing device 100, but this is not limited to this. The user's spoken voice acquired by the sensing unit 21 may be supplied to the operation signal receiving unit 22. With this configuration, the operation signal receiving unit 22 acquires the user's spoken voice from the sensing unit 21 and converts the acquired spoken voice into predetermined data, thereby enabling the user's spoken voice to be received as an operation signal. This makes voice-controlled remote operation possible.

[0025] (Information processing device 100) The information processing device 100 generates a display image for display on the display unit 30 and output sound for output to the audio output unit 40, based on sensing data supplied from the sensing unit 21 and at least one of the operation signals supplied from the operation signal receiving unit 22.

[0026] The display image is, for example, an image containing information presented to the user when performing healthcare counseling, various healthcare advice, exercise support, disease prediction, and suggestions regarding exercise, diet, and sleep on the display device 1. The display image includes at least one of still images and moving images. The display image may also include data generated by generative AI (Artificial Intelligence) such as a Large-Scale Language Model (LLM) through interaction with the user.

[0027] The output audio includes sounds related to the displayed image, various notification sounds, and operation sounds when operating the user interface displayed on the display unit 30. The output audio may also include audio converted from text data generated by a generative AI such as a large-scale language model (LLM) through interaction with the user.

[0028] Details of the information processing device 100 will be described later.

[0029] (Display section 30) The display unit 30 displays a display image generated by the information processing device 100. The display unit 30, for example, comprises a display panel and a driver that drives the display panel based on the image data of the display image. The display panel is, for example, a liquid crystal panel or an organic EL panel.

[0030] (Audio output unit 40) The audio output unit 40 is a speaker that outputs audio generated by the information processing device 100.

[0031] (Other components) The display device 1 may further include a content receiving unit for receiving content data and supplying the received content data to the information processing device 100. The content data may include, but is not limited to, encoded video data, encoded audio data, and related information associated with the video data. The encoded video data may, but is not limited to, data encoded by various video encoding technologies such as MPEG2, MPEG4, H.264, and H.265 (e.g., TS (Transport Steam)). The related information may, but is not limited to, at least one of the following: program information related to the content, program guide data including the program information, data broadcasting information provided in relation to the content, and explanatory information related to the content. The related information may, for example, be extracted from the content data without decoding processing by the aforementioned video encoding technology such as MPEG2. The content receiving unit may also be configured to acquire content data from the Internet via wireless or wired communication. Furthermore, the content receiving unit may be configured to acquire content data from broadcast waves and may include a tuner for selecting one of the multiple channels included in the broadcast wave. When the content receiving unit includes a tuner, the display device 1 may also be referred to as a television receiver (or simply a television).

[0032] (Example of the appearance of display device 1) Figure 2 shows an example of the appearance of the display device 1. The display device 1 shown in the figure is a stationary display device equipped with legs, and is installed, for example, in a room such as the living room in the home of user U. The display device 1 shown in the figure is equipped with one sensing unit 21 above the display unit 30, and one operation signal receiving unit 22 and two audio output units 40 below the display unit 30. Stationary or wall-mounted display devices are equipped with fixing parts for fixing to a structure. For example, a stationary display device is equipped with fixing parts for fixing to a stand which is a structure, and a wall-mounted display device is equipped with fixing parts for fixing to a wall which is a structure.

[0033] (Hardware configuration of the information processing device 100) An example of the hardware configuration of the information processing device 100 will be described with reference to Figure 3. Figure 3 is a block diagram showing an example of the hardware configuration of the information processing device 100.

[0034] As shown in Figure 3, the information processing device 100 comprises a control unit 101, a memory 102, a storage unit 103, and a communication interface 104. These components are interconnected via a bus 105 so that they can communicate with one another.

[0035] Memory 102 can be implemented as, for example, RAM (Random Access Memory), DRAM (Dynamic Random Access Memory), or other volatile memory. The storage unit 103 is composed of ROM (Read-Only Memory), HDD (Hard Disk Drive), SSD (Solid State Drive), etc., and stores sensing data supplied from the sensing unit 21 and operation signals supplied from the operation signal receiving unit 22. The storage unit 103 also stores a program for processing the sensing data and operation signals.

[0036] The control unit 101 is composed of, for example, one or more processors. The control unit 101 can be implemented as, for example, a CPU (Central Processing Unit), GPU (Graphics Processing Unit), MPU (Micro Processor Unit), FPGA (Field-Programmable Gate Array), or other device that performs arithmetic processing. The control unit 101 reads a program from the storage unit 103 and executes the program using the memory 102 as a working area. Although Figure 3 shows one control unit 101, it is not limited to this, and multiple control units 101 may be provided.

[0037] The communication interface 104 is implemented as hardware such as a network adapter, various communication software, or a combination thereof, and is configured to enable wireless or wired communication over a communication network.

[0038] (Functions of the control unit 101) An example of the functions of the control unit 101 will be described with reference to Figure 4. Figure 4 is a block diagram showing an example of the functions of the control unit 101. However, in Figure 4, the illustration of some components of the information processing device 100, as described above with reference to Figure 3, is omitted. The control unit 101 reads a program from the storage unit 103 and executes the program using the memory 102 as a working area, thereby functioning as the acquisition unit 112, generation unit 113, and dialogue unit 114. The functions of each of these units may, for example, be distributed across multiple devices connected via a communication network. In this case, the functions of each of these units may be configured as a system consisting of multiple devices. Also, what is described as "~unit" here may be rephrased as "~circuit," "~device," or "~equipment," or as "~step," "~procedure," or "~process." That is, what is described as "~unit" may be implemented by a program stored in the storage unit 103 as described above, or it may be implemented by hardware such as elements, devices, boards, and wiring only, or by a combination of software and hardware. These functions will be described below.

[0039] The acquisition unit 112 acquires sensing data supplied to the information processing device 100 from the sensing unit 21, and operation signals supplied to the information processing device 100 from the operation signal receiving unit 22. The acquisition unit 112 also acquires the user's physical information and predetermined behavioral history, as well as the history of conversations performed by the dialogue unit 114, from the storage unit 103, etc. The physical information is information about the user's body, and includes, for example, the user's height, weight and age, biological information such as respiratory rate acquired as sensing data, and information indicating the state of various parts of the user's body.

[0040] From another perspective, the acquisition unit 112 acquires factor information indicating at least one of the user's behavioral history and the environmental conditions of the user's location, as well as balance function information indicating the user's physical balance function, from the sensing unit 21 and the storage unit 103, etc. For example, the acquisition unit 112 acquires balance function information indicated by the captured image from the imaging unit of the sensing unit 21.

[0041] In the following explanation, the specified actions are described as specified exercises, but they may also be other healthcare-related actions such as eating, sleeping, going out, or the onset of illness. In other words, the aforementioned behavioral history may include exercise history, as well as at least one of the following: eating history, sleep history, going out history, and medical history. Furthermore, exercise may include strength training, circuit training, stretching, and rehabilitation exercises. Also, as can be seen from the fact that the time differs depending on the country where the user is located, the time of day in which exercise is performed may also be included in the environmental conditions of the user's location.

[0042] Furthermore, the acquisition unit 112 may acquire at least a portion of the factor information and balance function information from other devices such as smart home appliances that are linked with the information processing device 100. For example, the acquisition unit 112 may acquire factor information indicating the user's meal history from a cooking appliance.

[0043] In this disclosure, when information acquired by the acquisition unit 112 is used by other components, the explanation focusing on the acquisition unit 112 may be omitted.

[0044] The generation unit 113 generates an exercise course (exercise program) to propose to the user. Note that the exercise course may consist of only a single exercise. In other words, the exercise course may include one or more exercises, and is not limited to specifying the order in which each exercise is performed. In one embodiment, the generation unit 113 generates an exercise course corresponding to one or both of the factor information and the balance function information. Furthermore, the generation unit 113 may also generate an exercise course corresponding to the user's physical information. Note that the "generation" of an exercise course includes the process of determining which of the exercise courses stored in the storage unit 103 the user should perform.

[0045] The dialogue unit 114 engages in dialogue with the user using a predetermined conversational artificial intelligence. The dialogue unit 114 also proposes exercise courses generated by the generation unit 113 to the user. The conversational artificial intelligence may be implemented using a large-scale language model (LLM) and RAG (Retrieval Augmented Generation). An example of such conversational artificial intelligence is OpenAI's Chat GPT (registered trademark). Furthermore, the dialogue unit 114 may also perform the aforementioned healthcare-related counseling.

[0046] In one embodiment, the dialogue unit 114 functions as a Speech Recognizer (SR) and converts the audio data input from the microphone of the sensing unit 21 and acquired as sensing data by the acquisition unit 112 into text data. Subsequently, the dialogue unit 114 generates a response to the content indicated by the text data by referring to past dialogue history etc. stored in the storage unit 103. The dialogue unit 114 may also convert the text data indicating the response into output audio and output it from the audio output unit 40.

[0047] Furthermore, when generating a response to the user, the dialogue unit 114 may refer to a set of anticipated questions and answers stored in the memory unit 103, that is, anticipated user inputs and responses that have been generated or set in advance for those inputs. For example, the dialogue unit 114 may make an actual response based on the response that corresponds to the input that is most similar to the actual input made by the user among the anticipated inputs.

[0048] These aforementioned "responses" include questions or greetings that the dialogue unit 114 makes to the user before any input is received from the user.

[0049] Furthermore, in the dialogue, some or all of the user input may be performed by the user using the remote control device 2 or a keyboard, and the acquisition unit 112 may acquire the operation signals. Also, some or all of the output from the dialogue unit 114 may be displayed on the screen by the display unit 30.

[0050] Furthermore, the dialogue mainly includes a medical interview to update information indicating the condition of various parts of the user's body, such as pain; a dialogue to measure height and other biometric information; and a dialogue to set goals and identify suggested exercises. The dialogue unit 114 may determine which of these dialogues to proceed with by using vector analysis on the information input by the user. In addition, some or all of the dialogue content is stored in the storage unit 103.

[0051] Furthermore, when the dialogue unit 114 engages in dialogue to measure the user's biometric information, it may display an image on the display unit 30 that encourages the use of the aforementioned vital sensor. In addition, the dialogue unit 114 may acquire the user's biometric information, etc., from an external healthcare platform service that provides healthcare-related services via the content receiving unit.

[0052] Furthermore, the dialogue unit 114 may, through dialogue, identify which of the following exercises the user intends to use: muscle training, circuit training, stretching, and rehabilitation exercises.

[0053] Furthermore, the user may be able to specify the tone of voice and character settings when the dialogue unit 114 interacts with the user. These character settings may include personality and occupation settings. For example, if "physical therapist" is specified as the occupation setting, the dialogue unit 114 will refer to and output more information corresponding to the knowledge specific to physical therapists stored in the memory unit 103 to conduct the dialogue. The set personality may also be a fictional character or the like.

[0054] In addition, the control unit 101 performs processes such as supplying display images to the display unit 30 and supplying output audio to the audio output unit 40. As a result, for example, the control unit 101 controls the display of the display image generated in response to the operation signal acquired by the acquisition unit 112 to be displayed on the display unit 30. Furthermore, the control unit 101 performs processes to display, for example, an exercise display image on the display unit 30 in response to the instructions indicated by the audio data or operation signal acquired by the acquisition unit 112.

[0055] The memory unit 103 primarily stores information associated with the individual user, information indicating environmental conditions, information related to dialogue, information related to exercise, and information indicating various reference values ​​that are compared with the measurement results of the sensing unit 21.

[0056] The information associated with the individual user includes, for example, the user's physical information, profile including hobbies and preferences, balance function information, exercise history as a predetermined behavioral history, and past conversation history.

[0057] Furthermore, the information related to the dialogue includes, for example, data for realizing a predetermined conversational artificial intelligence, LLM and RAG, the aforementioned set of anticipated questions and answers, data corresponding to general physical therapy knowledge used in the aforementioned medical interview, data corresponding to knowledge acquired by RAG from the internet via the content receiving unit, data showing the correspondence between the dialogue content and physical information and goals, and data showing the settings at the time of the dialogue. The dialogue unit 114 may refer to information other than these, and the information related to the dialogue may also include past dialogue history.

[0058] Furthermore, information regarding exercises may include, for example, data indicating the content of the exercises, various display images, data that serves as the material for the display images and presented information, data indicating the parts of the body that require movement and the parts that are trained in each exercise, and data indicating the movements that serve as criteria for evaluating the exercises performed by the user. For example, the data indicating the content of the exercises may include information indicating the parts that are trained and the time required for each of the available exercises.

[0059] The memory unit 103 may store some or all of the aforementioned information in a database format, or more precisely, in a vector database format.

[0060] Furthermore, of the information stored in the memory unit 103, at least the information related to the dialogue and the information related to the exercises can be updated by the control unit 101 receiving data from the internet via the content receiving unit. In addition, the information related to the dialogue and the information related to the exercises can be used in common by multiple users of the display device 1. Some or all of this information used in common may be read-only information that cannot be updated by the dialogue unit 114, etc., unless the aforementioned update is performed.

[0061] The above describes an example of the configuration of the display device 1. In addition, each part included in the display device 1 has the function of performing the processes described below.

[0062] <Example of processing by an information processing device> Next, we will explain the process flow in which the information processing device 100 of the display device 1 generates an exercise course and has the user execute it. Figure 5 is a flowchart of an example of the process flow. The process shown in the flowchart of Figure 5 is started, for example, when the operation signal receiving unit 22 receives a signal instructing the execution of the exercise.

[0063] In step S101, the acquisition unit 112 of the information processing device 100 performs a process to acquire factor information from the sensing unit 21 or the storage unit 103 that indicates at least one of the user's behavior history and the environmental conditions of the location where the user is located.

[0064] In S102, the acquisition unit 112 performs a process to acquire balance function information indicating the user's body balance function from the sensing unit 21 or the storage unit 103. This process also includes cases in which the control unit 101 calculates the balance function from the captured image itself, which has been acquired as balance function information.

[0065] Furthermore, with respect to the processing in S101 and S102, sensing data indicating environmental conditions, etc., may be supplied by the sensing unit 21 to the information processing device 100 and stored in the storage unit 103 before the start of the processing shown in the flowchart of Figure 5.

[0066] In S103, the control unit 101 determines whether it has acquired sufficient factor information and balance function information when generating an exercise course to propose to the user. For example, if the exercise course to be generated cannot be uniquely determined from the acquired factor information and balance function information, the control unit 101 determines that one or both of the factor information and balance function information are insufficient and that sufficient information has not been acquired. If the control unit 101 determines that sufficient factor information and balance function information has been acquired (S103: YES), it then executes the process in S104. If it determines that it has not been acquired (S103: NO), it then executes the process in S105.

[0067] In S104, the dialogue unit 114 performs a process to collect either or both of the missing factor information and balance function information by having the user measure or input them through dialogue.

[0068] Each figure in Figure 6 shows an example screen of a display image that the dialogue unit 114 displays on the display unit 30, and Figure 51 above shows an example screen of a display image that the dialogue unit 114 uses to prompt the user to measure balance function in S104. In the example of Figure 51 above, the dialogue unit 114 prompts the user to assume a predetermined posture for measuring balance function. The dialogue unit 114 may also output output audio that partially or completely overlaps with the content of the display image, and the same applies to the display image shown in Figure 52 below, which will be described later. Subsequently, the sensing unit 21 measures the balance function of the user's body in the predetermined posture as a response and supplies the balance function information to the information processing device 100. Furthermore, when the dialogue unit 114 collects factor information, it may ask the user questions about, for example, their meal history and outing history through dialogue.

[0069] Furthermore, especially when the time of day is the middle of the night, the dialogue unit 114 may ask the user about the acceptable level of noise and vibration generated by the exercise in the environment in which the user is currently located, as an environmental condition. For example, if the dialogue unit 114 asks the user whether relatively vigorous exercise is acceptable and the user responds that it is not acceptable as an environmental condition, such exercises may be excluded from the exercises generated by the generation unit 113. Also, as mentioned above, the time of day of the exercise can also be included as an environmental condition. This makes it possible, for example, to suggest exercises that do not cause vibrations to be heard downstairs during the middle of the night.

[0070] The factor information and balance function information obtained from the user's responses are acquired by the acquisition unit 112 for use in generating exercise courses. In other words, the acquisition unit 112 can acquire at least a portion of the factor information and balance function information from the user's answers or responses when the dialogue unit 114 interacts with the user.

[0071] In S105, the generation unit 113 generates an exercise course to propose to the user, based on at least both factor information and balance function information. For example, if the generation unit 113 refers to factor information indicating environmental conditions, including the temperature of the user's location, and the temperature is above a standard value, it may generate an exercise course with a lower load than when the temperature is below the standard value. This can prevent the user from feeling unwell due to excessive exercise in a high-temperature environment. Also, for example, if the user's outing history indicates that the user went out today, the generation unit 113 may consider that sufficient exercise similar to walking has already been performed and include other exercises in the course. As another example, if the user's medical history indicates that the user has injured a certain part of their body, the generation unit 113 may exclude exercises that put a load on that part from the course. Furthermore, the generation unit 113 may generate an exercise course based on other information such as the user's age and muscle strength, in addition to both factor information and balance function information.

[0072] In S106, the dialogue unit 114 suggests to the user that they perform the exercise course generated by the generation unit 113 by outputting a display image or output sound. Figure 52 in Figure 6 shows an example of a display image screen used by the dialogue unit 114 to suggest performing the exercise in S106. In the example in Figure 52, the exercise course includes squats to improve lower body balance function and aerobics to burn a lot of calories. Specifically, the example in Figure 52 shows that the generation unit 113 selected a squat-centered exercise according to balance function information and selected an aerobics exercise according to factor information indicating the eating history, which is behavioral history. In addition, the generation unit 113 may also generate an exercise course consisting of only a single exercise according to both the factor information and the balance function information.

[0073] In S107, the control unit 101 determines whether the user has agreed to execute the proposed exercise course, in other words, whether the operation signal receiving unit 22 has received a signal indicating agreement to execute the exercise course. If the control unit 101 determines that the user has agreed to execute the proposed exercise course (S107: YES), it then executes the process in S108. On the other hand, if the control unit 101 determines that the user has not agreed to execute the proposed exercise course (S107: NO), it then executes the process from S104, collecting one or both of the factor information and balance function information to generate and propose other exercise courses.

[0074] In S108, the control unit 101 performs a process to cause the user to perform the exercise. In one embodiment, the control unit 101 displays an image on the display unit 30 of a person performing an action that the user should imitate, as a display image of a model exercise.

[0075] As described above, the information processing method performed by the information processing device 100 includes an acquisition step and a generation step, etc. In the acquisition step, factor information indicating at least one of the user's behavioral history and the environmental conditions of the location where the user is located, and balance function information indicating the user's physical balance function are acquired. In the generation step, an exercise course to be proposed to the user is generated according to both the factor information and the balance function information.

[0076] According to the processing method described in this example, it is possible to provide a suitable exercise course that reflects not only the measurement results of the user's physical balance function, but also other conditions related to the user's behavioral history.

[0077] [Examples of implementation using software] The functions of the information processing device 100 (hereinafter referred to as "the device") are programs that cause the device to function as a computer, and these programs can be realized by programs that cause each control block of the device (particularly each part included in the control unit 101) to function as a computer.

[0078] In this case, the device includes a computer having at least one control device (e.g., a processor) and at least one storage device (e.g., memory) as hardware for executing the program. By executing the program using this control device and storage device, the functions described in each of the embodiments are realized.

[0079] The above program may be recorded on one or more computer-readable recording media, not temporary ones. These recording media may or may not be provided by the above device. In the latter case, the program may be supplied to the above device via any wired or wireless transmission medium.

[0080] Furthermore, some or all of the functions of each of the above control blocks can also be implemented by logic circuits. For example, an integrated circuit in which logic circuits functioning as each of the above control blocks are formed is also included in the scope of this disclosure. In addition, it is also possible to implement the functions of each of the above control blocks by, for example, a quantum computer.

[0081] Furthermore, each process described in the above embodiments may be performed by AI (Artificial Intelligence). In this case, the AI ​​may operate on the control device described above, or it may operate on other devices (for example, an edge computer or a cloud server).

[0082] Furthermore, in the display device 1 described above, the sensing unit 21 may have a reflective object detection function such as LiDAR (Laser Imaging Detection and Ranging) or millimeter waves. For example, LiDAR detects the user by reflecting laser light. The sensing unit 21 transmits scan data, which indicates the data scanned by the LiDAR, to the information processing device 100 as sensing data.

[0083] 〔summary〕 This specification describes at least the following embodiments:

[0084] (Aspect 1) The information processing device (100) according to Embodiment 1 of this disclosure comprises an acquisition unit (112) that acquires factor information indicating at least one of the user's behavioral history and the environmental conditions of the location where the user is located, and balance function information indicating the user's physical balance function, and a generation unit (113) that generates an exercise course to propose to the user according to both the factor information and the balance function information. With this configuration, it is possible to provide a suitable exercise course that reflects not only the measurement results of the user's physical balance function but also other conditions related to the user's behavioral history, etc.

[0085] (Aspect 2) The information processing device according to Embodiment 2 of the present disclosure further comprises an imaging unit for imaging the user in Embodiment 1 described above, and the acquisition unit may be configured to acquire information corresponding to the balance function information from the imaging unit when the imaging unit is imaging the user. With the above configuration, for example, when passing through the detection range, it becomes possible to automatically measure and acquire the balance function.

[0086] (Aspect 3) The information processing device according to aspect 3 of this disclosure may further include a dialogue unit (114) that engages in dialogue with the user using a predetermined interactive artificial intelligence, in aspect 1 or 2 described above, and which proposes an exercise course generated by the generation unit. According to this configuration, for example, it contributes to improving the interest of the user when using the services provided by the information processing device.

[0087] (Aspect 4) The information processing device according to aspect 4 of this disclosure may be configured such that, in aspect 3 above, the acquisition unit acquires at least a portion of the factor information from the user's responses when the dialogue unit interacts with the user. This configuration contributes to more easily acquiring specific information necessary for generating exercise courses.

[0088] (Aspect 5) The information processing device according to aspect 5 of this disclosure may be configured such that, in any of aspects 1 to 4 above, the user's activity history includes at least one of the following: meal history, sleep history, outing history, and medical history. According to the above configuration, it is possible to provide a suitable exercise course that reflects these conditions related to meal history, etc.

[0089] (Aspect 6) The information processing device according to aspect 6 of the present disclosure may, in any of aspects 1 to 5 described above, have the following configuration: the environmental conditions include conditions relating to the temperature of the location where the user is located, and the generation unit is configured to generate an exercise course with a reduced load when the temperature is above a reference value compared to when the temperature is below a reference value. According to this configuration, it is possible to suppress user physical ailments caused by excessive exercise in a high-temperature environment.

[0090] (Aspect 7) The display device (1) according to aspect 7 of the present disclosure includes a display unit that displays information output by the information processing device described in any of aspects 1 to 6 above, and the display unit may have a fixing unit that is fixed to a structure. According to the above configuration, some of the output in the interaction can be displayed on the screen.

[0091] (Pattern 8) An information processing system according to aspect 8 of the present disclosure is an information processing system including an information processing device (100) and a display device (1) that is communicably connected to the information processing device, wherein the information processing device acquires factor information indicating at least one of the user's behavioral history and the environmental conditions of the location where the user is located, and balance function information indicating the user's physical balance function, generates an exercise course to propose to the user according to both the factor information and the balance function information, and the display device displays the information output by the information processing device. According to the above configuration, it is possible to provide a suitable exercise course that reflects not only the measurement results of the user's physical balance function but also other conditions related to the user's behavioral history, etc.

[0092] (Aspect 9) An information processing program according to aspect 10 of this disclosure is an information processing program for causing a computer to function as an information processing device, wherein the computer is configured to function as an acquisition unit that acquires factor information indicating at least one of the user's behavioral history and the environmental conditions of the location where the user is located, and balance function information indicating the user's physical balance function, and a generation unit that generates an exercise course to propose to the user according to both the factor information and the balance function information. With the above configuration, an information processing device that achieves the effects described above can be realized using a computer.

[0093] The effects described above in each embodiment of this disclosure will contribute, for example, to achieving United Nations Sustainable Development Goal (SDG) 3, "Ensure healthy lives and promote well-being for all at all ages."

[0094] Each aspect of the information processing device described herein may be implemented by a computer. In this case, the program for the information processing device that enables the computer to implement the information processing device by operating the computer as each part (software element) of the information processing device, and the computer-readable recording medium on which the program is recorded, also fall within the scope of this disclosure.

[0095] This disclosure is not limited to the embodiments described above, and various modifications are possible within the scope of the claims. Embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of this disclosure. Furthermore, new technical features can be formed by combining the technical means disclosed in each embodiment. [Explanation of symbols]

[0096] 1 Display device 21 Sensing unit (detection unit, imaging unit) 22 Operation signal receiving unit 30 Display section 40 Audio output section 100 Information Processing Devices 101 Control Unit 102 memory 103 Storage section 104 Communication I / F 112 Acquisition Department 113 Generation part 114 Dialogue Section

Claims

1. An acquisition unit that acquires factor information indicating at least one of the user's behavioral history and the environmental conditions of the location where the user is located, and balance function information indicating the user's physical balance function, A generation unit that generates an exercise course to propose to the user according to both the factor information and the balance function information, An information processing device equipped with the following features.

2. The system further includes an imaging unit for imaging the user, When the imaging unit is imaging the user, the acquisition unit acquires information corresponding to the balance function information from the imaging unit. The information processing apparatus according to claim 1.

3. A dialogue unit that interacts with the user using a predetermined interactive artificial intelligence, further comprising a dialogue unit that proposes an exercise course generated by the generation unit, The information processing apparatus according to claim 1 or 2.

4. The acquisition unit is, The dialogue unit obtains at least a portion of the factor information from the user's responses when it interacts with the user. The information processing apparatus according to claim 3.

5. The user's activity history is as follows: This includes at least one of the following: dietary history, sleep history, travel history, and medical history. The information processing apparatus according to claim 1 or 2.

6. The aforementioned environmental conditions are, This includes conditions relating to the temperature of the location where the user is located, The generation unit is When the temperature is above a certain threshold, an exercise course is generated with a lower load than when the temperature is below the threshold. The information processing apparatus according to claim 1 or 2.

7. The system includes a display unit that displays information output by the information processing device described in claim 1 or 2, The display unit has a fixing part for fixing it to the structure. Display device.

8. An information processing system including an information processing device and a display device that is communicatively connected to the information processing device, The aforementioned information processing device is The system acquires factor information indicating at least one of the user's behavioral history and the environmental conditions of the location where the user is located, and balance function information indicating the user's physical balance function. Based on both the aforementioned factor information and the aforementioned balance function information, an exercise course to be proposed to the user is generated. The aforementioned display device is The information output by the aforementioned information processing device is displayed. Information processing system.

9. An information processing program that enables a computer to function as an information processing device, The aforementioned computer, An acquisition unit that acquires factor information indicating at least one of the user's behavioral history and the environmental conditions of the location where the user is located, and balance function information indicating the user's physical balance function, A generation unit that generates an exercise course to propose to the user according to both the factor information and the balance function information, An information processing program that functions as such.

Images