Information processing device, display device, information processing system, and information processing program

Abstract

This technology provides information that can be delivered in real time based on the user's emotions and other factors while they are performing an exercise. [Solution] The information processing device includes a sensing unit (21) that acquires the state of the user while they are performing an exercise, an indicator detection unit (201) that detects an emotional indicator or a physical indicator analyzed from the state of the user acquired by the sensing unit (21), and a determination unit (202) that determines information about exercises to propose to the user based on the emotional indicator or physical indicator.

Description

Technical Field

[0001] The present disclosure relates to an information processing device, a display device, an information processing system, and an information processing program. Background Art

[0002] Conventionally, as disclosed in Patent Document 1, there is known an emotion information presentation method that presents emotions changing over time in an easily graspable form without being restricted by fluctuations in human mental states or weathering of memory, and utilizes the emotion information for searching information content such as daily experiences. Here, the emotion analysis processing unit obtains an emotion parameter indicating the degree of emotion based on biological information such as heart rate and blood pressure, converts the emotion parameter into an addable / subtractable one-dimensional emotion currency, and classifies the emotion parameter according to time, experience content and the like. Prior Art Documents Patent Documents

[0003] Patent Document 1 Japanese Unexamined Patent Application Publication No. 2005-124909 Summary of Invention Problems to be Solved by the Invention

[0004] However, although the above configuration stores the user's emotions in association with records of the user's past experiences, it does not provide information according to the user's real-time emotions. For this reason, development of a system that provides information catering to the user's emotions in real time is desired.

[0005] An object of one aspect of the present disclosure is to provide a technology capable of providing information in accordance with real-time emotions or the like of a user who is performing exercise. Means for Solving the Problems

[0006] To solve the above problems, an information processing device according to one aspect of the present disclosure includes: a sensing unit that acquires the state of a user while performing exercise; an indicator detection unit that detects an emotional indicator or a physical indicator analyzed from the state of the user acquired by the sensing unit; and a determination unit that determines information regarding exercises to be proposed to the user based on the emotional indicator or the physical indicator.

[0007] To solve the above problems, an information processing system according to one aspect of the present disclosure is an information processing system including an information processing device and a display device that is communicably connected to the information processing device, wherein the information processing device includes a sensing unit that acquires the state of a user performing an exercise, an index detection unit that detects an emotional index or a physical index analyzed from the state of the user acquired by the sensing unit, and a determination unit that determines information regarding an exercise to be proposed to the user based on the emotional index or the physical index, and the display device includes a display unit that displays a video that serves as an example of the exercise proposed by the information processing device.

[0008] To solve the above problems, an information processing program according to one aspect of the present disclosure is an information processing program for causing a computer to function as an information processing device, wherein the computer functions as a sensing unit that acquires the state of a user performing exercise, an index detection unit that detects an emotional index or a physical index analyzed from the state of the user acquired by the sensing unit, and a determination unit that determines information regarding exercises to propose to the user based on the emotional index or the physical index.

[0009] Each aspect of the information processing device described herein may be implemented by a computer. In this case, an information processing program that enables the computer to implement the information processing device by operating the computer as each part (software element) of the information processing device, and a computer-readable recording medium on which the program is recorded, also fall within the scope of this disclosure. [Effects of the Invention]

[0010] According to one aspect of this disclosure, it becomes possible to provide information in response to the user's real-time emotions and other factors while they are performing the exercise. [Brief explanation of the drawing]

[0011] [Figure 1] This is a block diagram showing an example configuration of a display device according to one embodiment of the present disclosure. [Figure 2] This figure shows an example of the appearance of a display device. [Figure 3] This is a block diagram showing an example of the hardware configuration of an information processing device according to one embodiment of the present disclosure. [Figure 4] This is a block diagram showing an example of the functions of a control unit of an information processing device according to one embodiment of the present disclosure. [Figure 5] This figure shows an example of a screen displayed by the display unit. [Figure 6] This flowchart shows an example of processing performed by an information processing device according to one embodiment of this disclosure. [Modes for carrying out the invention]

[0012] [Embodiment 1] Hereinafter, one embodiment of the present disclosure will be described in detail with reference to the drawings. In the drawings, identical or substantially identical components will be denoted by the same reference numerals, and detailed descriptions will not be repeated.

[0013] (Display device 1) Figure 1 is a block diagram showing an example configuration of the display device 1 according to this embodiment. As shown in Figure 1, the display device 1 includes a sensing unit 21, an operation signal receiving unit 22, an information processing device 100, a display unit 30, and an audio output unit 40. The display device 1 is typically a stationary display device, but it may also be a wall-mounted display device, or a smartphone, tablet terminal, PC (Personal Computer), etc.

[0014] Furthermore, the components of the display device 1 are not limited to being configured as a single device, but may be configured as a system distributed across multiple devices connected via a communication network. For example, the information processing device 100 may be configured as a set-top box or as a cloud server.

[0015] (Sensing unit 21) For example, the sensing unit 21 includes one or more imaging units (cameras) that capture images of the user performing the exercise. In this case, the sensing unit 21 supplies sensing data, including imaging data showing the images captured by the imaging units, to the information processing device 100.

[0016] As another example, the sensing unit 21 is equipped with one or more microphones that collect the user's voice. In this case, the sensing unit 21 supplies sensing data, including voice data indicating the voice collected by the microphones, to the information processing device 100. The voice collected by the microphones is mainly intended for human speech, but is not limited to this, and refers to sound in general that propagates through a medium such as air.

[0017] (Operation signal receiving unit 22) The operation signal receiving unit 22 receives an operation signal from the remote control device 2 used by a user to remotely operate the display device 1. The operation signal is, for example, a signal indicating a result obtained when the user operates the user interface displayed on the display unit 30 using the remote control device 2. The operation signal receiving unit 22 supplies the received operation signal to the information processing apparatus 100. Note that a device capable of operating the display device 1 is not limited to the remote control device 2, and the display device 1 may be operable by a keyboard (not shown) or the like. Furthermore, by installing a dedicated application on a smartphone or tablet terminal owned by the user, the smartphone or tablet terminal and the display device 1 may be configured to be capable of communicating with each other. In this case, the user can remotely operate the display device 1 using a smartphone or tablet terminal instead of the remote control device 2. In this case, the operation signal receiving unit 22 supplies the operation signal received from the smartphone or tablet terminal to the information processing apparatus 100. Furthermore, the user can also remotely operate the display device 1 using voice. Although the above description explains that the user's uttered voice acquired by the sensing unit 21 is supplied to the information processing apparatus 100, the present invention is not limited thereto. The user's uttered voice acquired by the sensing unit 21 may be supplied to the operation signal receiving unit 22. According to such a configuration, the operation signal receiving unit 22 can acquire the user's uttered voice from the sensing unit 21, convert the acquired uttered voice into predetermined data, and receive the user's uttered voice as an operation signal. This realizes remote operation by voice.

[0018] (Information processing apparatus 100) The information processing apparatus 100 generates a display image to be displayed on the display unit 30 and output audio to be output from the audio output unit 40, based on at least one of sensing data supplied from the sensing unit 21 and an operation signal supplied from the operation signal receiving unit 22.

[0019] The display image is, for example, an image including, in the display device 1, a moving image serving as an exercise sample and a moving image of a user's exercise implementation state captured by an imaging unit. Further, the display image may include data generated by generative AI (Artificial Intelligence) such as a large language model (LLM) through interaction with the user.

[0020] The output audio includes, in addition to audio related to the display image, various types of notification sounds, operation sounds for when operating a user interface displayed on the display unit 30, and the like. The output audio may include audio obtained by converting text data generated by generative AI such as a large language model (LLM) through interaction with the user.

[0021] Details of the information processing device 100 will be described later.

[0022] (Display Unit 30) The display unit 30 displays a display image generated by the information processing device 100. As an example, the display unit 30 is configured to include a display panel and a driver that drives the display panel based on image data of the display image. As an example, the display panel is a liquid crystal panel or an organic EL panel.

[0023] (Audio Output Unit 40) The audio output unit 40 is a speaker that outputs output audio generated by the information processing device 100.

[0024] (Other Components) The display device 1 may further include a content receiving unit for receiving content data and supplying the received content data to the information processing device 100. The content data may include, but is not limited to, encoded video data, encoded audio data, and related information associated with the video data. The encoded video data may, but is not limited to, data encoded by various video encoding technologies such as MPEG2, MPEG4, H.264, and H.265 (e.g., TS (Transport Steam)). The related information may, but is not limited to, at least one of the following: program information related to the content, program guide data including the program information, data broadcasting information provided in relation to the content, and explanatory information related to the content. The related information may, for example, be extracted from the content data without decoding processing by the aforementioned video encoding technology such as MPEG2. The content receiving unit may also be configured to acquire content data from the Internet via wireless or wired communication. Furthermore, the content receiving unit may be configured to acquire content data from broadcast waves and may include a tuner for selecting one of the multiple channels included in the broadcast wave. When the content receiving unit includes a tuner, the display device 1 may also be referred to as a television receiver (or simply a television).

[0025] (Example of the appearance of display device 1) Figure 2 shows an example of the appearance of the display device 1. The display device 1 shown in Figure 2 is a stationary display device equipped with legs, and is installed, for example, in a room such as a living room in a house. As an example, the display device 1 shown in Figure 2 is equipped with one sensing unit 21 above the display unit 30, and one operation signal receiving unit 22 and two audio output units 40 below the display unit 30. Stationary or wall-mounted display devices are equipped with fixing parts for fixing to a structure. For example, a stationary display device is equipped with fixing parts for fixing to a stand which is a structure, and a wall-mounted display device is equipped with fixing parts for fixing to a wall which is a structure.

[0026] (Hardware configuration of the information processing device 100) Next, an example of the hardware configuration of the information processing device 100 will be described with reference to Figure 3. Figure 3 is a block diagram showing an example of the hardware configuration of the information processing device 100.

[0027] As shown in Figure 3, the information processing device 100 comprises a control unit 101, a memory 102, a storage unit 103, and a communication interface 104. These components are interconnected via a bus 105 so that they can communicate with one another.

[0028] Memory 102 can be implemented as, for example, RAM (Random Access Memory), DRAM (Dynamic Random Access Memory), or other volatile memory. Storage unit 103 is composed of ROM (Read-Only Memory), HDD (Hard Disk Drive), SSD (Solid State Drive), etc., and stores sensing data supplied from sensing unit 21 and operation signals supplied from operation signal receiving unit 22. Storage unit 103 also stores a program for processing the sensing data and operation signals.

[0029] Furthermore, the memory unit 103 stores system data 50, including the user's facial expression data during exercise, the user's movement / posture data, AI prompts, and knowledge / learning data. Details of this system data 50 will be described later.

[0030] Furthermore, the memory unit 103 may store various databases, such as personal management information and system configuration information. Personal management information may include, for example, information such as each user's characteristics / preferences / likes, exercise objectives, emotion detection history, and usage history. System configuration information may include information such as software application customization specifications, software versions, hardware specifications, and hardware versions.

[0031] The control unit 101 is composed of, for example, one or more processors. The control unit 101 can be implemented as, for example, a CPU (Central Processing Unit), GPU (Graphics Processing Unit), MPU (Micro Processor Unit), FPGA (Field-Programmable Gate Array), or other device that performs arithmetic processing. The control unit 101 reads a program from the storage unit 103 and executes the program using the memory 102 as a working area. Although Figure 3 shows one control unit 101, it is not limited to this, and multiple control units 101 may be provided.

[0032] The communication interface 104 is implemented as hardware such as a network adapter, various communication software, or a combination thereof, and is configured to enable wireless or wired communication over a communication network.

[0033] (Functions of the control unit 101) Next, an example of the functions of the control unit 101 will be described with reference to Figure 4. Figure 4 is a block diagram showing an example of the functions of the control unit 101. The control unit 101 reads a program from the storage unit 103 and executes the program using the memory 102 as a working area, thereby functioning as the indicator detection unit 201 and the determination unit 202. The functions of each of these units may, for example, be distributed across multiple devices connected via a communication network. In this case, the functions of each of these units may be configured as a system consisting of multiple devices. Furthermore, what is described as "~unit" here may be rephrased as "~circuit," "~device," or "~equipment," or as "~step," "~procedure," or "~process." In other words, what is described as "~unit" may be implemented by a program stored in the storage unit 103 as described above, or it may be implemented by hardware such as elements, devices, boards, and wiring only, or by a combination of software and hardware. These functions will be described below.

[0034] The indicator detection unit 201 includes a facial expression analysis unit 210 and a movement / posture analysis unit 211. The facial expression analysis unit 210 can analyze the facial expressions (emotional indicators) of the user's face captured by the imaging unit using general facial expression recognition technology. For example, the facial expression analysis unit 210 analyzes the facial expressions of the user captured by the imaging unit by performing the following processes: identifying the user's face in the image captured by the imaging unit; extracting facial feature points using landmark detection technology to create a basis for analyzing facial expressions; and classifying emotions such as joy, anger, sadness, confusion, happiness, anxiety, and surprise using a machine learning algorithm based on the extracted features.

[0035] Furthermore, the facial expression analysis unit 210 can classify the user's emotions, such as joy, anger, and sadness, by using machine learning algorithms such as CNN (Convolutional Neural Network), VGG (Visual Geometry Group), and ResNet (Residual Network). The user's facial expression data (emotional indicators) analyzed by the facial expression analysis unit 210 is stored in the sequential storage unit 103.

[0036] The exercise / posture analysis unit 211 detects the magnitude and speed of the user's movements as physical indicators by comparing a video of an example exercise with a video of the user performing the exercise captured by the imaging unit. Figure 5 illustrates these physical indicators.

[0037] Figure 5 shows an example of a screen displayed by the display unit 30. In the example in Figure 5, the left screen 31 displays an image of a model (sample) exercise, and the right screen 32 displays a display image, including the user U's body, captured by the imaging unit of the sensing unit 21, in real time.

[0038] On the left screen 31, object 301 shows the remaining time for the exercise being performed, and text 302 shows the name and content of the exercise. For example, as shown in Figure 5, the name of the exercise is displayed as "Arm raises + calf raises," and the content is displayed as "Be mindful not to raise your shoulder blades." Person 303 is an image used to display a person performing the movements that user U should imitate. Objects 304a to 304c show the purpose of the exercise, calories burned, and the area being trained, respectively.

[0039] Furthermore, on the right screen 32, an image of the user U's body itself is superimposed with shapes 308 such as lines indicating the positions of the torso, limbs, and joints, an object 309 indicating the direction in which a certain part of the body should be moved, text 310 showing the result immediately after the movement, and an object 311 showing the cumulative score for the exercise being performed. For example, the text 310 "Bend your arms and then raise them up△" indicates that there was room for improvement in the arm movement.

[0040] Furthermore, a figure 308 representing the elbow position, corresponding to the text 310, is highlighted. The system may also highlight parts of the body that user U wishes to train using figures 308, etc. The aforementioned figures 308, object 309, and text 310 are examples of the information presented. In other words, the control unit 101 generates a screen in which the display image of the exemplary exercise and the presented information are combined so that they are included in the entire display image shown by the display unit 30. The control unit 101 may also determine that the user has completed the exercise if the cumulative score (score) indicated by object 311 is equal to or greater than a predetermined threshold at the end of the exercise.

[0041] The score may be the cumulative score as described above, or it may be the sum of numerical values ​​that represent how close the positions of the torso, limbs, and joints of the person 303 are to the positions of the torso, limbs, and joints of the person 303, based on the figures 308, such as lines, that indicate the positions of the torso, limbs, and joints, displayed on the display image of the user U's body itself.

[0042] The exercise / posture analysis unit 211 may also detect the user's level of concentration, calculated from the user's movements and scores during exercise. For example, the exercise / posture analysis unit 211 may determine that the user's level of concentration has decreased if the user's movements are smaller compared to the example video, or if the aforementioned score falls below a predetermined value.

[0043] Furthermore, the movement / posture analysis unit 211 may calculate how much the user's torso, limbs, and joints lag behind the positions of the sample person 303's torso, limbs, and joints, and use this value as the user's movement speed (follow-up rate). If the user's movement speed is less than a predetermined value, the movement / posture analysis unit 211 determines that the user has a high level of concentration (high follow-up rate), and if the user's movement speed is equal to or greater than the predetermined value, it determines that the user has a low level of concentration (low follow-up rate). The information such as the magnitude, speed, and follow-up rate of the user's movements analyzed by the movement / posture analysis unit 211 is stored in the sequential storage unit 103 as movement / posture data (physical indicators).

[0044] The decision unit 202 determines information or advice regarding exercises to suggest to the user based on emotional or physical indicators. For example, by referring to emotional indicators, if the user shows facial expressions such as confusion or anxiety (indicating low concentration), the decision unit 202 will suggest an exercise with different content from the exercise the user is currently performing.

[0045] Examples of exercise types (content) include neck stretches, shoulder stretches, underarm stretches, T-balance poses, palm pushes, squats, leg raises, standing abdominal exercises, and standing back exercises.

[0046] Furthermore, by referring to the emotional indicators, the decision unit 202 suggests an exercise with the same content as the exercise the user is currently performing but at a lower difficulty level if the user shows expressions such as confusion or anxiety. These exercise levels are ranked, for example, advanced, intermediate, beginner, etc., allowing the user to perform exercises according to their exercise level. Alternatively, by referring to the emotional indicators, the decision unit 202 may suggest an exercise with the same content as the exercise the user is currently performing but at a higher difficulty level if the user shows expressions such as joy or high levels of happiness (high level of concentration).

[0047] Furthermore, the decision unit 202 may, by referring to physical indicators, suggest an exercise with different content from the exercise the user is currently performing if the user's level of concentration is decreasing.

[0048] Furthermore, the decision unit 202 may, by referring to physical indicators, suggest an exercise with the same content but a lower exercise level (difficulty) if the user's concentration level is low. Conversely, the decision unit 202 may, by referring to physical indicators, suggest an exercise with the same content but a higher exercise level (difficulty) if the user's concentration level is high.

[0049] Furthermore, the decision unit 202 includes a generation AI unit 220. The generation AI unit 220 automatically generates digital content such as text, images, music, and videos that resemble those created by humans, using deep learning and machine learning techniques. For example, by referring to emotion indicators, if the user shows expressions of confusion or anxiety, the decision unit 202 may cause the generation AI unit 220 to generate encouraging text for the user and display it on the display unit 30. Alternatively, by referring to emotion indicators, if the user shows expressions of confusion or anxiety, the decision unit 202 may cause the generation AI unit 220 to generate text suggesting that the user take a break and display it on the display unit 30.

[0050] Furthermore, the decision unit 202, by referring to physical indicators, may cause the generation AI unit 220 to generate text encouraging the user if the user's concentration level is decreasing, and display it on the display unit 30. Alternatively, the decision unit 202 may cause the generation AI unit 220 to generate text suggesting the user take a break if the user's concentration level is decreasing, and display it on the display unit 30. Alternatively, the decision unit 202 may cause the generation AI unit 220 to generate more easily understandable advice and display it on the display unit 30.

[0051] Furthermore, the decision unit 202 may suggest the selection of eye-friendly content to the user based on emotional indicators or physical indicators. For example, if the decision unit 202 detects that the user is too engrossed in the display screen of the display unit 30 by referring to emotional indicators, it may cause the generation AI unit 220 to generate text suggesting that the user select eye-friendly content, and display this text on the display unit 30.

[0052] Furthermore, the decision unit 202 suggests increasing the amount of content presented to the user based on emotional or physical indicators. For example, by referring to physical indicators, the decision unit 202 may increase the amount of content displayed on the display unit 30 if the user's concentration level is low, thereby increasing the user's concentration level.

[0053] Figure 6 is a flowchart showing an example of processing performed by an information processing device 100 according to one embodiment of the present disclosure. First, the sensing unit 21 acquires the state of the user while they are performing the exercise (S101). For example, the imaging unit captures an image of the user's body, including their face, while they are performing the exercise.

[0054] Next, the indicator detection unit 201 detects emotional indicators or physical indicators analyzed from the user's state acquired by the sensing unit 21 (S102). For example, the facial expression analysis unit 210 analyzes the user's facial expression (emotional indicator) captured by the imaging unit using general facial expression recognition technology. In addition, the movement / posture analysis unit 211 detects the magnitude and speed of the user's movements as physical indicators by comparing a video of an example exercise with a video of the user performing the exercise captured by the imaging unit.

[0055] Finally, the decision unit 202 determines information about the exercise to suggest to the user based on emotional indicators or physical indicators (S103). For example, by referring to emotional indicators, the decision unit 202 suggests an exercise with different content from the exercise the user is currently performing if the user shows expressions such as confusion or anxiety. Alternatively, by referring to physical indicators, the decision unit 202 may suggest an exercise with different content from the exercise the user is currently performing if the user's level of concentration is decreasing.

[0056] The above describes an information processing device related to exercise, but the present invention can also be applied to information processing devices such as televisions and tablets used by users while studying. For example, if it is detected that a user is concentrating too much on (being engrossed in) the television, eye-friendly content may be displayed on the television screen. Also, if it is detected that a user is not concentrating (being engrossed in) the tablet while studying, more content may be displayed on the tablet to increase their concentration.

[0057] (Effects and Benefits) As described above, according to one embodiment of this disclosure, the following effects and advantages can be obtained.

[0058] In the information processing device 100, the decision unit 202 determines information about exercises to suggest to the user based on emotional indicators or physical indicators. Therefore, it is possible to make appropriate suggestions regarding exercises based on emotional indicators or physical indicators.

[0059] Furthermore, the decision unit 202 suggests a different exercise from the one the user is currently performing, based on the user's facial expression. Therefore, for example, if the user has a pained expression, it can suggest an exercise of lower difficulty.

[0060] Furthermore, the decision unit 202 suggests a different exercise from the one the user is currently performing, based on the magnitude or speed of the user's movements. Therefore, for example, if the user's movements become smaller, a less difficult exercise can be suggested.

[0061] Furthermore, the decision unit 202 suggests an exercise different from the one the user is currently performing, based on the degree to which it follows the user's movements. Therefore, for example, if the degree to which it follows the user's movements is low, it can suggest an exercise with a lower difficulty level.

[0062] Furthermore, different exercises include exercises with different content than the original exercise, or exercises with the same content but different difficulty levels. Therefore, the decision unit 202 can appropriately suggest either exercises with different content than the original exercise, or exercises with the same content but different difficulty levels, depending on the emotional or physical indicators.

[0063] Furthermore, the decision unit 202 suggests to the user that they take a break based on emotional or physical indicators. Therefore, for example, if it detects that the user is tired based on emotional or physical indicators, it can suggest that the user take a break.

[0064] Furthermore, the decision unit 202 suggests eye-friendly content to the user based on emotional or physical indicators. Therefore, for example, if it detects that the user is tired based on emotional or physical indicators, it can suggest eye-friendly content.

[0065] Furthermore, the decision unit 202 suggests increasing the amount of content presented to the user based on emotional or physical indicators. For example, if it detects that the user is not concentrating (immersed) in the exercise based on emotional or physical indicators, it can suggest increasing the amount of content.

[0066] [Examples of implementation using software] The functions of the information processing device 100 (hereinafter referred to as "the device") are programs that cause the device to function as a computer, and these programs can be realized by programs that cause each control block of the device (particularly each part included in the control unit 101) to function as a computer.

[0067] In this case, the device includes a computer having at least one control device (e.g., a processor) and at least one storage device (e.g., memory) as hardware for executing the program. By executing the program using this control device and storage device, the functions described in each of the embodiments are realized.

[0068] The above program may be recorded on one or more computer-readable recording media, not temporary ones. These recording media may or may not be provided by the above device. In the latter case, the program may be supplied to the above device via any wired or wireless transmission medium.

[0069] Furthermore, some or all of the functions of each of the above control blocks can also be realized by logic circuits. For example, an integrated circuit in which logic circuits functioning as each of the above control blocks are formed is also included in the scope of the present invention. In addition, it is also possible to realize the functions of each of the above control blocks by, for example, a quantum computer.

[0070] Furthermore, each process described in the above embodiments may be performed by AI (Artificial Intelligence). In this case, the AI ​​may operate on the control device described above, or it may operate on other devices (for example, an edge computer or a cloud server).

[0071] 〔summary〕 This disclosure includes at least the following aspects:

[0072] (Aspect 1) An information processing device according to Embodiment 1 of the present disclosure comprises: a sensing unit that acquires the state of a user while performing exercise; an indicator detection unit that detects an emotional indicator or a physical indicator analyzed from the state of the user acquired by the sensing unit; and a determination unit that determines information regarding exercises to be proposed to the user based on the emotional indicator or the physical indicator.

[0073] (Aspect 2) The information processing device according to aspect 2 of the present disclosure, in aspect 1 described above, the sensing unit includes an imaging unit that images a user performing an exercise, the index detection unit detects the emotional index analyzed from the user's face captured by the imaging unit or the physical index analyzed from the user's movements, and the determination unit determines content or advice regarding exercises to suggest to the user based on the emotional index or the physical index.

[0074] (Aspect 3) In the information processing apparatus according to aspect 3 of the present disclosure, in aspect 2 described above, the index detection unit detects the user's facial expression captured by the imaging unit as the emotion index, and the determination unit proposes an exercise different from the exercise the user is currently performing based on the user's facial expression.

[0075] (Aspect 4) In the information processing device according to aspect 4 of the present disclosure, in aspect 2 described above, the indicator detection unit detects the magnitude of the user's movement captured by the imaging unit as the physical indicator, and the determination unit proposes an exercise different from the exercise the user is currently performing based on the magnitude or speed of the user's movement.

[0076] (Aspect 5) In the information processing device according to aspect 5 of the present disclosure, in aspect 2 described above, the indicator detection unit detects the degree to which the user's movements follow a video that serves as an example of the exercise as the physical indicator, and the determination unit proposes an exercise different from the exercise the user is currently performing based on the degree to which the user's movements follow.

[0077] (Aspect 6) The information processing device according to Embodiment 6 of the present disclosure, in any of Embodiments 3 to 5 above, includes, for each of the different exercises, an exercise with different content from the exercise, or an exercise with the same content as the exercise but with a different difficulty level.

[0078] (Aspect 7) In the information processing device according to aspect 7 of this disclosure, in aspect 1 or 2 described above, the decision unit proposes to the user to take a break based on the emotional indicator or the physical indicator.

[0079] (Pattern 8) In the information processing device according to aspect 8 of the present disclosure, in aspect 1 or 2 described above, the decision unit proposes a selection of content that is easy on the user's eyes based on the emotional index or the physical index.

[0080] (Aspect 9) In the information processing device according to aspect 9 of this disclosure, in aspect 1 or 2 described above, the decision unit proposes an increase in the content to be presented to the user based on the emotional indicator or physical indicator.

[0081] (Aspect 10) A stationary display device according to aspect 10 of the present disclosure comprises a display unit that displays a video sample of an exercise recommended by an information processing device, in any of aspects 1 to 9 described above, and the display unit has a fixing unit that is fixed to a structure.

[0082] (Aspect 11) An information processing system according to aspect 11 of the present disclosure is an information processing system including an information processing device and a display device that is communicably connected to the information processing device, wherein the information processing device includes a sensing unit that acquires the state of a user performing an exercise, an index detection unit that detects an emotional index or a physical index analyzed from the state of the user acquired by the sensing unit, and a determination unit that determines information regarding an exercise to be proposed to the user based on the emotional index or the physical index, and the display device includes a display unit that displays a video that serves as an example of the exercise proposed by the information processing device.

[0083] (Aspect 12) An information processing program according to aspect 12 of this disclosure is an information processing program for causing a computer to function as an information processing device, wherein the computer functions as a sensing unit that acquires the state of a user performing exercise, an index detection unit that detects an emotional index or a physical index analyzed from the state of the user acquired by the sensing unit, and a determination unit that determines information regarding exercises to propose to the user based on the emotional index or the physical index.

[0084] This disclosure is not limited to the embodiments described above, and various modifications are possible within the scope of the claims. Embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of this disclosure.

[0085] For example, in the display device 1 of the embodiment 1 described above, the sensing unit 21 may have a reflective object detection function such as LiDAR (Laser Imaging Detection and Ranging) or millimeter waves. For example, LiDAR detects the user by the reflection of laser light. The sensing unit 21 transmits scan data indicating the data scanned by the LiDAR to the information processing device 100 as sensing data. [Explanation of symbols]

[0086] 1 Display device 21 Sensing Unit 22 Operation signal receiving unit 30 Display section 40 Audio output section 50 System Data 100 Information Processing Devices 101 Control Unit 102 memory 103 Storage section 104 Communication I / F 201 Indicator Detection Unit 202 Decision Section 210 Facial expression analysis department 211 Exercise / Posture Analysis Department 220 Generation AI Department

Claims

1. A sensing unit that acquires the user's status while they are performing exercise, An indicator detection unit that detects emotional indicators or physical indicators analyzed from the user's state acquired by the sensing unit, An information processing device comprising: a determination unit that determines information regarding exercises to be proposed to the user based on the aforementioned emotional indicator or the aforementioned physical indicator.

2. The sensing unit includes an imaging unit that captures images of the user while they are performing exercise. The indicator detection unit detects the emotional indicators analyzed from the user's face captured by the imaging unit, or the physical indicators analyzed from the user's movements. The information processing apparatus according to claim 1, wherein the determination unit determines content or advice regarding exercises to propose to the user based on the emotional index or the physical index.

3. The indicator detection unit detects the facial expression of the user captured by the imaging unit as the emotion indicator. The information processing apparatus according to claim 2, wherein the determination unit proposes an exercise different from the exercise the user is currently performing, based on the user's facial expression.

4. The indicator detection unit detects the magnitude or speed of the user's movement captured by the imaging unit as the physical indicator. The information processing apparatus according to claim 2, wherein the determination unit proposes an exercise different from the exercise the user is currently performing, based on the magnitude or speed of the user's movements.

5. The indicator detection unit detects the degree to which the user's movements follow the example video of the exercise as the physical indicator, The information processing apparatus according to claim 2, wherein the determination unit proposes an exercise different from the exercise the user is currently performing, based on the degree to which it follows the user's movements.

6. The information processing apparatus according to any one of claims 3 to 5, wherein the different exercises include exercises with different content from the exercise, or exercises with the same content as the exercise but with different difficulty levels.

7. The information processing apparatus according to claim 1 or 2, wherein the decision unit proposes to the user to take a break based on the emotional index or the physical index.

8. The information processing apparatus according to claim 1 or 2, wherein the decision unit proposes the selection of eye-friendly content to the user based on the emotional index or the physical index.

9. The information processing apparatus according to claim 1 or 2, wherein the determination unit proposes an increase in the amount of content to be presented to the user based on the emotional indicator or physical indicator.

10. The information processing device according to any one of claims 1 to 5 includes a display unit that displays a video that serves as an example of an exercise proposed by the information processing device according to any one of claims 1 to 5, The display unit has a fixing part for fixing to the structure. Stationary display device.

11. An information processing system including an information processing device and a display device that is communicatively connected to the information processing device, The aforementioned information processing device is A sensing unit that acquires the user's status while they are performing exercise, An indicator detection unit that detects emotional indicators or physical indicators analyzed from the user's state acquired by the sensing unit, The system includes a determination unit that determines information regarding exercises to be suggested to the user based on the aforementioned emotional indicators or physical indicators, The display device includes a display unit that displays a video that serves as an example of the exercise proposed by the information processing device. Information processing system.

12. An information processing program that enables a computer to function as an information processing device, The aforementioned computer, A sensing unit that acquires the user's status while they are performing exercise, An indicator detection unit that detects emotional indicators or physical indicators analyzed from the user's state acquired by the sensing unit, A determination unit that determines information regarding exercises to propose to the user based on the aforementioned emotional indicator or physical indicator, An information processing program designed to function as such.

Images