Information processing device and information processing method

Abstract

To provide an information processing device that gives a proposal suitable for a user, an information processing method, and the like.SOLUTION: An information processing device includes: an image acquisition unit that acquires a lying posture image obtained by imaging a user in the lying posture; a model estimation unit that estimates a skeleton model of the user on the basis of the lying posture image; and a bedding selection unit that performs processing of selecting bedding recommended to the user on the basis of the estimated skeleton model.SELECTED DRAWING: Figure 5

Description

[Technical Field]

[0001] The present invention relates to an information processing device, an information processing method, and the like. [Background technology]

[0002] Conventionally, there are known methods for selecting bedding suitable for a user. For example, Patent Document 1 discloses a method for classifying body types based on height and weight and selecting bedding based on the parameters obtained. Furthermore, Patent Document 2 discloses a method for selecting bedding based on sleeping posture estimation using body pressure values. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2006-320647 [Patent Document 2] Japanese Patent Application Laid-Open No. 2007-151817 Summary of the Invention [Problem to be solved by the invention]

[0004] An information processing device and an information processing method that make suggestions suitable for a user are provided. [Means for solving the problem]

[0005] One aspect of the present disclosure relates to an information processing device that includes an image acquisition unit that acquires a sleeping position image of a user in a sleeping position, a model estimation unit that estimates a skeletal model of the user based on the sleeping position image, and a bedding selection unit that performs processing to select bedding recommended for the user based on the estimated skeletal model.

[0006] Another aspect of the present disclosure relates to an information processing method that acquires a sleeping posture image of a user in a sleeping posture, estimates a skeletal model of the user based on the sleeping posture image, and performs a process of selecting bedding recommended for the user based on the estimated skeletal model. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 illustrates an example of the configuration of an information processing system. [Figure 2] FIG. 2 is a diagram illustrating an example of the flow of data in the processing of this embodiment. [Figure 3] FIG. 1 illustrates an example of the configuration of a server system. [Figure 4] FIG. 2 is a diagram illustrating an example of the configuration of a terminal device. [Figure 5] FIG. 1 illustrates an example of the configuration of an information processing device. [Figure 6] FIG. 2 is a diagram illustrating a detailed configuration example of an information processing device. [Figure 7] FIG. 10 is a diagram illustrating an example of the flow of data when selecting bedding. [Figure 8] 10 is a flowchart illustrating processing by the information processing device. [Figure 9A] 10A and 10B are diagrams illustrating an example of the positional relationship between a user and an imaging device when a standing position image is acquired. [Figure 9B] 10A and 10B are diagrams illustrating an example of the positional relationship between a user and an imaging device when acquiring a lying posture image. [Figure 9C] 10A and 10B are diagrams illustrating an example of the positional relationship between a user and an imaging device when acquiring a lying posture image. [Figure 9D] 10A and 10B are diagrams illustrating an example of the positional relationship between a user and an imaging device when acquiring a lying posture image. [Figure 10] FIG. 1 is a diagram illustrating a skeletal model. [Figure 11A] FIG. 10 is a diagram illustrating the relationship between the neck tilt angle and the pillow height in the supine position. [Figure 11B] FIG. 10 is a diagram illustrating the relationship between the neck tilt angle and the pillow height in the supine position. [Figure 11C]FIG. 10 is a diagram illustrating the relationship between the neck tilt angle and the pillow height in the supine position. [Figure 12A] FIG. 10 is a diagram illustrating the relationship between the waist inclination angle and mattress hardness in the supine position. [Figure 12B] FIG. 10 is a diagram illustrating the relationship between the waist inclination angle and mattress hardness in the supine position. [Figure 12C] FIG. 10 is a diagram illustrating the relationship between the waist inclination angle and mattress hardness in the supine position. [Figure 13A] FIG. 10 is a diagram illustrating the relationship between the waist inclination angle and mattress hardness in the lateral position. [Figure 13B] FIG. 10 is a diagram illustrating the relationship between the waist inclination angle and mattress hardness in the lateral position. [Figure 13C] FIG. 10 is a diagram illustrating the relationship between the waist inclination angle and mattress hardness in the lateral position. [Figure 14] FIG. 10 is a diagram illustrating another example of the data flow in selecting bedding. [Figure 15A] FIG. 10 is a diagram illustrating an example of a position change technique. [Figure 15B] FIG. 10 is a diagram showing an example of recommended mattress characteristics. [Figure 15C] FIG. 10 is a diagram showing examples of recommended pillow characteristics. [Figure 16A] FIG. 10 is a diagram illustrating an example of a position change technique. [Figure 16B] FIG. 10 is a diagram showing an example of recommended mattress characteristics. [Figure 16C] FIG. 10 is a diagram showing examples of recommended pillow characteristics. [Figure 17] FIG. 1 is a diagram illustrating a detection device that is an example of a sleep sensor. [Figure 18A] FIG. 10 is a diagram illustrating an example of recommended bedding. [Figure 18B] FIG. 10 is a diagram illustrating an example of recommended bedding. [Figure 18C] FIG. 10 is a diagram illustrating an example of recommended bedding. [Figure 18D] FIG. 10 is a diagram illustrating an example of recommended bedding. [Figure 18E] FIG. 10 is a diagram illustrating an example of recommended bedding. [Figure 18F] FIG. 10 is a diagram illustrating an example of recommended bedding. [Figure 18G] FIG. 10 is a diagram illustrating an example of recommended bedding. [Figure 19] FIG. 10 is a diagram illustrating an example of a data flow in advice output. [Figure 20A] 10 is an example of a user screen displayed on a terminal device. [Figure 20B] 10 is an example of a user screen displayed on a terminal device. [Figure 20C] 10 is an example of a user screen displayed on a terminal device. [Figure 20D] 10 is an example of a user screen displayed on a terminal device. DETAILED DESCRIPTION OF THE INVENTION

[0008] Hereinafter, the present embodiment will be described with reference to the drawings. In the drawings, identical or equivalent elements are designated by the same reference numerals, and duplicate explanations will be omitted. Note that the present embodiment described below does not unduly limit the content described in the claims. Furthermore, not all of the configurations described in the present embodiment are necessarily essential components of the present disclosure.

[0009] 1. System configuration example Fig. 1 shows an example of the configuration of an information processing system 10 according to this embodiment. The information processing system 10 according to this embodiment acquires information from a user who is suffering from problems such as stiff shoulders, back pain, headaches, etc., caused by body distortion or lifestyle habits, and presents measures to alleviate the problems. For example, the information processing system 10 may acquire a skeletal model of the user (e.g., Fig. 10, which will be described later), and may evaluate the bedding being used or select recommended bedding based on the skeletal model (e.g., Figs. 11A to 13C, which will be described later).

[0010] 2 is a diagram illustrating the flow of data in this embodiment, showing specific examples of information (Input) about a user, etc., and information (Output) output based on the information by the information processing system 10. The information processing system 10 may acquire or calculate the information indicated in Input, and output the information indicated in Output based on the information.

[0011] For example, the information processing system 10 of this embodiment may acquire information such as personal data, personal attributes, facility data, and facility attributes. Personal data includes information such as the user's standing posture, sleeping posture (sleeping posture), skeletal length, and sleep score. Personal attributes include information such as age, sex, height, weight, illness, and residential area. Personal attributes may also include the user's method of changing position (turning over method). Facility attributes include information on the type and location of the facility. A facility here refers to a facility that addresses problems such as stiff shoulders and lower back pain, and includes chiropractic clinics, osteopathic clinics, and clinics. Facility data includes a visit score that indicates the effect of visiting the facility. Details of each piece of information will be described later.

[0012] Based on this information, the information processing system 10 proposes measures to resolve the user's concerns. These measures include evaluation and selection of bedding, recommendation to visit the facility, and advice on sleep habits and lifestyle habits. The information processing system 10 may also calculate scores to objectively evaluate posture, sleep, pain / concerns, and the quality of the facility. Details of this information will be described later.

[0013] As shown in Fig. 1, the information processing system 10 may include a server system 100, a terminal device 200, an imaging device 300, and a sensing device 400. The configuration of the information processing system 10 is not limited to that shown in Fig. 1, and modifications such as omitting some components or adding other components are possible. For example, although the terminal device 200 and the imaging device 300 are shown as separate devices in Fig. 1, they may be realized by a single device. For example, the terminal device 200 having an imaging function may also function as the imaging device 300.

[0014] The server system 100 is connected to a terminal device 200, an imaging device 300, and a sensing device 400 via, for example, a network. The network here is, for example, a public communication network such as the Internet. However, the network is not limited to a public communication network and may be a LAN (Local Area Network) or the like. For example, the server system 100 may perform communication in accordance with the IEEE802.11 standard. However, various modifications are possible regarding the communication method between the devices.

[0015] The server system 100 may be a single server or may include multiple servers. For example, the server system 100 may include a database server and an application server. The database server may store, for example, the information shown in FIG. 2. The application server performs various processes. For example, the application server may calculate a skeletal model or select bedding recommended for the user, as will be described later with reference to FIG. 8. The multiple servers here may be physical servers or virtual servers. If a virtual server is used, the virtual server may be provided on a single physical server, or may be distributed across multiple physical servers. As described above, the specific configuration of the server system 100 in this embodiment can be modified in various ways.

[0016] The terminal device 200 is, for example, a device used by a user who uses the information processing system 10. For example, the terminal device 200 is used to input personal attribute data such as age, sex, height, and weight, and to output suggestions obtained by the server system 100. The suggestions here may include, for example, information indicating recommended bedding selected by the server system 100. The terminal device 200 of this embodiment is, for example, a mobile terminal device such as a smartphone or a tablet terminal. However, the terminal device 200 may also be other devices, such as a personal computer (PC), a headset, or a wearable device such as augmented reality (AR) glasses or mixed reality (MR) glasses.

[0017] The imaging device 300 is a device that captures images used to calculate a skeletal model of a user. The imaging device 300 includes an image sensor that captures an image of a predetermined imaging range and outputs image information. The image information here may be a still image or a moving image. The image information may also be color or monochrome. The imaging device 300 may also include a depth sensor that detects the distance to the subject, or a sensor (e.g., an infrared sensor) that detects the heat of the subject. The imaging device 300 may be a camera, a smartphone with an imaging function, or the like.

[0018] The sensing device 400 is a device used to sense information about a user's sleep and daily life. For example, the sensing device 400 has various sensors and acquires sensing data based on the sensors. The sensing data here may be the sensor output itself or information obtained by arithmetic processing based on the sensor output. The sensing device 400 may be, for example, a detection device 430 (sleep scan) placed between a bed 610 and a mattress 620 as shown in FIG. 1 and configured to sense the user's sleep state. Details of the detection device 430 will be described later with reference to FIG. 17. The sensing device 400 may also be a device that senses the state of the user engaged in some task, and may include, for example, a wristwatch-type device or a wearable device that is attached to the user's clothing or skin.

[0019] 3 is a block diagram showing a detailed configuration example of the server system 100. The server system 100 includes, for example, a processing unit 110, a storage unit 120, and a communication unit .

[0020] The processing unit 110 of this embodiment is configured by the following hardware. The hardware can include at least one of a circuit for processing digital signals and a circuit for processing analog signals. For example, the hardware can be configured by one or more circuit devices or one or more circuit elements mounted on a circuit board. The one or more circuit devices are, for example, an integrated circuit (IC), a field-programmable gate array (FPGA), etc. The one or more circuit elements are, for example, a resistor, a capacitor, etc.

[0021] The processing unit 110 may also be implemented by the following processor. The server system 100 of this embodiment includes a memory that stores information and a processor that operates based on the information stored in the memory. The information may be, for example, a program and various data. The memory may be the storage unit 120 or another memory. The processor includes hardware. Various processors, such as a central processing unit (CPU), a graphics processing unit (GPU), or a digital signal processor (DSP), may be used. The memory may be a semiconductor memory such as a static random access memory (SRAM), a dynamic random access memory (DRAM), or a flash memory, or may be a register, a magnetic storage device such as a hard disk drive (HDD), or an optical storage device such as an optical disk drive. For example, the memory stores computer-readable instructions, and the processor executes the instructions to realize the functions of the processing unit 110. The instructions may be instructions from an instruction set that constitutes a program, or instructions that instruct the hardware circuitry of the processor to operate.

[0022] The storage unit 120 is a work area for the processing unit 110 and stores various information. The storage unit 120 can be realized by various types of memory, and the memory may be a semiconductor memory such as an SRAM, a DRAM, a ROM (Read Only Memory), or a flash memory, or may be a register, a magnetic storage device, or an optical storage device.

[0023] The communication unit 130 is an interface for communicating via a network, and includes, for example, an antenna, an RF (radio frequency) circuit, and a baseband circuit when the server system 100 performs wireless communication. However, the server system 100 may also perform wired communication, in which case the communication unit 130 may include a communication interface such as an Ethernet connector and a control circuit for the communication interface. The communication unit 130 may operate under control of the processing unit 110, or may include a processor for communication control that is different from the processing unit 110. The communication unit 130 may perform communication according to a method specified in, for example, IEEE802.11 or IEEE802.3. However, the specific communication method can be modified in various ways.

[0024] Fig. 4 is a block diagram showing a detailed configuration example of the terminal device 200. The terminal device 200 includes, for example, a processing unit 210, a storage unit 220, a communication unit 230, a display unit 240, and an operation unit 250. However, the configuration of the terminal device 200 is not limited to that shown in Fig. 4, and modifications such as omitting some components or adding other components are possible. For example, the terminal device 200 may have various sensors such as an image sensor (imaging unit), a motion sensor such as an acceleration sensor or a gyro sensor, a pressure sensor, a GPS (Global Positioning System) sensor, etc.

[0025] The processing unit 210 is configured by hardware including at least one of a circuit for processing digital signals and a circuit for processing analog signals. The processing unit 210 may also be realized by a processor. Various types of processors, such as a CPU, a GPU, or a DSP, can be used as the processor. The processor executes instructions stored in the memory of the terminal device 200, thereby realizing the functions of the processing unit 210 as processing.

[0026] The storage unit 220 is a work area for the processing unit 210, and is realized by various types of memory such as SRAM, DRAM, ROM, etc. The storage unit 220 stores, for example, attribute information of the target user, captured images acquired from the imaging device 300, etc. The storage unit 220 may also store information representing suggestions to be presented to the user.

[0027] The communication unit 230 is an interface for communication via a network, and includes, for example, an antenna, an RF circuit, and a baseband circuit. The communication unit 230 communicates with the server system 100 via, for example, the network. The communication unit 230 may perform wireless communication with the server system 100 in accordance with, for example, the IEEE 802.11 standard.

[0028] The display unit 240 is an interface that displays various information and may be a liquid crystal display, an organic EL display, or another type of display. The operation unit 250 is an interface that accepts user operations. The operation unit 250 may be buttons or the like provided on the terminal device 200. The display unit 240 and the operation unit 250 may also be a touch panel that is integrally configured.

[0029] The terminal device 200 may also include components not shown in FIG. 4, such as a light-emitting unit, a vibration unit, a sound input unit, and a sound output unit. The light-emitting unit is, for example, an LED (light emitting diode) and provides notification by emitting light. The vibration unit is, for example, a motor and provides notification by vibration. The sound input unit is, for example, a microphone. The sound output unit is, for example, a speaker and provides notification by sound.

[0030] FIG. 5 is a diagram showing an example of the configuration of an information processing device 20 according to this embodiment. The information processing device 20 may correspond to the server system 100. For example, the units shown in FIG. 5 may be included in the processing unit 110 of the server system 100. However, the information processing device 20 according to this embodiment is not limited to the server system 100, and may correspond to the terminal device 200. For example, the units shown in FIG. 5 may be included in the processing unit 210 of the terminal device 200. Furthermore, the information processing device 20 according to this embodiment may correspond to a plurality of devices. For example, the processing of the units shown in FIG. 5 may be realized by distributed processing between the processing unit 110 and the processing unit 210.

[0031] As shown in Fig. 5, the information processing device 20 includes an image acquisition unit 21, a model estimation unit 22, and a bedding selection unit 23. The image acquisition unit 21 acquires a sleeping posture image of a user in a sleeping posture. The model estimation unit 22 estimates a skeletal model of the user based on the sleeping posture image. The bedding selection unit 23 performs a process of selecting bedding recommended for the user based on the estimated skeletal model.

[0032] According to the method of this embodiment, a skeletal model of a user can be estimated based on an image of the user's sleeping position. Since the body distorts during sleeping due to environmental factors such as pillows and mattresses, the skeletal model acquired based on the sleeping position image reflects the skeletal distortion caused by these environmental factors. Therefore, by using the skeletal model based on the sleeping position image, it is possible to provide appropriate advice regarding bedding, which is a factor that causes distortion of the body.

[0033] The image acquisition unit 21 may also acquire standing images of the user in a standing position. In this case, the model estimation unit 22 estimates a skeletal model of the user based on both the standing image and the lying image. Since the standing position is not affected by bedding such as pillows and mattresses, the skeletal model acquired based on the standing image reflects the basic body distortion of the target user. Therefore, by using both the skeletal model based on the standing image and the skeletal model based on the lying image, it is possible to distinguish whether the body distortion is basic distortion or distortion caused by environmental factors such as bedding, making it possible to accurately determine the bedding. Details of the processing will be described later.

[0034] Fig. 6 is a diagram showing a detailed configuration example of the information processing device 20 according to this embodiment. The information processing device 20 may include an image acquisition unit 21, a model estimation unit 22, a bedding selection unit 23, a sleeping posture determination unit 24, a position change estimation unit 25, a sleep information acquisition unit 26, an evaluation processing unit 27, a notification processing unit 28, and a sharing processing unit 29. However, the configuration of the information processing device 20 is not limited to that shown in Fig. 6, and various modifications are possible, such as omitting some components or adding other components. Note that the image acquisition unit 21, the model estimation unit 22, and the bedding selection unit 23 are the same as those in Fig. 5, and therefore descriptions thereof will be omitted.

[0035] The sleeping posture determination unit 24 determines whether the user's sleeping posture is one of a plurality of postures, including supine, right lateral, left lateral, and prone. The sleeping posture determination unit 24 may also determine the time ratio of each posture. The time ratios will be described in detail later. The sleeping posture determination unit 24 may be connected to the image acquisition unit 21 as shown in FIG. 6, and may determine the sleeping posture and time ratio based on images captured by the imaging device 300. Alternatively, although not shown in FIG. 6, the sleeping posture determination unit 24 may be connected to the sleep information acquisition unit 26, and may determine the sleeping posture and time ratio based on sensing data from a detection device 430, which will be described later.

[0036] The position change estimation unit 25 estimates a method used when the user changes position by turning over (hereinafter referred to as a position change method). The position change estimation unit 25 may estimate the position change method based on an image captured by the imaging device 300, or may estimate the position change method based on sensing data from a detection device 430, which will be described later. The position change method will be described later with reference to FIGS. 15 and 16.

[0037] The sleep information acquisition unit 26 acquires information related to the user's sleep. The sleep information acquisition unit 26 may perform a process of acquiring sleep data based on sensing data from the detection device 430, which will be described later. The sleep data here may be the output of the detection device 430 itself, or may be information calculated by the sleep information acquisition unit 26 based on the output of the detection device 430.

[0038] The evaluation processing unit 27 calculates an index value for evaluating the effectiveness of the proposal made by the method of this embodiment. For example, when the bedding selection unit 23 suggests changing the bedding, the evaluation processing unit 27 evaluates the effectiveness of changing the bedding. Furthermore, when the evaluation processing unit 27 recommends a visit to a facility, it may evaluate the effectiveness of the visit.

[0039] The notification processing unit 28 performs processing to notify the user of the processing results of each unit of the information processing device 20. For example, the notification processing unit 28 may notify the user of information related to the bedding selected by the bedding selection unit 23. Furthermore, the notification processing unit 28 may notify the user to visit a facility for a medical examination, or may notify the user of advice related to sleep or daily life, based on the evaluation results of the evaluation processing unit 27. For example, the notification processing unit 28 may send a control signal to the terminal device 200. The control signal here is a signal that instructs the display unit 240, light-emitting unit, vibration unit, sound output unit, etc. of the terminal device 200 to perform output according to the content of the proposal.

[0040] The sharing processing unit 29 performs processing for sharing the worries of the user to be processed and measures to resolve the worries with other users. For example, when the worry of the target user is resolved, the sharing processing unit 29 may transmit information such as the implemented measures to other users. Furthermore, when the condition of other users who have the same worry as the target user is improved by some measures, the sharing processing unit 29 may notify the target user of the measures.

[0041] Furthermore, the output of the processing results of the information processing device 20 is not limited to be used for notification and information sharing of bedding, but may also be used for other feedback. For example, a user according to this embodiment may use an electric bed that can automatically change the height and posture of the bottom, an air mattress that can automatically adjust the hardness (thickness) of each part, a posture control pillow that encourages the user to turn over in bed by adjusting the thickness of each part, etc. Then, the information processing device 20 may control these electric bedding items in real time based on the processing results. For example, when a preferred pillow height, softness, mattress hardness, etc. are determined, the electric bed, air mattress, posture control pillow, etc. may be controlled based on this information.

[0042] The details of the processing in each unit of the information processing device 20 will be described later along with specific examples.

[0043] Furthermore, part or all of the processing performed by the information processing device 20 (information processing system 10) of this embodiment may be realized by a program. The processing performed by the information processing device 20 may be processing executed by the processing unit 110 of the server system 100, processing executed by the processing unit 210 of the terminal device 200, or processing executed by a processor included in the sensing device 400. Furthermore, the processing performed by the information processing device 20 may be processing executed by two or more devices among the server system 100, the terminal device 200, and the sensing device 400.

[0044] The program according to this embodiment can be stored in, for example, a non-transitory information storage medium (information storage device), which is a medium readable by a computer. The information storage medium can be realized by, for example, an optical disc, a memory card, a HDD, or a semiconductor memory. The semiconductor memory is, for example, a ROM. The processing unit 110 and the like perform various processes of this embodiment based on the program stored in the information storage medium. In other words, the information storage medium stores a program for causing a computer to function as the processing unit 110 and the like. A computer is a device equipped with an input device, a processing unit, a storage unit, and an output unit. Specifically, the program according to this embodiment is a program for causing a computer to execute each step described below using FIG. 8 and the like.

[0045] The technique of this embodiment can also be applied to an information processing method including the following steps: The information processing method includes the steps of acquiring a standing image of a user in a standing position and a lying image of the user in a lying position, estimating a skeletal model of the user based on the standing image and the lying image, and performing a process of selecting bedding recommended for the user based on the estimated skeletal model.

[0046] 2. Processing Details Next, the processing of this embodiment will be described in detail. First, the processing of selecting bedding based on a skeletal model will be described, followed by an example of using the time ratio of sleeping postures and a position change method. Furthermore, feedback using sleep information will also be described. Note that the following describes an example in which the information processing device 20 is a server system 100.

[0047] 2.1 Skeletal model Fig. 7 is a diagram summarizing the data flow in the processing of this embodiment. As shown in Fig. 7, in this embodiment, bedding evaluation values ​​are analyzed based on a skeletal model, personal attribute information, and body position (sleeping posture) data, and measures proposed for bedding characteristics are output based on the analysis results.

[0048] The skeletal model is obtained by the model estimation unit 22 based on the lying position image. Alternatively, the skeletal model may be obtained based on the standing position image. The skeletal model may include information on the length of skeletal parts, as will be described later. Furthermore, the neck tilt angle and waist tilt angle may be obtained from the skeletal model, as will be described later with reference to FIGS. 11A to 13C.

[0049] The individual's attribute information includes information such as age, sex, height, weight, medical history, etc. For example, the individual's attribute information may be input into a text box or the like displayed on the terminal device 200, in which the target user enters their own information. The terminal device 200 transmits the attribute information to the server system 100 via the communication unit 230.

[0050] The body position data is information indicating which of a plurality of positions the user is sleeping in, including supine, right lateral, left lateral, and prone, and is acquired by the determination of the sleeping position determination unit 24. The information used by the sleeping position determination unit 24 for determination may be an image, pressure information, acceleration, or a combination of these pieces of information. Details will be described later.

[0051] The information processing device 20 analyzes the bedding evaluation value based on this information. For example, the bedding evaluation value is calculated by the bedding selection unit 23 based on the neck inclination angle and the waist inclination angle.

[0052] The information processing device 20 then proposes measures based on the obtained bedding evaluation values. Specifically, the measures here are information on recommended bedding. The proposed information may be the height of the pillow 630, the hardness of the mattress 620, or other information. The flow of the process will be specifically explained below using flowcharts and the like.

[0053] FIG. 8 is a flowchart illustrating an example of processing by the information processing device 20. Below, an example using both lying position images and standing position images will be described, but this is not essential. For example, the information processing device 20 may perform processing based on lying position images, and the standing position images in the following description can be omitted. First, before the processing of FIG. 8 starts, the imaging device 300 outputs a standing position image by capturing an image of the user in a standing position, and outputs a lying position image by capturing an image of the user in a lying position. FIGS. 9A to 9C are diagrams illustrating an example of the relationship between the user and the imaging device 300 when capturing standing position images and lying position images.

[0054] For example, as shown in Fig. 9A, the imaging device 300 may be placed at a predetermined height and angle using a stand ST. A standing image is captured when a user stands in front of the imaging device 300. The imaging device 300 may be any device owned by the user according to this embodiment, and for example, the terminal device 200 having an imaging function may be used as the imaging device 300. In this way, there is no need to prepare a dedicated device when capturing a standing image, etc., and the burden on the user can be reduced.

[0055] Similarly, as shown in FIGS. 9B and 9C, the imaging device 300 may be placed at a given height and angle near the side of a bed 610 or the like using a stand ST. A lying posture image is acquired when the user lies down on the bed 610. The lying posture image may be an image of the user in a supine position as shown in FIG. 9B, an image of the user in a lateral position as shown in FIG. 9C, or both. The lateral position may be a right lateral position, a left lateral position, or both. An image of a prone position may also be captured as a lying posture image.

[0056] In this embodiment, it is sufficient to capture standing position images and lying position images. The position, angle, and fixing method of the imaging device 300 are not limited to the examples shown in FIGS. 9A to 9C . For example, as shown in FIG. 9D , multiple lying position images may be captured while changing the position of the imaging device 300. In the example of FIG. 9D , the imaging device 300 rotates around the user's waist and an axis extending from the head to the feet as the rotation axis. For example, the imaging device 300 may stop at multiple points along its movement path to capture still images, or may capture moving images while rotating. This reduces the number of unimaged parts compared to using a fixed camera such as FIG. 9B , thereby improving the estimation accuracy of the skeletal model. Furthermore, FIG. 9D illustrates an example in which the captured image 300 is moved to capture lying position images corresponding to the supine position. However, the captured image 300 may be moved to capture lying position images corresponding to other sleeping positions, such as the lateral position, or to capture standing position images.

[0057] 8, the image acquisition unit 21 acquires the standing position image and the lying position image captured by the imaging device 300. For example, the image acquisition unit 21 is included in the processing unit 110 of the server system 100, and the processing unit 110 performs processing to receive the standing position image and the lying position image from the imaging device 300 via the communication unit 130. Note that the server system 100 is not limited to being directly connected to the imaging device 300, and may be connected via another device such as a terminal device 200.

[0058] In step S102, the model estimation unit 22 estimates a skeletal model of the user based on the standing position image and the lying position image. For example, the model estimation unit 22 may estimate the skeletal model of the user based on a trained model generated by machine learning. The trained model here is created based on training data in which a correct skeletal model is assigned as correct answer data for an input image. The correct answer data is assigned by a skeletal expert, such as a doctor. The trained model used in machine learning is, for example, a convolutional neural network (CNN), and the trained model may be a CNN in which parameters (weights) are set by a learning process. The model estimation unit 22 may obtain a standing position skeletal model by inputting a standing position image to the trained model, and obtain a lying position skeletal model by inputting a lying position image to the trained model. Note that various methods are known for calculating a skeletal model based on an image, such as "Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields" (https: / / arxiv.org / pdf / 1611.08050.pdf) and OpenPose disclosed by Zhe Cao et al., and these methods can be widely applied in this embodiment.

[0059] FIG. 10 shows an example of an estimated skeletal model. For example, the skeletal model may be information representing the respective positions of a plurality of pre-set body parts. In the example of FIG. 10, the positions of body parts such as the head, neck, right shoulder, left shoulder, right elbow, left elbow, right hand, left hand, back, waist, right knee, left knee, right foot, and left foot are estimated. Note that the number and positions of the set body parts are not limited to the example of FIG. 10, and various modifications are possible. Furthermore, as indicated by arrows in FIG. 10, the skeletal model may include information specifying the rotation state of rotatable body parts. For example, the skeletal model may include information on the rotation angle of the head. By having the skeletal model include information on the rotation angle, it becomes possible to specify, for example, the direction of the face when in a prone position.

[0060] For example, the model estimation unit 22 may perform a process to correct the lying-down posture skeletal model based on the standing posture skeletal model. For example, as shown in FIG. 9A, the standing posture is a posture in which the user's body is not affected by bedding such as a pillow or mattress. Therefore, the standing posture skeletal model calculated based on the standing posture image is information that reflects the user's basic body distortion that is not caused by bedding. Therefore, by performing a correction process to remove the body distortion in the standing posture skeletal model from the body distortion in the lying posture skeletal model, it is possible to accurately calculate the body distortion caused by bedding, etc. Furthermore, as shown in FIG. 9A, in the standing posture, the degree to which some parts of the body are occluded by other parts is lower than in the lying posture, which increases the estimation accuracy of the skeletal model. Therefore, a parameter that is expected to change little between the standing posture and the lying posture, such as a skeletal segment length, may be calculated based on the standing posture skeletal model, and the skeletal segment length may be used to correct the lying-down posture skeletal model. The skeletal segment length represents the distance between parts, and may represent, for example, the distance (edge ​​length) between a given point and an adjacent point in FIG. 10.

[0061] Alternatively, the model estimation unit 22 may use two images, a standing position image and a lying position image, as input data and perform processing using a trained model that estimates one skeletal model based on the input data. For example, training data used for learning may be used in which one skeletal model (in a narrow sense, a skeletal model for a lying position) is assigned as correct answer data to a pair of a learning standing position image and a learning lying position image. The model estimation unit 22 then inputs the pair of a standing position image and a lying position image into the trained model acquired from the training data to obtain a skeletal model. In this case, correct answer data that takes into account the relationship between the standing position and the lying position is assigned at the stage of acquiring the training data, so the output of the trained model is also a skeletal model that takes into account the relationship between the standing position and the lying position.

[0062] As shown in FIG. 2, the method of this embodiment may obtain a posture score that indicates whether the user's posture is good or bad. For example, the information processing device 20 (or, more specifically, the model estimation unit 22) determines the degree of skeletal distortion based on the estimated skeletal model, and calculates a posture score that indicates the degree of distortion. The posture score here is, for example, numerical data that increases as the distortion decreases and decreases as the distortion increases. In this way, it becomes possible to objectively evaluate the user's posture.

[0063] In step S103, the sleeping posture determination unit 24 determines the sleeping posture of the target user. For example, the sleeping posture determination unit 24 may determine whether the user's sleeping posture is supine, right lateral, left lateral, or prone. For example, when capturing a sleeping posture image, the user may capture an image in a sleeping posture that the user prefers. In this case, the sleeping posture determination unit 24 determines the user's sleeping posture using the sleeping posture image for obtaining a skeletal model.

[0064] Alternatively, an image of the sleeping user may be acquired separately from the sleeping posture image for determining the skeletal model. The sleeping posture determination unit 24 may determine the user's sleeping posture based on the image. Alternatively, as described later with reference to FIG. 17 , a detection device 430 may be used to detect information related to sleep. For example, the detection device 430 may include a pressure sensor, and the sleeping posture determination unit 24 may determine the sleeping posture based on the amount of pressure applied to which area of ​​the detection device 430. In this embodiment, a motion sensor (not shown in FIG. 1 ) may be used as the sensing device 400. The motion sensor may be, for example, an acceleration sensor, but may also be a gyro sensor. For example, the acceleration sensor may be attached to the user's skin or clothing. In this case, since the attachment position and direction of the motion sensor are known, the sleeping posture determination unit 24 can estimate the user's sleeping posture based on the detection result of the direction of gravity. Various modifications are possible with regard to the information used for the determination by the sleeping posture determination unit 24.

[0065] In step S104, the bedding selection unit 23 evaluates the bedding currently used by the user based on the skeletal model and the results of the sleeping posture determination. For example, the bedding selection unit 23 may calculate a bedding evaluation value based on the angle of a given part of the estimated skeletal model. The bedding evaluation value may be a pillow evaluation value that is an evaluation value of the pillow 630, or a mattress evaluation value that is an evaluation value of the mattress 620, or both. Note that the bedding to be evaluated is not limited to the pillow 630 and the mattress 620, and may also include the bed 610 (in a narrow sense, an electric bed).

[0066] 11A to 11C are diagrams illustrating a method for calculating a pillow evaluation value in the supine position. FIG. 11A shows a state in which the height of the pillow 630 is appropriate. As shown in FIG. 11A, when the height of the pillow 630 is appropriate, for example, the angle formed by the line connecting the neck and head of the skeletal model and the horizontal plane (hereinafter referred to as the neck tilt angle) is θ1 in FIG. 11A. Note that instead of the horizontal plane here, the bottom surface of the bed 610 or the surface of the mattress 620 may be used.

[0067] FIG. 11B shows a state in which the pillow 630 is too high, and FIG. 11C shows a state in which the pillow 630 is too low. The neck tilt angles are θ2 and θ3, respectively. As is clear from the figures, θ3<θ1<θ2. Therefore, the bedding selection unit 23 may determine the neck tilt angle from the detection results of the skeletal model in the sleeping position, and determine as the pillow evaluation value an evaluation value that increases the closer the neck tilt angle is to θ2 and decreases the further it is from θ2. Note that the pillow evaluation value is not limited to numerical data, and may be two-level information representing either "good" or "bad," or three-level information representing "too low / appropriate / too high," or other information.

[0068] 12A to 12C are diagrams illustrating a method for calculating a mattress evaluation value in the supine position. FIG. 12A illustrates a state in which the firmness of the mattress 620 is appropriate. As shown in FIG. 12A, when the firmness of the mattress 620 is appropriate, for example, three points of the skeletal model, namely the shoulders, waist, and hip joints, are aligned in a substantially horizontal direction. For example, in this embodiment, the waist inclination angle may be a set of a first angle formed by a line connecting the hip joints and waist with the horizontal direction and a second angle formed by a line connecting the waist and shoulder with the horizontal direction. In this case, in the example of FIG. 12A, the first angle and the second angle are substantially 0 degrees. Note that, here, as in FIGS. 11A to 11C, an angle in the direction of increasing height in the direction toward the head is considered to be a positive angle.

[0069] Figure 12B shows a state in which the mattress 620 is too soft. In the case of Figure 12B, the area from the buttocks to the back sinks excessively compared to Figure 12A. As a result, the position of the lower back and shoulders becomes higher relative to the hip joints. For example, similar to the above example, when considering the first and second angles as the lower back inclination angle, at least the first angle is larger than in the example of Figure 12A.

[0070] Figure 12C shows a state in which mattress 620 is too hard. In the case of Figure 12C, the user sinks less deeply into mattress 620 than in Figure 12A, and the spine is curved from the waist to the back. As a result, the first angle of the waist inclination angle is larger than in Figure 12A, and the second angle is smaller than in Figure 12A.

[0071] As described above, since the lumbar inclination angle varies depending on the hardness of the mattress 620, the bedding selection unit 23 calculates the mattress evaluation value based on the lumbar inclination angle. Specifically, the bedding selection unit 23 calculates the mattress evaluation value so that the value is large when the lumbar inclination angle is close to the angle shown in FIG. 12A and the value is small when the lumbar inclination angle approaches the angles shown in FIG. 12B or 12C. However, the method for calculating the mattress evaluation value based on the lumbar inclination angle is not limited to this. For example, in chiropractic treatment, a swayback (e.g., the posture shown in FIG. 12C) may be intentionally adopted, and the posture shown in FIG. 12C may be effectively used. Therefore, the bedding selection unit 23 may calculate the mattress evaluation value so that the value is large when the lumbar inclination angle approaches the angle shown in FIG. 12C. The same applies when the posture of lowering the waist shown in FIG. 12B is effective; the bedding selection unit 23 may calculate the mattress evaluation value so that the value is large when the lumbar inclination angle approaches the angle shown in FIG. 12C. For example, the bedding selection unit 23 may acquire information identifying a posture recommended for the target user. Based on this information, the bedding selector 23 may then switch between which of the waist inclination angles shown in Figures 12A to 12C the bedding evaluation value should be increased for. This makes it possible to calculate the bedding evaluation value from the perspective of whether the target user can easily assume the recommended posture. Note that information specifying the recommended posture may be included in, for example, user attribute information, which will be described later.

[0072] Furthermore, in the above description, the hardness of the mattress 620 is focused on, and an example has been described in which FIG. 12A shows a desirable hardness, FIG. 12B shows a soft state, and FIG. 12C shows a state that is too hard. However, the characteristics of the mattress 620 are not limited to hardness, and the height may also vary. Therefore, in this embodiment, the height of the mattress 620 (for example, the relationship between the heights of each position when the mattress 620 is divided into multiple sections) may be evaluated based on the waist inclination angle. For example, FIG. 12A may correspond to a state in which the height of each section is appropriate, FIG. 12B may correspond to a state in which the height of areas such as the waist and buttocks is too low, and FIG. 12C may correspond to a state in which areas such as the waist and buttocks are too high. The fact that the height of the mattress 620 may be evaluated also applies to the following description.

[0073] 13A to 13C are diagrams illustrating a method for calculating a mattress evaluation value in the lateral position. FIG. 13A shows a state in which the firmness of the mattress 620 is appropriate. As shown in FIG. 13A, when the firmness of the mattress 620 is appropriate, for example, the line connecting the waist, back, and neck of the skeletal model is approximately horizontal. For example, when the first angle and the second angle are set as waist inclination angles as in the example of FIGS. 12A to 12C, both angles have values ​​close to 0 degrees.

[0074] Figure 13B shows a state in which mattress 620 is too soft. In Figure 13B, the area from the waist to the back sinks excessively compared to Figure 13A. For example, the area from the waist to the back sinks initially, and the height changes suddenly from the back to the waist, so the first angle is smaller than in Figure 13A and the second angle is larger than in Figure 13A.

[0075] FIG. 13C shows a state in which the mattress 620 is too hard. In the case of FIG. 13C, the lower back and buttocks sink too little, resulting in a relatively large sinking of the area from the lower back to the back. Therefore, the first angle is smaller than that of FIG. 13A. When comparing FIG. 13B and FIG. 13C, the lower back and buttocks sink in FIG. 13B, so if the angle between the line connecting the lower back and neck and the horizontal direction is taken as the third angle, the value of the third angle is relatively large. In contrast, in FIG. 13C, the lower back and buttocks are lifted, resulting in a relatively small third angle. Therefore, for example, by considering the third angle, the bedding selection unit 23 can distinguish whether the mattress 620 is too soft or too hard.

[0076] 13A to 13C, even in the lateral position, the lumbar inclination angle determined from the skeletal model changes depending on the hardness of mattress 620, so bedding selection unit 23 calculates the mattress evaluation value based on the lumbar inclination angle. Specifically, bedding selection unit 23 calculates the mattress evaluation value so that the value is large when the lumbar inclination angle is close to the angle shown in Fig. 13A, and the value is small when the lumbar inclination angle is close to the angle shown in Fig. 13B or 13C.

[0077] Although not described here, in the case of the lateral position, the pillow evaluation value may be calculated based on the neck tilt angle.

[0078] Furthermore, the desirable neck tilt angle and waist tilt angle vary depending on the target user's attributes, such as age, sex, height, and weight. Therefore, the bedding selection unit 23 may acquire the user's personal attribute information and calculate the bedding evaluation value based on the skeletal model, sleeping posture, and attribute information. For example, the bedding evaluation value may be calculated using a function that uses the neck tilt angle or waist tilt angle calculated based on the skeletal model and the user's attribute information as variables. For example, the bedding selection unit 23 may calculate the bedding evaluation value by performing a correction process based on the personal attribute information on the value calculated from the neck tilt angle or waist tilt angle.

[0079] The attribute information may also include the user's medical history. For example, the attribute information may include the target user's illness, such as aspiration pneumonia or sleep apnea syndrome. For example, the information processing device 20 acquires data associating illnesses with parameters used to calculate a bedding evaluation value. The bedding selection unit 23 may then determine the parameters used to calculate the bedding evaluation value for the user based on the data and the user's illness. This makes it possible to calculate a bedding evaluation value tailored to the user's illness. For example, depending on the illness, a doctor may specify a sleeping position. Specifically, due to illnesses such as sleep apnea syndrome, sleeping in a lateral position may be recommended to prevent snoring. In this case, the bedding selection unit 23 may prioritize information related to the lateral position over information related to other positions in the calculation of the bedding evaluation value. The method of this embodiment makes it possible to calculate a bedding evaluation value that takes into account the impact of illnesses on the sleep state (e.g., sleeping position).

[0080] 8, the explanation will be continued. In step S105, the bedding selection unit 23 determines whether the bedding currently used by the user is appropriate based on the bedding evaluation value. For example, the bedding selection unit 23 determines that the bedding is appropriate if the bedding evaluation value is above a predetermined threshold, and determines that the bedding is inappropriate if the bedding evaluation value is below the threshold.

[0081] If the bedding selection unit 23 determines that the bedding is appropriate (step S105: Yes), that fact is output in step S107. For example, the server system 100 performs processing to display text, an icon, or the like indicating that the bedding is appropriate on the terminal device 200 used by the user.

[0082] If the bedding selection unit 23 determines that the bedding is inappropriate (step S105: No), in step S106 the bedding selection unit 23 performs a process of selecting bedding recommended to the user. In this embodiment, the selection of bedding may be a process of selecting the characteristics of the recommended bedding, or a process of selecting a specific product having those characteristics. The characteristics here include the height, hardness, shape, etc. of the bedding.

[0083] For example, because the bedding selection unit 23 calculates the neck tilt angle when calculating the pillow evaluation value, it can determine whether a low pillow evaluation value is caused by the pillow 630 being too high (closer to FIG. 11B ) or too low (closer to FIG. 11C ). Therefore, if the pillow height is too high, the bedding selection unit 23 selects a pillow 630 that is lower than the current pillow, and if the pillow height is too low, the bedding selection unit 23 selects a pillow 630 that is higher than the current pillow. The bedding selection unit 23 may perform a process of determining the appropriate height of the pillow 630 as the bedding selection process, or may obtain information identifying a product having a height close to the determined height, such as the product's manufacturer name or model number. For example, the storage unit 120 of the server system 100 may store bedding characteristic information that associates products with the characteristics of the products. The bedding selection unit 23 may perform a process of determining a specific product recommended for the user by comparing the characteristics determined based on the bedding evaluation value with the bedding characteristic information as the bedding selection process. The same applies to the case where the mattress 620 is the target, and the bedding selection unit 23 may determine the desired hardness of the mattress 620 as a process for selecting bedding, or may obtain information on specific products having hardness close to that hardness. The process for selecting bedding in this embodiment is not limited to the above, and various modifications are possible. Other examples of the process for selecting bedding will be described later using Figures 18A to 18G, etc.

[0084] After processing in step S106, a corresponding message is output in step S107. For example, the server system 100 outputs information indicating the bedding recommended by the bedding selection unit 23 to the terminal device 200 used by the user. For example, the display unit 240 of the terminal device 200 may display the desired pillow height, etc. Alternatively, when the bedding selection unit 23 recommends a specific product, link information to the web page of the manufacturer of the product, the web page of the sales site, etc. may be output.

[0085] Although the above describes an example in which the height of the pillow 630 and the hardness of the mattress 620 are suggested, as described above with reference to FIG. 7, the bedding suggestions in this embodiment are not limited to this. For example, the bedding selection unit 23 may evaluate the hardness and shape of the pillow 630 and determine the hardness and shape recommended to the user based on the evaluation results. Furthermore, as will be described later with reference to FIGS. 15 and 16, the mattress 620 may have different hardness in different parts. Therefore, the bedding selection unit 23 may evaluate the hardness distribution of the mattress 620 and determine the hardness distribution recommended to the user based on the evaluation results.

[0086] The recommended bedding may also include a comforter as shown in Fig. 7. For example, the bedding selection unit 23 may evaluate the comforter and suggest to the user to change to the recommended comforter based on the evaluation result.

[0087] For example, the bedding selection unit 23 may evaluate, based on captured images, whether the user's hands and feet are protruding from the comforter, or whether the comforter is too large and causing the user to slip off the bed 610. Alternatively, a temperature sensor and a humidity sensor may be provided around the bed 610 (or, more narrowly, in a position between the mattress 620 and the comforter when the user is sleeping), and the bedding selection unit 23 may evaluate the heat retention and moisture retention of the comforter based on the output of the temperature sensor and humidity sensor. Based on these evaluations, the bedding selection unit 23 may perform a process of suggesting a comforter with a recommended size, heat retention, and moisture retention for the user. Note that, although an example of a user using the bed 610 has been described above, a user who uses a mattress without using the bed 610 or a user who uses the mattress 620 directly on the floor may also be the processing target. The fact that a user who does not use the bed 610 may be the processing target also applies to processes other than the process of calculating the evaluation value for the comforter.

[0088] 2.2 Time ratio, positioning technique, and sleep score Furthermore, although the processing based on the skeletal model, lying position, and attribute information has been described above, other information may also be used.

[0089] Fig. 14 is a diagram summarizing the data flow in the processing of this embodiment. The example of Fig. 14 differs from Fig. 7 in that a position change method (turning over method) is added to the personal attributes, and a sleep score and a time ratio in sleeping position are added as sleep data. Each of these is explained below.

[0090] <Time Ratio> For example, the sleeping posture determination unit 24 of this embodiment may determine whether the user's sleeping posture is one of a plurality of postures, including supine, right lateral, left lateral, and prone, and may also calculate the time ratios of each of the plurality of postures. The time ratios here refer to, for example, the ratios of the time t1 spent in the supine position, the time t2 spent in the right lateral position, the time t3 spent in the left lateral position, and the time t4 spent in the prone position during one sleep session. For example, the time ratio for the supine position is t1 / (t1+t2+t3+t4), the time ratio for the right lateral position is t2 / (t1+t2+t3+t4), the time ratio for the left lateral position is t3 / (t1+t2+t3+t4), and the time ratio for the prone position is t4 / (t1+t2+t3+t4). However, various modifications are possible to the specific calculation method of the time ratios.

[0091] As described above, the information used by the sleeping posture determination unit 24 to determine the sleeping posture can be modified in various ways. For example, the sleeping posture determination unit 24 may use pressure values ​​from the detection device 430 or acceleration values ​​from an acceleration sensor to determine the time series of changes in sleeping posture during one sleep session, and calculate the time ratio from the length of time each posture was taken. The sleeping posture determination unit 24 may also calculate the time ratio for a period including multiple sleep sessions, such as one week or one month.

[0092] The bedding selector 23 may select bedding based on the time ratio. As can be seen from a comparison of Figs. 12A to 12C (supine position) and Figs. 13A to 13C (lateral position), the way the body sinks and the way the skeleton bends differs depending on the sleeping position, which may change the desirable characteristics of the bedding (height, hardness, etc.). In this regard, by taking the time ratio into consideration, it becomes possible to suggest bedding that is more suitable for the target user. For example, if a user spends a higher proportion of time in the supine position than in other positions, bedding suitable for the supine position is more likely to be recommended.

[0093] For example, the bedding selector 23 may calculate the pillow evaluation value using a function f1 shown in the following formula (1). f1 = (neck tilt angle when supine × time ratio in supine position × supine position coefficient) + Right lateral position neck tilt angle × right lateral position time ratio × right lateral position coefficient + Neck tilt angle in left lateral position × time ratio in left lateral position × left lateral position coefficient + Neck tilt angle in prone position × Prone position time ratio × Prone position coefficient) × personal attribute coefficient … (1)

[0094] Here, the supine position coefficient, right lateral position coefficient, and left lateral position coefficient are given coefficients preset for each posture. The personal attribute coefficient is a coefficient set based on personal attribute information. When calculating the mattress evaluation value, the lumbar inclination angle may be used instead of the neck inclination angle. This allows the time ratio of sleeping postures to be taken into account in the calculation process of the bedding evaluation value. However, the method using function f1 is only one example of a method for calculating the bedding evaluation value taking the time ratio into account, and the specific process is not limited to using function f1. For example, in the above formula (1), the value calculated from each posture is uniformly multiplied by the personal attribute coefficient, but this is not limited to this. For example, the personal attribute coefficient may include multiple parameters that vary depending on the posture. In a broader sense, the above function f1 is a function whose variables are the neck inclination angle in each posture, the time ratio of each posture, the coefficient of each posture, and the personal attribute coefficient, and the specific formula is not limited to the above formula (1).

[0095] <Position change method> 6, the information processing device 20 may also include a position change estimation unit 25 that estimates a position change technique used by the user when changing position by turning over while sleeping. The bedding selection unit 23 may perform processing to select bedding based on the estimated position change technique. In this way, it becomes possible to select bedding that takes into account the way the user turns over in their sleep.

[0096] 15A to 16C are diagrams illustrating the relationship between position change techniques and recommended bedding. For example, when a user lying supine in the center of the mattress 620 rolls over to change their position to a left lateral position, they may move to the left side of the mattress 620 as seen from the user's perspective, as shown in FIG. 15A. Similarly, when a user lying supine in the center of the mattress 620 rolls over to a right lateral position, they may move to the right side of the mattress 620 as seen from the user's perspective, as shown in FIG. 15A. In the case where the position change shown in FIG. 15A is performed, bedding such as the mattress 620 and pillow 630 is used such that the center portion is used in the supine position and the left and right end portions are used in the lateral position. Therefore, the bedding selector 23 may perform processing to suggest bedding with different characteristics in the center and end portions to a user who uses a position change technique that changes position when rolling over. The central portion and the end portion here refer to positions along the shorter side of the mattress 620 (the left-right direction for a user lying on their back).

[0097] For example, the position change estimation unit 25 may detect a change in the position where the user's body pressure is detected based on the pressure value from the detection device 430. If the amount of change in the position where the body pressure is detected in the short direction of the mattress 620 is equal to or greater than a threshold, the position change estimation unit 25 determines that the user's position change method is the method shown in Fig. 15A. Alternatively, the position change estimation unit 25 may determine the sleeping position based on the output of an acceleration sensor and obtain the displacement in the short direction of the mattress 620 when the sleeping position changes (when turning over) by integrating the acceleration value. If the displacement when turning over is equal to or greater than a predetermined threshold, the position change estimation unit 25 determines that the user's position change method is the method shown in Fig. 15A.

[0098] Fig. 15B is a diagram showing the hardness distribution of a mattress 620 recommended for a user who employs the position change technique shown in Fig. 15A, and is a diagram of the mattress 620 observed, for example, from the same direction as Fig. 15A. For example, as shown in Fig. 15B, the recommended mattress 620 has characteristics suitable for the supine position, in that the central portion corresponding to the head and back has a standard hardness, the lower back is a little harder, and the foot portion is a little softer. Furthermore, the mattress 620 has characteristics suitable for the lateral position, in that the head portion is a little harder and the remaining portions are a little softer at the left and right ends.

[0099] Fig. 15C is a diagram showing the characteristics of a pillow 630 recommended for a user who employs the position change technique shown in Fig. 15A, and is a cross-sectional view showing, for example, the height distribution in the direction along the longitudinal direction of the pillow 630 (the short direction of the mattress 620 when placed on the mattress 620). As shown in Fig. 15C, the recommended pillow 630 has a center part that is set low in height to be suitable for a supine position, and left and right end parts that are set high in height to be suitable for a lateral position.

[0100] In this way, by using bedding whose characteristics vary depending on the position in the short direction of mattress 620, it is possible to propose bedding that is suitable for a user who changes position using the method shown in FIG. 15A.

[0101] 16A, some users do not change their position in the short direction of the mattress 620 when turning over, and instead change their position to, for example, a right lateral position or a left lateral position while remaining in the center of the mattress 620. In such cases, it is possible to adopt both supine and lateral sleeping positions in the same position.

[0102] For example, the postural change estimation unit 25 determines that the user's postural change method is the method shown in Fig. 16A when the amount of change in the position where body pressure is detected in the short direction of the mattress 620 is less than a threshold. Alternatively, the postural change estimation unit 25 determines that the user's postural change method is the method shown in Fig. 16A when the displacement when turning over is less than a predetermined threshold.

[0103] FIG. 16B shows the hardness distribution of a mattress 620 recommended for a user using the position change technique shown in FIG. 16A , and is a view of the mattress 620 observed, for example, from the same direction as FIG. 16A . For example, as shown in FIG. 16B , the recommended mattress 620 has characteristics that are relatively hard in the head section, medium hardness in the neck to back section, relatively hard in the lumbar section, and relatively soft in the foot section, regardless of the position in the short direction. As described above, in this case, because the position is unlikely to change between the supine and lateral positions, a mattress 620 with characteristics that are independent of the position in the short direction is effective. However, the position change technique shown in FIG. 16A does not prevent the characteristics of the bedding from being dynamically changed depending on the position.

[0104] Fig. 16C is a diagram showing the characteristics of a pillow 630 recommended for a user who employs the position change technique shown in Fig. 16A, and is a cross-sectional view showing, for example, the height distribution in a direction along the longitudinal direction of the pillow 630. As shown in Fig. 16C, the recommended pillow 630 is set to a low height regardless of the position.

[0105] In this way, by using bedding with consistent characteristics regardless of the position in the short direction of the mattress 620, it is possible to propose bedding suitable for users who change positions using the method shown in Figure 16A, and it is also possible to reduce the cost of the bedding.

[0106] When the position change method is taken into consideration, the bedding selection unit 23 may calculate the pillow evaluation value using a function f2 shown in the following formula (2). f2 = (neck tilt angle in supine position × time ratio in supine position × supine position coefficient) + Right lateral position neck tilt angle × right lateral position time ratio × right lateral position coefficient + Neck tilt angle in left lateral position × time ratio in left lateral position × left lateral position coefficient + Neck tilt angle in prone position × Prone position time ratio × Prone position coefficient) × Individual attribute coefficient × Posture conversion coefficient …(2)

[0107] Here, the position change coefficient is a coefficient whose value is determined according to the determination result of the position change technique. For example, for a user who changes position as shown in FIG. 15A, a first value is set as the position change coefficient, and for a user who changes position as shown in FIG. 16A, a second value different from the first value is set as the position change coefficient. Note that everything except the position change coefficient is the same as in Equation (1) above. Similarly to Equation (1) above, when calculating the mattress evaluation value, the waist inclination angle is used instead of the neck inclination angle. For example, as shown in Equation (2) above, the bedding evaluation value may be calculated using the time ratio of each position. For example, when changing position between the supine position and the lateral position, in addition to the position change technique, processing may be performed according to which position has a higher time ratio. For example, a determination may be made giving priority to the position with a higher time ratio between the supine position and the lateral position. In this embodiment, the degree of deviation from the desired position may be determined for each of the supine position and the lateral position. The degree of imbalance may be determined from the neck tilt angle or waist tilt angle, as described above with reference to Figures 12A to 13C, or may be determined using other parts of the skeletal model.The bedding selection unit 23 may determine whether the posture is more imbalance in the supine or lateral position, giving priority to the one with the greater imbalance.The postural change coefficient is not limited to a coefficient obtained by uniformly multiplying a value calculated from each posture as in the above formula (2), but may include different parameters for each posture.In a broader sense, the above function f2 is a function whose variables are the neck tilt angle in each posture, the time ratio of each posture, the coefficient of each posture, the personal attribute coefficient, and the postural change coefficient, and the specific formula is not limited to the above formula (2).In addition, various modifications are possible for the method of calculating the bedding evaluation value.

[0108] For example, the bedding selection unit 23 may calculate a bedding evaluation value using the function f2 in the above formula (2), and if the bedding evaluation value is less than a threshold, perform a process of suggesting bedding shown in Figures 15B, 15C, 16B, 16C, etc. according to the position change method. In this case, as described above with reference to Figures 11A to 13C, a process of adjusting the hardness of each part based on the neck tilt angle and waist tilt angle of the current bedding may be performed. Furthermore, if the user is using bedding with adjustable hardness and height, such as an air mattress or a firmness adjustment sheet, the bedding selection unit 23 may control the air mattress or the like according to the determined characteristics of the bedding. In this way, if the characteristics of the current bedding differ from the characteristics of the desired bedding, feedback can be provided in real time to reduce the difference.

[0109] <Sleep data> As shown in Fig. 14, sleep data, which is information related to the user's sleep, may be used to select bedding. Fig. 17 is a diagram illustrating an example of a detection device 430 that outputs sleep data and is placed on the bottom of a bed 610. As shown in Fig. 17, the detection device 430 is a sheet-like or plate-like device that is placed between the bottom of the bed 610 and a mattress 620. The detection device 430 is a device that senses information related to the user's sleep. The detection device 430 includes a pressure sensor that outputs a pressure value.

[0110] When the user gets into bed, the detection device 430 detects the user's body vibrations (body movement, vibrations) through the mattress 620. Based on the body vibrations detected by the detection device 430, information regarding the breathing rate, heart rate, activity level, posture, wakefulness / asleep, and whether the user is out of bed or in bed can be obtained. For example, the periodicity of the body movement may be analyzed, and the breathing rate and heart rate may be calculated from the peak frequency. The periodicity may be analyzed using, for example, a Fourier transform. The breathing rate is the number of breaths per unit time. The heart rate is the number of heartbeats per unit time. The unit time may be, for example, one minute. Alternatively, body vibrations may be detected per sampling unit time, and the number of detected body vibrations may be calculated as the amount of activity. When the user gets out of bed, the detected pressure value decreases compared to when the user is in bed. Therefore, whether the user is out of bed or in bed can be determined based on the pressure value and its time-series change. When the user is in bed and the activity level is equal to or greater than a predetermined level, the user may be determined to be in an awake state, and when the user is in bed and the activity level is less than the predetermined level, the user may be determined to be in a sleeping state. Furthermore, the detection device 430 may subdivide the sleep state to determine whether the sleep state is non-REM sleep or REM sleep, or determine the depth of sleep.

[0111] The sleep data used in the processing of the bedding selection unit 23 broadly includes information related to sleep / wake-up, and may be pressure values ​​from a pressure sensor, or information regarding respiratory rate, heart rate, activity level, posture, wakefulness / sleep, and getting out of bed / being in bed.

[0112] For example, the bedding selector 23 may obtain a sleep score that indicates the quality of sleep by determining the sleep duration and depth of sleep from the output of the detector 430. The sleep score is, for example, numerical data that takes a high value when the user is getting good quality sleep. By using the sleep score in processing, the quality of sleep with the target bedding can be taken into consideration, making it possible to suggest bedding that can provide the user with good quality sleep.

[0113] For example, when taking the sleep score into consideration, the bedding selector 23 may calculate the pillow evaluation value using a function f3 shown in the following formula (3). f3 = (neck tilt angle when supine × time ratio in supine position × supine position coefficient) + Right lateral position neck tilt angle × right lateral position time ratio × right lateral position coefficient + Neck tilt angle in left lateral position × time ratio in left lateral position × left lateral position coefficient + Neck tilt angle in prone position × Prone position time ratio × Prone position coefficient) × Individual attribute coefficient × Position conversion coefficient ×Sleep coefficient …(3)

[0114] Here, the sleep coefficient is a coefficient whose value is determined according to the sleep score. Furthermore, all other factors are the same as in equation (2) above. Furthermore, when calculating the mattress evaluation value, the waist inclination angle is used instead of the neck inclination angle, which is also the same as in equations (1) and (2) above. Note that, although the sleep coefficient has been described here as information different from the other coefficients, the sleep coefficient may be included in the personal attribute coefficient, and various modifications can be made to the specific process for calculating the bedding evaluation value.

[0115] <Other> As shown in FIG. 2 , the information processing device 20 of this embodiment may calculate a pain / distress score that indicates the level of pain felt due to factors such as stiff shoulders or lower back pain, and how much the factors are bothering the user. For example, the information processing device 20 may accept a user input indicating which of the pain-causing events that may be experienced daily resembles the pain caused by stiff shoulders or lower back pain, and calculate a pain score that quantifies the pain based on the user input. Alternatively, when using a dedicated device, a state in which the pain caused by current flow is similar to that of stiff shoulders or lower back pain may be searched for, and the pain score may be calculated based on the current value in that state. Furthermore, the information processing device 20 may accept a user input indicating the extent to which various activities in daily life are hindered by stiff shoulders, lower back pain, or the like, and calculate a distress score that quantifies the distress based on the user input.

[0116] In the method of this embodiment, for example, the pain score or distress score may be used to suggest measures. For example, the information processing device 20 may more actively suggest changing the bedding the higher the pain score or distress score. For example, the pain score or distress score may be used in the calculation process of the bedding evaluation value, or a threshold value to be compared with the bedding evaluation value may be set based on the pain score or distress score. Furthermore, as will be described later, when recommending a visit to a specialist facility, the information processing device 20 may more actively recommend a visit to a specialist facility the higher the pain score or distress score.

[0117] 2.3 Example of bedding selection process A specific example of the process for selecting bedding in this embodiment will be described. A possible reason for a low calculated bedding evaluation value in the method of this embodiment is that the body may become distorted due to sleeping position. Furthermore, if distortion occurs, it may cause a deviation in sleeping position, further reducing the bedding evaluation value. For example, the bedding selection unit 23 may perform a process of selecting (1) bedding that makes it difficult to adopt a sleeping position that promotes distortion, (2) bedding that induces a change in position, or (3) bedding that corrects distortion. A specific example will be described below.

[0118] First, we will explain the process of selecting bedding that reduces the likelihood of a user adopting a sleeping position that promotes body distortion. For example, consider a user who tends to assume a position with their head turned to the right when lying prone. Because this sleeping position involves a significant twist of the neck, maintaining this sleeping position can easily promote body distortion. Therefore, the bedding selection unit 23 may recommend the use of specific bedding for a user who has a low bedding evaluation value, a predetermined or greater proportion of time spent in the prone position, and a high percentage of the user's face facing a predetermined direction based on a skeletal model while lying prone. The bedding in this case may be, for example, a pillow 630 with a central ventilation hole. By using such a pillow 630, breathing is not obstructed by the pillow 630, making it easier to assume a position with the head facing forward when lying prone. As a result, it is possible to prevent users from adopting a posture that is prone to body distortion.

[0119] Furthermore, if it is determined that there is a large bias in sleeping positions, the bedding selection unit 23 may select bedding that makes it difficult for the user to assume a sleeping position with a high time ratio. For example, suppose a user tends to sleep in a right lateral position due to body distortion. In this case, continuing to sleep in a right lateral position may worsen the body distortion. Therefore, the bedding selection unit 23 may suggest the use of specific bedding for a user who is determined to have a low bedding evaluation value and a time ratio in the right lateral position that is greater than or equal to a predetermined value. Note that this determination may be made based on the difference or ratio between the time ratio in the right lateral position and the time ratio of another sleeping position (e.g., the left lateral position), and the specific processing content can be modified in various ways.

[0120] FIG. 18A shows an example of bedding that makes it difficult for the user to assume a right lateral position. The bedding here may be, for example, a mattress 620 with different heights in the short direction (left-right direction). In the example of FIG. 18A, the right side of the mattress 620, as seen from the user when sleeping, is set higher than other areas. By using such a mattress 620, it becomes difficult for the user to maintain a state facing right, thereby encouraging a sleeping position other than the right lateral position. Note that while FIG. 18A illustrates an example of a mattress 620 with different heights in the short direction, bedding that makes it difficult for the user to assume a specific position is not limited to this. For example, a mattress 620 may be used that intentionally makes the side that the user does not want to face uncomfortable by adjusting the shape, material, texture, etc. of the mattress 620. For example, using a mattress 620 with a protrusion on the right side as seen from the user when sleeping or a mattress 620 made of a rough-textured material can encourage a sleeping position other than the right lateral position.

[0121] Next, we will explain bedding that induces a change in position. Note that the bedding proposed in this embodiment is not limited to static bedding with fixed characteristics. For example, bedding with dynamically changeable characteristics may be used. Dynamic bedding includes a bed 610 with a changeable bottom angle, a mattress 620 with a changeable shape, a pillow 630, etc. Dynamic bedding may also include bedding that provides physical stimulation to the user using vibration, sound, light, scent, etc.

[0122] The bedding selection unit 23 may select the characteristics of bedding that are desirable for the user based on the above-described processing, and may control the dynamic bedding to match the characteristics. For example, if it is known that a particular sleeping position is undesirable, the bedding selection unit 23 may control the dynamic bedding to induce a position change when the undesirable position continues for a predetermined period of time.

[0123] 18B and 18C are diagrams illustrating an example of dynamic bedding control. Here, an example is described in which a user is encouraged to change their body position to the right lateral position in order to eliminate an undesirable posture. For example, as shown in FIG. 18B, the bedding in this example is a shape-adjustable mattress 620, and the bedding selection unit 23 may control the left side of the mattress 620 to be higher than the right side. In this way, the difference in height and inclination make it easier for the user to change their body position to the right lateral position. Alternatively, as shown in FIG. 18C, the bedding in this example may be a bed 610 with a bottom angle that can be adjusted and a shape-adjustable mattress 620. The bedding selection unit 23 controls the bottom of the bed 610 to tilt so that the right side is lower, and controls the right side of the mattress 620 to create a flat section. In this case, too, the inclination of the bed 610 relatively lowers the height of the user's right side, making it easier for the user to change their body position to the right lateral position. Furthermore, creating a flat section in the mattress 620 can prevent the user from falling off the bed 610. At this time, from the viewpoint of further encouraging the user to change his / her position to a specific sleeping position, control may be performed to apply a stimulus to the side to which the user does not want to move. For example, when encouraging the user to change his / her position to the right lateral position, the bedding selection unit 23 may perform control to generate vibrations, sounds, lights, etc. on the left side of the mattress 620.

[0124] Next, we will explain bedding that corrects distortion. For example, in the field of osteopathy, the body may be forced to assume a specific posture to correct distortion. Figures 18D and 18E show examples of bedding used in this case. The bedding here may be a mattress 620 with different heights depending on the region. The mattress 620 here may be a static bedding with a fixed height, or a dynamic bedding.

[0125] FIG. 18D is a side view of the mattress 620, and FIG. 18E shows the cross-sectional shape of the mattress 620 in the dashed line area (buttocks area) of FIG. 18D as viewed from the user's head. In this mattress 620, for example, as shown in FIG. 18D, the height of the area corresponding to the user's buttocks is relatively higher than other areas, and as shown in FIG. 18E, the right side of this area is relatively higher than the left side in the left-right direction. In this case, the user lifts their buttocks and assumes a posture in which their body is slightly twisted to the left at the buttocks. This posture may cause distortion in the body, but by shifting the direction of the distortion in the opposite direction to the existing distortion (a direction that suppresses distortion), it is possible to correct the distortion. As can be seen from the above explanation, the characteristics of bedding that correct distortion may be determined based on the distortion actually occurring in the user, and the specific shape, etc., can be variously modified. Furthermore, a traction device or rubber may be installed on the bed board of the bed 630 and connected to a predetermined part of the user, thereby allowing the user to adopt a posture that corrects distortion. Therefore, the bedding selection process of this embodiment may include a process that suggests the use of such a traction device.

[0126] Furthermore, although the above describes a bedding selection process for addressing distortions and sleeping posture imbalances, the method of this embodiment is not limited to this. For example, in this embodiment, a process may be performed to suggest a chair or desk to correct distortions. In this way, it becomes possible to adjust furniture that affects posture during the day based on the results of the bedtime determination. For example, the bedding selection unit 23 may perform a process to select the inclination angle of a chair or the height of a desk. Furthermore, recommendations for exercises or stretching, or recommendations for chiropractic clinics, osteopathic clinics, clinics, etc. may be made to address distortions. These recommendations will be described later.

[0127] In addition, in this embodiment, not only body distortion, which is a relatively long-term effect of sleeping posture, but also stiff neck, which is a relatively short-term effect, may be addressed. For example, if a user adopts an unnatural sleeping posture, the user may feel pain in their body the next day, and the bedding selector 23 may execute processing to suppress this. This processing is, in a narrow sense, dynamic bedding control. For example, the bedding selector 23 may prompt the user to change their sleeping posture if the user's sleeping posture is determined to be poor. For example, the bedding selector 23 may determine that the sleeping posture is poor if the sleeping posture is biased toward the edge of the bed 610 (mattress 620) and vital signs (e.g., sleep data) are below a predetermined threshold. The sleeping posture change may be realized by the control described above with reference to FIGS. 18B and 18C, and may be control of any of the bed 610, mattress 620, and pillow 630, or may include output of vibration, sound, light, etc.

[0128] 18F and 18G are diagrams illustrating an example of bedding control for preventing stiff necks. An unnatural sleeping position here may be, for example, a prone position with the head turned sideways. This position not only causes distortion of the body but may also be a cause of stiff necks. For example, as shown in FIG. 18F, the bedding selection unit 23 may increase the height of one side of the mattress 620 in the left-right direction compared to the other side. This makes it possible to encourage the user to change their sleeping position to a position other than prone. Even if the user does not change their position, tilting the body angle reduces the rotation angle of the head relative to the body, thereby preventing stiff necks. Alternatively, the bedding selection unit 23 may control at least one of the bed 610 and the mattress 620 to lower the height of the user's head compared to other parts. FIG. 18F illustrates an example of control to lower the height of the mattress 620. In this way, breathing is less likely to be obstructed by the bedding, and the user can more easily assume a position with their head facing forward when in the prone position.

[0129] 2.4 Feedback In addition, in the method of this embodiment, feedback may be given to the user as to whether the proposed measures are effective or not.

[0130] For example, the information processing device 20 of this embodiment may include an evaluation processing unit 27 that calculates a bedding effect index that indicates the effect of the bedding selected by the bedding selection unit 23 based on the sleep data, as shown in Fig. 6. The sleep data indicates the sensing results related to the user's sleep obtained by a sleep sensor, and may be the output of the sleep sensor itself, or information calculated by the information processing device 20 based on the output of the sleep sensor.

[0131] The sleep sensor here is, for example, the detection device 430 described above with reference to FIG. 17, but other devices capable of sensing information related to the user's sleep may also be used. For example, a wristwatch-type device including an acceleration sensor or a photoelectric sensor for detecting pulse may be used as the sleep sensor. The sleep data may be, for example, the sleep score indicating the quality of sleep described above, but may also include other information related to sleep. For example, the sleep data may include information on the respiration rate, heart rate, activity level, posture, awake / asleep, and getting out / staying in bed, as described above.

[0132] For example, the evaluation processing unit 27 may perform a process of comparing the user's sleep score before introducing the bedding with the user's sleep score after introducing the bedding proposed by the information processing device 20. The evaluation processing unit 27 determines that the introduced bedding is effective if the sleep quality represented by the sleep score has improved, and determines that the introduced bedding is ineffective if the quality has not changed or has deteriorated. For example, the evaluation processing unit 27 calculates the degree of improvement in the sleep score (such as a difference or ratio) as a bedding effectiveness index. This allows the information processing device 20 to determine whether the bedding proposed by the information processing device 20 was effective for the user, thereby enabling appropriate feedback to the user. In particular, the use of the sleep score allows the effectiveness of the bedding to be objectively evaluated. Furthermore, the use of the sleep score allows the calculation of the bedding effectiveness index to be automated, thereby reducing the burden on both the service provider and the user of the service.

[0133] Various specific feedback methods are conceivable. For example, when the evaluation processing unit 27 determines that the effectiveness of the bedding is below a predetermined level, the bedding selection unit 23 may perform at least one of the following processes: adding input information used to select bedding, changing the bedding selection algorithm that selects bedding based on the input information, and adding types of bedding to be selected.

[0134] As described above, the bedding selection unit 23 of this embodiment can use various information, such as a skeletal model, sleeping position, personal attributes, time ratio, position change method, and sleep score, in processing related to bedding (or, more narrowly, processing to calculate bedding evaluation values). Therefore, the bedding selection unit 23 may first select bedding using a relatively small number of types of information, and then add new information if the selected bedding is determined to be ineffective. For example, the bedding selection unit 23 may perform processing based on a skeletal model, sleeping position, and personal attributes by default, and then add at least one of the time ratio, position change method, and sleep score if the proposed bedding is ineffective. This reduces the processing load by default, while improving processing accuracy by adding information if the proposed bedding is not sufficiently effective. As a result, it is possible to increase the effectiveness of changing bedding.

[0135] In addition, the bedding evaluation value calculation process can use, for example, the above-mentioned functions f1 to f3. Various settings are possible for the supine position coefficient, right lateral position coefficient, left lateral position coefficient, and prone position coefficient. By adjusting these values, it is possible to adjust which sleeping position is emphasized from a perspective other than the time ratio. The magnitudes of the personal attribute coefficient, position change coefficient, and sleep coefficient can also be changed. For example, if the calculation algorithm is changed so that the personal attribute coefficient is more likely to increase, it is possible to perform processing that emphasizes personal attribute information over the position change method and sleep score. The same applies to the other two coefficients. Therefore, for example, the bedding selection unit 23 may change the values ​​of these coefficients as a change to the bedding selection algorithm. Furthermore, the bedding selection unit 23 may use functions other than the above f1 to f3 as functions for calculating the bedding evaluation value. As described above, by adjusting the algorithm used in the bedding evaluation value calculation process, etc. for each user, it is possible to improve processing accuracy. As a result, it is possible to increase the effectiveness of bedding replacement.

[0136] The bedding selection unit 23 may also change the type of bedding to be selected. For example, by default, the bedding selection unit 23 may only calculate an evaluation value for the pillow 630, which is easy to change, and suggest changes, and omit processing for the mattress 620 and comforter. If the proposed pillow 630 is not effective enough, the bedding selection unit 23 starts processing for the mattress 620 in addition to the pillow 630. In this way, the number of types of bedding suggested increases, making it possible to improve the effect of changing the bedding. Note that the order in which the target bedding is added is, for example, pillow 630, mattress 620, and comforter, but is not limited to this order and various modifications are possible.

[0137] As another feedback method, the bedding selection unit 23 may accept an input of an evaluation value of the bedding by the user when the evaluation processing unit 27 determines that the effectiveness of the bedding is below a predetermined level or when the bedding effect index is not calculated. For example, the bedding selection unit 23 may accept an input of an evaluation value by the user for each of a plurality of evaluation items related to the bedding.

[0138] For example, the bedding selection unit 23 may output information to the terminal device 200 instructing the terminal device 200 to display a questionnaire screen regarding bedding. The terminal device 200 then accepts user input on the questionnaire screen and transmits the user input to the bedding selection unit 23. The evaluation items here are, for example, items provided for each piece of bedding, such as the pillow 630, mattress 620, and comforter. The terminal device 200 may accept a selection input for each item, indicating whether the comfort is "good / average / bad." The evaluation items are not limited to these, and may include, for example, the height, hardness, and shape of the pillow 630, the hardness and distribution of the mattress 620, and the heat retention, moisture retention, and size of the comforter, as shown in the countermeasure proposal in FIG. 7 . In this case, for example, the questionnaire screen may display options such as "too low, appropriate, or too high" for each evaluation item and accept a selection input. The evaluation items are not limited to these, and various modifications are possible.

[0139] In this way, it is possible to obtain the user's subjective opinion on the bedding. Therefore, it is possible to propose bedding that more closely matches the user's preferences. Furthermore, as described above, the input of the evaluation value may be accepted when the bedding evaluation index cannot be calculated. For example, it is difficult to calculate the bedding effectiveness index when a user does not have a sleep sensor such as the detection device 430 installed, or when a sleep sensor has been installed but sensing data cannot be acquired due to some error. In this way, even when it is difficult to automatically determine the effectiveness of the bedding, by prompting the user for input, it is possible to appropriately obtain feedback on the proposed bedding.

[0140] In addition, in the method of this embodiment, if a bedding recommendation alone is insufficient, a consultation at a specialized facility may be suggested. For example, as shown in FIG. 6, the information processing device 20 may include a notification processing unit 28 that outputs information recommending a consultation at a specialized facility, including at least one of a chiropractic clinic, an osteopathic clinic, and a clinic, to the user when the evaluation processing unit 27 determines that the effectiveness of the bedding is below a predetermined level. Here, a chiropractic clinic is a facility that provides private therapies such as massage. An osteopathic clinic is a facility where medical treatment is performed by a specialist such as a judo therapist. A clinic is a facility where medical treatment is performed by a specialist such as an orthopedic surgeon. However, the specialized facilities in this embodiment are not limited to these and may include other facilities used to relieve user concerns such as stiff shoulders, lower back pain, and headaches.

[0141] As described above, the method of this embodiment first attempts to change bedding at home, and if this does not produce sufficient results, a visit to a specialized facility is recommended. As described above with reference to FIG. 2, the method of this embodiment may use information such as the type of facility, its location, and the individual's residential area. In this case, the information processing device 20 may select a specific specialized facility to recommend a visit to based on the distance from the target user's residential area and the facility type. The method of this embodiment enables smooth collaboration with specialized facilities. Furthermore, in this embodiment, bedding change takes priority over a visit to a facility, so in cases where bedding change is sufficient, less-necessary visits to a facility can be reduced. Furthermore, when visiting a specialized facility, previously attempted measures, such as bedding change, are known, making it possible to efficiently determine the treatment details at the facility. For example, the bedding selection unit 23 may output a report including a bedding change history and the resulting changes in sleep scores. Using this report facilitates smooth communication between the user and the facility. For example, the report may contain information equivalent to a pre-medication interview with the user. Furthermore, medical examinations at facilities are not limited to outpatient visits, and remote medical examinations may also be conducted.

[0142] In addition, the method of this embodiment may determine the effect of visiting the specialized facility. For example, the evaluation processing unit 27 may calculate a facility effect index representing the effect of the specialized facility based on the sleep data before and after the consultation at the specialized facility.

[0143] For example, the evaluation processing unit 27 calculates the degree of improvement in the sleep score (such as a difference or a ratio) as a facility effectiveness index. This allows the user to determine whether the facility visited was effective for the user, enabling appropriate feedback to be provided to the user. For example, if the information processing device 20 determines that visiting a specialized facility was not effective, the information processing device 20 may suggest switching to another specialized facility.

[0144] For example, the information processing device 20 may calculate a facility score and a visit score as shown in FIG. 2. The facility score is a numerical representation of the effect of visiting a specialized facility for each facility. For example, the facility score may be the average or median of the facility effect index calculated for the facility. The visit score is a numerical representation of the effect of each individual visit, and may be, for example, the facility effect index itself. Note that, as described above, if outpatient and remote medical consultations are selectable, a visit score may be calculated for each.

[0145] In this way, the information processing device 20 of this embodiment can suggest appropriate specialized facilities and specific consultation contents to the user by quantifying and evaluating the specialized facilities and consultation contents. For example, when recommending a consultation at a specialized facility, the information processing device 20 may perform a process of selecting a recommended specialized facility based on the facility score and the consultation score.

[0146] In this embodiment, suggestions other than bedding selection and consultation at a specialist facility may also be made. For example, when the evaluation processing unit 27 determines that the effectiveness of the bedding is below a predetermined level, the notification processing unit 28 of the information processing device 20 may output information to the user recommending that the user start monitoring using at least one of an activity meter and a vital sensor. Alternatively, the information processing device 20 may acquire the user's snoring level and sleep index (e.g., the sleep score described above) and determine whether to start monitoring based on this information.

[0147] The activity meter here is a sensor device that calculates an activity amount, which is information indicating the level of a user's activity. The activity meter may be the detection device 430 described above with reference to FIG. 17, or a device including a motion sensor such as an acceleration sensor. Information acquired based on the activity meter may be the number of steps measured by the user's walking, exercise intensity, or other information indicating the level of the user's activity. The exercise intensity may be numerical data measured in units of METs, but other information may also be used. The vital sensor is a device that detects the user's vital information, and may be the detection device 430, a device including a motion sensor such as an acceleration sensor, or a device including a photoelectric sensor that detects the pulse rate, blood oxygen saturation, etc. Vital information is information that indicates the state of the user's biological activity, such as pulse (heart rate), respiratory rate, blood pressure, and body temperature.

[0148] This makes it possible to monitor the user's condition in their daily life, which makes it possible to try to alleviate pain and worries by improving their lifestyle rather than relying on bedding or specialized facilities.

[0149] Furthermore, when the evaluation processing unit 27 determines that the effectiveness of the bedding is equal to or less than a predetermined level, the notification processing unit 28 may output advice information to the user including at least one of advice regarding timing of caffeine intake, bathing, and urination. For example, the notification processing unit 28 may send a push notification of this advice information to the terminal device 200 at the corresponding timing. In this way, it becomes possible to present specific lifestyle habits to the user.

[0150] FIG. 19 is a diagram illustrating the flow of data related to advice. For example, the information processing device 20 may acquire sleep data using the sleep information acquisition unit 26. The sleep data is information acquired from, for example, the detection device 430, and includes bedtime, wake-up time, sleep duration, time to fall asleep, and time to wake up during sleep. The time to go to bed may be the time to stay in bed, the time to transition to a sleeping state, or both. The time to wake up may be the time to get out of bed, the time to transition to a waking state, or both. The sleep duration is the time during a day when a person is determined to be asleep. The time to fall asleep is the time from staying in bed to transitioning to a sleeping state. The time to wake up during sleep is the total time spent awake between going to bed at night and waking up the next morning. Note that when targeting night shift workers, the calculation period for the time to wake up during sleep may be set to daytime hours. The sleep data is not limited to the above examples and may include other information, such as the number of times a person wakes up during sleep per day. Furthermore, these sleep data are not limited to data from one sleep session, but may be continuously acquired over a period corresponding to multiple sleep sessions.

[0151] The information processing device 20 may obtain analytical data by performing an analysis based on the sleep data. The analytical data here may include daytime behavior, behavior before going to bed, sleeping habits, and the like. For example, when the detection device 430 is used, daytime behavior may be whether or not the user takes a nap (goes to bed during the day). The behavior before going to bed may be data, based on data from when the user becomes in bed until when the user goes to sleep, such as whether the user spends a long time in bed 610 before going to sleep or falls asleep immediately after getting into bed 610. Furthermore, the sleeping habits may be statistical data such as the time the user goes to bed and the time the user wakes up. Furthermore, the sleeping habits may include information such as the proportion of time spent in each sleeping position and the number of times the user turns over in sleep.

[0152] The analysis data here is not limited to data obtained based on information from the detection device 430, but may be obtained using other sensors, or may be obtained from the results of a questionnaire given to the user, etc. For example, information on whether or not the user exercised may be obtained as the way of spending the day. Furthermore, information on the timing of urination, the timing of caffeine intake, the timing of bathing, etc. may be obtained as the way of spending the time before going to bed.

[0153] The information processing device 20 may output lifestyle advice based on the sleep data and the analysis data. The lifestyle advice may include advice to encourage urination before going to bed, advice to encourage going to bed only after feeling sufficiently sleepy, advice to encourage taking a bath at a predetermined time before going to sleep, advice to encourage reducing caffeine intake after dinner, etc. For example, when the sleep state determined from the sleep data (which may be, for example, the level of the sleep score described above) is determined to be below a predetermined level and undesirable behaviors regarding urination, going to bed, bathing, or caffeine are observed, the information processing device 20 may send a push notification of the corresponding advice.

[0154] For example, the information processing device 20 may estimate a standard bedtime based on sleeping habits and send a push notification encouraging urination a predetermined time before the bedtime. The information processing device 20 may also estimate a first time to get into bed 610 and a second time to transition to a sleeping state based on sleeping habits and send a push notification before or after the first time to inform the user that they should not get into bed 610 yet, as well as a push notification encouraging the user to get into bed a predetermined time before the second time. The information processing device 20 may also send a push notification encouraging the user to take a bath a predetermined time before the standard bedtime. The information processing device 20 may also estimate the timing of dinner based on how the user spent their time during the day and before bed, and send a push notification after dinner encouraging the user to curb their future caffeine intake.

[0155] The order and manner of push notification are arbitrary, but for example, the following chronological notification may be performed using the display unit 240, a sound output unit, or the like. 10:00 PM: "This is the last time I'll have caffeine." 10:30 PM "It's time to take a bath and get ready for bed." 11:00 PM "Are you feeling sleepy? Go to bed when you feel sleepy enough." 11:30 PM "It's almost time to go to bed. Let's go to bed without overdoing it."

[0156] 19, for example, the information processing device 20 may acquire information on activity levels and vital signs during work as activity data. The activity data includes information on working hours, vital signs during meetings (hereinafter referred to as MTGs), meeting participants, and meeting times. Working hours may refer to, for example, the time spent working in a day, or the time spent working in units of a week or a month. Meeting-time vital signs refer to vital signs information while a meeting is taking place. Alternatively, meeting-time vital signs may be information indicating how much vital signs during a meeting deviate from normal. Meeting participants refer to information identifying people who participated in the meeting. Meeting times refer to the time the meeting was held. Whether a meeting is being held may be detected using a sensor installed in a conference room or the like, or may be determined based on schedule data entered by the user.

[0157] The information processing device 20 may obtain analytical data by performing an analysis based on the activity data. The analytical data here includes work habits, compatibility with work, and compatibility with business partners. Work habits may be, for example, the frequency of meetings and average working hours. Work habits may also include information such as arrival and departure times, and whether or not work is performed on holidays. Compatibility with work represents the degree to which work can be performed without stress. For example, the information processing device 20 determines that the closer the meeting vitals or vitals during working hours are to a normal state (e.g., vitals outside of working hours or vitals while sleeping), the better the compatibility with work. Compatibility with business partners represents compatibility with people involved in work, such as colleagues and business partners. For example, the information processing device 20 determines that the closer the meeting vitals are to a normal state, the better the compatibility between the target user and the meeting participants.

[0158] The information processing device 20 may then output business reform advice based on the activity data and analysis data. Business reform advice includes advice on changing work hours, changing team composition, etc. For example, if the working hours are longer than the predetermined time or if the vital signs during a meeting significantly deviate from the normal state, the information processing device 20 may consider that work is a burden on the user and suggest reducing the working hours. Alternatively, if the vital signs during early morning work or late-night overtime work deviate from the normal state, the information processing device 20 may provide advice on changing the arrival time or departure time. Furthermore, if the information processing device 20 determines that the compatibility with a specific person is below a predetermined level, the information processing device 20 may provide advice such as assigning the person and the target user to different teams. Furthermore, if the information processing device 20 determines that the user's physical strength is declining based on the activity data, or that the quality of sleep is poor based on the sleep data, the information processing device 20 may output advice to encourage a nap. Note that such advice may be output to a user (e.g., a supervisor, a human resources officer, etc.) or the company to which the user belongs who has the authority to take action in accordance with the advice. For example, the information processing device 20 may encourage the user to take a nap, and may also output advice to the company to which the user belongs, such as encouraging employees to take naps and providing nap spaces.

[0159] Furthermore, since the target user's daytime activity level (activity time, activity intensity, stress level), etc. can be estimated based on the activity data, etc., the information processing device 20 may output advice regarding diet and exercise based on this information. For example, if the activity intensity is low, such as when the time spent sitting at a seat is above a predetermined threshold, the information processing device 20 may advise the user to reduce the amount of food eaten. Furthermore, the information processing device 20 may advise recommended meal timings or specific meal contents based on the user's daily rhythm during work. Furthermore, if the target company has a staff cafeteria, etc., advice may be provided that suggests specific recommended menus by acquiring menu information. Furthermore, the information processing device 20 may output advice recommending exercise if the activity level is below a predetermined threshold. In this case, the information processing device 20 may advise specific exercise contents, such as climbing stairs or commuting on foot, by using structural information about the target company's building or map information from the station to the company, etc.

[0160] While the above describes lifestyle advice based on sleep data and work reform advice based on activity data, this is not limited to this. For example, activity data may be used for lifestyle advice, and sleep data may be used for work reform advice. Furthermore, advice other than lifestyle advice and work reform advice may also be provided.

[0161] 2.5 User Interface 20A to 20D are examples of user screens presented to a user using the information processing system 10 of this embodiment. The screens shown in FIGS. 20A to 20D are displayed, for example, on the display unit 240 of the terminal device 200. For example, the terminal device 200 of this embodiment may operate according to an application program that performs processes such as sending images of lying positions and standing positions, receiving bedding selection results and advice, etc. The screens shown in FIGS. 20A to 20D are displayed, for example, by the application program.

[0162] As shown in FIG. 20A , the user screen may display information regarding the target user's sleeping posture, subjective symptoms, bedding evaluation results, posture evaluation results, and countermeasures. The information regarding sleeping posture may include, for example, time ratios determined for each of the supine, right lateral, left lateral, and prone positions. As shown in FIG. 20A , the information regarding sleeping posture may also include information regarding distortion for each position. For example, the information processing device 20 determines the degree of distortion of the neck and lower back based on a skeletal model in each position. The information regarding sleeping posture is not limited to time ratios and distortions, and other information, such as information indicating the degree of snoring in each position, may be added. For example, the information processing device 20 may determine the degree of snoring by receiving an input regarding whether the user is aware of snoring, or by acquiring audio data during sleep using a microphone or the like.

[0163] 20A may display information on the time ratio and distortion for a single sleep session, or may display information on the time ratio and distortion for a period including multiple sleep sessions (e.g., one month). Although omitted from FIG. 20A, a graph showing the time-series changes in the time ratio and distortion may also be displayed. In this case, multiple graphs corresponding to multiple postures may be displayed side by side. In addition to the graphs of the time ratio and distortion, graphs showing changes in other information, such as the sleep score, may also be displayed.

[0164] Furthermore, the information regarding subjective symptoms may be data that quantifies the user's level of pain, distress, and comfort for each body part, such as the neck, shoulders, and lower back. In the example of FIG. 20A, each level is displayed on a scale of 1 to 10, and objects that are illustrations of faces with different expressions are displayed to clearly present the subjective symptoms. Furthermore, the information processing device 20 may display a screen shown in FIG. 20B on the display unit 240 of the terminal device 200, for example, when a selection operation for any of the objects is performed. In FIG. 20B, a slider (seek bar) extending horizontally is displayed, allowing the user to input operations. Using the screen shown in FIG. 20B, the user can easily input values ​​for each item.

[0165] The bedding evaluation results also include values ​​based on, for example, pillow evaluation values ​​and mattress evaluation values. In the example of Fig. 20A, a pillow deviation value, which is the deviation value of the pillow evaluation values ​​of the target user, is calculated from the pillow evaluation values ​​of multiple users, and the pillow deviation value is displayed. Similarly, a mattress deviation value calculated based on the mattress evaluation values ​​may be displayed.

[0166] As shown in FIG. 20A, the information processing device 20 may also perform a process for estimating the evaluation value of the recommended bedding selected by the bedding selection unit 23. For example, since the target user's skeletal model and the characteristics (height, hardness, etc.) of the recommended bedding are known, the information processing device 20 may estimate the bedding evaluation value that will be obtained if the target user uses the recommended bedding based on this information. In the example of FIG. 20A, two bedding items are selected (Recommended 1 and Recommended 2), and the pillow standard deviation and mattress standard deviation are displayed for each. In this way, the user can confirm the degree of improvement in the evaluation value if they change the bedding, making it possible to appropriately encourage them to change the bedding.

[0167] The posture evaluation result may also be information about a skeletal model calculated based on a lying posture image, for example. The skeletal model information may be the skeletal model itself, the magnitude of body distortion calculated based on the skeletal model, or an evaluation value representing the degree of distortion calculated based on the magnitude. The posture evaluation result may also include information about a skeletal model calculated based on a standing posture image. For example, as shown in FIG. 20A, the posture evaluation item displays two objects: "standing posture" and "lying posture." When either selection operation is performed, the information processing device 20 performs processing to display a screen including information about a skeletal model corresponding to the selected posture.

[0168] Furthermore, as information regarding measures, two objects, "change bedding" and "expert consultation," may be displayed as shown in Fig. 20A. Each object can be selected by the user, and when "change bedding" is selected, the information processing device 20 performs processing to display a bedding change screen shown in Fig. 20C on the display unit 240 of the terminal device 200, and when "expert consultation" is selected, the information processing device 20 performs processing to display an expert consultation screen shown in Fig. 20D on the display unit 240 of the terminal device 200.

[0169] As shown in FIG. 20C, the bedding change screen displays detailed information about the bedding selected by the bedding selection unit 23. For example, here, a first option (recommended 1) of changing the pillow 630 to "XX" and a second option (recommended 2) of changing the pillow 630 to "XX" and the mattress 620 to "△△" are presented. Recommendation 1 and Recommendation 2 here are the same bedding items used in the bedding evaluation section of FIG. 20A. This allows the user to confirm the specific bedding that is recommended. The bedding change screen may also display information about purchasing or subscribing to the recommended bedding. For example, as shown in FIG. 20C, the bedding change screen may display the purchase cost of the bedding and the monthly subscription fee. Furthermore, the bedding change screen may also allow transition to an EC (electronic commerce) site where purchases or subscriptions can be made. The bedding selection screen is not limited to recommended bedding for purchase or subscription, and may display objects that the user can use to individually customize the pillow 630, mattress 620, bed 610, and other items (such as comforters).

[0170] As shown in FIG. 20D , the expert consultation screen displays information about consultations with experts or specialized facilities, such as sleep improvement instructors, chiropractors, osteopathic clinics, and clinics. For example, the expert consultation screen may display two objects, “in-person” and “online,” for each item. When “in-person” is selected, the information processing device 20 displays a screen for booking an in-person consultation with the corresponding expert or specialized facility. For example, the information processing device 20 may provide a reservation service for each expert or specialized facility within the same application software, or may link with an external service for making reservations. Similarly, when “online” is selected, the information processing device 20 displays a screen for booking a remote consultation via a network with the corresponding expert or specialized facility. In this way, if a user determines that a consultation with an expert is necessary based on the presented analysis data, the consultation can be quickly realized, thereby improving convenience.

[0171] 3. Variations <Special seat> The above describes a method for selecting bedding based on a skeletal model. However, the method of this embodiment is not limited to this, and processing may also be performed using a dedicated sheet in addition to the skeletal model. Here, the dedicated sheet is, for example, a sheet printed with moiré fringes. For example, a user places the dedicated sheet on their own bedding and places a weight in a specific position (e.g., the position where their lower back rests when sleeping). The user then captures an image of the dedicated sheet in this state using the imaging device 300. In this case, the dedicated sheet deforms according to the shape and hardness of the bedding, distorting to a shape corresponding to the bedding. The moiré fringes printed on the dedicated sheet change in pattern depending on the degree of distortion of the dedicated sheet. Therefore, by detecting changes in the moiré fringe pattern, the information processing device 20 can determine the characteristics of the user's bedding, for example, the hardness and degree of wear of the mattress 620. The characteristics of a pillow 630 may also be determined by placing the dedicated sheet on the pillow 630.

[0172] For example, the bedding selection unit 23 may perform a process of selecting bedding recommended for the target user based on the posture distortion detected from the skeletal model and the characteristics of the bedding detected from the dedicated sheet.

[0173] <Share> In this embodiment, information may be shared on a community site, etc. For example, as shown in Fig. 6, the information processing device 20 may include a sharing processing unit 29 that performs a process of outputting input information used to select bedding for a user in a bedding selection unit 23 and output information including the bedding selection result, and a process of acquiring input information and output information used in processing related to other users.

[0174] In this way, each user can share information about their own situation, proposed measures, and the effects of implementing those measures. Therefore, for example, by referring to the data of other users who have the same concerns, it becomes possible to resolve one's own concerns. The information shared here may be information corresponding to the Input (input information) shown in FIG. 2, information related to the Output (output information), or both. Furthermore, it is not limited to sharing all of the information shown in FIG. 2; only items permitted by the target user may be shared.

[0175] In addition to the information shown in FIG. 2, users may also share their own experiences of difficulties, innovations, etc. as additional information. Each user may also rate the shared information, such as whether it was useful or not. For example, points may be awarded to users who are judged to have found the information useful. When displaying information about other users, the information processing device 20 may perform processing such as sorting the information in order of points. Furthermore, the evaluation targets are not limited to users, and each user may also evaluate specialized facilities such as chiropractic clinics, osteopathic clinics, and clinics, or specific treatment contents.

[0176] <Sleeping position during a nap> In the above description, the sleeping posture is, in a narrow sense, a sleeping posture during a full-scale sleep lasting for several hours or more (nighttime sleep for a normal user). However, the method of the present embodiment is not limited to this, and a sleeping posture during a nap (daytime sleep for a normal user) may also be used in each of the above-described processes.

[0177] Although the present embodiment has been described in detail above, those skilled in the art will readily understand that many modifications are possible without substantially departing from the novel features and advantages of the present embodiment. Therefore, all such modifications are intended to be included within the scope of the present disclosure. For example, a term described at least once in the specification or drawings together with a different term having a broader or equivalent meaning may be replaced with that different term anywhere in the specification or drawings. Furthermore, all combinations of the present embodiment and modifications are also intended to be included within the scope of the present disclosure. Furthermore, the configurations and operations of the information processing system, information processing device, server system, terminal device, etc. are not limited to those described in the present embodiment, and various modifications are possible. [Explanation of symbols]

[0178] 10...information processing system, 20...information processing device, 21...image acquisition unit, 22...model estimation unit, 23...bedding selection unit, 24...sleeping posture determination unit, 25...position change estimation unit, 26...sleeping information acquisition unit, 27...evaluation processing unit, 28...notification processing unit, 29...shared processing unit, 100...server system, 110...processing unit, 120...storage unit, 130...communication unit, 200...terminal device, 210...processing unit, 220...storage unit, 230...communication unit, 240...display unit, 250...operation unit, 300...imaging device, 400...sensing device, 430...detection device, 610...bed, 620...mattress, 630...pillow, θ1 to θ3...neck tilt angle, ST...stand

Claims

1. an image acquisition unit that acquires a sleeping posture image of a user in a sleeping posture; a model estimation unit that estimates a skeletal model of the user based on the sleeping posture image; a sleeping posture determination unit that determines whether the sleeping posture of the user is one of a plurality of postures including a supine position, a right lateral position, a left lateral position, and a prone position, and determines a time ratio of each of the plurality of postures; a bedding selection unit that performs processing to select bedding recommended for the user based on the estimated skeletal model and the time ratio; An information processing device comprising:

2. In claim 1, The image acquisition unit acquiring a standing image of the user in a standing position; The model estimation unit An information processing device that estimates the skeletal model of the user based on the standing position image and the lying position image.

3. In claim 2, The model estimation unit An information processing device calculates body distortion caused by the bedding from a sleeping posture skeletal model estimated based on the sleeping posture image and a standing posture skeletal model estimated based on the standing posture image, and corrects the sleeping posture skeletal model.

4. In claim 1, The device further includes a position change estimation unit that estimates a position change technique that is a technique used when the user changes their position by turning over while sleeping, The bedding selection unit An information processing device that performs processing to select the bedding based on the skeletal model and the position change method.

5. In any one of claims 1 to 4, The information processing device further includes an evaluation processing unit that calculates a sleep score that indicates the quality of sleep based on sleep data, which is the sensing result regarding the user's sleep obtained by a sleep sensor, and calculates a bedding effect index that indicates the effect of the bedding by performing a process of comparing the sleep score before and after introducing the bedding selected by the bedding selection unit.

6. In claim 5, The bedding selection unit When the evaluation processing unit determines that the effectiveness of the bedding is below a predetermined level, the information processing device performs at least one of the following processes: adding input information to be used to select the bedding, changing the bedding selection algorithm that selects the bedding based on the input information, and adding types of the bedding to be selected.

7. In claim 5, The bedding selection unit An information processing device that accepts input of an evaluation value of the bedding by the user when the evaluation processing unit determines that the effectiveness of the bedding is below a predetermined level or when the bedding effectiveness index cannot be calculated.

8. In claim 5, The device further includes a notification processing unit that, when the evaluation processing unit determines that the effectiveness of the bedding is equal to or less than a predetermined level, outputs to the user information recommending that the user be examined at a specialized facility including at least one of a chiropractic clinic, an osteopathic clinic, and a clinic; The bedding selection unit is an information processing device that performs processing to output a report including at least one of the bedding change history and the sleep score during the examination at the specialized facility.

9. In claim 8, The evaluation processing unit An information processing device that calculates a facility effect index that represents an effect of the specialized facility based on the sleep data before the examination at the specialized facility and the sleep data after the examination at the specialized facility.

10. In claim 5, The information processing device further includes a notification processing unit that, when the evaluation processing unit determines that the effectiveness of the bedding is below a predetermined level, outputs information to the user recommending that the user start monitoring using at least one of an activity meter and a vital sensor.

11. Acquire a sleeping posture image capturing a user in a sleeping posture; Estimating a skeletal model of the user based on the sleeping posture image; determining whether the user's sleeping position is one of a plurality of positions including a supine position, a right lateral position, a left lateral position, and a prone position, and also determining a time ratio of each of the plurality of positions; performing a process of selecting bedding recommended for the user based on the estimated skeletal model and the time ratio; Information processing methods.

Images