Display system, display method, and program

Abstract

To provide a display system capable of more appropriately displaying an evaluation result of a degree of fatigue.SOLUTION: A display system is used in a posture evaluation system 200 for evaluating a posture of a subject 11 and includes: a reception part 301 that receives an instruction of displaying an evaluation result of the posture of the subject 11; a display part 302 that causes display of one or more screens from among a plurality of screens for displaying the evaluation result of the posture of the subject 11; and an accumulation part 303 that accumulates frequency information being information including the number of times of viewing of a screen displayed in the past by the subject 11 or a time during which the subject 11 has viewed the screen displayed in the past. The display part 302 causes one or more screens to be displayed on the basis of the frequency information.SELECTED DRAWING: Figure 3

Description

Technical Field

[0001] The present disclosure relates to a display system, a display method, and a program used in a posture evaluation system for evaluating the posture of a subject.

Background Art

[0002] In recent years, there have been scattered cases leading to physical problems, injuries, and accidents starting from poor physical condition due to the accumulation of fatigue. In response to this, attention has been drawn to technologies that prevent physical problems, injuries, and accidents by estimating the degree of fatigue. For example, as a fatigue estimation system for estimating the degree of fatigue, Patent Document 1 discloses a fatigue determination device that determines the presence or absence of fatigue and the type of fatigue based on force measurement and bioelectrical impedance measurement.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] By the way, in the conventional fatigue determination device etc. exemplified in the above Patent Document 1, there are cases where the display of the evaluation result of the degree of fatigue cannot be appropriately performed. Therefore, the present disclosure provides a display system etc. that can more appropriately display the evaluation result of the degree of fatigue.

Means for Solving the Problems

[0005] A display system according to an aspect of the present disclosure is used in a posture evaluation system that evaluates the posture of a subject using a terminal operated by the subject and a camera associated with the terminal, and is a display system that displays the evaluation result of the posture. The posture evaluation system includes an acquisition unit that acquires an image captured by the camera after detecting the start of operation of the subject by the terminal, and a posture evaluation unit that estimates the skeleton of the subject based on the acquired image and evaluates the posture of the subject from the estimated skeleton. The display system includes a reception unit that receives an instruction to display the evaluation result of the posture of the subject, a display unit that displays one or more screens from a plurality of screens for displaying the evaluation result of the posture of the subject, and a storage unit that stores frequency information including the number of times the subject has viewed the screens displayed in the past or the time the subject has viewed the screens displayed in the past. The display unit displays the one or more screens based on the frequency information.

[0006] Also, a display method according to an aspect of the present disclosure is used in a posture evaluation system that evaluates the posture of a subject using a terminal operated by the subject and a camera associated with the terminal, and is a display method for displaying the evaluation result of the posture executed by a computer. The posture evaluation system includes an acquisition unit that acquires an image captured by the camera after detecting the start of operation of the subject by the terminal, and a posture evaluation unit that estimates the skeleton of the subject based on the acquired image and evaluates the posture of the subject from the estimated skeleton. The display method includes a step of receiving an instruction to display the evaluation result of the posture of the subject, a step of displaying one or more screens from a plurality of screens for displaying the evaluation result of the posture of the subject, and a step of storing frequency information including the number of times the subject has viewed the screens displayed in the past or the time the subject has viewed the screens displayed in the past. In the step of displaying, the one or more screens are displayed based on the frequency information.

[0007] Also, a program according to an aspect of the present disclosure is a program for causing the computer to execute the display method described above. [Effect of the Invention]

[0008] A display system and the like according to an aspect of the present disclosure can more appropriately display the evaluation result of the degree of fatigue. [Brief Description of the Drawings]

[0009]

Figure 1A

Figure 1B

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Figure 21

Figure 22

Figure 23

Figure 24

Figure 25

MODE FOR CARRYING OUT THE INVENTION

[0010] Hereinafter, embodiments will be specifically described with reference to the drawings. Note that all of the embodiments described below show comprehensive or specific examples. The numerical values, shapes, materials, components, arrangement positions and connection forms of the components, steps, order of steps, etc. shown in the following embodiments are merely examples and are not intended to limit the present disclosure. In addition, among the components in the following embodiments, the components not described in the independent claims are described as optional components.

[0011] Note that each figure is a schematic diagram and is not necessarily drawn precisely. Also, in each figure, substantially the same components are denoted by the same reference numerals, and duplicate explanations may be omitted or simplified.

[0012] (Embodiment 1) [System Configuration including Posture Evaluation Device] Hereinafter, the overall configuration of a posture evaluation system including a posture evaluation device according to an embodiment will be described. FIG. 1A is a first diagram for explaining the evaluation of a posture according to an embodiment. FIG. 1B is a second diagram for explaining the evaluation of a posture according to an embodiment.

[0013] In the present disclosure, a posture evaluation system 200 (see FIG. 2 described later) is, in an embodiment, a system that evaluates the posture of a subject 11 using an image output by imaging the subject 11 using an imaging device 201. The imaging device 201 is an example of a camera and is not limited to its form as long as it is a camera that images the subject 11 and outputs an image. As shown in FIG. 1A, it may be a fixed camera installed on a wall surface or ceiling of a building or the like, or may be a camera mounted on a PC, smartphone, or tablet terminal operated by the subject 11.

[0014] Here, the subject is in a sitting posture on a chair 12. In the posture evaluation system 200 in the present disclosure, among the fatigue of the subject 11, the posture of the subject 11 is evaluated based on the fatigue accumulated by taking a static posture in which the posture is fixed. That is, based on the fatigue accumulated by the load on at least one of the muscles and joints and the deteriorating blood flow (hereinafter also referred to as a decrease in blood flow volume) due to the fixed posture state, the posture is evaluated. Therefore, the subject 11 is in a static posture of sitting, lying, or standing still for at least a certain period. The certain period is, for example, the minimum period in which the posture evaluation system 200 can evaluate the posture, such as several tens of seconds or several seconds. Such a period is determined depending on the processing capabilities of the imaging device 201 and the evaluation device 100 (see FIG. 2 described later) that constitute the posture evaluation system 200.

[0015] Examples of the subject 11 taking such a static posture include desk workers in an office, drivers who steer a moving body, people who perform strength training using the load in a static posture, inpatients in facilities such as hospitals, passengers and crew members on an airplane, etc.

[0016] The image captured and output by the imaging device 201 is processed by the evaluation device 100, and the posture of the subject 11 is estimated as shown in FIG. 1B. The estimated posture of the subject 11 is output as a rigid body link model 11b as an example. Specifically, as shown in FIG. 1B, the skeletons indicated by straight lines are connected by joints indicated by black dots, and the posture of the subject 11 can be reproduced based on the positional relationship between two skeletons connected by one joint. In this way, the estimated posture is represented by the skeleton of the subject 11. In other words, the estimation of the posture of the subject 11 is performed by estimating the skeleton. The estimation of the posture here is performed by image recognition and is output as the above rigid body link model 11b based on the positional relationship between the joints and the skeletons.

[0017] In the estimated rigid body link model 11b, the angle formed between adjacent skeletons via joints can be calculated. Hereinafter, such an angle is referred to as a posture feature amount in the posture. The posture feature amount includes angles formed between skeletons in a plurality of combinations for one posture. For example, the posture feature amount includes the angle of the neck, the angle of the waist, and the hip joint angle, etc. In other words, one posture is defined by the angles formed between skeletons in these multiple combinations. Thus, in this embodiment, it is possible to calculate the posture feature amount by estimating the posture. From the posture feature amount of the estimated posture, it is possible to evaluate the posture corresponding to the load amount applied to at least one of the muscles and joints of each body part in order to maintain the skeletons in the angular relationship according to the estimated posture. Here, the load amount on at least one of the muscles and joints of each body part accumulates as the continuous time during which the above-mentioned static posture is continued (in other words, the cumulative time during which fatigue accumulates by maintaining the same posture) extends. Therefore, the degree of fatigue caused by the subject 11 maintaining the static posture is calculated by an operation using the cumulative time. In the following description, "at least one of the muscles and joints" is also expressed as "muscles and / or joints".

[0018] Also, in this embodiment, the amount of load applied to the above-mentioned muscles and / or joints may be reinterpreted as the degree of deterioration of the blood flow of the subject 11.

[0019] That is, after estimating the posture of the subject 11, the posture evaluation system 200 evaluates the posture according to the fatigue accumulated from at least one of the viewpoints of the load amount on the muscles of the subject 11, the load amount on the joints, and the degree of deterioration of the blood flow, based on the cumulative time of the posture.

[0020] Note that the degree of deterioration of the blood flow means that the blood flow volume of the subject 11 decreases as it increases, indicating that the degree of fatigue caused by the decrease in the blood flow volume increases.

[0021] In addition, in the subsequent evaluation of the posture of the subject 11, the posture is evaluated from the perspective of fatigue accumulated based on at least one of the load on the muscles, the load on the joints, and the degree of deterioration of blood flow estimated from the posture. However, as the evaluation value (evaluation score) associated with the posture, a subjective evaluation value based on the subjectivity of the subject 11 generated by accumulating data such as questionnaires is used. In addition, as the evaluation value, it may be calculated from the measured data of the load on the muscles, the load on the joints, and the degree of deterioration of blood flow. This measured data is, in other words, a database constructed by associating and accumulating the measured values of the load on the muscles, the load on the joints, and the blood flow rate measured for each posture with the posture. In the posture evaluation system 200 in this case, the evaluation of the estimated posture of the subject 11 can be performed based on the evaluation based on the measured values of the load on the muscles, the load on the joints, and the blood flow rate.

[0022] The measured data may be constructed using the measured values for each individual considering the individual differences of the subject 11, or may be constructed by qualifying the big data obtained from a large number of unspecified subjects so as to be suitable for each subject 11 by analytical processing such as statistical analysis or machine learning.

[0023] Next, the functional configuration of the posture evaluation system 200 in the present disclosure will be described with reference to FIG. 2. FIG. 2 is a block diagram showing the functional configuration of the posture evaluation system according to the embodiment.

[0024] As shown in FIG. 2, the posture evaluation system 200 in the present disclosure includes an evaluation device 100, an imaging device 201, a timing device 202, a reception device 204, a display system 300, a display device 205, and a recovery device 206.

[0025] The evaluation device 100 is an example of a posture evaluation device, and includes a first acquisition unit 101, a second acquisition unit 102, a third acquisition unit 103, a posture estimation unit 105, an evaluation unit 108, an output unit 109, and a storage unit 110.

[0026] The first acquisition unit 101 is a communication module connected to the imaging device 201 and acquiring an image of the subject 11 captured by the imaging device 201. That is, the first acquisition unit 101 is an example of an acquisition unit. The connection between the first acquisition unit 101 and the imaging device 201 is performed by wire or wirelessly, and there is no particular limitation on the communication method performed via the connection.

[0027] The second acquisition unit 102 is a communication module connected to the timing device 202 and acquiring time from the timing device 202. The connection between the second acquisition unit 102 and the timing device 202 is performed by wire or wirelessly, and there is no particular limitation on the communication method performed via the connection.

[0028] The third acquisition unit 103 is a communication module connected to the reception device 204 and acquiring personal information from the reception device 204. The connection between the third acquisition unit 103 and the reception device 204 is performed by wire or wirelessly, and there is no particular limitation on the communication method performed via the connection.

[0029] The posture estimation unit 105 is a processing unit realized by executing a predetermined program using a processor and a memory. By the processing of the posture estimation unit 105, based on the image acquired by the first acquisition unit 101, the posture of the subject 11 is estimated. That is, the posture estimation unit 105 estimates the skeleton of the subject 11 in the posture at that time, and calculates a posture feature amount for each processing unit time.

[0030] The evaluation unit 108 is a processing unit realized by executing a predetermined program using a processor and a memory. The evaluation unit 108 evaluates the posture of the subject 11 based on the cumulative time of the estimated posture, using the posture estimated by the posture estimation unit 105 and the time acquired by the second acquisition unit 102. The evaluation unit 108 outputs the evaluation result to the output unit 109.

[0031] The output unit 109 is a communication module connected to the display device 205 and the recovery device 206, and outputs the content based on the posture evaluation result by the evaluation device 100 to the display device 205 via the display system 300 and to the recovery device 206. The connection between the output unit 109 and the display system 300 or the recovery device 206 is made by wire or wirelessly, and there is no particular limitation on the communication method performed via the connection.

[0032] The storage unit 110 is a storage device that stores a plurality of reference postures serving as criteria for posture evaluation together with posture feature amounts corresponding to each of the plurality of reference postures. In the storage unit 110, scores are stored together with the corresponding reference postures and posture feature amounts such that, depending on the fatigue degree estimated in advance for each reference posture, the better the evaluation result of the posture is, the higher the difficulty of accumulating fatigue. The above scores may simply be numerical values, or may be a combination of a reference score whose numerical value can be calculated according to the cumulative time and a function for decreasing the reference score according to the length of the cumulative time. Note that the evaluation of the posture is not limited to such a scoring method, and any existing method can be used.

[0033] In the present embodiment, the estimated posture of the subject 11 is classified into any one of a plurality of reference postures by posture feature amounts, and the posture is evaluated from the evaluation score corresponding to the reference posture or the function. If none of the reference postures are applicable, the posture of the subject 11 may be classified into other postures for classifying the posture. The other postures may be set so as to have less influence on the evaluation result by being assigned any one of 0 points, full points, or an arbitrary point in between.

[0034] As described above, in the present embodiment, the estimated posture of the target person 11 is compared with the reference postures based on the posture feature amounts, and it is specified which of the plurality of prepared reference postures the estimated posture of the target person 11 corresponds to. Then, with respect to one reference posture specified as the reference posture corresponding to the estimated posture of the target person 11, it is possible to numerically determine whether or not the posture of the target person 11 is in a good state only by adding a preset score or the like. That is, it is possible to appropriately evaluate the posture of the target person 11 by a relatively simple process.

[0035] As described above, the imaging device 201 is a device that images the target person 11 and outputs an image, and is realized by a camera. As the imaging device 201, an existing camera in the space to which the posture evaluation system 200 such as a security camera or a fixed-point camera is applied may be used, or a dedicated camera may be newly provided. Such an imaging device 201 is an example of an information output device that outputs an image as information regarding the positions of the body parts of the target person 11. Therefore, the output information is an image and includes information on the positional relationship of the body parts of the target person 11 on the projected imaging element.

[0036] The time measuring device 202 is a device that measures time and is realized by a clock. The time measuring device 202 can transmit time to the connected second acquisition unit 102. Here, the time measured by the time measuring device 202 may be an absolute time or an elapsed time from a relative starting point. The time measuring device 202 may be realized in any form as long as it can measure the time (that is, the accumulated time) between the time when the stillness of the target person 11 is detected and the time when the posture is changed.

[0037] The reception device 204 is a user interface that receives the input of the personal information of the subject 11, and is realized by an input device such as a touch panel or a keyboard. The personal information includes at least one of age, gender, height, weight, muscle mass, stress level, body fat percentage, and proficiency in exercise. The age of the subject 11 may be a specific numerical value, or may be an age group divided every 10 years such as the teens, twenties, and thirties, or may be a two-division age group with a predetermined age as a boundary such as 59 years old or younger or 60 years old or older, or may be other.

[0038] Also, the gender of the subject 11 is one appropriate for the subject 11 selected from among male and female. Also, the height and weight are such that the numerical values of the height and weight of the subject 11 are respectively received. Also, the muscle mass is such that the composition ratio of the muscles of the subject 11 measured using a body composition meter or the like is received. Also, the stress level of the subject 11 is selected by the subject 11 himself / herself from among options such as high, medium, and low as the degree of subjective stress felt by the subject 11.

[0039] Also, the body fat percentage of the subject 11 is the ratio of the weight of body fat to the weight of the subject 11, and is expressed, for example, as a percentage out of 100.

[0040] Also, the proficiency of the subject 11 in exercise may be quantified by the score when the subject 11 performs a predetermined exercise program, or may be the situation of the exercise that the subject 11 usually engages in. In the former case, it is quantified, for example, by the time required to perform 10 back muscles, the time required to run 50 m, the flying distance of a long throw, etc. In the latter case, it is quantified, for example, by how many days of exercise are performed in a week or how many hours of exercise are performed. Note that since the personal information is used for the purpose of improving the accuracy of posture evaluation such as evaluation scores and personal optimization of functions, when sufficient accuracy is ensured or when realizing a generalized posture evaluation system 200, the posture evaluation system 200 may be realized without including the reception device 204.

[0041] The reception device 204 is also used when inputting to the display system 300. Inputs to the display system 300 include, for example, input of an instruction to display an evaluation result on the display device 205, input of ID information of the subject person, and the like. Here, FIG. 3 is a block diagram showing the functional configuration of the display system according to the first embodiment. As shown in FIG. 3, the display system 300 includes a reception unit 301, a display unit 302, and a storage unit 303. Note that the configuration of these display systems 300 shows the configuration of the functions of the display system 300, and in implementation, each component may be arranged in any manner. For example, in the present embodiment, the reception unit 301 and the display unit 302 are included in the terminal, and the storage unit 303 is included in a server communicably connected to the terminal. The terminal is a so-called information terminal, and is realized by a smartphone, a tablet terminal, a PC, or the like. The terminal further includes the above-described imaging device 201, timing device 202, reception device 204, and a display device 205 described later. Such a terminal includes a terminal for the subject person 11 to use and an administrator terminal for an administrator who manages the fatigue level of the subject person 11. Hereinafter, the description will continue with the terminal for the subject person 11 to use as an example. The administrator terminal will be described later.

[0042] The reception unit 301 is a functional part that receives an instruction to display the evaluation result of the posture of the subject person 11. The reception unit 301 receives from the reception device 204 an instruction to display the evaluation result of the posture of the subject person 11 generated by an input made by the subject person 11 or the like.

[0043] The display unit 302 is a functional part that causes the display device 205 to display one or more pieces of content (screen) based on a plurality of evaluation results for displaying the evaluation result of the posture of the subject person 11. In selecting one or more pieces of content here, if the subject person 11 selects content that he / she is not interested in, it may happen that the subject person 11 hardly looks at the displayed content, and there may be a case where the evaluation result of the fatigue level is not appropriately displayed.

[0044] Therefore, the display unit 302 selects, as the content to be displayed, the content that has been viewed relatively frequently based on the frequency of screen viewing by the past subject 11. As a result, since the displayed content has a record of being viewed by the subject 11 in the past, it is likely to attract the interest of the subject 11, and it becomes possible to appropriately display the evaluation result of the fatigue level. Here, as the above frequency, it is determined whether the content that has been viewed more frequently is the content that has been viewed a large number of times or for a long time by the subject 11 in the past, corresponding to the magnitude of the frequency.

[0045] That is, the display unit 302 generates frequency information by measuring how many times or for how long the subject 11 has viewed the displayed screen while displaying the screen showing the evaluation result. Then, the display unit 302 accumulates the frequency information in the storage unit 303 together with the content of the screen (content) showing the evaluation result. The display unit 302 acquires the information indicating the content with the most viewed times or the longest viewing time by the subject 11 in the accumulated frequency information, and selects it as the content to be displayed so that the content indicated by the information is preferentially or highly likely to be displayed.

[0046] The storage unit 303 is a functional part that stores (accumulates) the frequency information transmitted from the display unit 302 over a plurality of times. The storage unit 303 is included in a server capable of processing the stored information, and the server can identify the content with the most viewed times or the longest viewing time by the subject 11.

[0047] Returning to FIG. 2, the display device 205 is a device for displaying the content based on the evaluation result of the posture output by the output unit 109. The display device 205 displays an image showing the content based on the evaluation result of the posture on a display panel such as a liquid crystal panel or an organic EL (Electro Luminescence) panel, for example. The content displayed by the display device 205 will be described later.

[0048] The recovery device 206 is, as an example, a device that reduces the fatigue level of the subject 11 by promoting the blood circulation of the subject 11 when the evaluation result of the posture is not good (when the state is prone to accumulation of fatigue). Specifically, the recovery device 206 actively changes the posture of the seated subject 11 by applying voltage, applying pressure, vibrating, heating, etc., or by changing the arrangement of each part of the chair 12 by a mechanism provided in the chair 12. Thereby, the recovery device 206 changes the mode of load on at least one of the muscles and joints of the subject 11 and promotes blood circulation. Also, from the perspective of blood flow volume, by promoting blood circulation in this way, the influence of blood flow deterioration due to the subject 11 being in a static posture is reduced, and the fatigue level is recovered. The recovery device 206 is pre-mounted or brought into contact with an appropriate body part of the subject 11 according to the configuration of the device.

[0049] In addition, when promoting the blood circulation of the subject 11 by heating, since the space around the subject 11 is heated as a whole, in such a case, it is not necessary to be mounted or brought into contact with an appropriate body part of the subject 11. Also, when the posture evaluation system 200 is configured to only display the posture evaluation result to the subject 11, it only needs to include the display device 205, and the recovery device 206 is not essential.

[0050] Also, in this embodiment, an example of displaying on the display device 205 or reducing the fatigue level in the recovery device using the posture evaluation result output by the output unit 109 is described. However, the posture estimated by the posture estimation unit 105 (also called the posture analysis result) may be used to estimate the degree of eye fatigue, the risk of musculoskeletal disorders, and the work content.

[0051] For example, in the posture analysis result, if the hunched-back posture continues for a predetermined period, it can be determined that there is a possibility that the degree of eye fatigue is increasing. Also, for example, based on the degree of curvature and the duration of the neck and waist in the posture analysis result, the magnitude of the risk of developing musculoskeletal disorders such as stiff shoulders and low back pain can be estimated. Further, for example, in the posture analysis result, if the hand is moving, it can be determined that an operation such as on a keyboard is being performed, and if the hand is not moving and the monitor is being looked at, it can be determined that a meeting is in progress. The output via the above output unit 109 may include the output of the posture analysis result, and such a posture analysis result may be used as an input to an estimation device that estimates the above-mentioned degree of eye fatigue, musculoskeletal disorder risk, and work content, etc.

[0052] Hereinafter, the functions of the administrator terminal will be described together with display examples of the screen. FIGS. 4 to 6 are diagrams showing display examples of the management screen according to Embodiment 1. As shown in FIG. 4, the administrator terminal can list the evaluation results for each of a plurality of target persons 11 to be managed. For example, as shown in FIG. 4, the target persons 11 who are absent from work while the target persons 11 who are present at work on the day are distinguished and displayed (the target persons 11 in the broken-line rectangle). Among the target persons 11 who are present at work, the target persons 11 that should be noted in the evaluation result are highlighted compared to the other target persons 11 (indicated by the application of dot hatching). That is, by paying particular attention to and checking the highlighted target persons 11, a plurality of target persons 11 to be managed can be easily managed.

[0053] And for example, as shown in FIG. 5, it is also possible to know the trend of the evaluation results of all of the plurality of target persons 11 to be managed during a certain period. From the screen shown in FIG. 4 to the screen shown in FIG. 5, the screen can be switched by switching between the "Current Situation" tab and the "History" tab. From the administrator terminal, it is also possible to check the details of the evaluation results for the target persons 11 that need to be particularly noted. For example, by selecting the name etc. of the target person 11 shown in FIG. 4 or FIG. 5, it is possible to transition to the screen of FIG. 6, which is a page of the detailed evaluation results of the said target person 11. As shown in FIG. 6, the details of the evaluation results for each target person 11 and advice etc. for the said target person 11 can be confirmed from the administrator terminal.

[0054] [Operation] Next, the display of the evaluation results of the posture of the subject 11 using the posture evaluation system 200 in the embodiment will be described with reference to FIGS. 7 to 14. FIG. 7 is a flowchart showing the display method according to the first embodiment. FIGS. 8 to 14 are diagrams showing examples of the display of the evaluation screen according to the first embodiment.

[0055] In the posture evaluation system 200, first, the personal information of the subject 11 is acquired. The acquisition of the personal information is performed by the subject 11 himself or an administrator who manages the evaluation results of the posture of the subject 11 by input to the reception device 204. The input personal information of the subject 11 is stored in the storage unit 110 or the like and read out and used during the evaluation of the posture.

[0056] In the posture evaluation system 200, the subject 11 is detected by the imaging device 201. The detection of the subject 11 is performed by determining whether or not the subject 11 has entered the angle of view of the camera which is the imaging device 201. At this time, the subject 11 may be a specific subject 11, or among an unspecified number of people, the person who has entered the angle of view of the camera may be the subject 11. When the subject 11 is selected from an unspecified number of people, the input of personal information may be omitted. Also, when detecting a specific subject 11, a step of specifying the subject 11 by image recognition or the like is added.

[0057] In this embodiment, the subject 11 himself / herself inputs personal information. For example, on a personal terminal (also serving as the display device 205) shown in FIG. 8, by holding the employee ID card in front of the terminal according to the instructions on the screen, the tag information of the subject 11 embedded in the employee ID card can be read by the terminal. Thereby, the terminal can obtain the ID information included in the tag information. In this way, the terminal has the function of a tag reader that can read tag information. The reading of the tag information is performed, for example, by short-range wireless communication. The terminal can input personal information to the evaluation device 100 by querying the personal information in the database based on the ID information obtained from the tag information. Then, as shown in FIG. 9, a screen indicating authentication completion is displayed on the terminal, and then, as shown in FIG. 10, the screen transitions to the screen shown in FIG. 10, and the preparation for posture evaluation is completed.

[0058] As another example, first, the screen shown in FIG. 10 may be displayed, and the subject 11 may operate the terminal to press the "Monitor Start" button displayed on the screen. In the posture evaluation system 200, prior to evaluating the posture, an image of the subject 11 is acquired. Using the image thus obtained, a face image of the subject 11 included in the image is extracted, and based on the extracted face image, a database that associates the face image with ID information is queried. Using the ID information returned from the database as a result, the same operations as described above can be performed. At this time, the screen shown in FIG. 11 may be displayed to confirm with the subject 11 whether the ID information returned from the database is correct. That is, candidates for the ID information before confirmation are presented to the subject 11, and the subject 11 is further asked to input whether the presented ID information candidates are correct. As shown in FIG. 11, the input of correct or incorrect from the subject 11 is performed by pressing the "OK" button or the "No" button. If the "OK" button is pressed and the presented ID information candidate is correct, the ID information candidate may be used as the ID information. On the other hand, if the "No" button is pressed and the presented ID information candidate is incorrect, the screen shown in FIG. 12 is transitioned to, and the subject 11 is asked to input the correct ID information. Note that, from the beginning (without performing authentication by face image), the subject 11 may be asked to input the correct ID information as shown in the screen of FIG. 12.

[0059] As yet another example, ID information may be obtained using the beacon signal of the beacon transmitter owned by the subject 11. Specifically, the terminal is provided with a beacon receiver capable of receiving the beacon signals transmitted from the beacon transmitters respectively owned by the subject 11. This beacon receiver receives the beacon signal of the subject 11 who is near the terminal (in other words, can operate the terminal). Then, using the received beacon signal, a database that associates the beacon signal with ID information is queried. Using the ID information returned from the database as a result, the same operations as described above can be performed. Also in this case, it may be confirmed with the subject 11 whether the ID information returned from the database is correct, as described above.

[0060] As yet another example, ID information may be obtained using a personal terminal owned by subject 11. In the acquisition of ID information described above, the terminal was described on the premise that it was a terminal placed in the working space of subject 11. However, by installing the personal terminal of subject 11 in the working space each time, the posture of subject 11 can be evaluated using the personal terminal as the terminal. In such a case, if the ID information is stored in the personal terminal in advance, since the owner of the personal terminal is subject 11, the ID information of subject 11 can be obtained from the information stored in the terminal (i.e., the personal terminal).

[0061] After acquiring the ID information and being able to read the personal information, on the terminal, as shown in FIG. 13, the screen transitions and it is displayed that the posture is being analyzed (posture monitoring is in progress), and at an arbitrary timing, a "View Analysis Results" button for displaying the analysis results is displayed. Also, in the display example of the screen shown in FIG. 13, a "Reset" button for discarding the monitor results of the postures accumulated so far is displayed.

[0062] In this example, by grasping the detection area by the imaging device 201 and entering the detection area, the posture is evaluated. As an example, a private room booth equipped with the evaluation device 100 will be described. The evaluation device 100 in this example is provided in a private room booth where one (or in some cases two or more) subject 11 enters and performs work or the like in the space. Each space is partitioned from the outside by a partition wall in order to define a space that can accommodate subject 11. Thereby, since it becomes easy to define the position where subject 11 exists in the space, it becomes possible to easily optimize the arrangement of each component of the posture evaluation system 200 such as the imaging device 201.

[0063] In addition, furniture such as chairs and desks is arranged in the space of the private room booth. These pieces of furniture are configured to be displaceable according to the evaluation result of the posture of the subject 11. As an example, when the evaluation result of the posture of the subject 11 is relatively low and falls below the notification threshold, the furniture can be displaced to prompt a change in the posture. Also, it may be possible to infer from the estimated posture of the subject 11 that the position of the furniture is inappropriate. For example, when the subject 11 has a hunched back, it may be inferred that the arrangement of the work computer display is inappropriate. In this case, the chair may be displaced to utilize the lifting function of the chair among the furniture. Also, for example, when the subject 11 has a swayback, it may be inferred that the arrangement of the interface device of the work computer is inappropriate. In this case, the desk may be displaced to utilize the lifting function of the desk among the furniture.

[0064] In the posture evaluation system 200, the information stored in the storage unit 110 in advance is read out. The storage of information in the storage unit 110 will be described as already completed.

[0065] When it is determined that the subject 11 has not been detected, the posture evaluation system 200 repeats the determination until the subject 11 is detected. On the other hand, when the subject 11 is detected, the image output by the imaging device 201 is acquired by the first acquisition unit 101. Here, when it is detected that the subject 11 is stationary (in a stationary posture) in the acquired image, the posture of the subject 11 is estimated by the evaluation device 100. Specifically, the posture estimation unit 105 estimates the posture of the subject 11 based on the acquired image and calculates the posture feature amount. Next, based on the time acquired by the second acquisition unit 102, the cumulative time of the stationary posture of the subject 11 is measured. Next, it is determined whether or not the stationary state has been released based on whether or not the posture estimated by the posture estimation unit 105 has changed from a certain stationary posture.

[0066] When it is not determined that the stationary state has been released, the measurement of the cumulative time continues.

[0067] On the other hand, when it is determined that the stationary state has been released, the evaluation unit 108 evaluates the posture of the subject 11 by comparing the calculated posture feature amount in the posture of the subject 11 with the posture feature amounts corresponding to each of the plurality of stored reference postures. Since the evaluation of the posture has already been described as above, the description here is omitted. The evaluation unit 108 outputs the evaluation result of the posture. Thereafter, the same process is performed for the new posture.

[0068] For example, the subject 11 operates the operation terminal on the screen shown in FIG. 13 and presses the "View Analysis Results" button. Then, subsequent to the flowchart shown in FIG. 7, the pressing of the button is received as an instruction to display the evaluation result (step S41). The display unit 302 determines whether the number of accumulated frequency information already stored is less than a predetermined number (step S42). When it is determined that the number of accumulated frequency information already stored is less than the predetermined number (Yes in step S42), one of the plurality of screens for displaying the evaluation results is randomly selected (that is, not based on the frequency information) and displayed on the display device 205 (step S43). This is because it is difficult to select an appropriate screen (a screen that the subject 11 is interested in) for the subject 11 when the number of accumulated frequency information is not sufficient. In such a case, as described above, by randomly displaying the screen, it leads to obtaining frequency information for selecting an appropriate screen for the subject 11.

[0069] On the other hand, when it is determined that the number of accumulations of the frequency information already accumulated is equal to or greater than a predetermined number (No in step S42), one screen is selected from among the plurality of screens according to the priority order and displayed on the display device 205 (step S44). As shown in FIG. 14, the numerical result indicating the evaluation result is displayed on the display device 205. Here, the display unit 302 is displaying an image indicating the overall evaluation result of the posture. In the screen shown in FIG. 14, it is shown that the evaluation result is 72 percent, that is, 3.6 points, with respect to 5 points when there is no fatigue at all. Also, in the screen shown in FIG. 14, information on what postures the subject 11 has taken relatively frequently (in terms of the number of times or time) is displayed by a bar graph, and the characteristics of the posture of the subject 11 inferred from that tendency are displayed. Further, recommendation information such as advice is displayed for such posture characteristics. Thus, in the present embodiment, not only can the posture be simply evaluated numerically, but also the characteristics of the posture for each subject 11 can be analyzed to output useful information.

[0070] Returning to FIG. 7, as a result of displaying the screen, the frequency information of the subject 11 is generated by measuring from the number of times of viewing or the viewing time (step S45). When the frequency information is generated after step S44, it is useful to verify from the frequency information whether the displayed screen is appropriate and warm for the subject 11. Therefore, after step S45, it is verified whether the displayed screen was appropriate based on the generated frequency information (step S46). If step S43 is performed instead of step S44, step S46 may be skipped.

[0071] The display unit 302 acquires the ID information, and transmits the acquired ID information together with the generated frequency information to the storage unit 303 (so that the target person 11 corresponding to the frequency information can be identified) for newly storing (step S47). Further, the display unit 302 receives from the storage unit 303 information indicating a high-frequency screen based on a plurality of frequency information including past frequency information (step S48), and updates the priority so that the screen indicated by the received information has a high priority (step S49). Then, in the selection of the next screen, the screen according to the appropriate priority for the target person 11 after being updated as described above is selected and displayed. By repeating such a loop, it becomes possible to select and display an appropriate screen for the target person 11. In addition, on the screen shown in FIG. 14, an "End" button for ending the analysis is displayed. When the "End" button is pressed, various information acquired for the evaluation of the posture is deleted (cleared).

[0072] In the above description, an example has been described in which the priority is updated based on the frequency information, and the one with a higher rank is more likely to be displayed next in the updated priority. In the present embodiment, the display frequency can also be used instead of the priority. The display frequency indicates the frequency at which the screen is selected to be displayed, and in terms of the fact that the higher the display frequency, the more likely the screen is to be displayed, it is the same as the priority. On the other hand, when using the display frequency, instead of fixing the rank like the priority, since it is the ease of display with a certain degree of fluctuation called frequency, even if the display frequency is high, the screen is not necessarily displayed unless the display frequency reaches 100%. Therefore, if the sum of the display frequencies of each of the plurality of screens is set to 100%, for all the screens, while leaving the possibility of being displayed, the characteristic that the higher the display frequency, the more likely the screen is to be displayed can be utilized.

[0073] (Embodiment 2) Next, regarding Embodiment 2, differences from Embodiment 1 will be mainly described with reference to FIGS. 15 to 25, and descriptions of the same points as in Embodiment 1 will be omitted as appropriate. In Embodiment 2 described below, it is different from Embodiment 1 in that, while the screen to be displayed by the display unit 302 was one in Embodiment 1, two or more screens are to be displayed.

[0074] FIG. 15 is a flowchart showing a display method according to Embodiment 2. FIGS. 16 to 25 are diagrams showing examples of evaluation screens according to Embodiment 2. The flowchart shown in FIG. 15 is different from the flowchart shown in FIG. 7 in that step S46 is not performed. This is because in this embodiment, it does not make much sense to verify the displayed screen based on frequency information. Conversely, in this embodiment, frequency information for the next display can be obtained simultaneously for a plurality of screens used for display from the displayed screens. Specifically, in this embodiment, although the order is changed among themselves according to the priority, all the screens shown in FIGS. 16 to 25 are displayed. In the display device 205, an arbitrary portion can be displayed by performing an operation (such as a scroll operation) for displaying an arbitrary screen on the partially displayed screen.

[0075] The screen shown in FIG. 16 is a screen corresponding to the header (FIG. 16(a)) and the footer (FIG. 16(b)) among a plurality of screens. That is, these screens are always displayed at the first and last positions regardless of the priority. The screen shown in FIG. 17 is a screen showing the information that was displayed in the display example of the screen in FIG. 14 in another display format. The screen shown in FIG. 18 is a screen showing the fatigue state for each body part of the subject 11. The screen shown in FIG. 19 is a screen showing a playback button or the like for playing a pre-prepared video showing specifically what actions should be taken as advice.

[0076] Also, the screen shown in FIG. 20 is a screen showing the time-series change of the postures of each classification (the horizontal axis corresponds to time). Also, the screen shown in FIG. 21 is a screen showing the goodness or badness (circle and cross marks) of each of the five numbered items with respect to the working environment of the subject 11. Also, the screen shown in FIG. 22 is a screen showing the time-series change of the presence or absence (OK and NG) of muscle fatigue risk for each body part (here, the waist and neck) of the subject 11. Also, the screen shown in FIG. 23 is a screen showing the ratio of whether the subject 11 was within the camera's field of view (present and absent) within a certain period and the time-series change of whether the subject 11 was within the camera's field of view. Note that the information indicating whether the subject 11 was within the camera's field of view is determined based on the acquired image, and the determination result is also referred to as presence / absence information. If the time during which the subject 11 indicated by the presence / absence information was not within the field of view continues for a certain period or longer, the posture evaluation may be stopped and the screen may automatically return to the initial screen.

[0077] Also, the screen shown in FIG. 24 is a screen showing the ratio of whether the subject 11 was in a sitting posture or a standing posture (sitting and standing) within a certain period and the time-series change of whether the subject 11 was in a sitting posture or a standing posture. Also, the screen shown in FIG. 25 is a screen showing the ratio of the presence or absence (OK and NG) of overall or muscle fatigue risk for each body part of the subject 11 within a certain period.

[0078] Thus, in this embodiment where a plurality of screens are displayed, since the screens of interest (in other words, the screens that the user wants to display) are different for each subject 11, it is effective to determine the priority order for each subject 11 from the browsing history of the previously displayed screens so that an appropriate screen is displayed for each subject 11.

[0079] [Effects, etc.] As described above, the display system 300 in the first aspect is used in the posture evaluation system 200 that evaluates the posture of the subject 11 using the terminal operated by the subject 11 and the camera (imaging device 201) associated with the terminal, and is a display system 300 that displays the evaluation result of the posture. The posture evaluation system 200 includes an acquisition unit (first acquisition unit 101) that acquires an image captured by the camera after detecting the start of operation of the subject 11 by the terminal, and based on the acquired image, estimates the skeleton of the subject 11, and a posture evaluation unit (posture estimation unit 105 and evaluation unit 108) that evaluates the posture of the subject 11 from the estimated skeleton. The display system 300 includes a reception unit 301 that receives an instruction to display the evaluation result of the posture of the subject 11, a display unit 302 that displays one or more screens from among a plurality of screens for displaying the evaluation result of the posture of the subject 11, and a storage unit 303 that stores frequency information, which is information including the number of times the subject 11 has viewed the screens displayed in the past or the time the subject 11 has viewed the screens displayed in the past. The display unit 302 displays one or more screens based on the frequency information.

[0080] Such a display system 300 can display a screen based on the tendency of the number of times or the time viewed among the plurality of screens showing the evaluation results that the subject 11 has viewed in the past. For example, it is possible to display a screen that has been viewed a relatively large number of times or a screen that has been viewed for a relatively long time. That is, it is possible to display a screen that the subject 11 tends to view frequently. Therefore, the evaluation result of the fatigue level can be displayed more appropriately.

[0081] Also, the display system 300 in the second aspect is the display system 300 described in the first aspect, where the storage unit 303 is included in a server communicably connected to the terminal. The terminal includes a reception unit 301 and a display unit 302. By generating frequency information and transmitting it to the server, the frequency information is stored in the storage unit 303. After the reception unit 301 receives an instruction, the terminal receives, from the server, information indicating the screen with the most view times or the most view time in the stored frequency information. The display unit 302 updates the priority order so that the order of the screen indicated by the information is the most prioritized order among the received information indicating the screen with the most view times or the most view time, and displays one or more screens according to the updated priority order.

[0082] According to this, by communicating with the storage unit 303 provided in the server, frequency information can be stored. And by receiving information indicating the screen with the most view times or the most view time from the server, the priority order can be set so that the order of such a screen is the most prioritized. By determining and displaying the screen according to this priority order, the screen with the most view times or the most view time can be preferentially displayed.

[0083] Also, the display system 300 in the third aspect is the display system 300 described in the first aspect, where the storage unit 303 is included in a server communicably connected to the terminal. The terminal includes a reception unit 301 and a display unit 302. By generating frequency information and transmitting it to the server, the frequency information is stored in the storage unit 303. After the reception unit 301 receives an instruction, the terminal receives, from the server, information indicating the screen with the most view times or the most view time in the stored frequency information. The display unit 302 updates the display frequency so that the frequency of the screen indicated by the information is the highest frequency among the received information indicating the screen with the most view times or the most view time, and displays one or more screens according to the updated display frequency.

[0084] According to this, by communicating with the storage unit 303 provided in the server, frequency information can be stored. Then, by receiving information indicating the screen with the most viewing times or the most viewing time from the server, the display frequency can be set so that the frequency of such a screen becomes the highest frequency. By determining and displaying the screen according to this display frequency, it is possible to display the screen with the most viewing times or the most viewing time at a high frequency.

[0085] Further, the display system 300 in the fourth aspect is the display system 300 described in any one of the first to third aspects. When the number of stored frequency information stored in the storage unit 303 is less than a predetermined number, the display unit 302 randomly displays one or more screens without relying on the frequency information.

[0086] According to this, when the frequency information is less than a predetermined number and, for example, it is insufficient to grasp the viewing tendency of the subject 11, screens can be randomly displayed so that new frequency information for grasping the viewing tendency can be easily obtained.

[0087] Further, the display system 300 in the fifth aspect is the display system 300 described in any one of the first to fourth aspects. The frequency information is stored in association with the ID information for specifying the subject 11, and the ID information is obtained from a tag reader that reads the tag information of the subject 11 including the ID information.

[0088] According to this, the frequency information obtained from the tag reader that reads the tag information of the subject 11 including the ID information can be stored in association with the ID information. By being associated with the ID information, the frequency information can be classified and stored for each subject 11, so that a more personalized optimized screen display can be performed.

[0089] Also, the display system 300 in the sixth aspect is the display system 300 described in any one of the first to fifth aspects, wherein the frequency information is stored in association with the ID information for identifying the subject 11, and the ID information is obtained from a database that associates the face image of the subject 11 extracted from the acquired image with the ID information.

[0090] According to this, it is possible to accumulate the frequency information in association with the ID information obtained from a database that associates the face image of the subject 11 extracted from the acquired image with the ID information. By associating with the ID information, the frequency information can be classified and accumulated for each subject 11, so that a more personalized optimized screen display can be performed.

[0091] Also, the display system 300 in the seventh aspect is the display system 300 described in any one of the first to sixth aspects, wherein the frequency information is stored in association with the ID information for identifying the subject 11, and the ID information is obtained by the subject 11 inputting it.

[0092] According to this, it is possible to accumulate the frequency information in association with the ID information obtained by the subject 11 inputting it. By associating with the ID information, the frequency information can be classified and accumulated for each subject 11, so that a more personalized optimized screen display can be performed.

[0093] Also, the display system 300 in the eighth aspect is the display system 300 described in any one of the first to seventh aspects, wherein the frequency information is stored in association with the ID information for identifying the subject 11, candidates for the ID information are obtained from a database that associates the face image of the subject 11 extracted from the acquired image with the ID information, the candidates for the ID information obtained from the database are presented to the subject 11, the correctness of the presented candidates for the ID information is obtained, if the presented candidates for the ID information are correct, the candidates for the ID information are obtained as the ID information, and if the presented candidates for the ID information are incorrect, the ID information is obtained by accepting the input of the ID information by the subject 11.

[0094] According to this, by presenting candidate ID information obtained from a database that associates the face image of the subject 11 extracted from the acquired image with the ID information, depending on whether the candidate ID information is correct or not, the candidate ID information or the ID information obtained by the input of the subject 11 can be accumulated in association with frequency information. By being associated with the ID information, the frequency information can be classified and accumulated for each subject 11, so that a more personalized optimized screen display can be performed.

[0095] Also, the display system 300 in the ninth aspect is the display system 300 described in any one of the first to eighth aspects, wherein the frequency information is accumulated in association with the ID information for specifying the subject 11, and the ID information is obtained from a database that associates the beacon signal of the beacon transmitter owned by the subject 11 with the ID information.

[0096] According to this, the frequency information can be accumulated in association with the ID information obtained from a database that associates the beacon signal of the beacon transmitter owned by the subject 11 with the ID information. By being associated with the ID information, the frequency information can be classified and accumulated for each subject 11, so that a more personalized optimized screen display can be performed.

[0097] Also, the display system 300 in the tenth aspect is the display system 300 described in any one of the first to ninth aspects, wherein the frequency information is accumulated in association with the ID information for specifying the subject 11, and the ID information is obtained from the information stored in the personal terminal owned by the subject 11 used as a terminal.

[0098] According to this, the frequency information can be accumulated in association with the ID information obtained from the information stored in the personal terminal owned by the subject 11 used as a terminal. By being associated with the ID information, the frequency information can be classified and accumulated for each subject 11, so that a more personalized optimized screen display can be performed.

[0099] Also, the display method in the eleventh aspect is used in a posture evaluation system 200 that evaluates the posture of the subject 11 using a terminal operated by the subject 11 and a camera (imaging device 201) associated with the terminal, and is a display method for displaying the evaluation result of the posture executed by a computer. The posture evaluation system 200 includes an acquisition unit (first acquisition unit 101) that acquires an image captured by the camera after detecting the start of the operation of the subject 11 by the terminal, and a posture evaluation unit (posture estimation unit 105 and evaluation unit 108) that estimates the skeleton of the subject 11 based on the acquired image and evaluates the posture of the subject 11 from the estimated skeleton. The display method includes a step of receiving an instruction to display the evaluation result of the posture of the subject 11 (step S41), a step of displaying one or more screens from among a plurality of screens for displaying the evaluation result of the posture of the subject 11 (step S44), and a step of accumulating frequency information that is information including the number of times the subject 11 has viewed the screens displayed in the past or the time the subject has viewed the screens displayed in the past (step S47). In the step of displaying (step S44), one or more screens are displayed based on the frequency information.

[0100] According to this, the same effects as those of the display system 300 described above can be achieved.

[0101] Also, the program in the twelfth aspect is a program for causing a computer to execute the display method described in the eleventh aspect.

[0102] According to this, a computer can achieve the same effects as those of the display system 300 described above.

[0103] (Other Embodiments) Although the embodiments have been described above, the present disclosure is not limited to the above embodiments.

[0104] For example, in the above embodiments, the processing executed by a specific processing unit may be executed by another processing unit. Also, the order of a plurality of processes may be changed, or a plurality of processes may be executed in parallel.

[0105] In addition, the posture evaluation system or evaluation device in the present disclosure may be implemented by a plurality of devices each having a part of a plurality of components, or may be implemented by a single device having all of the plurality of components. Also, a part of the function of a component may be realized as the function of another component, and each function may be distributed to each component in any manner. The present disclosure includes any form having a configuration that includes all functions that can substantially realize the posture evaluation system or evaluation device of the present disclosure.

[0106] In the above embodiment, each component may be realized by executing a software program suitable for each component. Each component may be realized by a program execution unit such as a CPU or a processor reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory.

[0107] Also, each component may be realized by hardware. For example, each component may be a circuit (or an integrated circuit). These circuits may form one circuit as a whole, or may be separate circuits respectively. Also, these circuits may be general-purpose circuits or dedicated circuits respectively.

[0108] In addition, the general or specific aspect of the present disclosure may be realized by a system, a device, a method, an integrated circuit, a computer program, or a recording medium such as a computer-readable CD-ROM. Also, it may be realized by any combination of a system, a device, a method, an integrated circuit, a computer program, and a recording medium.

[0109] In the above embodiment, the posture of the target person is estimated from the image using the rigid body link model generated by image recognition, but the posture estimation method is not limited to this. Any existing method may be used as the method for estimating the posture of the target person from the image.

[0110] For example, in the posture estimation based on the above-described image, a method of combining measurement results by a pressure sensor may be applied to the content of the present application. The pressure sensor is a sensor having a detection surface, and measures the pressure applied to each of the unit detection surfaces that divide the detection surface into one or more. The pressure sensor measures the pressure for each unit detection surface in this way and outputs the pressure distribution on the detection surface. The pressure sensor is provided so that the subject is positioned on the detection surface. For example, the pressure sensor is provided on the seat surface and the backrest of the chair on which the subject sits. Also, for example, the pressure sensor may be provided with a marker on the detection surface, and the subject may be guided onto the detection surface by a display such as "Please sit on the marker". Further, by guiding the subject onto the detection surface of the pressure sensor provided on a part of the floor in this way, the pressure sensor may output the pressure distribution of the subject on the floor. The output pressure distribution is used, for example, to correct the estimated posture so that the bias is formed with respect to the posture estimated based on the image when a biased pressure is applied.

[0111] Further, the present disclosure may be realized as a posture evaluation method executed by a posture evaluation system or an evaluation device. The present disclosure may be realized as a program for causing a computer to execute such a fatigue estimation method, or may be realized as a computer-readable non-transitory recording medium on which such a program is recorded.

[0112] In addition, forms obtained by applying various modifications that can be conceived by those skilled in the art to the embodiments, or forms realized by arbitrarily combining the components and functions in each embodiment without departing from the spirit of the present disclosure are also included in the present disclosure.

Description of Reference Numerals

[0113] 11 Subject 11b Rigid Body Link Model 12 Chair 100 Evaluation Device 101 First Acquisition Unit (Acquisition Unit) 102 Second Acquisition Unit 103 Third Acquisition Unit 105 Posture estimation unit 108 Evaluation unit 109 Output unit 110 Memory unit 200 Posture evaluation system 201 Imaging device 202 Timing device 204 Reception device 205 Display device 206 Recovery device 300 Display system 301 Reception unit 302 Display unit 303 Storage unit

Claims

1. A display system used in a posture evaluation system that evaluates the posture of a subject using a terminal operated by the subject and a camera associated with the terminal, and that displays the evaluation result of the posture, comprising: The posture evaluation system includes: An acquisition unit that acquires an image captured by the camera after detecting the start of operation of the subject by the terminal; A posture evaluation unit that estimates the skeleton of the subject based on the acquired image and evaluates the posture of the subject from the estimated skeleton; The display system includes: A reception unit that receives an instruction to display the evaluation result of the posture of the subject; A display unit that displays one or more screens from a plurality of screens for displaying the evaluation result of the posture of the subject; A storage unit that stores frequency information, which is information including the number of times the subject has viewed the screens displayed in the past or the time the subject has viewed the screens displayed in the past; The display unit displays the one or more screens based on the frequency information Display system.

2. The storage unit is included in a server communicably connected to the terminal, The terminal includes the reception unit and the display unit, generates the frequency information, and transmits the frequency information to the server to store the frequency information in the storage unit, After the reception unit receives the instruction, the terminal receives, from the server, information indicating the screen with the most number of views or the longest viewing time in the stored frequency information The display unit updates the priority order so that the order of the screen indicated by the information becomes the most prioritized order among the information indicating the screen with the most number of views or the longest viewing time received, and displays the one or more screens according to the updated priority order The display system according to claim 1.

3. The storage unit is included in a server communicably connected to the terminal, The terminal includes the reception unit and the display unit, generates the frequency information, and transmits the frequency information to the server to store the frequency information in the storage unit, After the reception unit receives the instruction, the terminal receives, from the server, information indicating the screen with the most number of views or the longest viewing time in the stored frequency information The display unit updates the display frequency so that the frequency of the screen indicated by the information becomes the highest frequency among the information indicating the screen with the most number of views or the longest viewing time received, and displays the one or more screens according to the updated display frequency The display system according to claim 1.

4. When the number of accumulations of the frequency information accumulated in the accumulation unit is less than a predetermined number, the display unit randomly displays the one or more screens without relying on the frequency information. The display system according to claim 1.

5. The frequency information is accumulated in association with ID information for identifying the target person. The ID information is obtained from a tag reader that reads tag information of the target person including the ID information. The display system according to any one of claims 1 to 4.

6. The frequency information is accumulated in association with ID information for identifying the target person. The ID information is obtained from a database that associates a face image of the target person extracted from the acquired image with the ID information. The display system according to any one of claims 1 to 4.

7. The frequency information is accumulated in association with ID information for identifying the target person. The ID information is obtained by the target person inputting it. The display system according to any one of claims 1 to 4.

8. The frequency information is accumulated in association with ID information for identifying the target person. Candidate ID information is obtained from a database that associates a face image of the target person extracted from the acquired image with the ID information. The candidate ID information obtained from the database is presented to the target person, and the correctness of the presented candidate ID information is obtained. When the presented candidate ID information is correct, the candidate ID information is obtained as the ID information. When the presented candidate ID information is incorrect, the ID information is obtained by accepting input of the ID information by the target person. The display system according to any one of claims 1 to 4.

9. The frequency information is accumulated in association with ID information for identifying the target person. The ID information is obtained from a database that associates a beacon signal of a beacon transmitter owned by the target person with the ID information. The display system according to any one of claims 1 to 4.

10. The frequency information is accumulated in association with ID information for identifying the target person. The ID information is obtained from information stored in a personal terminal owned by the target person used as the terminal. The display system according to any one of claims 1 to 4.

11. A display method for displaying an evaluation result of a posture, which is used in a posture evaluation system for evaluating a posture of a subject using a terminal operated by the subject and a camera associated with the terminal, and is executed by a computer, comprising: The posture evaluation system includes: An acquisition unit that acquires an image captured by the camera after detecting the start of operation of the subject by the terminal; A posture evaluation unit that estimates the skeleton of the subject based on the acquired image and evaluates the posture of the subject from the estimated skeleton; The display method includes: Receiving an instruction to display an evaluation result of the posture of the subject; Displaying one or more screens from a plurality of screens for displaying the evaluation result of the posture of the subject; Accumulating frequency information, which is information including the number of times the subject has viewed the screens displayed in the past or the time the subject has viewed the screens displayed in the past; In the step of displaying, the one or more screens are displayed based on the frequency information Display method.

12. A program for causing the computer to execute the display method according to Claim 11 Program.

Images