Information processing system and information processing method

Abstract

To provide an information processing system and an information processing method capable of performing more appropriate display according to a fatigue state of eyes of a user.SOLUTION: An information processing system includes a fatigue level analysis unit configured to analyze a fatigue level of an eye of a user on the basis of an image of the user captured by an imaging unit, a burden level analysis unit configured to analyze a burden level on the eye due to an output content to be output, and a display control unit configured to determine at least one of a display content and a display mode in a display unit on the basis of the fatigue level analyzed by the fatigue level analysis unit and the burden level analyzed by the burden level analysis unit.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to an information processing system and an information processing method. [Background technology]

[0002] Conventionally, there are known display technologies that take visual fatigue into consideration. For example, Patent Document 1 discloses a VR (Virtual Reality) program that, when a transition to a break time occurs, displays a message indicating that it is break time, thereby encouraging the user to take a break. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2017-91423 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the technology disclosed in Patent Document 1 displays a screen encouraging the user to rest based on a time interval set by the user, so the criteria for determining fatigue are limited to the time interval set by the user, and there is room for improvement in determining user fatigue.

[0005] Furthermore, the technique disclosed in Patent Document 1 is limited to taking a break as a countermeasure against fatigue, and therefore does not consider methods of reducing fatigue other than taking a break.

[0006] The present disclosure has been made in view of the above-mentioned problems, and an object of the present disclosure is to provide an information processing system and an information processing method that are capable of providing a more appropriate display in accordance with the user's eye fatigue state. [Means for solving the problem]

[0007] An information processing system according to one embodiment of the present disclosure includes a fatigue analysis unit that analyzes the degree of eye fatigue of a user based on an image of the user captured by an imaging unit, a strain analysis unit that analyzes the degree of eye strain caused by output content that is output, and a display control unit that determines at least one of the display content and the display mode on a display unit based on the fatigue level analyzed by the fatigue analysis unit and the strain level analyzed by the strain analysis unit.

[0008] An information processing method according to one embodiment of the present disclosure is an information processing method executed by an information processing system, which analyzes the degree of eye fatigue of a user based on an image of the user captured by a capture unit, analyzes the degree of eye strain caused by output content to be output, and determines at least one of the display content and display mode on a display unit based on the analyzed degree of fatigue and the analyzed degree of strain. [Effects of the Invention]

[0009] According to the present disclosure, it is possible to provide an information processing system and an information processing method that are capable of providing a more appropriate display depending on the user's eye fatigue state. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is a functional block diagram illustrating a schematic configuration of an information processing system according to an embodiment. [Figure 2] 2 is a functional block diagram showing a schematic configuration of a burden level analysis unit in FIG. 1. FIG. [Figure 3] FIG. 10 is a diagram illustrating an example of data stored in a burden level database. [Figure 4] FIG. 10 is a diagram illustrating an example of data stored in a burden level database. [Figure 5] 2 is a functional block diagram showing a schematic configuration of a display content determination unit in FIG. 1. FIG. [Figure 6] FIG. 10 is a diagram illustrating an example of a table used to determine a recommendation list. [Figure 7] 2 is a functional block diagram showing a schematic configuration of a display mode determination unit in FIG. 1. FIG. [Figure 8] 10 is a flowchart illustrating an example of processing executed by the video display device. [Figure 9] 10 is a flowchart illustrating an example of a process executed by a display content determination unit. [Figure 10] FIG. 10 is a functional block diagram showing a schematic configuration of a burden level analysis unit according to a second embodiment. [Figure 11] FIG. 11 is a diagram showing an example of a table that is referred to when a burden calculation unit according to the second embodiment calculates a burden. [Figure 12] FIG. 11 is a functional block diagram showing a schematic configuration of a burden level analysis unit according to a third embodiment. [Figure 13] FIG. 10 is a functional block diagram showing a schematic configuration of a burden level analysis unit according to a fourth embodiment. [Figure 14] 10 is a flowchart illustrating an example of a process for displaying a determination image when the power is turned on. [Figure 15] 10 is a flowchart showing an example of processing in the case where a determination image is displayed when content is switched. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, several embodiments of the present disclosure will be described with reference to the drawings. In the drawings, identical or equivalent components are denoted by the same reference numerals, and redundant descriptions of identical or equivalent components will be omitted as appropriate.

[0012] [First embodiment] FIG. 1 is a functional block diagram showing a schematic configuration of an information processing system 1 according to one embodiment. In the example shown in FIG. 1, the information processing system 1 is configured by an image display device 10 capable of displaying images. The image display device 10 is any device equipped with a display unit 16 capable of displaying images, and is, for example, a television receiver or a terminal device such as a computer or a smartphone. In this embodiment, the image display device 10 will be described as a television receiver capable of outputting content including images.

[0013] 1, video display device 10 includes, as functional units, an imaging unit 11, a fatigue level analysis unit 12, a content input unit 13, a strain level analysis unit 14, a display control unit 15, and a display unit 16. Fatigue level analysis unit 12, strain level analysis unit 14, and display control unit 15 perform various controls, for example, by running a control program stored in a storage unit (not shown). Fatigue level analysis unit 12, strain level analysis unit 14, and display control unit 15 can be configured to include a control device such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit).

[0014] The information processing system 1 does not necessarily have to be configured by a single device such as the video display device 10, but may be configured by, for example, a plurality of devices capable of communicating information with each other. In this case, it is sufficient that each functional unit shown in Fig. 1 is included in at least one of the plurality of devices.

[0015] The photographing unit 11 is a device that photographs images, and is configured, for example, by a known camera. The photographing unit 11 is disposed in a position where it can photograph a user viewing an image displayed on the display unit 16 of the image display device 10. For example, the photographing unit 11 is disposed so as to be able to photograph the front side of the display unit 16. The front side of the display unit 16 is the side on which the image on the display unit 16 is displayed, and therefore the side on which the user is positioned when viewing the image displayed on the display unit 16. The photographing unit 11 may be built into the image display device 10 or may be externally attached. The photographing unit 11 outputs data of the photographed image to the fatigue level analysis unit 12.

[0016] The fatigue analysis unit 12 analyzes the user's eye fatigue level based on the image of the user captured by the imaging unit 11. The fatigue analysis unit 12 can output the analysis result in any manner. For example, the fatigue analysis unit 12 outputs the analysis result as a numerical value. As an example, the fatigue analysis unit 12 outputs the user's eye fatigue level as a numerical value from 0 to 100. Alternatively, the fatigue analysis unit 12 outputs the analysis result by indicating which of a plurality of pre-classified fatigue levels the user's eye fatigue level falls under. As an example, three levels of fatigue level are defined, and the fatigue analysis unit 12 outputs the fatigue level by indicating which of the three levels the user's eye fatigue level falls under. In this embodiment, the fatigue analysis unit 12 outputs the eye fatigue level by indicating which of the three levels, "low," "medium," or "high," the eye fatigue level falls under.

[0017] The fatigue level analysis unit 12 may analyze the user's fatigue level by performing image analysis using a known method on the image of the user captured by the imaging unit 11. The fatigue level analysis unit 12 analyzes the user's fatigue level based on the results of the image analysis using, for example, one or more of the following as criteria: eyelid movement, whether or not the eyes are bloodshot, gaze, amount of tears, number of blinks, time for which the eyes are closed, size of open eyes, facial expression, and posture.

[0018] For example, the fatigue level analysis unit 12 determines that the slower the movement of the user's eyelids is, the higher the fatigue level is. For example, the fatigue level analysis unit 12 determines that the user's eyes are bloodshot when the user's eyes are bloodshot. For example, the fatigue level analysis unit 12 determines that the longer the user's gaze is directed toward the display unit 16, the higher the fatigue level is. For example, the fatigue level analysis unit 12 determines that the less tears the user's eyes produce, the higher the fatigue level is. For example, the fatigue level analysis unit 12 determines that the more frequently the user blinks, the higher the fatigue level is. For example, the fatigue level analysis unit 12 determines that the longer the user's eyes are closed, the higher the fatigue level is. For example, the fatigue level analysis unit 12 determines that the smaller the user's eye opening is, the higher the fatigue level is. For example, the fatigue level analysis unit 12 determines that the user's fatigue level is high when the user's facial expression is gloomy or when the user's posture is poor. However, the determination criteria shown here are merely examples, and other determination criteria may be used.

[0019] The content input unit 13 receives, from the outside, input of content including video to be displayed on the display unit 16. For example, the content input unit 13 receives, from the outside, a signal of content such as a broadcast program broadcast by terrestrial digital broadcasting or a broadcast program broadcast by satellite broadcasting. The content input unit 13 outputs the received content signal to the burden level analysis unit 14.

[0020] The strain analysis unit 14 analyzes the strain on the eyes caused by the content output from the video display device 10 (hereinafter also referred to as "output content"). For example, the output content is content received by the content input unit 13. The strain analysis unit 14 can output the analysis result in any manner. For example, the strain analysis unit 14 outputs the analysis result as a numerical value or in multiple stages. Details of an example of analysis by the strain analysis unit 14 will be described later with reference to Figures 2 to 4.

[0021] The display control unit 15 controls the display on the display unit 16. For example, based on a predetermined operation input by a user, the display control unit 15 displays an image corresponding to the operation input on the display unit 16. The operation input may be, for example, via an operation button, keyboard, or touch sensor (not shown) provided on the image display device 10, or via a remote controller for remotely operating the image display device 10.

[0022] In this embodiment, the display control unit 15 determines at least one of the display content and the display mode on the display unit 16 based on the fatigue level analyzed by the fatigue level analysis unit 12 and the burden level analyzed by the burden level analysis unit 14. Details of how the display control unit 15 determines the display content and the display mode will be described later.

[0023] The display unit 16 is a device that displays images. The display unit 16 is configured with a well-known display such as a liquid crystal display (LCD), an organic electro-luminescence display (ELD), or an inorganic electro-luminescence display (IELD). The display unit 16 displays images based on the control of the display control unit 15.

[0024] Fig. 2 is a functional block diagram showing a schematic configuration of the burden level analysis unit 14. In this embodiment, as shown in Fig. 2, the burden level analysis unit 14 includes, as functional units, a content information acquisition unit 141, a burden level calculation unit 142, and a burden level database 143.

[0025] The content information acquisition unit 141 acquires a content signal from the content input unit 13. Based on the acquired content signal, the content information acquisition unit 141 outputs information about the content itself to the display control unit 15. Furthermore, based on the acquired content signal, the content information acquisition unit 141 outputs data necessary for calculating the burden level of the content to the burden level calculation unit 142.

[0026] In this embodiment, the content information acquisition unit 141 outputs metadata including information about the content to the burden level calculation unit 142 as data necessary for calculating the burden level of the content. For example, the content information acquisition unit 141 outputs metadata including the genre or name of the content to the burden level calculation unit 142 as information about the content. The genre is a classification indicating the nature of the content. The name is a name given to the content, such as the title of the work or program of the content.

[0027] The burden level calculation unit 142 calculates the burden level of the content on the eyes based on the metadata acquired from the content information acquisition unit 141. In this embodiment, the burden level calculation unit 142 analyzes the burden level based on the genre or name of the output content. In this embodiment, the burden level calculation unit 142 calculates the burden level by referring to data stored in the burden level database 143.

[0028] The burden level database 143 is a storage device that stores data used for calculating the burden level by the burden level calculation unit 142. The burden level database 143 can be configured, for example, by a semiconductor memory or a magnetic memory. Specifically, the burden level database 143 can be configured, for example, by an EEPROM (Electrically Erasable Programmable Read-Only Memory).

[0029] In this embodiment, the burden level database 143 stores a table indicating the relationship between the genre or name of content and the degree of eye strain. Figures 3 and 4 are diagrams showing examples of data stored in the burden level database 143. Specifically, Figure 3 is a table indicating the relationship between the genre of content and the degree of eye strain, and Figure 4 is a table indicating the relationship between the name of content and the degree of eye strain. The burden level database 143 stores, for example, at least one of the tables shown in Figures 3 and 4.

[0030] In this embodiment, the degree of strain on the eyes is divided into three stages: Stage I is the lowest strain, Stage II is the next lowest strain after Stage I, and Stage III is the highest strain.

[0031] The table shown in FIG. 3 shows the relationship between content genres and levels of eye strain. For example, the "news / reporting" genre is associated with level I of strain. Similarly, for example, the "sports" genre is associated with level III of strain. As shown in FIG. 3, some genres may be associated with multiple levels. For example, in the example shown in FIG. 3, the "movies" genre is associated with levels II and III of strain.

[0032] The table shown in Figure 4 shows the relationship between the name of content and the level of eye strain. For example, content named "Action A" is associated with a level of strain III. Similarly, content named "Quiz Show B" is associated with a level of strain I.

[0033] The burden level calculation unit 142 calculates the eye strain of the content by referring to the table shown in FIG. 3 or 4 based on the metadata acquired from the content information acquisition unit 141. For example, it is assumed that the metadata of the content acquired from the content information acquisition unit 141 indicates the genre of "drama." In this case, the burden level calculation unit 142 refers to the table of FIG. 3 stored in the burden level database 143. In the table of FIG. 3, the genre of "drama" is associated with a strain level of Level II. Therefore, the burden level calculation unit 142 calculates the eye strain of the content related to the metadata to be Level II. Similarly, it is assumed that the metadata of the content acquired from the content information acquisition unit 141 indicates the title of "Opera H." In this case, the burden level calculation unit 142 refers to the table of FIG. 4 stored in the burden level database 143. In the table of FIG. 4, the title of "Opera H" is associated with a strain level of Level I. Therefore, the burden level calculation unit 142 calculates the eye strain of the content related to the metadata to be Level I.

[0034] The strain calculation unit 142 does not necessarily need to calculate the strain on the eyes by referring to a table. For example, the strain calculation unit 142 may calculate the strain on the eyes by using a predetermined calculation algorithm stored in the strain database 143.

[0035] The strain level calculation unit 142 outputs information on the calculated strain level on the eyes to the display control unit 15. The display control unit 15 determines at least one of the display content and the display mode on the display unit 16 based on the fatigue level analyzed by the fatigue level analysis unit 12 and the strain level analyzed by the strain level analysis unit 14.

[0036] Here, a specific example of a method for determining the display content and display mode by the display control unit 15 will be described. As shown in Fig. 1, the display control unit 15 has, as functional blocks, a display content determination unit 151 and a display mode determination unit 152. The display content determination unit 151 determines the display content, and the display mode determination unit 152 determines the display mode. Therefore, when determining only one of the display content and the display mode, the display control unit 15 may have only one of the display content determination unit 151 and the display mode determination unit 152 depending on the target to be determined.

[0037] Fig. 5 is a functional block diagram showing a schematic configuration of the display content determination unit 151. As shown in Fig. 5, the display content determination unit 151 includes a content list acquisition unit 153, a burden level acquisition unit 154 for currently outputted content, a burden level acquisition unit 155 for other content, and a recommendation list determination unit 156.

[0038] The content list acquisition unit 153 acquires a content list indicating a list of contents that can be output from the video display device 10. The contents included in the content list can be handled as output contents because they can be output from the video display device 10. The content list acquisition unit 153 may acquire the content list from outside the video display device 10 via communication, for example, or may acquire a content list indicating a list of contents stored in a storage unit (not shown).

[0039] The content list includes all or part of the content that can be output from the video display device 10. The content included in the content list may be determined, for example, based on the user's content viewing history. For example, the content included in the content list may be content related to the content the user is currently viewing or content that the user has viewed in the past (hereinafter also referred to as "related content"). The related content may be determined, for example, by an external device or the video display device 10 using a known method. The related content may be, for example, content in the same or similar genre as the content included in the viewing history, or other content viewed by another user who viewed the content included in the viewing history. In this embodiment, the content list is assumed to be a list of related content.

[0040] The content list may include metadata including the genre or name of the related content. The content list acquisition unit 153 outputs the acquired content list to the other content burden level acquisition unit 155 and the recommendation list determination unit 156.

[0041] The currently output content burden level acquisition unit 154 acquires the burden level of the content currently being output from the video display device 10 (hereinafter also referred to as "currently output content"). The content currently being output from the video display device 10 is the content whose video is being displayed on the display unit 16. Specifically, the burden level analysis unit 14 analyzes the burden level of the currently output content by the method described with reference to FIG. 2, and outputs the analysis result to the currently output content burden level acquisition unit 154. For example, as in the above example, the burden level analysis unit 14 outputs the burden level of the currently output content by indicating it in three stages, from stage I to III. The currently output content burden level acquisition unit 154 outputs the acquired burden level of the currently output content to the recommendation list determination unit 156.

[0042] The other content burden level acquisition unit 155 outputs metadata of the related content included in the content list to the burden level analysis unit 14 based on the content list acquired from the content list acquisition unit 153. In this case, the burden level analysis unit 14 analyzes the burden levels of the content included in the content list (i.e., the related content) using the same method as that described with reference to FIG. 2. The burden level analysis unit 14 outputs the analysis result of the burden levels of the related content to the other content burden level acquisition unit 155. The other content burden level acquisition unit 154 acquires the burden levels of the related content from the burden level analysis unit 14. The other content burden level acquisition unit 155 outputs the acquired burden levels of the related content to the recommendation list determination unit 156.

[0043] The recommendation list determination unit 156 determines a recommendation list based on the content list acquired from the content list acquisition unit 153, the burden level of related content acquired from the other content burden level acquisition unit 155, and the eye fatigue level acquired from the fatigue level analysis unit 12. The recommendation list is a list of content that is recommended for viewing by the user from among the content included in the content list. Since the recommendation list determination unit 156 determines the recommendation list based on the eye fatigue level, in this embodiment, the recommendation list is a list of content that is recommended for viewing from among the related content in accordance with the eye fatigue level.

[0044] The recommendation list determination unit 156 determines the recommendation list by, for example, narrowing down the content list acquired from the content list acquisition unit based on the burden level and eye fatigue level of the related content. Specifically, the recommendation list determination unit 156 determines, as the recommendation list, a list of content included in the content list whose burden level is equal to or less than a reference value determined according to the fatigue level. The recommendation list is an example of display content to be displayed on the display unit 16. Therefore, the recommendation list determination unit 156 determines, as the display content, a list of content included in the content list whose burden level is equal to or less than a reference value determined according to the fatigue level.

[0045] For example, the recommendation list determination unit 156 determines the recommendation list by referring to an algorithm or a table stored in a storage unit (not shown). FIG. 6 is a diagram showing an example of a table used to determine the recommendation list. The table shown in FIG. 6 shows a correspondence relationship between the degree of eye fatigue and the refinement content. The refinement content corresponds to a "reference value" in this embodiment. As shown in FIG. 6, the refinement content is determined in accordance with the degree of eye fatigue, and therefore the reference value is determined according to the degree of eye fatigue.

[0046] For example, the narrowing down content "no change" is associated with a "low" level of eye fatigue. This means that when the level of eye fatigue acquired from the fatigue level analysis unit 12 is "low," the recommendation list determination unit 156 makes no changes to the content list acquired from the content list acquisition unit. Therefore, when the level of eye fatigue acquired from the fatigue level analysis unit 12 is "low," the recommendation list determination unit 156 determines the content list acquired from the content list acquisition unit as the recommendation list as is. In other words, when the level of eye fatigue is "low," the reference value is stage III, and the recommendation list determination unit 156 includes all content in stages I to III that are equal to or less than the reference value in the recommendation list.

[0047] For example, the narrowing content "exclude level III" is associated with a level of eye fatigue "medium." This means that when the level of eye fatigue acquired from the fatigue level analysis unit 12 is "medium," the recommendation list determination unit 156 excludes, from the content included in the content list acquired from the content list acquisition unit, content whose burden level among the related content acquired from the other content burden level acquisition unit 155 is level III. Therefore, when the level of eye fatigue acquired from the fatigue level analysis unit 12 is "medium," the recommendation list determination unit 156 excludes content whose burden level is level III from the content included in the content list acquired from the content list acquisition unit, and determines the list of remaining content as the recommendation list. In other words, when the level of eye fatigue is "medium," the reference value is level II, and the recommendation list determination unit 156 includes, in the recommendation list, content whose burden level is level II or lower (i.e., level I and level II) that is equal to or lower than the reference value. In this way, when the level of eye fatigue is "medium," the recommendation list determination unit 156 can exclude content at level III, which has the highest level of eye strain, and include related content with a level of eye strain below a predetermined level in the recommendation list that is recommended for viewing.

[0048] For example, the narrowing content "Exclude Level II and Level III" is associated with the level of eye fatigue "high." This means that when the level of eye fatigue acquired from the fatigue level analysis unit 12 is "high," the recommendation list determination unit 156 excludes, from the content included in the content list acquired from the content list acquisition unit, content whose burden levels of related content acquired from the other content burden level acquisition unit 155 are Level II and Level III. Therefore, when the level of eye fatigue acquired from the fatigue level analysis unit 12 is "high," the recommendation list determination unit 156 excludes content whose burden levels are Level II and Level III from the content included in the content list acquired from the content list acquisition unit, and determines a list of the remaining content (i.e., content whose burden level is Level I in this example) as the recommendation list. In other words, when the level of eye fatigue is "high," the reference value is Level I, and the recommendation list determination unit 156 includes content whose burden level is Level I or less (i.e., only Level I) that is equal to or less than the reference value in the recommendation list. In this way, when the degree of eye fatigue is "high," the recommendation list determination unit 156 can include only the content of level I, which has the lowest degree of strain on the eyes, in the recommendation list that is recommended for viewing.

[0049] The recommendation list determination unit 156 may further determine a recommendation list by performing different narrowing down depending on the source of the content list. The source of the content list is a device that provided the content list to the content list acquisition unit 153. Therefore, the recommendation list determination unit 156 performs different narrowing down depending on, for example, whether the content list is provided from outside the video display device 10 or from a storage unit (not shown) within the video display device 10. As an example, when the content list is provided from outside the video display device 10, the recommendation list determination unit 156 performs narrowing down using the table shown in FIG. 6, and when the content list is provided from a storage unit within the video display device 10, the recommendation list determination unit 156 performs narrowing down using a table different from the table shown in FIG. 6. In the different table, for example, the narrowing down content associated with the level of eye fatigue of "low" in the table of FIG. 6 can be set to "hide." In this case, the recommendation list determination unit 156 determines not to display the recommendation list if the content list is provided from a memory unit within the video display device 10 and the eye fatigue level obtained from the fatigue level analysis unit 12 is "low."

[0050] Furthermore, the recommendation list determination unit 156 may further narrow down the list based on the burden level of the currently output content acquired from the currently output content burden level acquisition unit 154.

[0051] The above-described method for determining the recommendation list is an example, and the recommendation list determination unit 156 may determine the recommendation list by narrowing down the content list using other methods based on the degree of burden and the degree of eye fatigue.

[0052] The recommendation list determination unit 156 displays the determined recommendation list on the display unit 16. By displaying the recommendation list on the display unit 16, the user can know the content that is recommended based on the degree of eye fatigue. By viewing the content included in the recommendation list, the user can continue viewing the content while reducing eye strain.

[0053] The recommendation list may be displayed on the display unit 16 at an appropriate timing. For example, the recommendation list is displayed on the display unit 16 when the content currently being output has finished. For example, the recommendation list is displayed on the display unit 16 in response to a predetermined operation input by the user. The predetermined operation input may be an operation input for displaying the recommendation list, or an operation input for stopping the content currently being output. For example, the recommendation list is displayed on the display unit 16 when a certain amount of time has passed since the user watched the content. The timing at which the recommendation list is displayed is not limited to the example shown here, and may be an appropriate timing.

[0054] 7 is a functional block diagram showing a schematic configuration of the display mode determination unit 152. As shown in FIG. 7, the display mode determination unit 152 includes a fatigue level acquisition unit 157, a burden level acquisition unit 158, a control table 159, and a display mode determination unit 160.

[0055] The fatigue level acquisition unit 157 acquires the fatigue level as the analysis result from the fatigue level analysis unit 12. The fatigue level acquisition unit 157 outputs the acquired fatigue level to the display mode determination unit 160.

[0056] The burden level acquisition unit 158 ​​acquires the burden level as the analysis result from the burden level analysis unit 14. The burden level acquisition unit 158 ​​outputs the acquired burden level to the display mode determination unit 160.

[0057] The control table 159 is a table that defines the relationship between the fatigue level and / or the burden level and the display mode.

[0058] The display mode determination unit 160 determines the display mode on the display unit 16 based on the fatigue level acquired from the fatigue level acquisition unit 157 and the burden level acquired from the burden level acquisition unit 158, with reference to the control table 159.

[0059] For example, when the degree of fatigue or the degree of strain is equal to or greater than a threshold, the display mode determination unit 160 determines the display mode to be one that places less strain on the eyes. In this embodiment, the threshold is indicated by a stage. Specifically, in this embodiment, the threshold for the degree of fatigue is indicated as one of "low," "medium," and "high," and the degree of strain is indicated as one of Stage I, Stage II, and Stage III.

[0060] The display mode determination unit 160 can adjust the image quality or screen to reduce eye strain. For example, the display mode determination unit 160 can reduce the brightness, contrast, or color temperature of the screen to reduce eye strain. The display mode determination unit 160 may also reduce the frame rate of the content to be displayed to reduce eye strain. The display mode determination unit 160 can also adjust other parameters as appropriate to reduce eye strain.

[0061] When the degree of fatigue or strain is equal to or greater than a threshold, the display mode determination unit 160 may determine the display content on the display unit 16 to be content that suggests viewing of content that places less strain on the eyes. Alternatively, the display mode determination unit 160 may determine the display content on the display unit 16 to be content that recommends stopping the content.

[0062] The display mode determination unit 160 can execute these determination processes by referring to the control table 159. The display mode determination unit 160 may change the timing of changing the display mode depending on whether content is being output from the display unit 16. For example, if content is being output, the display mode determination unit 160 may change the display mode immediately upon determining to change the display mode. For example, if content is not being output, the display mode determination unit 160 may change the display mode before the next content is output upon determining to change the display mode. Furthermore, the display mode determination unit 160 may, for example, recommend stopping the content when content is being output, and may suggest viewing content that puts less strain on the eyes when content is not being output.

[0063] 8 is a flowchart showing an example of processing executed by the video display device 10. First, the fatigue level analysis unit 12 analyzes the degree of eye fatigue of the user (step S11). Then, the strain level analysis unit 14 analyzes the degree of eye strain caused by the content (step S12). Steps S11 and S12 do not necessarily have to be executed in the order shown in FIG. 8. For example, the degree of eye strain caused by the content may be analyzed, and then the degree of eye fatigue of the user may be analyzed. Furthermore, these two analyses may be executed in parallel.

[0064] When the analysis in steps S11 and S12 is completed, the display control unit 15 determines the display mode and / or display content based on the analysis results (step S13). The display mode and the method for determining the display mode are as described with reference to Figs. 7 and 5, respectively. The display control unit 15 displays on the display unit 16 in the determined display mode and / or display content (step S14).

[0065] 9 is a flowchart showing an example of processing executed by the display content determination unit 151. First, the content list acquisition unit 153 acquires a content list from an external device or from a storage unit of the video display device 10 (step S21). Next, the strain level analysis unit 14 analyzes the degree of eye strain caused by the content (related content) in the content list (step S22). Furthermore, the fatigue level analysis unit 12 analyzes the degree of eye fatigue of the user (step S23). Steps S21, S22, and S23 do not necessarily have to be performed in the order shown in FIG. 9. For example, the degree of eye strain caused by the content may be analyzed first, and then the degree of eye strain caused by the related content may be analyzed. Furthermore, these two analyses may be performed in parallel.

[0066] Next, the recommendation list determination unit 156 determines a recommendation list based on the content list acquired in step S21, the burden level analyzed in step S22, and the eye fatigue level analyzed in step S23 (step S24). A specific method for determining a recommendation list is as described with reference to Fig. 5. The recommendation list determination unit 156 displays the determined recommendation list on the display unit 16 (step S25).

[0067] [Second embodiment] 10 is a functional block diagram showing a schematic configuration of the burden level analysis unit 14 according to the second embodiment. In the second embodiment, the configuration of the information processing system 1 is the same as in the first embodiment, but the configuration of the burden level analysis unit 14 is different from that in the first embodiment. Below, the second embodiment will be described mainly focusing on the differences, with the same points as in the first embodiment being omitted as appropriate.

[0068] 10, the burden level analysis unit 14 according to the second embodiment includes, as functional units, a content information acquisition unit 141, a burden level calculation unit 142, and a video analysis unit 144. In this embodiment, the burden level analysis unit 14 analyzes the burden level based on the result of the video analysis of the output content.

[0069] The content information acquisition unit 141 acquires a content signal from the content input unit 13. Based on the acquired content signal, the content information acquisition unit 141 outputs information about the content itself to the display control unit 15. Furthermore, based on the acquired content signal, the content information acquisition unit 141 outputs data about the video of the content to the video analysis unit 144.

[0070] The video analysis unit 144 performs video analysis of the content based on data related to the video of the content. The video analysis unit 144 can perform video analysis using a known method. For example, the video analysis unit 144 analyzes elements of the video of the content, such as changes in brightness, the number of flashes, saturation, color usage, and the speed of movement of objects included in the video. The elements analyzed by the video analysis unit 144 are not limited to the examples shown here. The video analysis unit 144 quantifies, for example, each of these elements through the video analysis. The video analysis unit 144 outputs the analysis results to the burden level calculation unit 142.

[0071] The burden level calculation unit 142 calculates the burden level of the content on the eyes based on the analysis result acquired from the video analysis unit 144. The burden level calculation unit 142 calculates the burden level by, for example, referring to a table stored in a storage unit (not shown).

[0072] Fig. 11 is a diagram showing an example of a table that is referred to when the burden calculation unit according to the second embodiment calculates the burden. The table shown in Fig. 11 shows the relationship between the image content and the eye burden. For example, the image content of "small change in luminance" is associated with a burden level of stage I. Similarly, the image content of "large change in luminance" is associated with a burden level of stage III.

[0073] The burden level calculation unit 142 analyzes the burden level based on the result of the video analysis of the output content. In this embodiment, the burden level calculation unit 142 analyzes the burden level based on the result of the video analysis by referring to the table in FIG. 11. For example, the burden level calculation unit 142 acquires a numerical value related to a luminance change in the video of the output content from the video analysis unit 144 as a result of the video analysis. The burden level calculation unit 142 determines whether the video corresponds to a "small luminance change" or a "large luminance change" based on the numerical value related to the luminance change. For example, a threshold value related to the luminance change is set in advance, and the burden level calculation unit 142 determines that the video corresponds to a "small luminance change" when the numerical value related to the luminance change in the video of the output content is less than the threshold, and that the video corresponds to a "large luminance change" when the numerical value is equal to or greater than the threshold. The threshold value is stored in, for example, a storage unit (not shown).

[0074] When the burden calculation unit 142 determines that the video falls under the category of "small change in luminance", it refers to the table shown in Fig. 11 and determines that the degree of strain on the eyes caused by the video is stage I, which corresponds to "small change in luminance". Similarly, when the burden calculation unit 142 determines that the video falls under the category of "large change in luminance", it refers to the table shown in Fig. 11 and determines that the degree of strain on the eyes caused by the video is stage III, which corresponds to "large change in luminance".

[0075] 11, the table also defines associations between video content and eye strain for other elements. For example, "low blinking" and "high blinking" are defined for the number of blinks in the video, "low saturation," "medium saturation," and "high saturation" are defined for the saturation of the video, "monotone color," "fluorescent color," and "complementary color" are defined for the color usage, and "low movement speed" and "high movement speed" are defined for the movement speed. The strain calculation unit 142 can determine the level of eye strain for other elements using a method similar to that for the luminance change described above.

[0076] The strain calculation unit 142 makes a determination on one or more of the above-mentioned elements and outputs the determination result as a calculation result of the strain on the eyes to the display control unit 15. When the strain calculation unit 142 makes a determination on two or more of the above-mentioned elements, the strain calculation unit 142 may calculate the strain on the eyes of the output content by, for example, applying a predetermined weighting to the determination result of each element. Furthermore, the strain calculation unit 142 may calculate the strain on the eyes using other elements, not limited to the above-mentioned elements.

[0077] The display control unit 15 determines at least one of the display content and the display mode on the display unit 16 based on the fatigue level analyzed by the fatigue level analysis unit 12 and the burden level analyzed by the burden level analysis unit 14. The method of determining the display content and the display mode by the display control unit 15 may be the same as in the first embodiment, and therefore a description thereof will be omitted here.

[0078] In the information processing system 1 according to the second embodiment, the burden level can be analyzed based on the results of video analysis, and therefore the burden level can be calculated taking into consideration the video characteristics of each piece of content, thereby enabling more appropriate display according to each piece of content.

[0079] [Third embodiment] 12 is a functional block diagram showing a schematic configuration of the burden level analysis unit 14 according to the third embodiment. In the third embodiment, the configuration of the information processing system 1 is the same as in the first embodiment, but the configuration of the burden level analysis unit 14 is different from that in the first embodiment. Hereinafter, the third embodiment will be described mainly focusing on the differences, omitting appropriate explanations of the same points as in the first and second embodiments.

[0080] 12, the burden level analysis unit 14 according to the third embodiment includes, as functional units, a content information acquisition unit 141, a burden level calculation unit 142, a video analysis unit 144, and a viewing environment detection unit 145. In this embodiment, the burden level analysis unit analyzes the burden level based on the viewing environment of the output content viewed by the user.

[0081] The content information acquisition unit 141 acquires a content signal from the content input unit 13. Based on the acquired content signal, the content information acquisition unit 141 outputs information about the content itself to the display control unit 15. Furthermore, based on the acquired content signal, the content information acquisition unit 141 outputs data about the video of the content to the video analysis unit 144.

[0082] The video analysis unit 144 performs video analysis of the content based on data related to the video of the content. The function of the video analysis unit 144 is the same as that of the second embodiment. The video analysis unit 144 outputs the analysis result to the burden level calculation unit 142.

[0083] The viewing environment detection unit 145 detects the viewing environment of the output content by the user. The viewing environment detection unit 145 detects the viewing environment based on, for example, an image captured by the imaging unit 11. For example, the viewing environment detection unit 145 detects the brightness of the room where the user views the output content as the viewing environment based on the image captured by the imaging unit 11. The viewing environment detection unit 145 outputs information on the detected viewing environment to the burden level calculation unit 142.

[0084] It should be noted that the viewing environment detection unit 145 does not necessarily have to detect the viewing environment based on images captured by the imaging unit 11. The viewing environment detection unit 145 may detect the viewing environment based on images captured by an imaging device other than the imaging unit 11.

[0085] The burden level calculation unit 142 calculates the level of burden on the eyes of the content based on the analysis result acquired from the video analysis unit 144 and the viewing environment acquired from the viewing environment detection unit 145. For example, the burden level calculation unit 142 calculates the level of burden based on the analysis result acquired from the video analysis unit 144 using a method similar to that described in the second embodiment. In addition, the burden level calculation unit 142 changes (adjusts) the calculated level of burden based on the viewing environment acquired from the viewing environment detection unit 145. For example, when the brightness of the room where the user views the output content is equal to or higher than a predetermined brightness, the burden level calculation unit 142 changes the calculated level of burden to a smaller value. For example, when the brightness of the room where the user views the output content is less than a predetermined brightness, the burden level calculation unit 142 changes the calculated level of burden to a larger value. The burden level calculation unit 142 outputs the changed level of burden to the display control unit 15.

[0086] The display control unit 15 determines at least one of the display content and the display mode on the display unit 16 based on the fatigue level analyzed by the fatigue level analysis unit 12 and the burden level analyzed by the burden level analysis unit 14. The method of determining the display content and the display mode by the display control unit 15 may be the same as in the first embodiment, and therefore a description thereof will be omitted here.

[0087] In the information processing system 1 according to the third embodiment, the burden level is further analyzed based on the viewing environment, so that the burden level can be calculated taking into account not only factors related to the content but also factors related to the viewing environment, thereby enabling more appropriate display according to the viewing environment.

[0088] [Fourth embodiment] 13 is a functional block diagram showing a schematic configuration of a burden level analysis unit 14 according to the fourth embodiment. In the fourth embodiment, the configuration of the information processing system 1 is the same as in the first embodiment, but the configuration of the burden level analysis unit 14 is different from that in the first embodiment. Below, the fourth embodiment will be described mainly focusing on the differences, with the same points as in the first embodiment being omitted as appropriate.

[0089] As shown in FIG. 13, the burden analysis unit 14 according to the fourth embodiment includes, as functional units, a content information acquisition unit 141, a burden calculation unit 142, a burden database 143, a burden update unit 146, and a communication unit 147.

[0090] The content information acquisition unit 141 acquires a content signal from the content input unit 13. Based on the acquired content signal, the content information acquisition unit 141 outputs information about the content itself to the display control unit 15. Furthermore, based on the acquired content signal, the content information acquisition unit 141 outputs data necessary for calculating the burden level of the content to the burden level calculation unit 142.

[0091] The burden calculation unit 142 calculates the burden of the content on the eyes based on the metadata acquired from the content information acquisition unit 141. In this embodiment, the burden calculation unit 142 calculates the burden by referring to data stored in the burden database 143.

[0092] The burden level database 143 stores data used for calculating the burden level by the burden level calculation unit 142. In this embodiment, the burden level database 143 stores a table showing the relationship between content and the degree of strain on the eyes. That is, in this embodiment, each content is associated with a degree of strain on the eyes.

[0093] The burden level update unit 146 updates the data stored in the burden level database 143. Specifically, the burden level update unit 146 acquires the eye fatigue level of the user viewing the content from the fatigue level analysis unit 12. The burden level update unit 146 also acquires information about the content being viewed by the user. The burden level update unit 146 updates the burden level database 143 based on the acquired content information and the eye fatigue level.

[0094] For example, when the degree of eye fatigue caused by viewing a certain content becomes equal to or greater than a predetermined threshold, the burden level update unit 146 increases the burden level associated with the content in the burden level database 143. For example, when the degree of eye fatigue caused by viewing a certain content becomes less than a predetermined threshold, the burden level update unit 146 decreases the burden level associated with the content in the burden level database 143. In this way, the burden level update unit 146 can update the burden level associated with the content by changing it according to the degree of eye fatigue.

[0095] The communication unit 147 communicates information with the outside. The communication unit 147 communicates information with, for example, an external server. The external server may be a physical server or a cloud server. The server includes a burden management unit 20. The burden management unit 20 stores a table indicating the relationship between content and the degree of eye strain. The communication unit 147 transmits information of the burden database 143 updated by the burden update unit 146 to the burden management unit 20. Information of the burden database 143 is also transmitted to the burden management unit 20 from video display devices 10 used by other users. In other words, the burden management unit 20 collects information of multiple burden databases 143 that have been updated as multiple users view content. In this way, the data stored in the burden management unit 20 is updated based on the fatigue levels of multiple users.

[0096] Furthermore, the communication unit 147 receives data stored in the burden level management unit 20 and transmits it to the burden level database 143. The burden level database 143 updates the data stored therein based on the data acquired from the communication unit 147. As described above, the burden level management unit 20 stores data updated based on the fatigue levels of multiple users. Therefore, in this case, the data in the burden level database 143 is updated with data updated based on the fatigue levels of multiple users. The burden level calculation unit 142 calculates the burden level using the data in the burden level database 143 updated in this manner. Therefore, the video display device 10 according to this embodiment makes it possible to calculate the burden level based on the actual conditions of multiple users.

[0097] [Judging video] When the fatigue level analysis unit 12 analyzes the user's eye fatigue level, the image display device 10 can use a judgment image for judging the fatigue level. Data for the judgment image is stored, for example, in a storage unit (not shown). The judgment image can be an image displayed, for example, in a predetermined pattern while changing the brightness, contrast, color temperature, etc. of the screen. However, the judgment image is not limited to the example shown here, and can be any image that can be used to judge the fatigue level.

[0098] When the judgment image is used, the display control unit 15 causes the judgment image for judging the fatigue level to be displayed on the display unit 16. The fatigue level analysis unit 12 analyzes the fatigue level of the user's eyes when the judgment image is displayed.

[0099] The judgment image can be displayed at a predetermined appropriate timing. For example, the judgment image can be displayed when the image display device 10 is turned on. Alternatively, the judgment image can be displayed when the content displayed on the image display device 10 is switched.

[0100] 14 is a flowchart showing an example of processing for displaying a determination image when the power is turned on. For example, when an operation input for turning on the power is received, the display control unit 15 turns on the power (step S31). The operation input for turning on the power can be received, for example, by operating a button provided on the image display device 10, or by receiving a signal transmitted from a remote controller or a terminal device for remotely operating the image display device 10. Alternatively, the display control unit 15 may turn on the power at a time set by a timer.

[0101] After turning on the power, the display control unit 15 causes the display unit 16 to display the judgment image (step S32). Then, the fatigue level analysis unit 12 analyzes the degree of eye fatigue of the user when the judgment image is displayed (step S33). The recommendation list determination unit 156 determines a recommendation list based on the degree of eye fatigue analyzed in step S33 (step S34). The recommendation list determination unit 156 displays the determined recommendation list on the display unit 16 (step S35). Note that steps S33 to S35 may be the same as steps S23 to S25 in FIG. 9, respectively, and detailed description thereof will be omitted here.

[0102] 15 is a flowchart showing an example of processing for displaying a determination image when switching content. For example, when a user performs an operation input for switching content displayed on display unit 16, display control unit 15 accepts the input for switching content (step S41). The user can perform an operation for switching content by, for example, operating a button provided on image display device 10 or operating a remote controller or terminal device for remotely operating image display device 10.

[0103] When the display control unit 15 receives an input to switch the content, it causes the display unit 16 to display the judgment image (step S42). Then, the fatigue level analysis unit 12 analyzes the degree of eye fatigue of the user when the judgment image is displayed (step S43). The display control unit 15 determines the display mode based on the analysis result (step S44). The method of determining the display mode is the same as, for example, the first embodiment. Then, the display control unit 15 causes the display unit 16 to display the post-switching content specified based on the user's operation input in the determined display mode (step S45).

[0104] In this way, the image display device 10 can display the judgment image at an appropriate timing and perform display based on the analysis result of the burden level when the judgment image is displayed.

[0105] In each of the above-described embodiments, the display control unit 15 determines at least one of the display content and the display mode on the display unit 16 based on the user's eye fatigue level and the user's eye strain level. Specifically, in each of the above embodiments, the user's eye fatigue level is determined based on the image of the user captured by the image capture unit 11. Therefore, display can be performed taking into account each user's actual level of fatigue, without relying on a uniform determination, such as the viewing time of content. Furthermore, in each of the above embodiments, even if the user's eyes are fatigued, content can be output in a display mode appropriate to the user's eye fatigue level, or content viewing appropriate to the user's eye fatigue level can be recommended. Therefore, even if the user's eyes are fatigued, the user can continue viewing content with minimal eye strain. This allows the information processing system 1 to perform more appropriate display depending on the user's eye fatigue level.

[0106] Although the present disclosure has been described based on the drawings and embodiments, it should be noted that those skilled in the art can easily make various modifications and alterations based on the present disclosure. Therefore, it should be noted that these modifications and alterations are included in the scope of the present disclosure. For example, functions included in each functional unit or step can be rearranged so as not to be logically inconsistent, and multiple functional units or steps can be combined or divided into one. [Explanation of symbols]

[0107] 1. Information Processing Systems 10. Video display device 11 Filming Department 12 Fatigue Analysis Section 13 Content input section 14 Burden Analysis Department 15 Display control unit 16 Display section 20 Burden Management Department 141 Content information acquisition unit 142 Burden calculation unit 143 Burden Database 144 Video Analysis Department 145 Viewing environment detection unit 146 Burden Update Department 147 Communications Department 151 Display content determination section 152 Display mode determination unit 153 Content list acquisition unit 154 Content burden acquisition unit during output 155 Other Content Burden Acquisition Department 156 Recommendation list determination unit 157 Fatigue Level Acquisition Unit 158 Burden Acquisition Department 159 Control Table 160 Display mode determination unit

Claims

1. a fatigue level analysis unit that analyzes the degree of eye fatigue of the user based on the image of the user captured by the imaging unit; a strain analysis unit that analyzes the strain on the eyes caused by the output content; a display control unit that determines at least one of display content and display mode on a display unit based on the fatigue level analyzed by the fatigue level analysis unit and the burden level analyzed by the burden level analysis unit; An information processing system comprising:

2. The information processing system according to claim 1 , wherein the display control unit determines the display mode to be a mode that imposes less strain on the eyes when the degree of fatigue or the degree of strain is equal to or greater than a threshold value.

3. The information processing system according to claim 1 , wherein, when the degree of fatigue or the degree of strain is equal to or greater than a threshold, the display control unit determines the display content to be content that suggests viewing of content that places less strain on the eyes.

4. The information processing system according to claim 1 , wherein the burden level analysis unit analyzes the burden level based on a genre or a name of the output content.

5. The information processing system according to claim 1 , wherein the burden level analysis unit analyzes the burden level based on a result of video analysis of the output content.

6. The information processing system according to claim 1 , wherein the burden level analysis unit analyzes the burden level based on a viewing environment of the output content by the user.

7. The information processing system according to claim 4 , further comprising a viewing environment detection unit that detects the viewing environment based on the image captured by the image capturing unit.

8. the strain analysis unit analyzes a strain on the eyes caused by content included in a content list indicating a list of content that can be output as the output content; the display control unit determines, as the display content, a list of content included in the content list, the content having the burden level equal to or lower than a reference value determined according to the fatigue level. The information processing system according to claim 1 .

9. the display control unit causes the display unit to display a judgment image for judging the fatigue level; the fatigue level analysis unit analyzes the degree of eye fatigue of the user when the determination image is displayed; The information processing system according to claim 1 .

10. An information processing method executed by an information processing system, Analyzing the degree of eye fatigue of the user based on the image of the user captured by the imaging unit; Analyze the degree of strain on the eyes caused by the output content, determining at least one of the content and the display mode of the display unit based on the analyzed fatigue level and the analyzed burden level; Information processing methods.

Images