Subject Analysis Device

The subject analysis device addresses the limitations of existing methods by measuring gaze and pupil responses to stimuli, offering a comprehensive evaluation of personality and preferences through gaze position and pupil diameter analysis.

JP7587833B2Active Publication Date: 2024-11-21NATSUME RES INST
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2021080777
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-05-12
Publication Date
2024-11-21
Estimated Expiration
2041-05-12

AI Technical Summary

Technical Problem

Existing methods for determining a subject's latent psychological state and personality are inadequate, as they rely solely on question answers, failing to capture unconscious emotions and preferences.

Method used

A subject analysis device that measures gaze information, pupil diameter, and attention level when the subject engages with stimuli, using a combination of gaze position analysis, pupil diameter analysis, and attention level determination to evaluate personality, mental and physical situation, interests, and preferences.

Benefits of technology

Accurately determines a subject's personality, abilities, mental and physical situation, interests, and preferences by analyzing gaze position and pupil diameter, providing a comprehensive evaluation of presented stimuli.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007587833000001
    Figure 0007587833000001
  • Figure 0007587833000002
    Figure 0007587833000002
  • Figure 0007587833000003
    Figure 0007587833000003
Patent Text Reader

Abstract

To provide a method for performing determination of character / ability of a subject, evaluation of mental and physical conditions / interest / taste, and evaluation of presentation stimulus, by measuring visual axis information, a diameter of pupil or an attention degree, when the subject perceives the content of a question.SOLUTION: A subject analyzer 1 has a question output part 21 for outputting a question, a reply display 5 for displaying a reply candidate to the question on a display 3 for the subject, and a visual line position analyzer 7 for analyzing the visual line position of the subject.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a subject analysis device. [Background technology]

[0002] Patent Publication No. 5445981 describes a device for determining a viewer's emotions regarding a visual scene.

[0003] In the past, questions were presented to subjects, and the subject's personality, abilities, and psychological state were understood based solely on the answers they gave to those questions. However, this method made it difficult to grasp the subject's latent, unconscious psychological state, personality, etc. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent No. 5445981 [Patent Document 2] Patent No. 6651536 Summary of the Invention [Problem to be solved by the invention]

[0005] Therefore, the purpose of the present invention is to measure the gaze information, pupil diameter, and level of attention of a subject when the subject senses the question content of a presented stimulus, etc., in order to judge the subject's personality and abilities, evaluate the mental and physical condition, interests, and preferences, and evaluate the presented stimuli. [Means for solving the problem]

[0006] One invention described in this specification is a subject analysis device 1 having the following configuration. The subject analysis device 1 has a question output section 21 that outputs a question to the subject. Furthermore, the subject analysis device 1 has an answer display unit 5 that displays answer candidates to the question on the subject display unit 3. Furthermore, the subject analysis device 1 has an eye gaze position analysis unit 7 that analyzes the eye gaze position of the subject.

[0007] A preferred example of the present invention is one in which the gaze position analyzed by the gaze position analysis unit 7 is added to the image information of the question output unit 21 and the answer display unit 5, gaze position-added image information is generated, and an image based on the gaze position-added image information is displayed on the analyst display unit 2.

[0008] A preferred example of the present invention is one in which the subject's personality or ability, mental and physical condition, interests and preferences, or presented stimuli are judged based on the changes in gaze position analyzed by the gaze position analysis unit 7.

[0009] A preferred embodiment of the present invention further comprises a pupil diameter analysis unit 11 for analyzing the pupil diameter of the subject.

[0010] A preferred example of the present invention is one in which the gaze position analyzed by the gaze position analysis unit 7 is displayed on the analyst's display unit 2, and the color, size, or shape of the gaze position displayed on the analyst's display unit 2 is changed based on the subject's pupil diameter analyzed by the pupil diameter analysis unit 11. Effect of the Invention

[0011] This invention measures the subject's gaze information, pupil diameter, and level of attention when the subject senses the content of the question, making it possible to judge the subject's personality and abilities, evaluate their physical and mental condition, interests, and preferences, and evaluate the presented stimuli. [Brief description of the drawings]

[0012] [Figure 1] FIG. 1 is a block diagram of a subject analysis device according to the present invention. [Diagram 2] FIG. 2 is a diagram showing an example of a screen of a player for reproducing the pupil analysis results of the present invention. [Diagram 3]FIG. 3 shows an example of a pupil diameter graph displayed on the screen of a player that reproduces the pupil analysis results. [Figure 4] FIG. 4 is a diagram showing an example of an attention graph displayed on the screen of a player reproducing the pupil analysis results. [Diagram 5] FIG. 5 is a diagram showing an example of the contents of a file output in the present invention. [Figure 6] FIG. 6 is a diagram showing an example of the contents of a file output in the present invention. [Figure 7] FIG. 7 is a flow diagram showing an example of the processing executed in the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] Hereinafter, the embodiments for carrying out the present invention will be described with reference to the drawings. The present invention is not limited to the embodiments described below, and includes appropriate modifications of the embodiments described below within the scope obvious to those skilled in the art.

[0014] <Explanation of each element> The subject analysis device 1 described below may basically have hardware such as a control arithmetic device, a storage device, an input device, and an output device. The control arithmetic device executes a predetermined arithmetic process according to a program stored in the storage device based on information input from the input device, and controls the output device while writing and reading the calculation results appropriately to and from the storage device. An example of the control arithmetic device is a processor such as a CPU or a GPU. The storage function of the storage device can be realized by a non-volatile memory such as an HDD or SSD, and the memory function of the storage device can be realized by a volatile memory such as a RAM or a DRAM. Examples of the input device are a communication module for receiving information via a network, and an operation module such as a mouse or a keyboard. Examples of the output device are a communication module for transmitting information via a network, a display, a speaker, etc. For example, the memory unit may store a control program or various information. When specified information is input from an input device, the control unit reads out the control program stored in the memory unit. The control unit then reads out the information stored in the memory unit as appropriate and transmits it to the calculation unit. The control unit also transmits the input information to the calculation unit as appropriate. The calculation unit performs calculation processing using the various information it receives and stores it in the memory unit. The control unit reads out the calculation results stored in the memory unit and outputs them from the output unit. In this manner, various processes are executed. The various processes are executed by each means. In the present invention, first, the subject is asked to sense the question content in a video, still image, or real object, and eye information at that time is acquired and analyzed. At the same time, the question content sensed by the subject is recorded as a video with a camera angle of the subject's gaze. A marker is added to the video information, which is located at the subject's gaze position in the above video for each time, and a pupil analysis result video is processed and generated. Then, the video is played back and displayed on the analyst display unit 2 or the like by the user's operation. Furthermore, the personality diagnosis unit 23 performs a personality diagnosis of the subject based on the above information.

[0015] (Subject Analysis Device 1) FIG. 1 is a block diagram of a subject analysis device 1 of the present invention. The subject analysis device 1 has an analyst display unit 2, a gaze position analysis unit 7, a control unit 13, and a communication unit 15. Furthermore, the subject analysis device 1 preferably has an attention point determination unit 9 and a pupil diameter analysis unit 11. Moreover, the subject analysis device 1 preferably has a question providing device 19. The subject analysis device 1 may be provided with a personality diagnosis unit 23. The subject analysis device 1 is a device for analyzing the gaze position and changes in gaze position of a subject viewing a still image, video, or the like. It is preferable that a camera or an external device is connected to the subject analysis apparatus 1 in order to obtain eye information and visual information of the subject.

[0016] (Analyst display section 2) The analyst's display unit 2 is a liquid crystal display or the like, and displays various information such as the pupil analysis result playback player 4 described later according to instructions from the control unit 13. , and may be the same as the subject display unit 3 described later.

[0017] (Pupil analysis results player 4) FIG. 2 is a diagram showing the contents of the pupil analysis result video display player 4 of the subject analysis device 1. The pupil analysis result video display player 4 is an element for displaying the pupil analysis results of the subject who sensed the question content. The pupil analysis result video display player 4 may operate on the web, or may operate offline in a terminal such as a personal computer. As shown in Fig. 2, the pupil analysis result video display player 4 may have an analysis result video display field 4a for displaying, for example, the subject's attention level and pupil analysis results. The pupil analysis result video display player 4 may be provided with a content heat map setting field 4d, a pupil diameter / attention level graph display setting field 4c, a mini menu display position setting field 4d, and a pupil diameter / attention level graph display field 4e.

[0018] The analysis result video display area 4a is a section that displays images that correspond to the question content, answer candidates, the subject's gaze position, and attention level that the subject senses. Specifically, for example, the image displayed in the analysis result video display area 4a is a basic image that uses the question content and answer candidate video information sensed by the subject as a base image, to which information such as gaze position and attention point is added as follows. The gaze position of the subject sensing the question content, etc. is added and displayed as a specified heat map marker on the basic image. In other words, the actual gaze position of the subject while perceiving the question content and answer candidates corresponds to the position of the heat map marker in the above-mentioned video information. In addition, the color, size, or shape of the marker may change depending on the subject's attention level. At the bottom of the analysis result video display field 4a, for example, a video playback button, a rewind button, and a fast forward button may be provided. In addition to this, a mini menu for setting the playback position and the playback speed may be displayed in the analysis result video display field 4a.

[0019] The pupil analysis result video display player 4 may be provided with a heat map setting field 4b such as a radio box that allows the user (analyst) to select whether or not to display a heat map marker or the like in the analysis result video. For example, when the play button is pressed with the heat map setting field 4b selected as hidden, the video is played without the marker of the attention point being displayed in the analysis result video. When the play button is pressed with the content heat map setting field selected as displayed, the video is played with the marker of the attention point being displayed in the analysis result video. Furthermore, when the marker is displayed in the analysis result video, a mesh line may be displayed on the video.

[0020] The pupil analysis result video display player 4 may be provided with a pupil diameter / attention level graph selection field 4c having a radio box that allows the user to select which of the above graphs is to be displayed. If the pupil diameter radio box is selected, a pupil diameter graph is displayed in the pupil diameter / attention graph display field 4e, and if the attention radio box is selected, an attention graph is displayed in the pupil diameter / attention graph display field 4e.

[0021] The pupil analysis result video display player 4 may have a pupil diameter / attention graph display field 4d for displaying a pupil diameter graph showing the pupil diameter of the subject and an attention graph showing the attention level of the subject. The graph showing the pupil diameter of the subject and the graph showing the attention level of the subject may be displayed in a manner such that only one of them is displayed, or both of them are displayed. The method for measuring attention level, pupil diameter graphs, and attention level graphs will be described later.

[0022] In addition, the pupil analysis result video display player 4 may be provided with a mini menu display position setting field 4d. In the mini-menu display position setting field 4d, the mini-menu display position can be set.

[0023] (Pupil diameter, pupil diameter graph) The subject analysis device 1 receives pupil diameter information of the subject from an external device having a camera, etc. The method of measuring the pupil diameter used in the present invention may be the method disclosed in Japanese Patent No. 6651536.

[0024] According to the invention of Japanese Patent No. 6651536, it is possible to measure pupil diameter without being affected by light and dark, breathing and pulse rate, and it becomes possible to more accurately judge the emotion of the viewer. In the present invention, a pupil diameter that can be measured by any other known method may be used as long as it can be appropriately measured.

[0025] 3 is a graph showing the change in pupil diameter over time when the subject senses the content of the question. This graph is displayed in the pupil diameter vs. attention graph display field 3e on the display unit 3. The horizontal direction of this graph indicates how far the analysis result is from the time position during playback of the video (video playback time position line 33). In this graph, the vertical line (video playback time position line 33) indicates the exact position (time) currently being played in the pupil analysis result video displayed on the analyst display unit 2. On the graph, the left side of the video playback time position line 33 is information related to the attention level at the time position that has been played on the pupil analysis result playback player 4, and the right side is information related to the attention level at the time position that has not been played on the pupil analysis result playback player 4. Additionally, the vertical direction of this graph (the upward direction in Figure 3 is the positive direction) represents the pupil diameter and the size equivalent to the content luminance.

[0026] In this graph, the horizontal line, raw measured pupil diameter 27, is a line formed by a set of points representing the size of the pupil diameter at each playback time position of the subject. In this graph, the horizontal line equivalent to content luminance 29 is a line formed by a set of points that represent the size of the pupil diameter estimated from the content luminance at each playback time position of the subject. In other words, the lines of the raw measured pupil diameter 27 and the content luminance equivalent 29 will shift to the left on the graph as the playback position (time) of the analysis video progresses. In addition to the above, the specifications of the pupil diameter graph may be as follows. The raw measured pupil diameter 27 and content brightness equivalent 29 for the entire duration of the analysis video may be displayed fixedly before the video is played, and a time position line 33 during video playback may transition in accordance with the position (time) during video playback.

[0027] (Attention level / attention level graph) The degree of attention is an index showing how much the subject is paying attention to the object. The degree of attention in the present invention may be determined by, for example, the method described in the above-mentioned Patent Publication No. 665136. In the present invention, the level of attention may be measured by any other known method as long as it can be appropriately measured.

[0028] The graph in Figure 4 (attention graph) shows the time shift in the subject's attention when perceiving the question content. This graph is displayed in the pupil diameter vs. attention graph display field 4e of the pupil analysis result playback player 4. The horizontal direction of this graph indicates how far the analysis result is from the time position during playback of the video (video playback time position line 33). In this graph, the vertical video playback time position line 33 indicates the exact position (time position) currently being played in the analysis result video displayed on the pupil analysis result playback player 4. On the graph, the left side of the video playback time position line 33 is information related to the attention level at the time position that has been played on the pupil analysis result playback player 4, and the right side is information related to the attention level at the time position that has not been played on the pupil analysis result playback player 4. The vertical direction of this graph (the upward direction in Figure 4 is the positive direction) represents the level of attention. In this graph, the horizontal line of attention level 31 is a line formed by a set of points that represent the magnitude of the subject's attention level at each playback time position. In other words, this attention level 31 line will shift to the left on the graph above as the playback position of the pupil analysis result video progresses.

[0029] In this graph, a horizontal attention level reference line 35 is a reference line positioned at a height equivalent to an attention level value (preferably greater than 1.0), and is displayed fixedly on the graph. In addition to the above, the specifications of the attention graph may be as follows. The analysis result may be such that the attention level 31 line for the entire duration of the video and the attention level reference line 35 are displayed fixedly before the video is played, and the video playback time position line 33 transitions in accordance with the position (time) during video playback.

[0030] (Question content providing device 19) The question content providing device 19 is a device for providing question contents to the subject and presenting answer candidates, etc. The question content providing device 19 includes a question output unit 21, an answer display unit 5, a subject display unit 3, a control unit 37, and a communication unit 39. (Subject display unit 3) The subject display unit 3 is a liquid crystal display or the like, and displays various information on the answer display unit 5 (described later) and the like, according to instructions from the control unit 37.

[0031] (Question output unit 21) The question output unit 21 is a part for providing questions to the subject. The questions provided by the question output unit 21 are diverse, including those that appeal to the five senses. For example, if the question appeals to the visual sense, it may be a display or monitor that provides a video, and if it appeals not only to the visual sense but also to the sense of smell, it may be a machine that presents an actual object. Also, if it appeals to the auditory sense, it may be a display or monitor that provides a video, or a speaker, or a machine that can provide an actual object that emits a sound. If it appeals to the sense of smell, it may be a machine that provides something that emits a scent. The content provided by the question output unit 21 may be content that evokes the subject's memory. For example, even if a subject is explicitly questioned verbally or otherwise about past memories or experiences, it may be difficult to grasp the true facts of the subject's memory. In contrast, in the present invention, by presenting the subject with information that evokes memories of witnessing or the like, it is possible to infer the true facts of recognition in that memory from the subject's pupillary response, etc. The content presented to the subject by the question output unit 21 is not limited to explicit questions. For example, a blank screen or TV commercial that is seemingly meaningless, an image in which the color changes gradually or alternately, or meaningless sound such as white noise may be provided to the subject as the question content. When the question content provided by the question output unit 21 is a video or the like, the question output unit 21 may be the same device as the subject display unit 3 .

[0032] (Answer display section 5) The answer display unit 5 is an element, a screen, etc. for displaying possible answers to the above questions provided to the subject. The answer display unit 5 may be displayed on a display or monitor. For example, if the question provided to the subject by the question output unit 21 is a sentence question, answer candidates such as "Applies," "Somewhat applies," "Somewhat does not apply," and "Does not apply" are displayed on the answer display unit 5. The subject then selects his or her own answer from among the answer candidates. The personality diagnosis unit 23 can then diagnose and evaluate the subject based on the content of the answer, the subject's gaze position on the screen, and the level of attention.

[0033] (Gaze position analysis section 7) The gaze position analysis unit 7 is an element for analyzing the subject's gaze position from the image of the question content perceived by the subject captured by an external camera, etc., and the subject's eye movement information. The gaze position analysis unit 7 acquires the eye movement image captured by the external camera. When what is provided by the question output unit 21 is video information such as a moving image, the gaze position analysis unit 7 acquires the video information as video information of the question content. On the other hand, if what is provided by the question output unit 21 is not video information, the information provided by the question output unit 21 is photographed by an external camera or the like. Then, the gaze position analysis unit 7 combines the image information of the question content with the image information of the answer display unit 5, and acquires the information as image information of the question content and the answer. The video information of the questions and answers includes video information taken from a camera angle from the subject's viewpoint. The video information of the questions and answers mentioned below shall represent the video information mentioned above. Then, the gaze position analysis unit 7 identifies the subject's gaze position in the image based on the question content, the image information of the answer display unit, and the eye movement image, and stores this information in the memory unit 17.

[0034] The method of analyzing the gaze position used by the gaze position analysis unit 7 may be any known method as long as it is a method capable of identifying the gaze position in the image of the question content sensed by the subject.

[0035] (Attention point determination unit 11) The attention point determination unit 11 is an element for determining which part of the question content and answer candidates the subject, who senses the question content and answer candidates, is paying attention to. For example, the attention point determination unit 11 receives video information of the question content and answer sensed by the subject, and information on the subject's eye movement, etc., acquired from an external device such as a camera for eye measurement. Then, the information on the screen location on the video screen and the subject's attention level to that part are stored in the storage unit 17. By using this information, the subject's gaze position, represented by various markers described later, can be added to the pupil analysis result video displayed on the pupil analysis result playback player 4.

[0036] (Display of gaze position) The subject analysis device 1 generates information on the display mode of the gaze position marker to be displayed on the analysis result video based on the information obtained by the gaze position analysis unit 7 etc. Then, the above information is added to the video information of the question content and answer to generate gaze position added video information. Then, an image based on the gaze position-added image information is displayed on the analyst's display unit 2. This makes it possible to display the above-mentioned gaze position marker at the subject's gaze position in the image of the question and answer perceived by the subject. For example, based on the playback time of the video and the attention level for each gaze position, the color of the marker for that gaze position in the analysis result video is set. If the attention level is above a certain value, the marker part is colored red, and if it is below that value, the color is changed to blue. Furthermore, the display mode of the gaze position marker may not only change color, but also the size and shape of the marker may change.

[0037] (Pupillary diameter analysis section 13) The pupil diameter analysis unit 13 is an element for analyzing the pupil diameter of the subject. The pupil diameter analysis unit 13 acquires information on the subject's eyeball obtained from an external camera or the like. As described above in (Pupil diameter, pupil diameter graph), the method of measuring pupil diameter in the present invention is assumed to be the method shown in Patent Publication No. 6651536. Other methods for measuring pupil diameter in the present invention may be used as long as they are publicly known and can accurately measure pupil diameter.

[0038] (Personality Diagnostic Section 23) The subject analysis device 1 may have a personality diagnostic section 23. The personality diagnostic section 23 is an element for judging the character and abilities of the subject, evaluating the mental and physical conditions, interests and preferences, or evaluating presented stimuli. The personality diagnostic results may be displayed on the analyst display section 2 or the like, or may be output as a report file. The diagnosis process of the personality diagnosis unit 23 may be performed using the trained model 25. The trained model 25 is model data in which parameters (so-called "weights") have been adjusted by performing machine learning on the biological data of a large number of subjects. For example, a trained model 25 is created by performing machine learning such as deep learning using questions (contents), gaze position, attention level, and the personality of the subjects (character, ability, mental and physical state, interests and preferences, true reaction to presented stimuli) provided to a large number of subjects as teacher data. In this case, by referring to this trained model 25 using the question content, answer candidates, gaze position, pupil diameter, and attention level provided to a certain subject as input values, a personality diagnosis result can be obtained as an output value corresponding to the input values. The subject analysis device 1 may have such a trained model in advance. However, this trained model 25 is not a required element.

[0039] (Control unit 13, control unit 37) Control unit 13 is an element for issuing processing instructions to each element of subject analysis device 1. It is also an element for accessing storage units etc. and for referring to, registering, updating, etc. data. The control unit 37 is an element for issuing processing instructions to each element of the question providing device.

[0040] (Communication unit 15, communication unit 39) The communication unit 15 has a function for the subject analysis device 1 to transmit and receive information to and from the question content providing device 19, etc. The communication unit 15 is an element that performs communication in compliance with any communication standard. The communication unit 39 has a function for the question content providing device 19 to transmit and receive information to and from the subject analysis device 1, etc. The communication unit 39 is an element that performs communication in compliance with any communication standard.

[0041] (Analysis result output file) The measurement results of the pupil diameter and the degree of attention of the subject by the subject analysis device are output as a report file. The output destination may be within the subject analysis device or an external device, etc.

[0042] FIG. 5 shows graph data of the time transition of each subject's attention level and its average value from the output file data. The horizontal axis of the graph in Figure 5 is the time axis, and the vertical axis is the subject's attention level. Figure 6 illustrates the total attention distribution data for each subject from among the output file data. The above total attention distribution data is an illustration of the data for tabulating the total attention distribution for each subject from among the output file data. In addition to the above files, files containing information on standard deviation indicating the variation in attention level between multiple subjects, and information on standard deviation indicating the variation in attention level during measurement of a single subject may be output.

[0043] <Information Processing Operation in Subject Analysis Device 1> Next, a process of the information processing system according to an embodiment of the present invention will be described with reference to FIG 7. FIG 7 is a flow chart showing an example of the process executed in the present invention. Note that the processing flow described below is an example of internal processing for realizing the subject analysis device 1 of the present invention, and the internal processing that can be used in the subject analysis device 1 of the present invention is not limited to the example below. (1. Acquiring visual and video information from subjects, creating video information for analysis) When a user (analyst, etc.) presses a start button or the like on the question providing device, provision of question content to the subject (playback of a sample video, etc.) starts (S01: providing question content). At the same time as providing the question in step S01, video information of the subject's eye movement and video information of the question and answer are acquired by a known method using an external camera or the like.

[0044] Then, the subject's eye movement information and the video information of the question and answer are sent in a predetermined manner to the gaze position analysis unit 7. Then, based on this information, gaze position information for each time in the video of the subject's question etc. is created in the gaze position analysis unit 7. The video information of the question content, gaze position information, and eye movement information may be stored in the memory unit 17 etc. (S02: Creating gaze position information).

[0045] Thereafter, the image information of the questions and answers, the gaze position information, and the eye movement information are sent to the pupil diameter analysis unit 11 in a prescribed manner. The pupil diameter analysis unit 11 measures the pupil diameter using a known method based on the eye movement, the image information of the questions and answers, and their brightness, etc. Then, pupil diameter information is created for each time and gaze position information in the image of the subject's questions, etc. The above information may be stored in the memory unit 17, etc. (S03 Pupil diameter information creation).

[0046] Thereafter, the video information of the question and answer, gaze position information, and eye movement information are sent to attention point determination unit 9 in a prescribed manner. Attention point determination unit 9 measures the level of attention using a known method based on the eye movement, content video, and its brightness, etc. Then, pupil diameter and attention level information is created for each time and gaze position information in the video information of the subject's question and answer (S04: Creation of attention level information). By the above-mentioned processes from S01 to S04, information for the subject's pupil analysis result video is created. In addition, the above-mentioned analysis result output file is created based on that information (S05: Create analysis result output file).

[0047] (2. Pupil analysis result display) When a user (analyst) presses a video playback button or the like on the pupil analysis result playback player 4, gaze position-added video information is generated in the analysis result video display area 4a of the pupil analysis result playback player 4 based on the information generated in steps S01 to S04 above. Then, an analysis result video, which is a video based on the gaze position-added video information, is played and displayed (S06: Play analysis result video). At the same time as the video is played, a pupil diameter graph and an attention level graph are displayed based on the selection of the pupil diameter / attention level graph display setting section 4c of the pupil analysis result playback player 4 (S07: Display graph). Furthermore, a personality diagnosis result may be displayed and output in response to an operation by the user (analyst) (S08: Personality diagnosis).

[0048] In the above, in order to realize the contents of the present invention, the present specification has described the embodiment of the present invention with reference to the drawings. However, the present invention is not limited to the above embodiment, and includes modifications and improvements that are obvious to a person skilled in the art based on the matters described in the present specification. [Industrial Applicability]

[0049] The present invention can be used in the field of information analysis. [Explanation of symbols]

[0050] 1. Subject analysis device 2 Analyst display 3. Subject display unit 4 Pupil analysis result playback player 4a Analysis result video display section 4b Heat map display setting field 4c Pupil diameter / attention graph selection field 4d Mini menu display position setting section 4e Pupil diameter / attention graph display area 5 Answer display area 7 Gaze position analysis section 9. Attention point determination section 11 Pupil diameter analysis section 13 Control section 15 Communications Department 17 Memory section 19 Question providing device 21 Question output section 23 Personality Diagnostic Department 25 Pre-trained models 27 Raw Pupil Diameter 29 Content Brightness Equivalent 31 Popularity 33 Time position line during video playback 35 Attention Baseline 37 Control Unit 39 Communications Department

Claims

1. A question output unit (21) that outputs a question to a subject; An answer display unit (5) that displays answer candidates to the question on a subject display unit (3); A gaze position analysis unit (7) for analyzing the gaze position of the subject; Having a display screen of a display unit for an analyst (2) on which the question and the answer candidates are displayed is divided into a plurality of regions, a degree of attention of at least one of the plurality of regions is calculated, and the degree of attention thus calculated is displayed in a corresponding region of the plurality of regions on the display screen of the display unit for an analyst (2), the plurality of regions including a plurality of unit regions of the same shape formed by dividing the display screen into a lattice shape; Subject analysis device (1).

2. A subject analysis device (1) according to claim 1, A subject analysis device (1) which divides a display screen of an analyst display unit (2) on which the questions and answer candidates are displayed into a plurality of regions, calculates a degree of attention for at least one of the plurality of regions, and adds the degree of attention to the video information of the question output unit (21) and the answer display unit (5) so as to display the calculated degree of attention in a corresponding region among the plurality of regions on the display screen of the analyst display unit (2), thereby generating attention-added video information, and displays an image based on the attention-added video information on the analyst display unit (2).

3. A subject analysis device (1) according to claim 1, A subject analysis device (1) that generates gaze-position-added video information by adding the gaze position analyzed by the gaze position analysis unit (7) to the video information of the question output unit (21) and the answer display unit (5), and displays an image based on the gaze-position-added video information on an analyst display unit (2).

4. A subject analysis device (1) according to claim 1, Based on the change in the gaze position analyzed by the gaze position analysis unit (7), the subject's personality, ability, mental and physical condition, interests and preferences, or presented stimuli are evaluated. Subject analysis device (1).

5. A subject analysis device (1) according to claim 1, The apparatus further includes a pupil diameter analysis unit (11) for analyzing the pupil diameter of the subject. Subject analysis device (1).

6. A subject analysis device (1) according to claim 5, The gaze position analyzed by the gaze position analysis unit (7) is displayed on the analyst display unit (2), changing the color, size, or shape of the gaze position displayed on the analyst display unit (2) based on the pupil diameter of the subject analyzed by the pupil diameter analysis unit (11); Subject analysis device (1).

7. 2. The subject analysis device according to claim 1, wherein the attention level displayed in a corresponding area among the plurality of areas is a numerical value.

Citation Information

Patent Citations

  • Water pproducing method for refuse incinerating plants

    JP1979045981A

  • Evaluation device for video image content

    JP2004282471A

  • Diagnosis support apparatus and diagnosis support method

    JP2016032587A

  • Viewer emotion determination device and program for determining viewer emotion

    JP6651536B2

  • Apparatus for gaze analysis, system and method for gaze analysis of using the same

    KR1020210048075A