Cognitive Power Analysis Device, Method, and Computer Program for Social Situation Based on Content Feedback

Abstract

The cognitive ability analysis device according to an embodiment of the present invention includes an information acquisition unit that acquires user information, a content unit that determines the type of content for determining the cognitive ability regarding the social situation based on the user information, an interrogation unit that presents the content and questions regarding the content to the user to acquire the user's response, and a determination unit that determines the cognitive ability regarding the user's social situation based on the user's response.

Description

Technical Field

[0001] The present invention relates to an apparatus, method, and computer program for analyzing the cognitive ability of social situations based on content feedback.

Background Art

[0002] Autism refers to a disorder in which no mutual relationship with others is formed and no emotional bond occurs. In the International Classification of Diseases (ICD-10), autism is diagnosed as a general developmental disorder across development, and the general developmental disorder is divided into nine subtypes. Recently, in subsequent research related to this, autism is commonly referred to by the term autism spectrum, based on the conclusion that clinically it does not make much sense to separate these individually.

[0003] On the other hand, when determining the presence or absence of autism, a model has been used in which, for a presented specific situation, it is confirmed whether a child exhibits an appropriate level of emotional reaction, and if no appropriate level of reaction is shown, a diagnosis of autism is made.

[0004] However, since the factors to be judged for recognizing various social situations are diverse not only in terms of emotional reactions but also according to the patterns of social situations, there is a need for an accurate evaluation tool to implement a social training program that enables children with autism to accurately recognize and cope with social situations.

Summary of the Invention

Problems to be Solved by the Invention

[0005] The problem to be solved by the present invention is to provide a technology capable of analyzing various feedbacks of a user on provided content in association with the context of social situations in order to determine an accurate cognitive state regarding social situations.

[0006] However, the problems to be solved by the present invention are not limited to what has been mentioned above, and may include the purpose that, although not mentioned, should be clearly understood by those skilled in the art from the following description.

Means for Solving the Problems

[0007] A cognitive ability analysis apparatus according to an embodiment includes an information acquisition unit that acquires user information, a content unit that determines a type of content for discriminating cognitive ability regarding a social situation based on the user information, an interrogation unit that presents the content and questions regarding the content to a user and acquires a response of the user, and a discrimination unit that discriminates the cognitive ability of the user regarding the social situation based on the response of the user.

[0008] Further, the user information includes gender, degree of disability, IQ, age, and SRS-2 (Social Responsiveness Scale Second Edition) score.

[0009] Further, the content unit determines a content level based on gender, degree of disability, IQ, age, and SRS-2 score included in the user information.

[0010] Further, the interrogation unit acquires from the user a first response that is a response option selected by the user for a question given to the content, a second response to a non-verbal expression to be performed for a situation given to the content, and a third response to a point in time at which the non-verbal expression should be performed.

[0011] Further, the discrimination unit searches for content to be presented to the user based on scores of the first to third responses and provides it to the user.

[0012] In addition, for the content, based on the coordinate information of the area including some of the text to be output or the coordinate information of the area including some of the images output by the content, an area serving as a clue for determining the social situation is specified in advance.

[0013] In addition, the device further includes a line-of-sight acquisition unit that acquires the coordinate information of the point where the user looks at among the content, the time information of looking at the point where the user looks, and the order information of moving the points where the user looks in a time series.

[0014] In addition, the line-of-sight acquisition unit separately identifies and stores a point where the time the user looks at a predetermined point is equal to or longer than a preset time.

[0015] In addition, the determination unit determines whether a point where the looking time is equal to or longer than the preset time is included in the clue area.

[0016] In addition, the determination unit can determine the cognitive ability of the user regarding the content from the user's line-of-sight information based on a preset point standard for each of the coordinate information of the line of sight, the staying time of the line of sight, whether the staying of the line of sight occurs for a time equal to or longer than a preset time, and whether the staying of the line of sight occurs in the clue area.

[0017] In a cognitive ability analysis method performed by a cognitive ability analysis device according to an embodiment, a step of acquiring user information, a step of determining a type of content for determining the cognitive ability regarding the social situation based on the user information, a step of presenting the content and questions regarding the content to the user and acquiring the user's response, and a step of determining the cognitive ability of the user regarding the social situation based on the user's response are included.

Advantages of the Invention

[0018] According to an embodiment of the present invention, in order to determine an accurate cognitive state regarding a social situation, a sophisticated technique can be provided for analyzing various feedbacks of a user on provided content in association with the context of the social situation. For example, when group bullying occurs, or when several people create a deceptive situation to tease someone, it is impossible to accurately recognize the overall situation just by looking at one person's expression. Therefore, the present invention can determine the user's social situation recognition ability based on how the user reacts in the situation presented by the content. Thereby, the present invention can serve as an evaluation tool for implementing a social training program that enables users to accurately recognize and cope with various social situations.

[0019] The effects obtained by the present invention are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the following description.

Brief Description of the Drawings

[0020]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Best Mode for Carrying Out the Invention

[0021] The advantages, features, and the ways to achieve them of the present invention will become apparent by referring to the embodiments described in detail below together with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below and can be embodied in various forms. However, these embodiments are provided to complete the disclosure of the present invention and to fully inform those skilled in the art of the scope of the invention, and the scope of the present invention is only defined by the claims.

[0022] When describing the embodiments of the present invention, specific descriptions of well-known functions or configurations are omitted unless actually necessary when describing the embodiments of the present invention. And the terms described below are terms defined in view of the functions in the embodiments of the present invention, which may vary depending on the intention or convention of the user, operator, etc. Therefore, the definition should be made based on the content throughout this specification.

[0023] Terms such as "··· unit" and "··· device" used below mean a unit that processes at least one function or operation, which is implemented by hardware, software, or a combination of hardware and software.

[0024] FIG. 1 is a functional block diagram of an apparatus 100 for analyzing the cognitive ability of social situations based on content feedback (hereinafter, "cognitive ability analysis apparatus 100") according to an embodiment of the present invention.

[0025] Referring to FIG. 1, a cognitive ability analysis apparatus 100 according to an embodiment of the present invention includes an information acquisition unit 110, a content unit 120, a questioning unit 130, and a discrimination unit 140, and may further include a gaze acquisition unit 150. The overall operation of the cognitive ability analysis apparatus 100 according to an embodiment of the present invention is performed by one or more processors, and the one or more processors control the functional blocks included in FIG. 1 to perform the operations described below.

[0026] The information acquisition unit 110 acquires information of a user who tests the cognitive ability regarding the social situation based on the content provided by the present invention. The information acquisition unit 110 directly receives user information from the user or acquires user information from a user terminal connected by wire or wirelessly. For example, the user information includes the user's gender, degree of disability, IQ, age, and SRS-2 (Social Responsiveness Scale Second Edition) score.

[0027] The content unit 120 provides content for the user to determine the cognitive ability regarding the social situation. The content unit 120 determines the level of the content to be provided to the user based on the user information acquired by the information acquisition unit 110. The content according to an embodiment is classified into levels according to the difficulty for determining the social situation, and each content includes an image, text, and voice representing the social situation. The content unit 120 outputs the voice matched with the text shown in the content together. For example, the content unit 120 outputs the content to the user via a display connected to the cognitive ability analysis apparatus 100 by wire or wirelessly. For example, the content unit 120 provides the content to a user terminal connected to the cognitive ability analysis apparatus 100 by wire or wirelessly. The content unit 120 includes a hardware memory for storing the content. The content unit 120 includes a communication module for acquiring the content from an external device.

[0028] FIG. 2 is an exemplary diagram of the types of content according to an embodiment of the present invention.

[0029] Referring to FIG. 2, according to one embodiment, the content is classified and stored according to the type of content by the dialogue location, the dialogue partner, the number of speakers, the type of non-verbal expression for asking the user, and the response time of the non-verbal expression for asking the user. The content unit 120 determines the type of content to be provided to the user based on the user information.

[0030] The interrogation unit 130 provides the content to the user, presents a question about the provided content to the user, and obtains the user's response.

[0031] FIG. 3 is an exemplary diagram of a question regarding the content according to one embodiment of the present invention.

[0032] Referring to FIG. 3, according to one embodiment, the content is stored with related questions and response options mapped, and the interrogation unit 130 calculates a score for the user's cognitive ability based on the user's selection from the response options.

[0033] As an example, the interrogation unit 130 obtains from the user a first response that is the response option selected by the user for the question given to the content, a second response for the non-verbal expression to be performed for the situation given to the content, and a third response for the time point at which the non-verbal expression is to be performed.

[0034] The discrimination unit 140 discriminates the user's cognitive ability regarding the user's social situation based on the user's response. As an example, the discrimination unit 140 determines the level of the next content to be presented to the user based on the scores mapped for the first response, the second response, and the third response obtained by the interrogation unit 130.

[0035] According to an embodiment further including a line-of-sight acquisition unit 150, the line-of-sight acquisition unit 150 can acquire the line-of-sight information of the point where the user views the content.

[0036] FIG. 4 is an exemplary diagram of a clue area of the content according to one embodiment of the present invention.

[0037] Referring to FIG. 4, for the content according to an embodiment, areas (A and B in FIG. 4) serving as clues for determining the social situation may be specified in advance. As an example, in order to identify the areas, for the content, whether the coordinate information inside the area (area A in FIG. 4) including a part of the image (for example, the area of the image showing an expression) in the area where the image of the content is output is specified in advance, or whether the coordinate information inside the area (area B in FIG. 4) including a part of the text (for example, the area of the text indicating emotion) in the area where the text of the content is output may be specified in advance.

[0038] FIG. 5 is an exemplary diagram of the gaze information collected from the content according to an embodiment of the present invention.

[0039] Referring to FIG. 5, the gaze acquisition unit 150 acquires the coordinate information of the point where the user looks at in the content, the time information of looking at the point where the user looks at, and the order information of sequentially moving the point where the user looks at. For example, the gaze acquisition unit 150 includes a camera module capable of sensing the user's gaze, and can measure the coordinate information of the point where the user looks at and the staying time of the gaze where the user's gaze stays at a predetermined point in units of 10 ms. The gaze acquisition unit 150 separately identifies and stores the point where the time when the user looks at a predetermined point is equal to or longer than a preset time (for example, 60 ms). At this time, the discrimination unit 140 discriminates whether the area serving as a clue (for example, A and B in FIG. 4) includes the point where the time when the user looks at is equal to or longer than a preset time (for example, 60 ms). The gaze acquisition unit 150 stores the acquired time information in time series and acquires the order information of the user's time point moving in time series.

[0040] FIG. 6 is an exemplary diagram of an operation for discriminating the user's cognitive ability according to the social situation based on the user's gaze information and response according to an embodiment of the present invention.

[0041] Referring to FIG. 6, the discrimination unit 140 can determine the user's cognitive ability regarding the social situation of the content from the user's gaze information based on a preset point criterion for each of the coordinate information of the gaze, whether there is a gaze stay for a preset time (e.g., 60 ms) or more, the gaze stay time, and whether there is a gaze stay in the cue area (e.g., A and B in FIG. 4) according to the chronological order of the user's gaze. Further, the discrimination unit 140 can use a neural network model learned to discriminate the cognitive ability of the social situation based on each data of the coordinate information of the gaze, the gaze stay time, whether there is a gaze stay for a preset time or more, and whether there is a gaze stay in the cue area, to determine the user's cognitive ability regarding the social situation.

[0042] As an example, when the user's response to a question regarding the content is correct but the user's cognitive ability score determined from the user's gaze information is equal to or less than a preset value, the discrimination unit 140 determines that the user's response is incorrect, searches for new content for reconfirming the user's cognitive ability, and re-measures the user's cognitive ability.

[0043] FIG. 7 is a flowchart of a cognitive ability analysis method performed by the cognitive ability analysis apparatus 100 according to an embodiment of the present invention. Each step of the cognitive ability analysis method according to FIG. 7 is performed by the cognitive ability analysis apparatus 100 described through FIG. 1. Describing each step is as follows.

[0044] In step S1010, the information acquisition unit 110 acquires user information.

[0045] In step S1020, the content unit 120 determines the type of content for discriminating the cognitive ability regarding the social situation based on the user information.

[0046] In step S1030, the questioning unit 130 presents the content and a question regarding the content to the user and acquires the user's response.

[0047] In step S1040, the discrimination unit 140 discriminates the user's cognitive ability regarding the user's social situation based on the user's response.

[0048] On the other hand, in addition to the steps shown in FIG. 7, by variously configuring embodiments in which the above-described information acquisition unit 110, content unit 120, questioning unit 130, discrimination unit 140, and gaze acquisition unit 150 perform the operations described with FIGS. 1 to 6, new steps performed by each functional block are added also to the steps of FIG. 7. Further, since the configuration of the additional steps and the components that are the main bodies of each step perform the operations for implementing the steps, which have been described with FIGS. 1 to 6, overlapping descriptions are omitted.

[0049] According to the above-described embodiments, in order to discriminate an accurate cognitive state regarding the social situation, it is possible to provide a sophisticated technique for analyzing various feedbacks of the user with respect to the provided content in association with the context of the social situation. For example, when group bullying occurs, or when several people create a deceptive situation to tease someone, it is not possible to accurately recognize the overall situation by looking at only one person's expression. Therefore, the present invention can discriminate the user's social situation cognitive ability based on how the user reacts in the situation produced by the content. Thereby, the present invention can serve as an evaluation tool for implementing a social training program in which the user can accurately recognize and cope with various social situations.

[0050] The above description merely exemplarily explains the technical idea of the present invention, and those skilled in the art will be able to make various modifications and variations without departing from the essential quality of the present invention. Therefore, the embodiments disclosed in this specification are for the purpose of explanation rather than for limiting the technical idea of the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The protection scope of the present invention must be construed according to the following claims, and all technical ideas within the equivalent scope thereof must be construed as being included in the scope of rights of the present invention.

Claims

1. An information acquisition unit that acquires user information; A content unit that determines the type of content for discriminating the cognitive ability regarding the social situation based on the user information; An interrogation unit that presents the content and questions regarding the content to the user and acquires the response of the user; A discrimination unit that discriminates the cognitive ability of the user regarding the social situation based on the response of the user, the cognitive ability analysis device comprising the same.

2. The cognitive ability analysis device according to claim 1, wherein the user information includes gender, degree of disability, IQ, age, and SRS-2 (Social Responsiveness Scale Second Edition) score.

3. The cognitive ability analysis device according to claim 2, wherein the content unit determines the content level based on the gender, degree of disability, IQ, age, and SRS-2 score included in the user information.

4. The cognitive ability analysis device according to claim 1, wherein the interrogation unit acquires from the user a first response which is a response option selected by the user for a question given to the content, a second response for a non-verbal expression to be made regarding the situation given to the content, and a third response for the time point at which the non-verbal expression is to be made.

5. The cognitive ability analysis device according to claim 4, wherein the discrimination unit searches for the next content to be presented to the user based on the scores of the first to third responses and provides the same to the user.

6. The cognitive ability analysis device according to claim 1, wherein for the content, an area serving as a clue for judging the social situation is designated in advance based on the coordinate information regarding an area including a part of the text to be output or the coordinate information regarding an area including a part of the image output by the content.

7. The cognitive ability analysis device according to claim 6, further comprising a line-of-sight acquisition unit that acquires the coordinate information of the point where the user looks at among the content, the time information of the point where the user looks at, and the order information of the points where the user looks at in a time series and moves.

8. The cognitive ability analysis device according to claim 7, wherein the line-of-sight acquisition unit separately identifies and stores a point where the time the user looks at a predetermined point is equal to or more than a preset time.

9. The discrimination unit according to claim 8 of the cognitive ability analysis device, which discriminates whether a point where the time of gazing becomes equal to or longer than the preset time is included in the area serving as the clue.

10. The discrimination unit discriminates the cognitive ability of the social situation regarding the content from the user's gaze information based on a preset score criterion for each of the coordinate information of the gaze, the staying time of the gaze, whether the staying of the gaze occurs for a preset time or longer, and whether the staying of the gaze occurs in the area serving as the clue. The cognitive ability analysis device according to claim 9.

11. In a cognitive ability analysis method performed by a cognitive ability analysis device, a step of acquiring user information; a step of determining a type of content for discriminating the cognitive ability regarding the social situation based on the user information; a step of presenting the content and questions regarding the content to the user and acquiring the user's response; a step of discriminating the cognitive ability of the user regarding the social situation based on the user's response. A cognitive ability analysis method including these steps.

12. A program stored in a computer-readable recording medium that performs each step of the method according to claim 11.

Images