Digital treatment system based on cognitive behavioral therapy and method thereof

Abstract

The present invention relates to a digital treatment system based on cognitive behavioral therapy and a method thereof. The digital treatment system based on cognitive behavioral therapy according to the present invention comprises a user terminal, and a digital treatment server for providing the user terminal with content based on cognitive behavioral therapy, wherein the digital treatment server comprises: a collection unit for collecting background information of a user via the user terminal; a presentation unit for presenting one or more subjects to the user terminal; a learning unit for, when the user terminal selects one of the subjects, providing the user terminal with a plurality of tasks and basic content according to the subject; an application unit for providing the user terminal with technology reinforcement content enabling application of a technology corresponding to the basic content; a virtual field unit for providing the user terminal with virtual field content which has been derived from the basic content or obtained by reconstructing content of the technology reinforcement content; and an evaluation unit for evaluating content learned by the user.

Description

Digital treatment system and method based on cognitive behavioral therapy

[0001] The present invention relates to a digital treatment system and method based on cognitive behavioral therapy, and more particularly, to a digital treatment system and method based on cognitive behavioral therapy that provides personalized smart healthcare services to individuals with autism spectrum disorders aged 10 to 18 who require intensive development of peer social situational awareness and interaction rather than infants and toddlers.

[0002]

[0003] Autism spectrum disorder (ASD) is a mental illness characterized by developmental deficits in social interaction, restricted interests, stereotyped behaviors, and sensory sensitivity. It is a developmental disability that appears early in life and persists throughout life. Individuals with ASD exhibit developmental delays in various areas, including cognition, language, social-emotional development, physical development, and behavior, beginning in infancy. Developmental delays due to ASD can impact diverse areas of life, including school, work, social relationships, daily life, and independence. Difficulties in social interaction and safety often lead to the need for support from family, teachers, and caregivers. Therefore, identifying and treating ASD can significantly impact a child's long-term growth and development, and can have a positive impact on the family and society as a whole.

[0004] However, the development of effective treatments for social interaction deficits in people with autism spectrum disorder (ASD) is slow, and their availability is limited due to high costs and limited treatment facilities. While risperidone and aripiprazole have been FDA-approved for the treatment of hypersensitivity associated with ASD, there are no FDA-approved standard medications targeting core symptoms such as social situational awareness and interaction difficulties (National Research and Development Promotion Foundation, 2021). According to the American Association of People with Disabilities, the average annual cost of treatment for a child with ASD in the United States in 2017 was $17,081. Furthermore, including direct treatment costs incurred by parents of children with ASD as well as indirect costs (e.g., lost work time, household labor costs, etc.), the average household cost of treatment is estimated to be over $36,000 per year. Applied Behavior Analysis (ABA) has been introduced in Korea to improve social interaction in autism spectrum disorder (ASD) patients for over a decade, and treatment programs are gradually becoming widespread. However, the utilization rate is low due to the small number of licensed therapists and their concentration in the metropolitan area. Furthermore, the cost per session is around 60,000 to 100,000 won, resulting in monthly treatment costs exceeding 3 million won (Dong-A Ilbo, August 9, 2022). Furthermore, services such as rehabilitation exercise therapy, speech therapy, art therapy, and music therapy may incur additional costs, with 49.7% of parents of children with developmental disabilities reporting that treatment costs are "very burdensome" or "somewhat burdensome" (Childcare Policy Research Institute, 2019).

[0005] Meanwhile, digital therapeutic devices help children learn in engaging ways. These devices utilize games, videos, and animations to present content in a way that children can easily understand and engage with. This approach can help children find learning enjoyable, build confidence, and actively participate. Digital therapeutic devices are portable and can be applied using smartphones, smart pads, and other devices, allowing for multiple repetitions while remaining relatively inexpensive compared to face-to-face therapy. They are particularly useful because they allow for real-time feedback and problem-solving when problems arise in daily life.

[0006] Meanwhile, cognitive behavioral therapy (CBT) is a type of psychotherapy that focuses on the relationship between human thoughts, behaviors, and emotions through six stages: assessment or psychological assessment, reconceptualization, skills acquisition, skills consolidation and application training, generalization and maintenance, and post-treatment assessment follow-up. CBT is known to be able to achieve results such as cognitive improvement, behavior modification, and emotional regulation through repetitive learning, and is an evidence-based treatment method that is being used for various mental illnesses such as ADHD, mood disorders, and addiction.

[0007] Therefore, the need for a digital treatment system and method for autism spectrum disorders based on cognitive behavioral therapy and using digital treatment devices is emerging.

[0008]

[0009] The purpose of the present invention to solve the above-described problems is to provide a digital treatment system and method based on cognitive behavioral therapy that can improve the daily life-centered executive function of a person with autism spectrum disorder using a digital treatment device.

[0010]

[0011] In order to achieve the above-described object, a digital treatment system based on cognitive behavioral therapy according to one embodiment of the present invention includes a user terminal and a digital treatment server providing cognitive behavioral therapy-based content to the user terminal, wherein the digital treatment server includes a collection unit that collects user background information through the user terminal, a presentation unit that presents at least one topic to the user terminal, a learning unit that provides a plurality of tasks and basic content according to the topic to the user terminal when the user terminal selects any one of the topics, an application unit that provides technology-enhanced content capable of applying technology corresponding to the basic content to the user terminal, a virtual field unit that provides virtual field content derived from the basic content or in which the content of the technology-enhanced content is reconstructed to the user terminal, and an evaluation unit that evaluates what the user has learned.

[0012] The services provided by the above collection unit, the presentation unit, the learning unit, the application unit, the repetition unit, and the evaluation unit to the user terminal correspond to assessment or psychological assessment, reconceptualization, skills acquisition, skills consolidation and application training, generalization and maintenance, and post-treatment assessment follow-up of cognitive behavioral therapy, respectively.

[0013] The user's background information collected by the above collection unit includes the user's age and disability level, and the learning unit, the application unit, and the virtual field unit adjust the difficulty of the basic content, the technology-enhanced content, and the virtual field content according to the user's collected age and disability level.

[0014] The plurality of topics presented by the above presentation unit to the user terminal are characterized in that they are topics according to situations that may occur in daily life.

[0015] The above basic content consists of a video containing scenes corresponding to each of the above multiple tasks.

[0016] The above technology-enhanced content is created in a manner in which multiple speakers converse with each other based on the conversation content included in the basic content, and one of the speakers includes first technology-enhanced content that performs the role of the user.

[0017] The above technology-enhanced content includes second technology-enhanced content in which the speech of a speaker performing the role of the user is silenced, and the application unit provides the first technology-enhanced content to the user terminal, and then provides the second technology-enhanced content to the user terminal, and when the silenced speech of the speaker is provided, the user terminal records the speech of the user, and the application unit receives the recorded speech of the user.

[0018] The above virtual scene content includes first virtual scene content including a video containing content derived from the basic content or a video in which the content of the technology-enhanced content is reconstructed, the first virtual scene content is formed in a manner in which a plurality of speakers converse with each other, and one of the speakers performs the role of the user, the virtual scene content includes second virtual scene content in which the speech of the speaker performing the role of the user in the first virtual scene content is muted, and the virtual scene unit provides the first virtual scene content to the user terminal and then provides the second virtual scene content to the user terminal, and the user terminal records the speech of the user when the speech of the muted speaker is provided, and the virtual scene unit receives the recorded speech of the user.

[0019] The above evaluation unit evaluates what the user has learned based on the user's speech received by the application unit and the virtual field unit, respectively.

[0020] In order to achieve the above-described object, a digital treatment method based on cognitive behavioral therapy according to one embodiment of the present invention includes the steps of collecting background information of a user through a user terminal, the step of presenting at least one topic to the user terminal, the step of providing a plurality of tasks and basic content according to the selected topic to the user terminal when the user terminal selects any one of the topics, the step of providing technology-enhanced content capable of applying a technology corresponding to the basic content to the user terminal, the step of providing virtual field content derived from the basic content or in which the content of the technology-enhanced content is reconstructed to the user terminal, and the step of evaluating what the user has learned.

[0021]

[0022] According to the present invention, a digital treatment system and method based on cognitive behavioral therapy, by providing educational content based on cognitive behavioral therapy to autism spectrum disorders, it is possible to obtain results such as cognitive improvement, behavior modification, and emotional control through repetitive learning.

[0023] According to the present invention, a digital treatment system and method based on cognitive behavioral therapy provide educational content to autism spectrum disorder patients through a digital treatment device, and thus are portable, location-independent, and allow for multiple repetitions of learning, while being relatively inexpensive and effective compared to face-to-face treatment.

[0024] According to the present invention, a digital treatment system and method based on cognitive behavioral therapy, by providing educational content to autistic spectrum disorder patients using games, videos, animations, etc., there is an effect in which autistic spectrum disorder patients can more easily understand and find educational content more interesting.

[0025]

[0026] Figure 1 is a block diagram showing each component of a digital treatment system based on cognitive behavioral therapy according to the present invention.

[0027] Figure 2 is a block diagram showing each configuration of a digital treatment server according to the present invention.

[0028] Figure 3 is a drawing showing an example of a topic presented by a presentation unit to a user terminal.

[0029] Figure 4 is a flowchart of a digital treatment method based on cognitive behavioral therapy according to the present invention.

[0030]

[0031] Hereinafter, some embodiments of the present invention will be described in detail with reference to exemplary drawings. When designating components in each drawing, it should be noted that, where possible, identical components are given the same reference numerals, even if they appear in different drawings.

[0032] And when describing an embodiment of the present invention, if it is determined that a specific description of a related known configuration or function hinders understanding of the embodiment of the present invention, the detailed description is omitted.

[0033] Additionally, in describing components of embodiments of the present invention, terms such as first, second, A, B, (a), (b), etc. may be used. These terms are only intended to distinguish the components from other components, and the nature, order, or sequence of the components are not limited by the terms.

[0034] In this specification, the singular includes the plural unless specifically stated otherwise. The terms “comprises” and / or “comprising” as used herein do not exclude the presence or addition of one or more other components in addition to the components mentioned.

[0035] Hereinafter, the present invention will be described in more detail with reference to the attached drawings.

[0036] Figure 1 is a block diagram showing each component of a digital treatment system (1000) based on cognitive behavioral therapy according to the present invention.

[0037] A digital treatment system (1000) based on cognitive behavioral therapy according to the present invention (hereinafter referred to as “system (1000)”) includes a user terminal (10) and a digital treatment server (100).

[0038] A user terminal (10) (digital therapeutic device, hereinafter referred to as "user terminal (10)") is carried by a user with autism spectrum disorder. The user can transmit and receive information to and from a digital therapeutic server (100) via the user terminal (10).

[0039] An application for treating autism spectrum disorder of a user may be installed on the user terminal (10). The application is a user program specifically for performing the system (1000) and method according to the present invention. This application may be downloaded and installed from a digital treatment server (100) or another app store server. The application installed on the user terminal (10) may communicate with the digital treatment server (100) to receive educational content, display educational screens within the educational content on the display device of the user terminal (10), speak audio information, or record the user's speech.

[0040] The digital treatment server (100) provides at least one communication protocol for communicating with a user terminal (10) through a communication network, and can provide an interface, such as an application programming interface (API) for app linkage for service for an application, to the user terminal (10).

[0041] Hereinafter, with reference to FIG. 2, each component of the digital treatment server (100) according to the present invention will be described in detail.

[0042] Figure 2 is a block diagram showing each configuration of a digital treatment server (100) according to the present invention.

[0043] The digital treatment server (100) according to the present invention, referring to FIG. 2, includes a collection unit (110), a presentation unit (120), a learning unit (130), an application unit (140), a virtual site unit (150), and an evaluation unit (160). Meanwhile, the services provided to the user terminal (10) by the aforementioned collection unit (110), presentation unit (120), learning unit (130), application unit (140), virtual site unit (150), and evaluation unit (160) correspond to ① assessment or psychological assessment, ② reconceptualization, ③ skills acquisition, ④ skills consolidation and application training, ⑤ generalization and maintenance, and ⑥ post-treatment assessment follow-up of cognitive behavioral therapy, respectively.

[0044] For example, the collection unit (110) assesses the user's current knowledge to correspond to the "evaluation or psychological assessment" of cognitive behavioral therapy. The collection unit (110) can collect the user's current knowledge and the degree of disability, etc. In addition, the collection unit (110) can also collect the user's age, gender, etc.

[0045] The presentation section (120) presents topics to be learned, responding to the "reconceptualization" aspect of cognitive behavioral therapy. Meanwhile, reconceptualization refers to the process of re-evaluating and restructuring the way users understand and process their current problem situations. Therefore, the topics presented in the presentation section are selected based on situations that users may encounter in their daily lives.

[0046] The learning unit (130) corresponds to the "skill acquisition" aspect of cognitive behavioral therapy. When a user selects a topic, it presents detailed tasks based on the selected topic and provides the user with basic content containing the content of those detailed tasks. This basic content allows the user to acquire skills in the detailed tasks through repeated practice.

[0047] The application unit (140) provides users with skill-enhancing content comprised solely of the speech content included in the basic content, in response to the "skill-enhancing and application training" aspect of cognitive behavioral therapy. The skill-enhancing content provides users with options to select appropriate speech, or provides an environment in which users can actually speak, allowing them to apply acquired skills to real-world situations.

[0048] The virtual field section (150) provides users with virtual field content that allows them to repeatedly practice tasks derived from basic content and skill-enhancing content, or situations that may additionally arise for each topic, in a virtual field to correspond to the 'generalization and maintenance' of cognitive behavioral therapy. The virtual field content provides users with options to select appropriate speech in a virtual field related to the topic presented by the presentation section (120), or provides an environment in which the user can actually speak, allowing the user to apply the skills acquired in the virtual field.

[0049] The evaluation unit (160) enables the overall process to be evaluated and repeated to correspond to the "post-treatment follow-up evaluation" of cognitive behavioral therapy. For example, the evaluation unit (160) evaluates the user's educational and learning outcomes based on the user's selections and / or actual utterances in the technology-enhanced content of the application unit (140) and / or the virtual field content of the virtual field unit (150).

[0050] Cognitive behavioral therapy, as mentioned above, is a type of psychotherapy that focuses on the relationship between human thoughts, behaviors, and emotions through a process that encompasses ① assessment or psychological assessment, ② reconceptualization, ③ skills acquisition, ④ skills consolidation and application training, ⑤ generalization and maintenance, and ⑥ post-treatment assessment follow-up. Cognitive behavioral therapy is known to be able to achieve results such as cognitive improvement, behavior modification, and emotional regulation through repetitive learning, and is an evidence-based treatment method that is being utilized for various mental illnesses such as ADHD, mood disorders, and addiction.

[0051] Meanwhile, adolescents and adults with autism spectrum disorder (ASD) experience significant difficulties adapting to daily life due to executive functioning issues, even in the absence of intellectual disability. In particular, they often struggle to complete targeted behaviors due to challenges with key executive functions such as cognitive flexibility, self-control, working memory, and planning and initiation.

[0052] Several studies have identified individual vulnerabilities in executive functioning in individuals with autism spectrum disorder (ASD) and demonstrated the effectiveness of tailored programs to strengthen executive functioning (Chung, 2016; Oswald, 2017; Yang, 2022; de Vries, 2015; Kenworthy, 2013; Baker-Ericzín, 2017). These studies have demonstrated improvements in executive functioning, including working memory, behavioral control, planning, and organizational skills, and have also demonstrated effectiveness in reducing anxiety.

[0053] However, the above studies were mostly conducted under controlled experimental conditions, and only indirect effects were reported in the process of increasing adaptive ability and social interaction in daily life, so it is limited to say that they promoted real-world social behavior.

[0054] Accordingly, the system (1000) according to the present invention comprises: ① a collection unit (110) that identifies the user's current knowledge (background information) through a user terminal (10), ② a presentation unit (120) that presents at least one topic to the user terminal (10) and receives a selection of at least one topic from the user terminal (10), ③ a learning unit (130) that provides the user terminal (10) with basic content that can be repeatedly practiced along with a plurality of detailed tasks according to the topic when the user terminal (10) selects at least one topic, so that the user can acquire a skill, ④ an application unit (140) that provides skill enhancement content to the user terminal so that the skill acquired through the basic content can be applied, ⑤ a virtual field unit (150) that provides virtual field content that reconstructs the content of tasks or skill enhancement content that can be derived from the basic content, so as to promote repetitive practice in a field that changes from moment to moment, and ⑥ an evaluation unit (160) that evaluates and learns the learned content, so that the user can apply the learned content to everyday life. Educates and treats individuals with autism spectrum disorders in terms of adaptive skills and social interaction.

[0055] The collection unit (110) collects background information of a user with autism spectrum disorder (ASD) through the user terminal (10) and determines the user's current knowledge. The collection unit (110) collects, for example, the user's age, degree of disability, gender, etc.

[0056] Figure 3 is a drawing showing an example of a topic presented by a presentation unit (120) to a user terminal (10).

[0057] The presentation unit (120) presents at least one topic to the user terminal (10). The topics presented by the presentation unit (120) can be configured to enable practice of communication processes with individuals who may be encountered in daily life or social situations, taking into account deficiencies in social interaction and communication skills of individuals with autism spectrum disorders. This corresponds to the purpose of the present invention, which is to provide personalized smart healthcare services to individuals with autism spectrum disorders aged 10 to 18, who require intensive development of peer social situation awareness and interaction, rather than infants and toddlers. As the topics presented by the presentation unit (120) are applied to situations that may occur in daily life, the basic content provided by the learning unit (130), which will be described later, also includes content on communication processes with individuals who may be encountered in daily life or social situations, thereby comprehensively promoting planning and organization, cognitive flexibility, and social interaction in the process of individuals with autism spectrum disorders adapting to daily life.

[0058] As described above, the topics presented by the presentation unit (120) to the user terminal (10) may be topics that may occur in daily life, and for example, as shown in FIG. 3, include ① dressing according to the weather, ② using the restroom, ③ finding directions (using public transportation), ④ using the bus (cash, card), ⑤ using the subway (cash, card), ⑥ going to the bank (using an ATM), ⑦ doing offline shopping (cash, card), ⑧ doing online shopping (card), ⑨ going to the hospital, ⑩ going to the pharmacy, etc.

[0059] When the presentation unit (120) presents the aforementioned topics to the user terminal (10), the user terminal (10) can select any of the topics presented by the presentation unit (120). Alternatively, as an example, a guardian of an individual with autism spectrum disorder, such as a parent, may select any of the aforementioned topics. Although not illustrated in the drawing, if a guardian participates in the service provided by the present invention, the guardian may access the digital therapy server (100) via a guardian terminal (not illustrated).

[0060] When the user terminal (10) selects one of the aforementioned topics, the presentation unit (120) receives information about the selection and transmits the information to the learning unit (130).

[0061] The learning unit (130) provides a plurality of detailed tasks according to the subject to the user terminal (10).

[0062] As an example, when the topic of dressing according to the weather is selected, the learning unit (130) presents detailed tasks such as ① checking the weather, ② checking the temperature, ③ deciding on a broad range of clothes, ④ selecting appropriate clothes from among the clothes I own, and ⑤ checking for inappropriate clothes.

[0063] Or, as an example, when a topic about using a bus (card) is selected, the learning unit (130) presents detailed tasks such as ① searching for a departure point and a destination through the Naver Map or Kakao Map application, ② checking the required time, ③ preparing to depart 20 minutes before the required time, ④ checking the bus number to take, ⑤ checking the bus stop, ⑥ waiting for the bus at the bus stop, ⑦ holding the transportation card in hand in advance, ⑧ when the bus arrives, boarding and tapping the transportation card (e.g., tagging by dragging the transportation card), ⑨ sitting down, ⑩ checking the stop to get off, ⑪ listening carefully to the bus announcement and pressing the bell, ⑫ tapping the card and getting off.

[0064] Or, as an example, when a topic about using the subway (card) is selected, the learning unit (130) presents detailed tasks such as ① searching for the departure point and destination through the Naver Map or Kakao Map application, ② checking the number of subway transfers, ③ checking the subway station, ④ checking the required time, ⑤ preparing to depart 20 minutes earlier than the required time, ⑥ checking the name of the station to get off at, ⑦ listening carefully to the subway announcement and preparing to get off, ⑧ checking the map to see which exit number to take after getting off, ⑨ after the announcement, looking at the exit information board and finding the ticket gate after getting off, ⑩ tapping the transportation card when exiting, ⑪ looking at the exit information board and finding the exit.

[0065] Or, as an example, when a topic about going to the bank (using an ATM - withdrawing money) is selected, the learning unit (130) presents detailed tasks such as ① checking the bank mark on the check card (for example, the bank name appears by bank mark), ② searching for the bank name on Naver Map or Kakao Map, ③ finding the nearest bank, ④ opening the door to an ATM machine and entering, ⑤ clicking the deposit / withdrawal button, ⑥ clicking “card,” ⑦ inserting the card into the flashing area in the direction of the arrow, ⑧ selecting the amount, ⑨ selecting “other” if there is no amount, then pressing the number and pressing the confirmation button, ⑩ checking the amount and pressing the confirmation button, ⑪ entering the 4-digit card password, ⑫ printing the statement, ⑬ receiving the card and statement.

[0066] Or, as an example, when a topic about online shopping (guidance on how to install a card-app card) is selected, the learning unit (130) presents detailed tasks such as ① searching for “mask” on Naver, ② pressing the shopping tab, ③ looking at the desired color and size and clicking, ④ checking the quantity to purchase after selecting the color and size, ⑤ pressing purchase, ⑥ searching and entering home address in the delivery address, ⑦ entering mobile phone number, ⑧ entering delivery message, ⑨ clicking general payment, ⑩ selecting credit card, ⑪ clicking the company name of the card I have, ⑫ pressing “Pay,” ⑬ pressing “Pay with app card,” ⑭ pressing QR code to pay, and ⑮ entering a simple payment password.

[0067] Meanwhile, the tasks presented by the learning unit (130) can each be composed of one scene from the basic content.

[0068] The learning unit (130) provides basic content corresponding to a topic selected by the user and multiple tasks corresponding to the topic to the user terminal (10). The basic content provided by the learning unit (130) to the user terminal (10) consists of a video containing scenes corresponding to tasks corresponding to the topic selected by the user. The basic content may be, for example, an animation in the form of multiple speakers conversing with each other. The video of the basic content may include not only the conversation between the multiple speakers, but also separate components for explaining each topic and task and helping the user understand the current situation.

[0069] Meanwhile, the learning unit (130) can adjust the difficulty of the basic content based on the user's background information collected by the collection unit (110). For example, the learning unit (130) can adjust the difficulty of the basic content based on the user's age and disability level. In this case, the difficulty of the basic content is adjusted by adjusting the number of speakers or the number of tasks.

[0070] As the number of speakers increases, the volume of conversation increases, and a higher level of conversational skills are required. For example, with two speakers, it's enough to take turns in conversation and focus only on the other person. However, with four speakers, the conversation must also remember the three other speakers' words and respond appropriately to the flow of the conversation. Furthermore, conversational timing and eye contact become more complex.

[0071] Furthermore, as the number of tasks increases, the difficulty decreases, and as the number of tasks decreases, the difficulty increases. For example, if the task of "finding the exit after boarding the subway" is broken down into subtasks such as "confirm the station you will be getting off at > listen carefully to the announcement > check the exit on the map," the difficulty of each task decreases.

[0072] Meanwhile, this adjustment of difficulty is not only applied to the basic content of the learning section (130), but can also be applied to the technology enhancement content of the application section (140) and / or the virtual field content of the virtual field section (150), which will be described later.

[0073] The application unit (140) provides technology-enhanced content that can apply and utilize technology corresponding to the basic content to the user terminal (10). The technology-enhanced content can be centered on a method in which multiple speakers converse with each other so that conversation training can be focused solely on the conversation content included in the basic content. At this time, one of the speakers plays the role of a user. When the speaker playing the role of the user speaks, some of the animations in the technology-enhanced content are modified to display the speaker playing the role of the user so that the focus can be on that speech. In relation to the display of the speaker, the application unit (140) assigns feature points to the user's facial area captured by the camera of the user terminal (10), and calculates and digitizes the amount of change in the assigned feature points using interpolation, thereby enabling the implementation of an animation of the face and / or expression of a 2D or 3D model that changes in real time, which will be described later.

[0074] When providing technology-enhanced content to a user terminal (10), the application unit (140) may provide the technology-enhanced content after silencing the speech of the speaker who performed the role of the user in the technology-enhanced content. That is, the application unit (140) may provide the general technology-enhanced content (e.g., 'first technology-enhanced content') as described above to the user terminal (10) a preset number of times determined according to the age and degree of disability of the user, and then provide technology-enhanced content (e.g., 'second technology-enhanced content') in which only the speech of the speaker who performed the role of the user is silenced to the user terminal (10). The application unit (140) presents a video in which the dialogue of a person who will represent the user is omitted during video playback through the second technology-enhanced content, and allows the user to learn linguistic conversational expressions while completing the omitted dialogue.

[0075] When the dialogue of a character representing the user is omitted in the second technology-enhanced content, the application unit (140) can display multiple options on the user terminal (10) to select an appropriate speech content of the character. The user can select an option containing an appropriate speech content from among the displayed options.

[0076] Alternatively, the application unit (140) may provide an environment in which the user can actually speak appropriate speech content of the character when the dialogue of the character representing the user is omitted in the second technology-enhanced content. The user terminal (10) may record the user's speech when the speech of the muted speaker is provided during playback of the second technology-enhanced content. The user terminal (10) transmits the choice information selected by the user and / or the recorded user's speech to the application unit (140), and the application unit (140) transmits the received choice information and / or the recorded user's speech to the evaluation unit (160). The evaluation unit (160) may evaluate the choice information selected by the user and / or the recorded user's speech according to the criteria described below.

[0077] The virtual field section (150) provides virtual field content in which tasks or technology-enhanced content that can be derived from a subject and / or basic content are reconstructed to the user terminal (10).

[0078] The virtual scene content provides options for the user to select an appropriate speech in a virtual scene related to the topic presented by the presentation unit (120), or provides an environment in which the user can actually speak, allowing the user to apply the skills acquired in the virtual scene.

[0079] The virtual reality content is designed to teach and educate people with autism spectrum disorder how to appropriately respond to various changing situations, taking into account their characteristics, such as difficulty adapting and adapting flexibly to various changes.

[0080] For example, if the topic selected by the user is 'Dress for the Weather', the corresponding subtasks are, as described above, ① Check the weather, ② Check the temperature, ③ Determine the general range of clothing, ④ Select appropriate clothing from among the clothes I own, and ⑤ Identify inappropriate clothing. The basic content is a video containing scenes for each subtask, and the technology-enhanced content is composed by extracting only the utterance content from each basic content. At this time, the virtual scene content includes content that can be derived from the aforementioned topics and tasks, such as when the weather forecast and actual weather are different, when it suddenly starts raining, and how to rent an umbrella or purchase an inexpensive umbrella. Furthermore, the virtual scene content may be a reconstruction of the utterance content of the technology-enhanced content that is composed by extracting only the utterance content from each basic content. This reconstruction may mean changing the speaker from a woman to a man, changing the age of the speakers, or changing the number of speakers. Therefore, virtual field content presents various changing situations based on topics and detailed tasks, and enables education and learning of correct speaking according to them.

[0081] The virtual scene content, like the aforementioned technology-enhanced content, includes a speaker performing the role of a user, and includes first virtual scene content that fully includes the content of the speaker's speech, and second virtual scene content in which the speaker's speech performing the role of a user is silenced when the speaker speaks.

[0082] That is, the first virtual scene content includes videos containing content derived from the base content and / or videos reconstructed from technology-enhanced content. The first virtual scene content consists of multiple speakers conversing with each other, with one of the speakers acting as the user.

[0083] The second virtual scene content is provided to the user with the speech of the speaker who performed the user's role in the first virtual scene content silenced.

[0084] The virtual scene section (150) provides the first virtual scene content to the user terminal (10) a preset number of times according to the user's age and degree of disability, and then provides the second virtual scene content, in which only the speech of the speaker who performed the role of the user is silenced, to the user terminal (10). The virtual scene section (150) presents a video in which the speech of the person representing the user is omitted when playing the video through the second virtual scene content, and allows the user to learn linguistic conversation expressions by completing the omitted conversation by applying the speech learned from the basic content and the technology-enhanced content.

[0085] At this time, the virtual scene unit (150) can receive the selection information and / or speech information selected or recorded through the virtual scene content from the user terminal (10), and the virtual scene unit transmits the received selection information and / or recorded speech information to the evaluation unit (160). The evaluation unit (160) can evaluate the selection information selected by the user and / or the recorded user speech according to the criteria described below.

[0086] The evaluation unit (160) evaluates what the user has learned based on the accuracy of the selection information received by the application unit (140) and / or the virtual field unit (150) and / or the recorded user's speech.

[0087] If the evaluation unit (160) evaluates what the user has learned based on the recorded user's speech, the evaluation unit (160) evaluates what the user has learned based on multiple evaluation criteria. The evaluation criteria include a keyword evaluation criteria, a dialogue response speed evaluation criteria, a speech rate evaluation criteria, a dialogue repetition evaluation criteria, etc.

[0088] The evaluation unit (160) analyzes and evaluates the recorded user's speech, and if the user's conversation meets the preset evaluation criteria, it determines that the learning training is successful. If the user's conversation does not meet the evaluation criteria, it determines that the learning training is failed.

[0089] The keyword evaluation criteria are intended to determine and evaluate whether keywords are included in the user's utterance.

[0090] The evaluation criteria for conversational response speed are based on how appropriately the user speaks after the other person has finished speaking. If the user waits too long to respond, the conversation may be interrupted or rushed, disrupting smooth communication. Furthermore, if the user begins speaking before the other person has finished speaking, the conversation may be interrupted or even start a completely different conversation unrelated to the other person's response.

[0091] The speech rate assessment criteria are intended to assess speech speed during conversation. Speech rate is a crucial skill for effectively conveying your message to the other person. If your speech is too fast or too slow, it can be difficult for the other person to understand or pay attention, making it difficult to maintain a conversation.

[0092] The dialogue repetition evaluation criterion evaluates whether the user repeats the same words or phrases when speaking.

[0093] Figure 4 is a flowchart of a digital treatment method based on cognitive behavioral therapy according to the present invention.

[0094] The digital treatment method (hereinafter referred to as the 'method') based on cognitive behavioral therapy according to the present invention, with reference to FIG. 4, includes a step (S100) in which a collection unit (110) collects user background information from a user terminal (10), a step (S200) in which a presentation unit (120) presents at least one topic to the user terminal (10), a step (S300) in which a learning unit (130) provides a plurality of tasks and basic content according to the selected topic to the user terminal when the user terminal selects one of the topics, a step (S400) in which an application unit (140) provides technology-enhanced content capable of applying technology corresponding to the basic content to the user terminal (10), a step (S500) in which a virtual field unit (150) provides virtual field content derived from the basic content or in which the content of the technology-enhanced content is reconstructed to the user terminal (10), and a step (S600) in which an evaluation unit (160) evaluates the learned content. Details at each stage are as described above.

[0095] Meanwhile, the present method may further include a step (not shown) of providing a reward to the user after step S600.

[0096] The step of providing a reward to the user is to provide the first reward to the user terminal (10) when the evaluation is completed by the evaluation unit (160).

[0097] At this time, the step of providing a reward to the user is to provide a second reward together with the first reward to the user terminal (10) when the user's conversation content is determined to be a success in learning training by meeting the preset evaluation criteria by the evaluation unit (160).

[0098] To this end, the system (1000) according to the present invention may further include a compensation unit (not shown).

[0099] Upon receiving the evaluation results from the evaluation unit (160), the reward unit provides the first reward to the user terminal (10). The first reward is provided to the user upon completion of learning a topic and tasks related to that topic, regardless of the results. Therefore, the first reward may be smaller in size than other rewards, as described below.

[0100] On the other hand, the second reward may be a greater reward than the first reward because it is given when the user successfully completes a topic and tasks related to the topic to achieve a result that meets the evaluation criteria, thereby achieving successful learning training. The reward unit that provides the second reward to the user transmits the result to the collection unit (110), the presentation unit (120), and / or the learning unit (130). If the user receives the second reward, the collection unit (110) collects and stores the result as background information of the user. If the user receives the second reward, the presentation unit (120) may indicate successful learning training for the topic for which the second reward was received for a certain period of time, or may not present the topic to the user terminal (10) for a certain period of time. The learning unit (130) may increase the difficulty of the basic content for the topic if the user re-selects the topic for which the second reward was received. Therefore, as described above, the number of speakers may be increased, or basic content with a reduced number of tasks may be provided to the user terminal (10). Meanwhile, in the case of autism spectrum disorders, since repeated learning of the same topic and task is important, if the basic content according to the topic and task that received the second reward with increased difficulty is repeatedly learned, and the evaluation unit (160) evaluates the learning training as successful again, the evaluation unit (160) provides the user with a third reward. Therefore, the reward unit can encourage participation in learning by providing the user with a reward for repeated learning, and can also motivate voluntary repeated participation in the topic and task learned within a certain period of time.

[0101] Meanwhile, the first through third rewards described above can also be paid out through the guardian terminal. For example, each reward can be applied as mileage or points that can be exchanged for tangible rewards. Alternatively, each reward can take the form of a symbolic icon that can be directly exchanged for a tangible reward. For example, the symbolic icon could represent a user's favorite tangible item, such as chocolate, strawberries, or snacks. The guardian terminal can then directly provide the reward to the user through the icon provided. This provides users with tangible rewards, thereby motivating them to participate in learning and repeat their participation.

[0102] Additionally, for example, if each reward is mileage or points, the rewards department can categorize the topics learned by the user and determine topics with high similarity as similar topics.

[0103] The reward section can separately calculate the reward amount based on the difficulty level, average time required, etc. for similar topics. The reward amount calculated in this way can be determined as an expected reward amount and displayed on the user terminal (10) along with the topic when the user selects the topic.

[0104] This is intended to provide users with greater rewards for repeating similar topics. Furthermore, it has the advantage of increasing learning efficiency by studying similar topics.

[0105] Meanwhile, as described above, the application unit (140) and the virtual field unit (150) provide technology-enhanced content and virtual field content, respectively, to the user terminal (10). Meanwhile, the technology-enhanced content and the virtual field content include a speaker who performs the role of the user. In this case, the application unit (140) and / or the virtual field unit (150) can recognize the user's face or expression and provide an animation in which the user's current face or expression is synthesized in real time onto the face of the speaker who performs the user's role, to the user terminal (10).

[0106] The user terminal (10) captures the face of the user being studied through a camera and transmits the captured face to the digital treatment system (1000). The application unit (140) and / or the virtual field unit (150) synthesizes the received face or expression of the user onto the face of the speaker performing the role of the user in the animation.

[0107] Accordingly, users can recognize the speaker, whose face or expression is synthesized, as the speaker performing their role, and their gaze can be directed to the speaker themselves, thereby enhancing learning efficiency. This not only makes learning more enjoyable for users, but also provides real-time confirmation that they are focusing on the technology-enhanced content and / or virtual reality content within the correct area.

[0108] The application unit (140) and the virtual field unit (150) can implement animation of the face and / or expression of a 2D or 3D model that changes in real time by assigning feature points to a face area captured by a camera of a user terminal (10) and calculating the amount of change in the assigned feature points using interpolation and converting it into data.

[0109] The application unit (140) and the virtual field unit (150) respectively search for the user's face area in an image captured by the camera of the user terminal (10), assign feature points to the searched face area, and when the amount of change in the feature point is input, digitize the amount of change, and apply the digitized amount of change to a 2D or 3D model in which feature points and control points according to the amount of change are preset, thereby implementing an animation of the face and / or expression of the 2D or 3D model that changes in real time. When applying the digitized amount of change, the application unit (140) and the virtual field unit (150) respectively load a 2D or 3D model in which feature points and control points are preset, and when the amount of change in the digitized feature point is recognized, control the amount of change in the feature point by the preset control point and output it, and if the amount of change in the feature point is not transmitted, output the initialized face and / or expression of the loaded model. At this time, it is preferable that the digitized amount of change is a vector function value with respect to time.

[0110] Below, a more specific description will be given of the application part (140) and the virtual scene part (150) that implement the user's current face or expression by synthesizing it in real time onto the face of the speaker performing the user's role.

[0111] The application unit (140) and the virtual scene unit (150) each capture a face and / or expression through a camera to search a facial area, and assign feature points to eyes, nose, mouth, eyebrows, and the entire facial outline within the searched facial area. Then, by converting the amount of change in the feature points that changes as the face and / or expression changes into data and applying this to a 2D or 3D model in which feature points and control points according to the amount of change in the feature points are preset, a face and / or expression animation of a 2D or 3D model that changes in real time is implemented.

[0112] When applying the variation of digitized feature points, a 2D or 3D model with preset feature points and control points that will change according to the variation of the feature points is loaded, and it is checked whether the variation of the digitized feature points is received. If it is received, the variation of the feature points is controlled by the preset control points and output. If the variation of the feature points is not received, the initialized facial and / or facial expression animation of the loaded model is output. Therefore, it is possible to recognize that the user is not viewing technology-enhanced content or virtual scene content, or is viewing it outside a certain area.

[0113] Meanwhile, the amount of change in feature points within the facial area captured by the camera can be calculated through interpolation.

[0114] Interpolation is a technique for generating facial expression animation by approximating intermediate stages from faces and / or expressions expressed through multiple feature points. There are various known methods, such as shape interpolation, which approximates geometric structures, and key frame interpolation, which approximates images over time.

[0115] Below, an example of a process in which interpolation is applied is described in detail.

[0116] First, still images are extracted at regular intervals from a moving image input in real time through a camera, and feature points are assigned to the searched facial region in the still image and temporarily stored in a first data memory. Then, after a certain period of time (e.g., 0.1 to 1 second) has elapsed, still images are extracted from the input moving image, feature points are assigned to the searched facial region, and temporarily stored in a second data memory. Then, the feature points temporarily stored in the first and second data memories are compared to calculate and digitize the amount of change. At this time, the amount of change is expressed as an approximate vector function value with respect to time. Then, a 2D or 3D model with preset feature points is loaded and the amount of change in the digitized feature points is applied to implement facial expression animation.

[0117] The user terminal (10) and guardian terminal according to the present invention are terminals such as a desktop PC, a notebook PC, a tablet PC, a smartphone, etc., which are equipped with input means such as a keyboard, a mouse, a touchpad, a touch screen, etc., and a display screen, and are not limited thereto, and can include any configuration capable of processing digital information that can connect to a digital treatment server (100) through a communication network, input search information and selection information, and install an application program capable of displaying searched result information. The user terminal (10) according to the present invention is a component that connects to a digital treatment server (100) through a communication network to transmit and receive information, and may include, for example, at least one of a smartphone, a tablet personal-computer, a mobile phone, a video phone, a desktop personal computer, a laptop personal computer, a netbook computer, a personal digital assistant (PDA), a portable multimedia player (PMP), a wearable device (e.g., smart glasses, a head-mounted device (HMD), etc.), an unmanned terminal (kiosk), or a smart watch).

[0118] The user terminal (10) and the digital treatment server (100) according to the present invention can communicate through the communication unit and communication network each of them has. The communication network refers to a connection structure that enables information exchange between each node, such as terminals and servers, and examples of such a communication network include, but are not limited to, a 3GPP (3rd Generation Partnership Project) network, an LTE (Long Term Evolution) network, a 5G network, a WIMAX (World Interoperability for Microwave Access) network, the Internet, a LAN (Local Area Network), a Wireless LAN (Wireless Local Area Network), a WAN (Wide Area Network), a PAN (Personal Area Network), a Wi-Fi network, a Bluetooth network, a satellite broadcasting network, an analog broadcasting network, a DMB (Digital Multimedia Broadcasting) network, etc. The communication unit of each of the user terminal (10) and the digital treatment server (100) may include electronic components provided for the communication network so as to perform wired and wireless data communication through the aforementioned communication network.

[0119] In this specification, the digital treatment server (100) and each component of the digital treatment server (100) may be processors that execute sequential execution processes stored in memory. Alternatively, they may operate as software modules driven and controlled by the processor. Furthermore, the processor may be a hardware device.

[0120] For reference, a digital treatment method based on cognitive behavioral therapy according to one embodiment of the present invention may be implemented in the form of program commands that can be executed through various computer means and recorded on a computer-readable medium. The computer-readable medium may include program commands, data files, data structures, etc., either singly or in combination. The program commands recorded on the medium may be those specifically designed and configured for the present invention or may be those known and usable by those skilled in the art of computer software. Examples of the computer-readable medium may include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and hardware devices specifically configured to store and execute program commands, such as ROMs, RAMs, and flash memories. Examples of program commands include not only machine codes generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter, etc. The above-described hardware devices may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

[0121] In this specification, the term "unit" includes a unit realized by hardware, a unit realized by software, and a unit realized using both. Furthermore, a single unit may be realized using two or more pieces of hardware, and two or more units may be realized by a single piece of hardware.

[0122] The scope of protection of the present invention is not limited to the description and expression of the embodiments explicitly described above. Furthermore, it should be noted that the scope of protection of the present invention may not be limited by obvious modifications or substitutions within the technical field to which the present invention pertains.

Claims

1. Includes a user terminal and a digital treatment server that provides learning content based on cognitive behavioral therapy to the user terminal. The above digital treatment server, A collection unit that collects user background information through the user terminal; A presentation unit that presents at least one topic to the user terminal; A learning unit that provides a plurality of tasks and basic contents according to the topic to the user terminal when the user terminal selects one of the topics; An application unit that provides technology-enhanced content that can apply technology corresponding to the basic content to the user terminal; A virtual site section that provides virtual site content derived from the basic content or reconstructed from the technology-enhanced content to the user terminal; and An evaluation section that evaluates what the user has learned; A digital treatment system based on cognitive behavioral therapy, including:

2. In claim 1, The services provided by the above collection unit, the presentation unit, the learning unit, the application unit, the repetition unit and the evaluation unit to the user terminal are respectively: A digital treatment system based on cognitive behavioral therapy, characterized by corresponding to assessment or psychological assessment, reconceptualization, skills acquisition, skills consolidation and application training, generalization and maintenance, and post-treatment assessment follow-up.

3. In claim 1, The user's background information collected by the above collection department is: Including the age and degree of disability of the user, The above learning section, the application section and the virtual field section, A digital treatment system based on cognitive behavioral therapy, characterized in that the difficulty of the basic content, the technology-enhanced content, and the virtual field content is adjusted according to the collected age and degree of disability of the user.

4. In claim 1, The multiple topics presented by the above presentation unit to the user terminal are: A digital treatment system based on cognitive behavioral therapy, featuring topics based on situations that can arise in everyday life.

5. In claim 4, The above basic content is, A digital treatment system based on cognitive behavioral therapy, characterized in that it comprises a video containing scenes corresponding to each of the above multiple tasks.

6. In claim 5, The above technology enhancement content is, A digital treatment system based on cognitive behavioral therapy, characterized in that it is conducted in a manner in which multiple speakers converse with each other based on the conversation content included in the above basic content, and one of the speakers includes first technology-enhanced content that performs the role of the user.

7. In claim 6, The above technology enhancement content is, Includes second technology-enhanced content in which the speech of the speaker performing the role of the above user is silenced. The above application part is, After providing the first technology-enhanced content to the user terminal, the second technology-enhanced content is provided to the user terminal. The user terminal records the user's speech when the muted speaker's speech is provided, A digital treatment system based on cognitive behavioral therapy, characterized in that the above application unit receives the recorded user's speech.

8. In claim 7, The above virtual site content is, Includes first virtual scene content including a video containing content derived from the above basic content or a video in which the content of the above technology-enhanced content is reconstructed, The above first virtual site content is, It is done in a way that multiple speakers talk to each other, and one of the speakers plays the role of the user, The above virtual site content is, Includes second virtual scene content in which the speech of the speaker performing the role of the user in the first virtual scene content is silenced, The above virtual site department is, After providing the first virtual site content to the user terminal, the second virtual site content is provided to the user terminal, The user terminal records the user's speech when the muted speaker's speech is provided, A digital treatment system based on cognitive behavioral therapy, characterized in that the virtual field section receives the recorded user's speech.

9. In claim 8, The above evaluation department, A digital treatment system based on cognitive behavioral therapy, characterized in that the application unit and the virtual field unit each evaluate what the user has learned based on the user's speech received.

10. Step of collecting user background information through user terminal; A step of presenting at least one topic to a user terminal; When a user terminal selects one of the above topics, a step of providing a plurality of tasks and basic contents according to the selected topic to the user terminal; A step of providing technology-enhanced content that can apply technology corresponding to the basic content to a user terminal; A step of providing virtual field content derived from the basic content or reconstructed from the technology-enhanced content to a user terminal; and A step to evaluate what the user has learned; A digital treatment method based on cognitive behavioral therapy, including:

Images