Systems and methods for enhancing language and communication learning skills by adding customizable audio prompts to objects and visuals

Abstract

The invention relates to a system and method that enables putting customizable audio prompts to the objects used in a student's learning environment to enhance language learning and communication skills. The invention enables instructors and caregivers to create personalized audio recordings for their kids / students using their voice or with the support of artificial intelligence and place the recordings to preferred objects in the learning environment such as books, toys, clothes, furniture and parts of the room.

Description

[0001] DESCRIPTION

[0002] SYSTEMS AND METHODS FOR ENHANCING LANGUAGE AND COMMUNICATION LEARNING SKILLS BY ADDING CUSTOMIZABLE AUDIO PROMPTS TO OBJECTS AND VISUALS

[0003] Technical Field

[0004] The invention relates to a system and method for improving the cognitive, communication and language skills of individuals who have communication disorders and / or who are learning a new language.

[0005] The invention particularly relates to a system and method for adding interactive and customizable audio prompts recorded by the users and / or created by artificial intelligence to all objects in a learning environment, such as furniture, books and toys in a classroom, home, or playground.

[0006] Prior Art

[0007] Improving the cognitive, communication and language skills of individuals with communication disorders, notably children, is essential. To improve cognitive, communication and language skills of individuals, customized training programs are prepared by a group of psychologists, educators, and therapists according to each individual's needs, abilities and interests. The materials used in these methods need to be customized, durable, easy to use, multi-sensory and interactive to provide efficient and effective training. However, current materials are not able to meet these needs.

[0008] Paper flashcards are used in the present technique for teaching common words, names, phrases and sentences. Instructors make a great effort to personalize and use them together with other techniques, since they are not audible, not interactive and not customizable. Pairing the visuals with sounds in the present technique is another challenge. Even though there are recordable sound buttons used for this purpose, they have limited recording capacity, are not easy to use and not compatible with most of the objects in the learning environment such as books, toys and utensils. Using recordable buttons to add audio prompts to objects or flash cards requires having one recordable button for each sound recording, resulting - in some cases - sticking multiple buttons on an object.

[0009] Another system used in the present technique is a device that is able to play 60- seconds audio clips recorded by the instructor by swiping magnetic tape cards through it. This device is 40 cm long, covering half of a desk. It is not portable and works connected to a plug. It only operates with magnetic tape cards and is not suitable to use with the objects in a learning environment.

[0010] Another system used in the present art and the subject matter of application US20230142950A1 is a system comprising a device for vocalizing ID tags placed on the objects in a room. This device is able to operate only when it is connected to a computing device and plays pre-recorded sounds stored on a cloud system. The system is not accessible for users to prepare custom sound recordings. In this system, ID tags are placed on objects and each tag is assigned to a single pre-recorded sound selected through the mobile application. This device is not suitable for children to use alone because it needs to be connected to a smartphone or a tablet to operate. Since the audio content in this system is limited to the ones stored in its cloud system, it lacks the ability to customize the recordings according to each student’s needs, abilities and interests.

[0011] Another system used in the present technique is using various tablet or smartphone software. These applications are capable of storing a wide variety of customizable audio and visual content. However, using these applications as an alternative communication device requires relatively high cognitive skills and restrains eye contact during communication. Smart devices with screens are limited to 2D images, which makes it difficult for children to transfer the information into real life and may cause behavioral problems, mainly screen addiction. They are not preferred especially in early age groups, because of the aforementioned disadvantages. In addition, they are not preferred for individuals who display aggressive and disruptive behaviors, since these devices can easily be damaged.

[0012] Another system used in the present technique comprises a device operating with barcoded cards. Each barcode on cards triggers a single sound when scanned by the device. Neither the visuals on the cards, nor the sound recordings can be customized by the users

[0013] With this invention, it is aimed to provide a system and method to compensate for the aforementioned disadvantages and shortcomings of the prior systems and methods.

[0014] Purpose of the Invention

[0015] The main purpose of the invention is to develop a system and method for improving the cognitive, communication and language skills of individuals who have communication disorders, notably children with special needs, or who are learning a new language.

[0016] Another purpose of the invention is to design a system and method that enables adding customizable and interactive audio prompts to educational flashcards and objects used in a learning environment.

[0017] Another purpose of the invention is to provide a system and method comprising modular and portable parts that children can easily carry to use in various activities and environments.

[0018] Another purpose of the invention is to create a system and method that is capable of being used in various forms such as a talking plush toy, a wearable voice assistant, or a talking furniture item, to eliminate disturbance of certain colors, textures or sounds due to different sensory sensitivities of individuals with special needs. The invention offers instructors the flexibility of use for each individual that no other system developed has been able to provide so far. The device designed for this purpose can be used in various places: (a) It can be placed under an object such as a table or a mirror and the contactless cards and tags are tapped on this object to trigger the sound recordings, (b) Or the device can be used as a voice assistant that the child carries around and receives verbal cues by tapping it on the contactless cards and tags placed in the learning environment, (c) Or the device can be placed inside an object such as a plush toy to attract the child's attention and turned into a talking toy that the child carries and speaks when he / she touches the contactless cards and tags that are part of the system, making it easier to attract the child's attention, (d) Or the device can be held by the instructor and the child brings the contactless cards and tags to communicate with the instructor.

[0019] Another purpose of the invention is to provide a system and method that enables improving cognitive and communication skills using real objects in an environment without exposing children to a screen.

[0020] Another purpose of the invention is to provide a system and method that enables users to make audio recordings with their own voices.

[0021] Another purpose of the invention is to provide a system and method that enables users to reach pre-recorded updatable audio content in line with each individual's needs.

[0022] Another purpose of the invention is to provide a system and method that enables users to change the audio content at their discretion.

[0023] Another purpose of the invention is to provide a system and method that is capable of operating independently, without requiring any other computing device or internet connection during its use.

[0024] Another purpose of the invention is to provide a system and method that is able to execute various game algorithms to enhance learning.

[0025] Another purpose of the invention is to provide a system and method that is capable of processing the user interactions to assess the user's performance, presenting the user's progress or lack thereof to the instructor, and suggesting and / or updating educational content according to the user’s level.

[0026] Another purpose of the invention is to provide a system and method that is capable of directing users to look at the person that they are communicating with

[0027] In order to fulfill the aforementioned objectives, the invention is a system improving the cognitive, communication and language skills of individuals with communication disorders, or who are learning a new language. Accordingly, the system includes the following;

[0028] • at least one contactless adhesive tag and / or a contactless card that is capable of storing unique identification data, customizable data, capable of wireless communication and suitable to place on, in or under the objects in a learning environment,

[0029] • a main device that; o comprises an identification unit such as RFID, NFC, camera or infrared unit to transfer data to / from the contactless adhesive tags and / or contactless cards, o comprises a microphone for users to make their own audio recordings and a sound output module to deliver audio content to the users, o comprises a memory and processor enabling the main device to process and store the data received from various input modules such as microphone, communication modules, buttons and / or sensors o is configured to operate in different modes such as learning mode, quiz mode, memory game mode; and to execute various game algorithms according to the data received from the contactless adhesive tag and / or contactless card o comprises a wireless communication unit that enables communication with the cloud system (9) and / or mobile application

[0030] • a cloud system that is capable of; o communicating with the main device and / or a mobile application o storing pre-recorded educational content, and data transferred by the main device containing user’s system interactions o processing the data transferred by the main device and / or by the mobile application to assess student’s progress to present updated audio content aligned with the student’s progress, o transferring audio content to the main device and assessment results to the mobile application A preferred embodiment of the invention also comprises: an executable program executed by the main device that records the student's interactions with the system and transfers the records to the cloud system.

[0031] A preferred embodiment of the invention also comprises: a mobile application enabling a dashboard for the instructor to preview educational content, transfer data to cloud system and / or to the main device, and / or view student assessments.

[0032] A preferred embodiment of the invention also comprises: an text-to-speech voice simulating Al converting text to audio recording with different users’ voice

[0033] A preferred embodiment of the invention also comprises: a direction-detecting receiver module which is capable of communicating wirelessly with the directiondetecting assistant device and which is capable of conditioning the main device to withhold the generated output until the signal is received from the directiondetecting assistant device.

[0034] A preferred embodiment of the invention also comprises: a direction-detecting assistant device, which transmits signals for the direction-detecting receiver module and communicates wirelessly with the main device.

[0035] The invention also includes methods for improving cognitive, communication and language skills of individuals, who have communication disorders or who are learning a new language. Accordingly, the methods involve the following steps:

[0036] • creating or installing audio content associated with the contactless adhesive tags and / or contactless cards by means of the microphone on the main device, and / or by means of a mobile application connected to the main device, and / or by means of the cloud system connected to the main device,

[0037] • if the audio content is to be created by means of the text-to-speech algorithm within the cloud system, o recording a one-minute voice of the user reading a text by means of the mobile application o transferring the voice recording to the cloud system for artificial intelligence algorithm within the cloud system to be trained with o transferring a text written by the user to be simulated by the cloud system by means of the mobile application o converting the text to audio clip vocalized by the preferred user’s voice by means of the cloud system o transferring the audio created by the cloud system to the main device

[0038] • pairing the audio content and programs for different operational modes stored in the main device with the data stored on the the contactless adhesive tag and / or contactless card,

[0039] • transferring data stored on a contactless adhesive tag and / or a contactless card to the main device via wireless communication

[0040] • processing the received data and executing an algorithm to generate an output according to the user’s preferences

[0041] • delivering the output by means of the sound output module (8) and other additional output modules.

[0042] • recording user’s interactions with the system by means of the main device

[0043] • transferring the data containing user’s interactions with the system stored in the memory of the main device to the cloud system to be assessed by artificial intelligence within the cloud system via wireless communication

[0044] • assessing the user’s performance by artificial intelligence within the cloud system

[0045] • presenting the results of the assessment to the instructor via the mobile application

[0046] • uploading and / or suggesting an updated for the educational content in the main device according the user’s progress,

[0047] • if the student is to be encouraged to make eye contact, o connecting direction-detecting assistant device to the directiondetecting receiver module on the main device via wireless communication o conditioning the main device to withhold the output until the direction-detecting receiver module on the main device receives a signal from the direction-detecting assistant device.

[0048] A preferred embodiment of the invention also comprises: the step of providing the communication between main device and said contactless adhesive tag and / or contactless card by NFC.

[0049] A preferred embodiment of the invention also comprises: the step of providing the communication between the cloud system and the main device via wireless communication unit, preferably over Wi-Fi.

[0050] A preferred embodiment of the invention also comprises: the step of providing communication between the direction-detecting receiver module and directiondetecting assistant device, preferably by infrared and / or bluetooth.

[0051] A preferred embodiment of the invention also comprises: the step of recording the voice of the person reading a text to be used to train artificial intelligence within the cloud system via a mobile application.

[0052] A preferred embodiment of the invention also comprises: step of converting the text written via the mobile application into a voice recording by the pre-trained artificial intelligence within the cloud system.

[0053] A preferred embodiment of the invention also comprises: the step of making a voice recording associated with a contactless adhesive tag and / or a contactless card by means of a microphone on the main device.

[0054] A preferred embodiment of the invention also comprises: the step of the main device delivering audio output directly triggered by an instructor via the mobile application without the need for a contactless card or contactless adhesive tag.

[0055] A preferred embodiment of the invention also comprises: the step of the cloud system simulating the data transmitted via the mobile application by artificial intelligence algorithms pre-trained with the voice in the pre - recorded text reading recording of the person concerned. A preferred embodiment of the invention also comprises: the step of the main device recording the student's interactions and transferring them to the cloud system.

[0056] A preferred embodiment of the invention also comprises: the step of the cloud system processing the data containing the user’s system interactions to assess user’s progress by the user assessment Al, presenting assessment results to the instructor via the mobile application and suggesting educational content updated by artificial intelligence algorithms according to the user’s progress.

[0057] The structural and characteristic features and all advantages of the invention will be more clearly understood by means of the figures given below and the detailed description written by making references to these figures, and therefore, the evaluation should be made by taking these figures and detailed description into consideration.

[0058] Figures to Help Understanding of the Invention

[0059] Figure - 1 shows a schematic view of the inventive system.

[0060] Figure - 2 shows a schematic view of the contactless adhesive labels and contactless cards used in the inventive system.

[0061] Figure - 3 shows a schematic view of the use of the eye contact companion device used in the inventive system.

[0062] Description of Part References

[0063] 1. Main device

[0064] 2. Contactless adhesive tag

[0065] 3. Contactless card

[0066] 4. Microphone

[0067] 5. Wireless communication module

[0068] 6. Identification unit 7. Processor + Memory

[0069] 8. Sound output module

[0070] 9. Cloud system

[0071] 10. Text to Speech voice simulating Al

[0072] 11. User Assessment Al

[0073] 12. Direction Detecting Assistant Device

[0074] 13. Direction Detecting Receiver Module

[0075] Detailed Description of the Invention

[0076] In this detailed description, the preferred embodiments of the inventive system and method are described only for a better understanding of the subject matter.

[0077] The invention is a system for improving the cognitive, communication and language skills of individuals with communication disorders and / or who are learning a new language. Figure - 1 shows a schematic view of the inventive system. According to this, the system includes; at least one contactless adhesive tag (2) and / or contactless card (3) that contains both unique identification data and customizable data that can be received and processed by the main device (1), a main device (1 ) that is capable of communicating with contactless adhesive tags (2), contactless cards (3), and the cloud system (9), capable of executing various game algorithms, recording audio, delivering audio outputs, storing audio files and tracking user data. a cloud system (9) capable of communicating with the main device (1 ).

[0078] The system also may include optionally a direction detecting assistant device (12) and optionally a direction detecting receiver module(13).

[0079] Each contactless adhesive tag (2) and / or contactless card (3) contains customizable data readable by the main device (1). The data contained in contactless adhesive tags (2) and contactless cards (3) is written by the manufacturer and can be edited and customized by the user using the identification unit (6) on the main device (1). The data contained in a contactless adhesive tag (2) and / or a contactless card (3) includes a unique identification code and / or a generic code triggering main device (1) to execute a game algorithm, and generate an output such as asking a question, waiting for an answer, playing an audio or one or editing user preferences, for example. In some embodiments, contactless adhesive tags (2) and / or contactless cards (3) optionally may include printed images and may contain data related with the printed image.

[0080] Contactless adhesive tags (2) and / or contactless cards (3) can be placed on the objects used in a learning environment such as on toys, parts of the room, furniture, clothes, flashcards or pages of a book, for example by the user in order to add interactive learning prompts to the objects.

[0081] The main device (1) shown in the Figure-1 comprises at least one input module to power the main device (1) on and off. The main device (1) also comprises; a microphone (4) enabling users to record their voice, an identification unit (6) to receive and / or edit data stored on the contactless adhesive tags (2) and / or contactless cards (3), a wireless communication module (5) to communicate with the cloud system (9) and / or with other main devices (1), a processor and memory (7) to store and process the data received from the input modules, identification unit (6) and wireless communication module (5), operate in various states and execute game algorithms to generate an output, a sound output module (9) to play the audio files.

[0082] The main device (1) optionally may comprise other output modules to enhance multi-sensory learning such as a vibration motor, LED, headphones for example.

[0083] The main device (1) optionally may comprise more than one input modules such as switches, buttons or sensors for changing the state of the main device (1 ) such as adjusting volume, switching between user preferences and game algorithms, pausing, playing or stopping a game algorithm and / or an audio file, for example. The wireless communication module (5) on the main device (1) is configured to either directly communicate with the cloud system (9) or optionally it may communicate with a mobile application.

[0084] The processor and memory (7) on the main device (1 ); decodes the data received by means of the identification module (6), the wireless communication module (5), the microphone (4) and other input modules; stores executable game algorithms, audio files, user preferences, user interaction history; executes an algorithm based on the received user input prompting the main device (1) to generate an output. This output is delivered through one or more output modules, such as a speaker, a vibration motor, and / or an LED, for example. Output modules may be either integrated directly to the main device (1 ) or externally connected, utilizing either contactless or contact-based communication methods.

[0085] The main device (1) is also capable of recording and storing the user's interactions in its internal memory.

[0086] The main device (1) is also capable of independently receiving user input, processing game algorithms, and providing direct output to the user, all without the need for communication with the cloud system (9) or any other external systems during its use in training sessions. Users have the option to toggle the device’s connection to the cloud system on or off, to use it offline.

[0087] When the main device (1) is connected to the cloud system (9) by means of the wireless communication module (5), data containing user’s interactions is automatically transferred to the cloud system (9) and data containing updated educational content is automatically downloaded to the main device (1).

[0088] In scenarios where the main device (1) is actively communicating with the cloud system (9) during a training session, the instructor may initiate real-time updates on the main device (1). These updates can comprise modifications to the game algorithm, alterations in the audio files associated with a contactless adhesive tag (2) or a contactless card (3), or adjustments in user preferences. To execute realtime updates, instructors may connect a smartphone to the cloud system (9) to generate new audio from a text and upload it to the main device (1) without physically interfering with the main device(1). In such scenarios, the text-to- speech voice simulating Al (10) provides instructors an option to convert text messages into audio files simulated with their voice. The text-to-speech voice simulating Al (10) may be pre-trained with instructors' 1 -minute voice recordings in order to simulate it instantly when the text messages received from the user.

[0089] The cloud system (9) shown in the Figure-1 , stores users data collected from the main devices and / or from other software to process it and present personalized educational plans for each user via the user assessment Al (11). The cloud system (9) hosts various educational content such as audio files, game instructions, game algorithms and users’ history of interaction reports received from the main device (1). The user assessment Al (11) uses the data on the cloud system (9) to assess user’s progress, then curate, generate and deliver personalized content for each user. The tailored content and user progress can be accessed by the user and / or instructor through the main device (1) or instructors can view it on a dashboard displayed on a smartphone. The tailored educational content can be transferred to the main device (1) automatically or upon the instructor's request, according to the user's preferences.

[0090] In the preferred embodiment of the invention, the system comprises a mobile application enabling the audio recordings stored on the cloud system (9) to be uploaded to the main device (1) and / or enabling user data recorded by the main device (1) to be uploaded to the cloud system (9).

[0091] In the preferred embodiment of the invention, the communication between the main device (1) and the contactless adhesive tag (2) and / or contactless card (3) is provided by near field communication.

[0092] In the preferred embodiment of the invention, the communication between the cloud system (9) and the main device (1) is provided by means of a wireless communication unit (5), preferably over Wi-Fi.

[0093] In some embodiments, the system may include a direction-detecting assistant device (12) and a direction-detecting receiver module (13) to promote eye contact during use. The direction-detecting assistant device (12) can be a mobile device that the instructor carries or wears around their neck. When this device (12) wirelessly connects to the main device (1), it automatically activates the direction-detecting receiver module (13) on the main device (1), prompting the system to operate in engagement direction assistant mode. In this mode, the main device (1 ) withholds the generated output from user input until the directiondetection receiver module (13) detects a signal from the direction-detecting assistant device (12), in order to motivate the student to engage with the contact person. The direction-detection assistant device may have a sensor to detect users’ face or pupils to detect user orientation or it may send signals to detect the position of the main device (1) In some implementations, these two components may communicate wirelessly using a protocol such as infrared, bluetooth, or wifi.

[0094] The working principle of the system is as follows:

[0095] The instructor customizes the contactless adhesive tags (2) and / or contactless cards (3) by placing them on the objects in a learning environment and / or placing visuals and / or texts on them for the user to interact Instructor may adjust user preferences on the main device (1) sou is recorded by the main device (1), or audio content stored in the cloud system (9) is downloaded to the main device (1 ) is paired with the contactless adhesive tag (2) that may contain the data related to the object on which it is pasted and / or the contactless card (3) that may contain the data related to the visuals pasted on it.

[0096] The invention provides different methods for users to make audio recordings. Firstly, by means of the microphone (4) on the main device (1), it is possible to record sound to be used with the contactless adhesive tag (2) and / or contactless card (3).

[0097] Another method is to use the mobile application for sound recording and to upload the recording to be used with a contactless adhesive tag (2) and / or contactless card (3) to the main device (1 ).

[0098] Another method to make audio recording is to convert the text written by the user to an audio recording with the user’s preferred voice using the text-to-speech voice simulating Al (10) and to upload the recording to the main device (1) to be used with the contactless adhesive tag (2) and / or contactless card (3). The text- to-speech voice simulating Al (10) simulates the text using a one-minute sound clip recorded by the user previously.

[0099] The main device (1) may also play sounds triggered by an instructor via the mentioned mobile app without the need for a contactless card (3) or contactless adhesive label (2). This method quickly adds variety and flexibility to the audio prompts for the student during training.

[0100] When the main device (1) is brought close to the contactless adhesive tag (2) and / or contactless card (3), the audio content triggered by the data on the contactless tag (2) and / or contactless card (3) is played. According to the data transferred by the contactless adhesive tag (2) and / or contactless card (3), the main device (1 ) executes an algorithm to deliver an output containing educational content. The output may be an audio, a light, a vibration or a mixture of them to enhance multi-sensory learning. The audio content may be one or a series of audio files containing words, sentences, questions, songs, narrations, sound effects or a mixture of them.

[0101] In some embodiments, the main device (1) may also keep data of the student's interactions with the system and transfer them to the cloud system (9) via the wireless communication unit (5). The data may contain the IDs of the sound recordings played, the playtime of each sound, the games and / or modes operated by the main device, and student’s scores in each game and / or mode. The cloud system (9) processes the data received from the main device (1) , preferably with artificial intelligence algorithms, and assesses the student’s progress, and presents new educational content created by artificial intelligence algorithms. In some embodiments, the system may process the student’s voice to detect pronunciation mistakes, and present the detected mistakes and new training methods to the instructor via the aforementioned mobile application. As the child learns the educational content, the system updates the audio content accordingly.

[0102] In some embodiments, the main device (1) may comprise a direction-detecting receiver module (13) and operate with a direction-detecting assistant device (12). If the student is to be encouraged to make eye contact, the direction-detecting assistant device (12) is paired with the main device (1) which conditions the main device (1 ) to withhold the output until the direction-detecting receiver module (13) receives a signal from the direction-detecting assistant device (12). This configuration enables instructors to encourage directing student’s faces towards them during communication.

Claims

CLAIMS1. A system for improving the cognitive, communication and language skills of individuals with communication disorders, or who are learning a new language, characterized by comprising:• at least one contactless adhesive tag (2) and / or a contactless card (3) that is capable of storing unique identification data, customizable data, capable of wireless communication and suitable to place on, in or under the objects in a learning environment,• a main device (1) that; o comprises an identification unit (6) such as RFID, NFC, camera or infrared unit to transfer data to / from the contactless adhesive tags (2) and / or contactless cards (3), o comprises a microphone (4) for users to make their own audio recordings and a sound output module (8) to deliver audio content to the users, o comprises a memory and processor (7) enabling the main device (1) to process and store the data received from various input modules such as microphone, communication modules, buttons and / or sensors o is configured to operate in different modes such as learning mode, quiz mode, memory game mode; and to execute various game algorithms according to the data received from the contactless adhesive tag (2) and / or contactless card (3) o comprises a wireless communication unit (5) that enables communication with the cloud system (9) and / or mobile application• a cloud system (9) that is capable of; o communicating with the main device (1 ) and / or a mobile application o storing pre-recorded educational content, and data transferred by the main device (1) containing user’s system interactions o processing the data transferred by the main device (1 ) and / or by the mobile application to assess student’s progress to present updated audio content aligned with the student’s progress,o transferring audio content to the main device (1) and assessment results to the mobile application2. The system according to claim 1 , further comprising an executable program executed by the main device (1) that records the student's interactions with the system and transfers the records to the cloud system (9).

3. The system according to claim 1 , further comprising a mobile application enabling a dashboard for the instructor to preview educational content, transfer data to cloud system (9) and / or to the main device (1 ), and / or view student assessments.

4. The system according to claim 1 , further comprising an text-to-speech voice simulating Al (10) converting text to audio recording with different users’ voice5. The system according to claim 1 , further comprising a direction-detecting receiver module (13) which is capable of communicating wirelessly with the direction-detecting assistant device (12) and which is capable of conditioning the main device (1) to withhold the generated output until the signal is received from the direction-detecting assistant device (12).

6. The system according to claim 1 , further comprising a direction-detecting assistant device (12), which transmits signals for the direction-detecting receiver module (13) and communicates wirelessly with the main device (1 )-7. A method for improving the cognitive, communication and language skills of individuals with communication disorders, or who are learning a new language, characterized by comprising following steps;• creating or installing audio content associated with the contactless adhesive tags (2) and / or contactless cards (3) by means of the microphone (4) on the main device (1), and / or by means of a mobile application connected to the main device (1), and / or by means of the cloud system (9) connected to the main device(1),• if the audio content is to be created by means of the text-to-speech algorithm within the cloud system (9),o recording a one-minute voice of the user reading a text by means of the mobile application o transferring the voice recording to the cloud system (9) for artificial intelligence algorithm within the cloud system (9) to be trained with o transferring a text written by the user to be simulated by the cloud system (9) by means of the mobile application o converting the text to audio clip vocalized by the preferred user’s voice by means of the cloud system (9) o transferring the audio created by the cloud system (9) to the main device (1)• pairing the audio content and programs for different operational modes stored in the main device (1) with the data stored on the the contactless adhesive tag (2) and / or contactless card (3),• transferring data stored on a contactless adhesive tag (2) and / or a contactless card (3) to the main device (1) via wireless communication• processing the received data and executing an algorithm to generate an output according to the user’s preferences• delivering the output by means of the sound output module (8) and other additional output modules.• recording user’s interactions with the system by means of the main device (1)• transferring the data containing user’s interactions with the system stored in the memory of the main device (1) to the cloud system (9) to be assessed by artificial intelligence within the cloud system (9) via wireless communication• assessing the user’s performance by artificial intelligence within the cloud system (9)• presenting the results of the assessment to the instructor via the mobile application• uploading and / or suggesting an updated for the educational content in the main device (1) according the user’s progress,• if the student is to be encouraged to make eye contact,o connecting direction-detecting assistant device (12) to the directiondetecting receiver module (13) on the main device (1 ) via wireless communication o conditioning the main device to withhold the output until the direction-detecting receiver module (13) on the main device (1 ) receives a signal from the direction-detecting assistant device (12).

8. The method according to claim 7, further comprising the step of providing the communication between main device (1) and said contactless adhesive tag (2) and / or contactless card (3) by NFC.

9. The method according to claim 7, further comprising the step of providing the communication between the cloud system (9) and the main device (1) via wireless communication unit (5), preferably over Wi-Fi.

10. The method according to claim 7, further comprising the step of providing communication between the direction-detecting receiver module (13) and direction-detecting assistant device (12), preferably by infrared and / or bluetooth.11 . The method according to claim 7, further comprising the step of recording the voice of the person reading a text to be used to train artificial intelligence within the cloud system (9) via a mobile application.

12. The method according to claim 7, further comprising the step of converting the text written via the mobile application into a voice recording by the pretrained artificial intelligence within the cloud system (9).

13. The method according to claim 7, further comprising the step of making a voice recording associated with a contactless adhesive tag (2) and / or a contactless card (3) by means of a microphone (4) on the main device (1).

14. The method according to claim 7, further comprising the step of the main device (1 ) delivering audio output directly triggered by an instructor via the mobile application without the need for a contactless card (3) or contactless adhesive tag (2).

15. The method according to claim 7, further comprising the step of the cloud system (9) simulating the data transmitted via the mobile application byartificial intelligence algorithms pre-trained with the voice in the pre - recorded text reading recording of the person concerned.

16. The method according to claim 7, further comprising the step of the main device (1 ) recording the student's interactions and transferring them to the cloud system (9).

17. The method according to claim 7, further comprising the step of the cloud system (9) processing the data containing the user’s system interactions to assess user’s progress by the user assessment Al (11 ), presenting assessment results to the instructor via the mobile application and suggesting educational content updated by artificial intelligence algorithms according to the user’s progress.

Images