Method, apparatus, and computer program for providing role-playing style conversational content

Abstract

To provide a method, a device, and a computer program for providing a conversation content of a role-playing format.SOLUTION: The method for a conversation learning service includes the steps of: registering an audio produced by a participant as a pronunciation content of an accent according to the accent indicating the country or the ethnic group or the local area of the participant; and providing conversation sentences made of at least two sentences in a role-playing format using a speech content of the sentences.SELECTED DRAWING: Figure 10

Description

[Technical Field]

[0001] The following description relates to techniques for providing conversational text for language learning. [Background technology]

[0002] Most language education, including English education, has traditionally been conducted offline, with instructors delivering educational content in the classroom, but in recent years online education methods using the Internet have begun to spread.

[0003] Online education methods include video lectures, in which the instructor delivers a lecture to students via the Internet; methods that use electronic whiteboards and audio; and VCS (Video Conference System) methods for video chat.

[0004] As an example of an online education method, Patent Document 1 (registered March 18, 2008) discloses an English pronunciation learning method that uses representative word pronunciations, which allows users to accurately learn the pronunciation of words and sentences using the Internet. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Korean Patent No. 10-0816378 Summary of the Invention [Problem to be solved by the invention]

[0006] For each accent, we create a database (DB) of pronunciation content recorded by users with that accent, and provide a conversation learning platform that uses this.

[0007] To provide a service that enables a user to record and listen to pronunciation content for a conversational sentence of a title selected by the user in a role-playing manner.

[0008] Actual users with user-selected accents appear as role-playing conversation partners, providing a realistic, interactive user experience.

[0009] By expanding the conversation tree through free talking participation, conversation sentences for various scenarios are generated. [Means for solving the problem]

[0010] A conversation learning service method executed on a computer device, the computer device including at least one processor configured to execute computer-readable instructions contained in a memory, the conversation learning service method including a step of registering, by the at least one processor, audio spoken by a participant for each accent representing the participant's country, ethnicity, or region of origin as pronunciation content for the accent, and a step of providing, by the at least one processor, a conversation consisting of two or more sentences in a role-playing format using the pronunciation content corresponding to the sentences.

[0011] According to one aspect, the step of providing in a role-playing format may provide dialogue for a specific title selected by the learner in a role-playing format using pronunciation content in a specific accent selected by the learner.

[0012] According to another aspect, the step of providing in the role-playing format may include the step of providing a first role interface for playing the pronunciation content and a second role interface for recording the learner's spoken voice for sentences assigned according to the sentence order of the dialogue.

[0013] According to another aspect, the step of providing in the role-playing format may include providing a first role interface for playing pronunciation content in a first accent and a second role interface for playing pronunciation content in a second accent different from the first accent for sentences assigned according to the sentence order of the conversation.

[0014] According to another aspect, the conversation learning service method may further include registering, by the at least one processor, the speech as pronunciation content of an accent corresponding to the learner.

[0015] According to another aspect, the first role interface may include profile information of the participant who registered the pronunciation content, and the second role interface may include profile information of the learner.

[0016] According to yet another aspect, the second role interface may include an interface for setting an emotional tone for the speech.

[0017] According to another aspect, the second role interface may include an interface for inputting a sentence different from the sentence of the conversation sentence, and the conversation learning service method may further include adding, by the at least one processor, the other sentence to a conversation tree composed of the sentence of the conversation sentence, and generating a new conversation sentence based on the conversation tree.

[0018] According to another aspect, the step of providing the first role interface and the second role interface may include a step of highlighting and displaying profile information corresponding to a current order among the participant's profile information and the learner's profile information.

[0019] According to another aspect, the providing in the role-playing format may further include sequentially displaying the pronunciation content or the sentences for which the spoken voice has been recorded in a message balloon.

[0020] According to another aspect, the step of providing in the role-playing format may further include the step of providing at least one of an interface for pronunciation playback and an interface for inputting a positive response for each sentence for which playback of the pronunciation content or recording of the spoken voice has been completed.

[0021] According to another aspect, the step of providing in the role-playing format may include the step of providing a list of participants selectable as role-playing partners based on at least one of a real-time connection status and a relationship with the learner.

[0022] According to another aspect, the step of providing in the role-playing format may include a step of providing a title list selectable by learning title, and a step of providing dialogue of a specific title selected from the title list as content for the learner's language learning.

[0023] According to another aspect, the step of providing the title list may include a step of displaying title information for each title included in the title list, and the title information may include profile information of at least one participant who participated in recording of the dialogue belonging to the corresponding title.

[0024] According to another aspect, the title information may include at least one of an object associated with the title, the number of dialogues belonging to the title, and the number of participants who participated in recording the dialogues belonging to the title.

[0025] According to yet another aspect, the title information may include history information of the learner regarding conversations belonging to the corresponding title.

[0026] A computer program for causing a computer device to execute the conversation learning service method is provided.

[0027] A computer device is provided, the computer device including at least one processor configured to execute computer-readable instructions stored in a memory, the at least one processor processing a process of registering audio spoken by a participant for each accent representing the participant's country, ethnicity, or region of origin as pronunciation content for the accent, and a process of providing a conversation consisting of two or more sentences in a role-playing format using the pronunciation content corresponding to the sentences. [Effects of the Invention]

[0028] According to an embodiment of the present invention, for each accent, pronunciation content of the corresponding accent recorded by users of the corresponding accent is organized as a database, and a conversation learning platform using this can be provided.

[0029] According to an embodiment of the present invention, a service can be provided that allows a user to record and listen to pronunciation content for a conversation of a title selected by the user in a role-playing manner.

[0030] Embodiments of the present invention can provide a realistic, interactive user experience by featuring real users with user-selected accents as role-playing conversation partners.

[0031] According to an embodiment of the present invention, a conversation tree can be expanded through participation in free talking, thereby generating conversation sentences for various scenarios as content for language learning. [Brief explanation of the drawings]

[0032] [Figure 1] FIG. 1 illustrates an example of a network environment in accordance with an embodiment of the present invention. [Figure 2] FIG. 1 is a block diagram illustrating an example of a computing device according to an embodiment of the present invention. [Figure 3] 1 is a flow chart illustrating an example method for providing an audio participation service for collecting pronunciations by accent, in accordance with an embodiment of the present invention. [Figure 4] FIG. 10 is an exemplary diagram showing a service screen for setting a learning participant's accent in accordance with an embodiment of the present invention. [Figure 5] FIG. 10 is an exemplary diagram showing a service screen for registering pronunciation content according to an embodiment of the present invention. [Figure 6] FIG. 10 is an exemplary diagram showing a service screen for registering pronunciation content according to an embodiment of the present invention. [Figure 7] FIG. 10 is an exemplary diagram showing a service screen for registering pronunciation content according to an embodiment of the present invention. [Figure 8] FIG. 10 is an exemplary diagram showing a service screen displaying pronunciation content according to an embodiment of the present invention. [Figure 9] FIG. 10 is an exemplary diagram showing a personal profile screen according to an embodiment of the present invention. [Figure 10] 1 is a flowchart illustrating an example of a method for providing dialogue for language learning in a role-playing format in accordance with an embodiment of the present invention. [Figure 11] FIG. 10 is an exemplary diagram showing a service screen for selecting a language learning title according to an embodiment of the present invention. [Figure 12] FIG. 10 is an exemplary diagram showing a service screen for selecting a language learning title according to an embodiment of the present invention. [Figure 13] 1 is an exemplary diagram illustrating a role-playing conversation learning process according to an embodiment of the present invention; [Figure 14] 1 is an exemplary diagram illustrating a role-playing conversation learning process according to an embodiment of the present invention; [Figure 15] 1 is an exemplary diagram illustrating a role-playing conversation learning process according to an embodiment of the present invention; [Figure 16] 1 is an exemplary diagram illustrating a role-playing conversation learning process according to an embodiment of the present invention; [Figure 17] 1 is an exemplary diagram illustrating a role-playing conversation learning process according to an embodiment of the present invention; [Figure 18] 1 is an exemplary diagram illustrating a role-playing conversation learning process according to an embodiment of the present invention; [Figure 19] 1 is an exemplary diagram illustrating a conversation tree expansion process in one embodiment of the present invention. [Figure 20] 1 is an exemplary diagram illustrating a conversation tree expansion process in one embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0033] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[0034] FIELD OF THE INVENTION Embodiments of the present invention relate to techniques for providing conversational text for language learning.

[0035] Embodiments including those specifically disclosed herein can provide conversational text for language learning in the form of a role-playing, real-life interaction.

[0036] A conversation learning service system according to an embodiment of the present invention may be realized by at least one computer device, and a conversation learning service method according to an embodiment of the present invention may be executed by at least one computer device included in the conversation learning service system. In this case, a computer program according to an embodiment of the present invention may be installed and executed in the computer device, and the computer device may execute the conversation learning service method according to an embodiment of the present invention under the control of the executed computer program. The computer program may be recorded on a computer-readable recording medium in combination with the computer device to cause the computer to execute the conversation learning service method.

[0037] FIG. 1 is a diagram showing an example of a network environment in one embodiment of the present invention. The network environment in FIG. 1 shows an example including multiple electronic devices 110, 120, 130, and 140, multiple servers 150 and 160, and a network 170. FIG. 1 is merely an example for explaining the invention, and the number of electronic devices and the number of servers are not limited to those shown in FIG. 1. Furthermore, the network environment in FIG. 1 is merely an example of an environment applicable to this embodiment, and environments applicable to this embodiment are not limited to the network environment in FIG. 1.

[0038] The electronic devices 110, 120, 130, and 140 may be fixed or mobile terminals implemented by computer devices. Examples of the electronic devices 110, 120, 130, and 140 include smartphones, mobile phones, navigation systems, personal computers (PCs), notebook PCs, digital broadcasting terminals, personal digital assistants (PDAs), portable multimedia players (PMPs), and tablets. While FIG. 1 illustrates a smartphone as an example of the electronic device 110, in embodiments of the present invention, the electronic device 110 may represent one of a variety of physical computer devices capable of communicating with the other electronic devices 120, 130, and 140 and / or the servers 150 and 160 via the network 170 using a substantially wireless or wired communication method.

[0039] The communication method is not limited, and may include not only communication methods using communication networks (for example, a mobile communication network, a wired Internet, a wireless Internet, and a broadcast network) that can be included in network 170, but also short-range wireless communication between devices. For example, network 170 may include any one or more of networks such as a personal area network (PAN), a local area network (LAN), a campus area network (CAN), a metropolitan area network (MAN), a wide area network (WAN), a broadband network (BBN), and the Internet. Furthermore, network 170 may include any one or more of network topologies including, but not limited to, a bus network, a star network, a ring network, a mesh network, a star-bus network, a tree or hierarchical network, etc.

[0040] Each of the servers 150, 160 may be realized by one or more computer devices that communicate with the multiple electronic devices 110, 120, 130, 140 via the network 170 to provide instructions, code, files, content, services, etc. For example, the server 150 may be a system that provides a service (such as a conversation learning service, for example) to the multiple electronic devices 110, 120, 130, 140 connected via the network 170.

[0041] 2 is a block diagram showing an example of a computer device according to an embodiment of the present invention. Each of the electronic devices 110, 120, 130, and 140 and each of the servers 150 and 160 described above may be realized by a computer device 200 shown in FIG.

[0042] As shown in FIG. 2 , such a computer device 200 may include a memory 210, a processor 220, a communication interface 230, and an input / output interface 240. The memory 210 is a computer-readable recording medium and may include random access memory (RAM), read-only memory (ROM), and a persistent mass storage device such as a disk drive. Here, a persistent mass storage device such as a ROM or a disk drive may be included in the computer device 200 as a separate persistent storage device distinct from the memory 210. The memory 210 may also store an operating system and at least one program code. Such software components may be loaded into the memory 210 from a computer-readable recording medium separate from the memory 210. Such separate computer-readable recording medium may include a computer-readable recording medium such as a floppy drive, a disk, a tape, a DVD / CD-ROM drive, or a memory card. In another embodiment, the software components may be loaded into the memory 210 through a communication interface 230, which is not a computer-readable recording medium. For example, the software components may be loaded into the memory 210 of the computer device 200 based on a computer program installed by a file received over the network 170 .

[0043] Processor 220 may be configured to process computer program instructions by performing basic arithmetic, logic, and input / output operations. The instructions may be provided to processor 220 by memory 210 or by communication interface 230. For example, processor 220 may be configured to execute instructions received according to program code stored in a storage device such as memory 210.

[0044] The communication interface 230 may provide a function for the computer device 200 to communicate with other devices (e.g., the above-mentioned storage device) via the network 170. For example, requests, instructions, data, files, etc. generated by the processor 220 of the computer device 200 in accordance with program code stored in a storage device such as the memory 210 may be transmitted to other devices via the network 170 under the control of the communication interface 230. Conversely, signals, instructions, data, files, etc. from other devices may be received by the computer device 200 via the communication interface 230 of the computer device 200 via the network 170. The signals, instructions, data, etc. received via the communication interface 230 may be transmitted to the processor 220 or the memory 210, and files, etc. may be recorded on a storage medium (e.g., the above-mentioned permanent storage device) that the computer device 200 may further include.

[0045] The input / output interface 240 may be a means for interfacing with the input / output device 250. For example, the input device may include a device such as a microphone, keyboard, or mouse, and the output device may include a device such as a display or speaker. As another example, the input / output interface 240 may be a means for interfacing with a device that integrates input and output functions into one, such as a touch screen. The input / output device 250 may be configured as a single device together with the computer device 200.

[0046] Also, in other embodiments, computing device 200 may include fewer or more components than those shown in Figure 2. However, most prior art components need not be explicitly shown in the figures. For example, computing device 200 may be implemented to include at least some of the input / output devices 250 described above, and may further include other components such as a transceiver, a database, etc.

[0047] Specific embodiments of a method and apparatus for providing role-playing style conversational content are described below.

[0048] The computer device 200 according to the present embodiment may provide a conversation learning service to a client through a dedicated application installed on the client or through connection to a web / mobile site associated with the computer device 200. A conversation learning service system implemented by a computer may be configured in the computer device 200. For example, the conversation learning service system may be implemented in the form of an independently operating program, or may be configured in the form of an in-app for a specific application so as to be operable on the specific application.

[0049] The processor 220 of the computer device 200 may be realized by components for executing the following conversation learning service method. Depending on the embodiment, the components of the processor 220 may be selectively included or excluded from the processor 220. Also, depending on the embodiment, the components of the processor 220 may be separated or combined to express the functions of the processor 220.

[0050] Such processor 220 and its components may control computer device 200 to perform steps included in the following conversation learning service method. For example, processor 220 and its components may be implemented to execute instructions from operating system code and at least one program code contained in memory 210.

[0051] Here, the components of the processor 220 may represent different functions that are performed by the processor 220 according to instructions provided by program code stored on the computer device 200 .

[0052] The processor 220 may read the necessary instructions from the memory 210, which is loaded with instructions related to the control of the computing device 200. In this case, the read instructions may include instructions for controlling the processor 220 to perform the steps described below.

[0053] The steps described below may be performed in a different order than that shown in the figures, some steps may be omitted, or additional processes may be included.

[0054] The conversation learning service according to the present invention may be realized as a function included in an audio participation service that collects and provides pronunciation content for various accents of each language through audio participation.

[0055] FIG. 3 is a flow chart illustrating an example method for providing an audio participation service for collecting pronunciations by accent, in accordance with an embodiment of the present invention.

[0056] Referring to FIG. 3, in step 310, the processor 220 may set accent information for each learning participant according to the participant settings. Accent information refers to linguistic information used in the participant's country of origin, ethnicity, or region. For example, the processor 220 may set the participant's primary language, such as their native language, as the accent information. In this embodiment, taking into consideration that accents vary depending on the country or region of origin even for the same language, pronunciations of the same words or sentences are collected for each accent. To this end, the processor 220 may set the primary language of the learning participant participating in pronunciation collection as the accent information of the participant.

[0057] In step 320, the processor 220 may generate pronunciation content by recording audio of the participant speaking for a given sample. The processor 220 may utilize a dictionary database to randomly select words, idioms, sentences, etc. from the dictionary and provide them as samples. The processor 220 may generate pronunciation content for the accent by tagging and recording the participant's audio recording for the sample with the participant's accent information. In this case, the processor 220 may tag the participant's pronunciation content with the participant's demo information (e.g., age, gender, occupation, etc.), record, and manage the participant's pronunciation content. The processor 220 may tag the participant's pronunciation content with not only the demo information, but also the original text provided as the sample, the type of the original text (e.g., word, idiom, sentence, etc.), and tone information and title information specified by the participant. The information tagged to the pronunciation content may be used as a filter condition for selecting and providing pronunciation content. The processor 220 may also review the participant's audio recordings and filter the pronunciation content based on the review results. The processor 220 may filter the pronunciation content based on the results of speech recognition of the participant's audio, sound quality evaluation results such as noise volume, etc.

[0058] In step 330, the processor 220 may provide pronunciation content based on an accent. For example, when a specific accent is selected, the processor 220 may provide a playlist consisting of pronunciation content of the selected accent. For another example, the processor 220 may use a sample type, such as a word, phrase, or sentence, as a filter condition to provide a playlist consisting of pronunciation content of a specific sample type. For yet another example, the processor 220 may use demo information, such as the age, gender, or occupation of a learning participant, as a filter condition to provide a playlist consisting of pronunciation content of a specific demo. For yet another example, the processor 220 may use tone information or title information as a filter condition to provide a playlist consisting of pronunciation content of the corresponding tone or title. In this case, the processor 220 may sort the pronunciation content playlist based on the content creation time, the cumulative number of plays, the cumulative number of positive responses (e.g., "likes"), the cumulative number of shares, etc.

[0059] The processor 220 may display the pronunciation content on the screen of the audio participation service, as well as in the service area of another platform that can be linked with the audio participation service, for example, a dictionary platform that provides language dictionaries and language learning services. The processor 220 may display the pronunciation content in conjunction with the language dictionary and language learning in the dictionary platform, and may support synchronization of related data such as playback, acknowledgment, and sharing of the pronunciation content with the dictionary platform.

[0060] 4 is an exemplary diagram showing a service screen for setting the accent of a learning participant according to an embodiment of the present invention. Fig. 4 shows a setting screen 400 for registering a service user as a learning participant.

[0061] 4, the setting screen 400 may include an "Accent" interface 410 for setting accent information of a learning participant. In some embodiments, the setting screen 400 may include an interface for directly setting a target language for participating in audio recording for pronunciation collection. For example, assuming that user A is from Canada, the accent information of user A may be set to Canadian, and the target language for participating in audio recording may be set to English.

[0062] The setting screen 400 may include a "push notification" interface 420 for setting permission to receive push notifications. Push notifications may provide user response information, such as the cumulative number of plays of the pronunciation content generated by the learner and the cumulative number of positive responses, as periodic information related to the learner's pronunciation content. The "push notification" interface 420 may be configured as an interface for selectively setting permission to receive notifications according to information type.

[0063] 5 and 6 are exemplary diagrams showing a service screen for registering pronunciation content according to an embodiment of the present invention. 5 and 6 show a pronunciation registration screen 500.

[0064] 5, processor 220 may provide samples 510 for pronunciation collection on pronunciation registration screen 500. Samples 510 may be provided in sets, for example, 10 samples corresponding to words, phrases, sentences, etc.

[0065] The pronunciation registration screen 500 may include a "record" interface 520 for recording participant audio by reading the samples 510. The processor 220 may record the participant audio by providing the set of samples 510 in sequence.

[0066] In this case, the processor 220 may set voice tone information prior to recording the participant audio. Referring to FIG. 6, the processor 220 may provide a settable tone list 610 (e.g., Default, Happy, Angry, Sad, Frustrated, Scared, etc.) on the pronunciation registration screen 500. When recording, a voice tone may be specified before recording. For example, if the sample 510 is happy, "Happy" may be selected from the tone list 610 before recording. The tone for recording the participant audio may be set directly by the participant in the tone list 610, or an appropriate tone may be recommended depending on the content of the sample 510.

[0067] To collect pronunciation content for each title category, the processor 220 may provide samples 510 of title categories designated by the participant. Prior to recording participant audio, the processor 220 may provide a list of selectable titles on the pronunciation registration screen 500, and may provide samples 510 of titles selected from the title list to collect the corresponding pronunciation content.

[0068] The processor 220 may provide dictionary information for words included in the sample 510. When a specific word is selected from the sample 510, the processor 220 may display dictionary information including the meaning and pronunciation of the word using an interface such as a pop-up.

[0069] In addition to providing dictionary information, processor 220 may also provide at least one translation for sample 510. Upon request of a participant, the translation may be provided by translating sample 510 into a language specified by the participant or into at least one predefined language.

[0070] Once the participant has completed recording audio for the sample 510 using the "Record" interface 520, the processor 220 may activate a "Play" interface 710 for playing the recorded audio, a "Retry" interface 720 for recording the audio again, and an "Upload" interface 730 for uploading the recorded audio on the pronunciation registration screen 500, as shown in FIG. 7 .

[0071] When a participant requests upload of recorded audio using the "upload" interface 730, the processor 220 may receive the participant audio and accept the audio.

[0072] If the processor 220 determines after audio inspection that the match rate between the text extracted from the participant audio and the original text of the sample 510 is extremely low or that there is an excessive amount of noise mixed in the participant audio, the processor 220 may use a pop-up on the pronunciation registration screen 500 to request the participant to re-record the audio for the sample 510.

[0073] The processor 220 can collect and register participant audio for the sample 510 as pronunciation content through participant interaction on the pronunciation registration screen 500 .

[0074] 8 is an exemplary diagram showing a service screen for displaying pronunciation content according to an embodiment of the present invention, showing an audio participation service screen 800, which is a display area for the audio participation service itself.

[0075] As shown in FIG. 8, the processor 220 may display a pronunciation content list 810 on an audio participation service screen 800.

[0076] The processor 220 may display the pronunciation content list 810 by dividing it into sections based on the accents 820 of the learners who generated the pronunciation content.

[0077] The processor 220 may sort and display the pronunciation content list 810 based on the content creation time, the cumulative number of plays, the cumulative number of positive responses, the cumulative number of shares, and the like.

[0078] The processor 220 may provide a detailed search for the pronunciation content list 810 using sample types (words, phrases, sentences, etc.), demos (age, gender, occupation, etc.), tone information, title information, etc. as search filters.

[0079] The processor 220 may support overall playback of the pronunciation content list 810, or may support selective individual playback of each piece of pronunciation content.

[0080] Along with the pronunciation content list 810, the processor 220 may provide, for each pronunciation content included in the pronunciation content list 810, an interface for inputting a positive response (e.g., a "like"), an interface for sharing, an interface for accessing the profile page of a learning participant, and the like.

[0081] The processor 220 may display the pronunciation content list 810 together with the cumulative number of plays, cumulative number of positive responses, cumulative number of shares, etc. for each pronunciation content included in the pronunciation content list 810.

[0082] Processor 220 may display, for each piece of pronunciation content included in content list 810, tone of voice information and title information that were set at the time of recording.

[0083] The processor 220 may provide push notifications to learning participants who have allowed notifications based on the user responses to the pronunciation content of the learning participants (e.g., the cumulative number of plays, the cumulative number of positive responses, etc.). As an example, the processor 220 may collect the user responses to the pronunciation content of the learning participants as a unit and provide a push notification based on the collected results once a day.

[0084] Furthermore, the processor 220 may provide pronunciation content of other participants that the learning participant has registered through a registration function. As an example, the processor 220 may support a follow-based registration relationship between users using the audio participation service. For example, assuming that participant A has registered participant B, if participant B registers new pronunciation content, a notification of participant B's new content may be provided to participant A. The processor 220 may provide a participant with a feed of new content of other participants that the participant has registered.

[0085] The processor 220 can provide push notifications to encourage continued motivation and return visits to the service.

[0086] FIG. 9 is an example view showing a personal profile screen according to an embodiment of the present invention.

[0087] 9, the processor 220 may display activity information 910 as a learning participant on a personal profile screen 900. The activity information 910 may include the number of pronunciation contents owned, the total cumulative number of plays of all the pronunciation contents, the total cumulative number of positive responses of all the pronunciation contents, etc., and may include a ranking for each history.

[0088] The processor 220 may display a list 920 of pronunciation content generated by the learning participant on the personal profile screen 900.

[0089] The processor 220 may sort and display the pronunciation content list 920 based on the content creation time, the cumulative number of plays, the cumulative number of positive responses, the cumulative number of shares, and the like.

[0090] The processor 220 may display, along with the pronunciation content list 920, the cumulative number of plays, the cumulative number of positive responses, the cumulative number of shares, and the like for each pronunciation content included in the pronunciation content list 920.

[0091] The processor 220 can enhance individual motivation by providing a learning participant's activity history through the personal profile screen 900.

[0092] In addition to the activity information 910 and the pronunciation content list 920, the personal profile screen 900 may also include space for promoting the learner with photos, introductions, hashtags, and the like.

[0093] FIG. 10 is a flowchart illustrating an example of a method for providing dialogue for language learning in a role-playing format in accordance with an embodiment of the present invention.

[0094] Referring to FIG. 10 , in step 1010, the processor 220 may construct a dialogue for each title using sentences for which pronunciation content is registered by the audio participation service. A dialogue may refer to a set of two or more sentences in which two or more users exchange a scenario for a given title. During the generation process, the pronunciation content may be tagged with the original text, accent, title, tone information, registration date and time information, and the like, and then recorded and managed. The processor 220 may collect pronunciation content for various accents of each language to build a database, and may generate a dialogue for each title using sentences for which pronunciation content is registered in the database. The processor 220 generates a dialogue for a title by combining sentences for which pronunciation content is registered in association with the title, and may generate a dialogue for the title with a more linguistically natural scenario by using a language model. Various conversation titles may be specified assuming various situations for language learning, such as visiting an airport, school life, checking a hotel reservation, talking about current events, and restaurant menus. For each title, a conversation sentence may be generated by combining sentences from the corresponding title in a specific order. In some embodiments, a conversation sentence composed of a set of correct sentences may be predefined for each title. In other words, the processor 220 may generate a conversation sentence for each title using sentences for which pronunciation content can be registered through an audio participation service, or may provide a conversation learning service using text-based content regardless of pronunciation content. Furthermore, the processor 220 may generate a conversation tree through free talking participation for each title, and then generate conversation sentences for various scenarios based on the conversation tree. The expansion of the conversation tree through free talking participation will be described in more detail below.

[0095] In step 1020, the processor 220 may provide dialogue for a specific title selected by the learning participant as a language learning title in a role-playing format in which participants actually converse with each other. In this case, the processor 220 may receive from the learning participant a selection of a specific accent to be learned and may designate at least one other participant (hereinafter referred to as the "other participant") with the selected accent as the other participant for the dialogue. In other words, the processor 220 may provide the other participant who has registered pronunciation content for the accent selected by the learning participant as the other participant for the sentence included in the dialogue. It is also possible to provide the other participant directly selected by the learning participant as the other participant. The processor 220 may provide an experience in which the learning participant and the other participant each take on a role and speak the sentences included in the dialogue sentence by sentence. In the case of a sentence assigned to the other participant, the processor 220 may play the pronunciation content registered by the other participant for the sentence. Meanwhile, an audio recording mode may be implemented in which real-time speech is required for a given sentence from the learner, and the audio of the learner's speech is recorded. For each sentence assigned according to the sentence order of the dialogue, the process of playing the pronunciation content of the other learner and recording the learner's actual speech is repeated, providing an experience of actual dialogue. Learners may speak and record a sentence assigned to a role in the dialogue. For sentences included in the dialogue that do not have pronunciation content actually recorded by the learner, the pronunciation may be played back using TTS (text to speech).

[0096] In step 1030, the processor 220 may generate and register the audio recording by the learner as pronunciation content in the learner's accent for each sentence included in the conversational text and assigned to the learner. Similarly, the pronunciation content generated by the learner may be tagged and recorded with the original text sentence, accent, title, etc. The processor 220 may store the learner's audio recording in a database for each accent to provide a playback mode for the conversational text or to use it for other participants to play their partner roles. After the learner completes role-playing in the audio recording mode, the processor 220 may provide role-playing for the conversational text in a playback mode including the learner's pronunciation content. In other words, in the playback mode, the pronunciation content of the learner and the partner participant is played back in order for each sentence assigned according to the sentence order of the conversational text, thereby providing an experience of actual dialogue.

[0097] This embodiment may include a structure that allows for easy language expansion, and an audio participation service for collecting pronunciations for each accent may be implemented for each language. Based on the pronunciation content collected by the audio participation service, content for conversation learning services may be provided, i.e., services may be expanded to major languages such as Korean, Chinese, Japanese, etc., instead of the language of the conversation text.

[0098] 11 and 12 are exemplary views showing a service screen for selecting a language learning title according to one embodiment of the present invention.

[0099] FIG. 11 shows a conversation learning main screen 1100.

[0100] Referring to FIG. 11, a conversation learning main screen 1100 may include recent status information 1110 of learning participants, a list of titles available for conversation learning 1120, and the like.

[0101] The processor 220 may display the title of a conversation sentence that the learning participant has recently learned as recent status information 1110. For example, if the learning participant has completed recording a set of conversation sentences, the learning participant's nickname and the most recent language learning title may be displayed as recent status information 1110. When the nickname on the recent status information 1110 is selected, the personal profile screen 900 or a mini-profile screen (not shown) configured with activity information 910 may be displayed.

[0102] A learning participant may select a category of a situation for which they wish to learn from the title list 1120. The title list 1120 may be made up of titles that are made up of at least one conversational sentence and that can be used for language learning, and title information 1121 may be displayed for each title.

[0103] 12, title information 1121 may include various information as a concept of a virtual space for the corresponding title. For example, title information 1121 may include objects 1201 related to the title, the number of conversations in the title 1202, the total number of participants who participated in the conversation recording 1203, profile information of participants who recently participated in the conversation recording (e.g., profile image, image related to accent, etc.) 1204, and a start button 1205 for starting language learning. Participant profile information 1204 may be updated in real time based on the profiles of the most recent participants (e.g., three people) among all participants who participated in the conversation recording of the corresponding title and displayed.

[0104] Object 1201 may be a design element used to express a situation or space that corresponds to the title, such as an airport, airplane, suitcase, or passport for travel; popcorn, balloons, or a merry-go-round for play; or a school, pencil, book, or doctoral cap for school life.

[0105] For a title with a history of participating in conversation recording, participation information 1206 of the learning participant may be displayed, and the participation information 1206 may include information on the recording and listening behavior of the learning participant, such as the number of conversations that the learning participant participated in recording, the total cumulative number of times that the pronunciation content recorded by the learning participant for the sentences included in the conversations has been played, and the number of times that the learning participant has played the conversations. The learning participant's recording behavior may include (1) what content (individual sentences) the learning participant recorded, (2) how many times the recording file (pronunciation content) in (1) was played, (3) how many times the recording file in (1) received "likes," (4) how many conversation sentence sets the learning participant recorded for each title, (5) how many times the files the learning participant recorded for each title were played, etc. The learning participant's listening behavior may include (6) what conversation sentences the learning participant listened to, (7) how many times the learning participant listened to the conversation sentence in (6), (8) how many times the learning participant listened to the conversation sentence for each title, etc. For titles with a history of participation in conversation sentence recording, the number of conversation sentences the learning participant participated in language learning for each title and the total number of plays may be displayed based on the participation information 1206.

[0106] 13 to 18 are exemplary diagrams illustrating a role-playing conversation learning process according to one embodiment of the present invention.

[0107] When a learning participant presses start button 1205 for a particular title from title list 1120, processor 220 may provide role-playing conversation screen 1300, as shown in FIG.

[0108] Referring to FIG. 13, a role-playing conversation screen 1300 may include title information 1301, mode buttons 1302, a content scrolling area 1303, a participant profile area 1304, an original text area 1305, a tools area 1306, a progress bar 1307, and the like.

[0109] The title information 1301 may display the title of the current conversation, that is, the language learning title selected by the learning participant.

[0110] The mode button 1302 corresponds to a toggle button for switching between audio recording mode and playback mode, and is provided in audio recording mode as a default, but the mode can be changed for the same conversation.

[0111] The content scrolling area 1303 is an area where guide messages that guide the role-playing conversation and content messages including the sentences that have been recorded / played are displayed. The content scrolling area 1303 may be configured to resemble a chat room interface to allow the learning participant and the other participant to have a dialogue exchange experience, and the sentences that have been recorded / played may be displayed in a message bubble.

[0112] The participant profile area 1304 may display profile information (e.g., a profile image and an image related to an accent) of the learning participant and the other participants, for example, the other participant's profile may be displayed on the left and the learning participant's profile may be displayed on the right.

[0113] The original text area 1305 may display the original text sentence currently being recorded or played back from among the sentences included in the conversation.

[0114] The tool area 1306 may display audio recording or playback tools depending on the mode.

[0115] The progress bar 1307 operates during recording / playback of the conversation sentence, and may indicate the progress of the conversation through recording / playback.

[0116] 14, the processor 220 may sequentially display sentences included in the conversational text that are assigned to the learning participant and the other participant in the original text area 1305. In the audio recording mode, a playback tool may be displayed in the tool area 1306 for the other participant's turn, and an audio recording tool may be displayed in the tool area 1306 for the learning participant's turn.

[0117] In the learning participant's turn, the tool area 1306 may further include an emotion setting button 1407 for setting an emotional tone along with an audio recording tool. When the learning participant enters the emotion setting button 1407, a configurable tone list 610 may be provided as shown in FIG. 6.

[0118] When displaying the profile information in participant profile area 1304, processor 220 may use display elements such as image size, highlighting, etc. to display the profile information of the participant whose turn it is to speak in a more emphasized manner than the other participant. Participant profile area 1304 may display profile images of speakers participating in the role-playing conversation, and when it is a speaker's turn to speak, dynamic motions may be provided, such as changing the size of the profile image or adding an emphasis effect to the frame of the profile image.

[0119] The processor 220 may compare the text extracted from the learner's audio recording using speech recognition technology with the original text sentence and determine whether the degree of match is equal to or greater than a predetermined threshold. If the degree of match between the text extracted by speech recognition and the original text is equal to or greater than the threshold, the processor 220 may record the learner's audio recording as pronunciation content for the sentence. On the other hand, if the degree of match between the text extracted by speech recognition and the original text is less than the threshold, the processor 220 may request the learner to re-record the audio.

[0120] The processor 220 may register the audio recordings made by the learner as pronunciation content for the accent used by that learner and store them in a database for each accent. The audio recordings of the learner may be stored in a database for each accent and used in playback mode for dialogue or as a voice acting partner for other learners. The pronunciation content recorded by the learner through role-playing conversations can be viewed in the learner's My Page area, for example, in the pronunciation content list 920 on the personal profile screen 900.

[0121] The processor 220 may use pronunciation content from a database for each accent to provide various combinations of conversation sentences based on the accent, and may realize a role-playing conversation (playback mode) using accent combinations desired by the learner. By having the learner and the other participant each take on a role in the conversation sentence while proceeding with the role-playing conversation, a role interface for playing the other participant's pronunciation content and a role interface for recording the learner's speech can be provided for sentences assigned in the order of the conversation sentence. Furthermore, the role-playing conversation can also proceed with the other participants with different accents each taking on a role, as a combination of accents desired by the learner. In other words, rather than the learner appearing directly, the learner can select the combination they desire, for example, assigning a user with an American accent to role A and a user with a Korean accent to role B, and playing back the conversation sentence.

[0122] Processor 220 may display the sentences that have been played / recorded in the conversation text in a message balloon on content scroll area 1303. The conversation content sticks that have been played / recorded may be accumulated and displayed in order.

[0123] Although the above describes a role-playing conversation involving two people, it is also possible to provide an experience in which three or more people participate in the conversation, each taking on a role.

[0124] When providing a user list for a user to select a partner for a role-playing conversation, the processor 220 may provide a list of users who have pronunciation content for the sentence of the conversation sentence. In this case, the processor 220 may check the login status of each user and provide a user list that distinguishes between users who are connected in real time and other users. The processor 220 may also provide a list of users who have pronunciation content for the sentence of the conversation sentence among users who have established a relationship with the learner. For example, the learner may specify the partner by inviting a friend from the friend list who the learner desires to play the partner role to the role-playing conversation screen 1300. In some embodiments, the learner may be able to view information such as the participant's pronunciation content and self-introduction from the profile page of a specific participant. If the learner desires to have a conversation experience during this process, a service may be provided in which the learner can participate in a conversation recording that the participant has already registered.

[0125] The processor 220 provides role-playing dialogue in an environment that allows learning of various situations for one title by sequentially providing multiple dialogues for one title. For example, as shown in FIG. 15, if a learning participant selects "School Life" as a language learning title, dialogues for various situations such as <Test Difficulty>, <Lunch Menu>, and <Essay Topic> may be sequentially provided as subtitles of "School Life."

[0126] 16, a play button 1601 may be activated to play the pronunciation content of a sentence in the conversation content displayed in order in the content scroll area 1303. In the case of a sentence assigned to the other participant, the play button 1601 may be displayed, and in the case of a sentence recorded by the learning participant, a retry button 1602 may be displayed together with the play button 1601 to re-record the audio.

[0127] When the recording of one set of conversation sentences is completed, the processor 220 may activate and display on the role-playing conversation screen 1300 a next conversation sentence button 1603 for proceeding to record another conversation sentence of the same title, a role change button 1604 for proceeding with recording of previously recorded conversation sentences by changing roles between participants, and the like.

[0128] When the processor 220 has completed recording a set of conversation sentences, it may display a guide message following the final message bubble on the content scrolling area 1303, which includes a conversation sentence playback button 1605 for playing back the pronunciation content of the entire sentence contained in the conversation sentence.

[0129] After recording one set of conversation sentences, if the learner selects the conversation sentence playback button 1605, the processor 220 may execute the playback mode for the conversation sentence, thereby automatically scrolling the conversation content displayed in order in the content scroll area 1303 and playing back the pronunciation content of each sentence in order from the first sentence, as shown in Fig. 17. In other words, in the playback mode, the pronunciation content of the other learner and the learner can be played back in order for each sentence assigned to the conversation sentence in the order of the sentences, thereby realizing the experience of an actual dialogue.

[0130] Similarly, in playback mode, when displaying profile information in participant profile area 1304, processor 220 may highlight the profile information of the participant currently in turn compared to the other participant's profile.

[0131] Referring to FIG. 18, when the processor 220 completes recording one set of conversation sentences, it may activate and display a play button 1801 for playing the pronunciation content of each sentence on a sentence-by-sentence basis in the conversation content displayed in sequence in the content scroll area 1303, a feedback button 1802 for inputting a positive response (e.g., "like"), and the like.

[0132] The processor 220 may display the total cumulative number of plays and the total cumulative number of positive responses for the pronunciation content on a sentence-by-sentence basis in the conversation content displayed in order in the content scroll area 1303.

[0133] Conversational sentences can be played back and given feedback on a sentence-by-sentence basis, and the total number of plays and the total number of positive responses can be added to the activity information of each learning participant and used to determine rankings and rewards for each history.

[0134] The processor 220 may record and share the conversation role-playing process in which the learning participant participated as a multimedia output, such as video or audio. For example, when a set of conversation sentences has been recorded on the role-playing conversation screen 1300, the processor 220 may provide an interface on the role-playing conversation screen 1300 for downloading the conversation role-playing process. For another example, the processor 220 may provide a list of conversations in which the learning participant participated on the personal profile screen 900 and, for each conversation included in the list, may provide an interface for downloading the conversation role-playing process. When a download of a conversation role-playing process in which the learning participant participated is requested, the processor 220 may deliver the process in a multimedia format and record it in a storage space associated with the learning participant or share it on another platform selected by the learning participant. When recording and sharing the conversation role-playing process, the source of the service may be included using a watermark, audio, a QR code, etc.

[0135] 19 and 20 are exemplary diagrams illustrating the process of expanding a conversation tree in an embodiment of the present invention.

[0136] The processor 220 may expand the database (e.g., an accent database from the audio participation service, a conversation content database from the conversation learning service, etc.) through the learner's free talking during the role-playing conversation. Referring to FIG. 19 , in the audio recording mode, when it is the other learner's turn, the pronunciation content registered in the other learner's accent for the assigned sentence may be played back. When it is the learner's turn, a text input field 1901 may be activated and displayed in place of the original text field 1305, allowing the learner to input the sentence they wish to add. The learner may enter a sentence in the text input field 1901 and then speak the sentence to proceed with audio recording. In some embodiments, a method in which the learner speaks a sentence and then converts it into text using STT (speech to text) technology may be applied. The processor 220 may provide a language learning environment in which dialogue can be freely exchanged through an interface that allows the learner to add new sentences to basic conversation sentences or speak other content instead of the basic conversation sentences.

[0137] The processor 220 may construct and provide a basic conversation sentence for each title, and may generate new conversation sentences based on sentences added through free talking participation. Referring to FIG. 20, the processor 220 may radially expand a conversation tree composed of sentences of the basic conversation sentence 2010 by providing an interface for a learner to add new sentences during a role-playing conversation participation process using the basic conversation sentence 2010. A learner may directly add sentences while modifying the basic conversation sentence 2010 and proceed with recording. The processor 220 may generate new conversation sentences 2020 for various scenarios based on sentences added through the learner's participation in free talking.

[0138] As described above, according to an embodiment of the present invention, a database of pronunciation content recorded by users with each accent can be constructed, and a conversation learning platform can be provided using the database. In particular, according to an embodiment of the present invention, a service can be provided in which a user can record and listen to pronunciation content for a conversation for a title selected by the user in a role-playing format. According to an embodiment of the present invention, a user experience can be provided in which a real user with the accent selected by the user appears as the other party in a role-playing conversation, and the user can actually converse. According to an embodiment of the present invention, a conversation tree can be expanded through participation in free talking, and conversations for various scenarios can be generated as content for language learning.

[0139] The above-described devices may be implemented using hardware components, software components, and / or a combination of hardware and software components. For example, the devices and components described in the embodiments may be implemented using one or more general-purpose or special-purpose computers, such as a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or various devices capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the OS. The processing device may also access, record, manipulate, process, and generate data in response to the execution of the software. For ease of understanding, a single processing device may be described. However, those skilled in the art will understand that a processing device may include multiple processing elements and / or multiple types of processing elements. For example, a processing device may include multiple processors or one processor and one controller. Other processing configurations, such as parallel processors, are also possible.

[0140] Software may include computer programs, codes, instructions, or a combination of one or more of these, which may configure a processing device to operate as desired or may independently or collectively instruct the processing device. The software and / or data may be embodied in any type of machine, component, physical device, computer storage medium, or device to be interpreted by the processing device or to provide instructions or data to the processing device. The software may be distributed and stored and executed in a distributed manner on computer systems connected by a network. The software and data may be stored on one or more computer-readable storage media.

[0141] Methods according to embodiments may be implemented in the form of program instructions executable by various computer means and recorded on a computer-readable medium. Here, the medium may continuously record a computer-executable program or temporarily record it for execution or download. Furthermore, the medium may be various recording or storage means in the form of a single piece of hardware or multiple pieces of hardware combined together. It is not limited to media directly connected to a computer system, but may also be distributed over a network. Examples of media include magnetic media such as hard disks, floppy disks, and magnetic tapes; optical media such as CD-ROMs and DVDs; magneto-optical media such as floptical disks; ROMs, RAMs, flash memories, and the like, configured to record program instructions. Other examples of media include recording media or storage media managed by application stores that distribute applications, or by sites, servers, and the like that provide or distribute various software.

[0142] Although the embodiments have been described above based on limited examples and drawings, those skilled in the art will appreciate that various modifications and variations may be made from the above description. For example, the described techniques may be performed in an order different from that described, and / or the described system, structure, device, circuit, or other element may be coupled or combined in a manner different from that described, or may be substituted or replaced by other elements or equivalents, and still achieve suitable results.

[0143] Therefore, different embodiments that are equivalent to the claims are within the scope of the appended claims. [Explanation of symbols]

[0144] 110, 120, 130, 140: Electronic equipment 150, 160: Server 170: Network

Claims

1. A conversation learning service method executed on a computer device, comprising: the computing device includes at least one processor configured to execute computer-readable instructions contained in a memory; The conversation learning service method comprises: a step of registering, by the at least one processor, audio of the target language spoken by each of a plurality of participants for each accent representing the native language, country or ethnic origin, or region of the participant as pronunciation content of the accent, wherein the pronunciation content is classified and registered as one of at least two accents of the target language; providing, by the at least one processor, a conversation in the target language, which is composed of two or more sentences, in a role-playing format using the pronunciation content corresponding to the sentences; Including, The step of providing in a role-playing format includes, when a specific accent is selected by the learner, providing a conversational sentence of a specific title selected by the learner in a role-playing format using pronunciation content of the specific accent selected by the learner from among the pronunciation contents of the multiple participants.

2. The step of providing in the role-playing format includes: providing a first role interface for playing the pronunciation content and a second role interface for recording the learner's speech for the sentences assigned according to the sentence order of the conversation sentences; The conversation learning service method according to claim 1, comprising:

3. The step of providing in the role-playing format includes: providing a first role interface for reproducing pronunciation content in a first accent and a second role interface for reproducing pronunciation content in a second accent different from the first accent for the sentences assigned according to the sentence order of the conversation sentences; The conversation learning service method according to claim 1, comprising:

4. The conversation learning service method comprises: the at least one processor registering the speech as pronunciation content for the learner's appropriate accent. The conversation learning service method according to claim 2, further comprising:

5. The first role interface includes profile information of the participant who registered the pronunciation content; The second role interface includes profile information of the learner.

3. The conversation learning service method according to claim 2, wherein:

6. The second role interface includes an interface for setting an emotional tone for the speech.

3. The conversation learning service method according to claim 2, wherein:

7. the second role interface includes an interface for inputting sentences other than the sentences of the conversation sentences; The conversation learning service method comprises: the at least one processor adding the other sentence to a conversation tree made up of sentences of the conversation sentence and generating a new conversation sentence based on the conversation tree. The conversation learning service method according to claim 2, further comprising:

8. The step of providing the first role interface and the second role interface includes: highlighting and displaying the profile information of the participants and the learners that corresponds to the current order; The conversation learning service method according to claim 5, comprising:

9. The step of providing in the role-playing format includes: a step of sequentially displaying the sentences for which the reproduction of the pronunciation content or the recording of the utterance voice has been completed in a message balloon; The conversation learning service method according to claim 2, further comprising:

10. The step of providing in the role-playing format includes: providing at least one of an interface for reproducing the pronunciation and an interface for inputting a positive response, for each sentence for which the reproduction of the pronunciation content or the recording of the utterance has been completed; The conversation learning service method according to claim 2, further comprising:

11. The step of providing in the role-playing format includes: providing a list of participants selectable for role-playing based on at least one of a real-time connection status and a relationship with the learner; The conversation learning service method according to claim 2, comprising:

12. The step of providing in the role-playing format includes: providing a list of titles from which to select as study titles; and Providing a conversation of a specific title selected from the title list as content for language learning to a learner. The conversation learning service method according to claim 1, comprising:

13. The step of providing the title list includes: displaying title information for each title included in the title list; Including, The title information includes profile information of at least one participant who participated in the recording of the conversation belonging to the title. The conversation learning service method according to claim 12,

14. The title information includes at least one of an object related to the title, the number of conversations belonging to the title, and the number of participants who participated in recording of the conversations belonging to the title. The conversation learning service method according to claim 13,

15. The title information includes history information of the learner regarding conversation sentences belonging to the title. The conversation learning service method according to claim 13,

16. A computer program for causing a computer device to execute the conversation learning service method according to any one of claims 1 to 15.

17. 1. A computer device comprising: at least one processor configured to execute computer-readable instructions contained in the memory; Including, The at least one processor a step of registering audio of a target language spoken by a plurality of participants as pronunciation content of the accent for each of the participants' native language, country of origin, ethnicity, or region, wherein the pronunciation content is classified into one of at least two accents of the target language and registered; providing the conversational text in the target language, which is composed of two or more sentences, in a role-playing format using the pronunciation content corresponding to the sentences; Process The process of providing in a role-playing format includes, upon receiving a selection of a specific accent from a learner, providing a conversational sentence of a specific title selected by the learner in a role-playing format using pronunciation content of the specific accent selected by the learner from among the pronunciation contents of the multiple participants.

18. The at least one processor providing a first role interface for playing the pronunciation content and a second role interface for recording the learner's speech for the sentences assigned according to the sentence order of the conversation sentences; or a first role interface for reproducing pronunciation content with a first accent and a second role interface for reproducing pronunciation content with a second accent different from the first accent for sentences assigned in accordance with the sentence order of the conversation sentences; 18. The computer device of claim 17.

Images