System and method for providing sign language service

Abstract

The invention provides a system and a method for providing sign language service. The system includes a first terminal that generates at least one piece of first message data corresponding to a message to be delivered by a first user. The system also includes a server that converts the first message data received from the first terminal into first operation data corresponding to an operation of the robot. The system also includes a robot performing an operation according to the first operation data received from the server. When two or more pieces of first operation data are recognized, the server ranks the two or more pieces of first operation data based on a transmission order according to a predetermined criterion, and transmits the ranked first operation data to the robot. And the robot executes an operation based on the sorted first operation data.

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims the benefit of and priority to Korean Patent Application No. 10-2023-0110699 filed in the Korean Intellectual Property Office on August 23, 2023, the entire contents of which are incorporated herein by reference. Technical Field

[0003] The present disclosure relates to a system and method for providing a sign language service, and more particularly, to a technology for delivering a user's message as a sign language through the operation of a robot. Background Art

[0004] The statements in this section merely provide background information related to the present disclosure and may not constitute prior art.

[0005] A sign language robot is a robot that communicates with the hearing-impaired. The function of the sign language robot is to convert the message that the user wants to convey to the hearing-impaired into sign language and notify the hearing-impaired of the sign language.

[0006] Existing sign language robots may often only transmit information from one user. Therefore, when multiple people want to communicate with each other through sign language, multiple sign language robots are required. When multiple people communicate with each other through multiple sign language robots, the conversion may become complicated because multiple robots perform sign language operations at the same time. In addition, since each person needs a robot, the cost burden increases. Summary of the invention

[0007] The present disclosure is made to solve the above-mentioned problems occurring in the prior art while keeping the advantages achieved by the prior art unchanged.

[0008] One aspect of the present disclosure provides a system and method for providing a sign language service, so as to enable two-way communication between multiple users through one robot as one robot converts multiple messages transmitted by multiple users into sign languages ​​based on a certain sequence.

[0009] Another aspect of the present disclosure provides a system and method for providing sign language services, so that the emotions, intentions, etc. to be conveyed through the user's message can be conveyed together with the message through the robot's light-emitting elements that emit light of different colors, so as to improve the accuracy of the delivered message.

[0010] Another aspect of the present disclosure provides a system and method for providing a sign language service to reduce costs because a plurality of users communicate with each other through one robot.

[0011] Another aspect of the present disclosure provides a system and method for providing a sign language service to deliver messages of high importance or urgency to multiple people at one time to improve convenience.

[0012] The technical problems to be solved by the present disclosure are not limited to the aforementioned problems, and a person skilled in the art in the art to which the present disclosure belongs should clearly understand any other technical problems not mentioned herein through the following description.

[0013] According to one aspect of the present disclosure, a system for providing a sign language service may include: a first terminal, generating at least one first message data corresponding to a message to be transmitted by a first user. The system for providing a sign language service may further include: a server, converting the first message data received from the first terminal into first operation data corresponding to the operation of a robot. The system for providing a sign language service may further include: a robot, performing an operation according to the first operation data received from the server. The server may, when identifying two or more first operation data, sort the two or more first operation data based on a transmission order according to a predetermined criterion. The server may further transmit the sorted first operation data to the robot. The robot may perform an operation based on the sorted first operation data.

[0014] In an embodiment, the system may further include: a second terminal, generating at least one second message data corresponding to the message to be transmitted by the second user. The server may convert the second message data received from the second terminal into second operation data corresponding to the operation of the robot. The server may further sort the first operation data and the second operation data based on the transmission order according to a predetermined standard when identifying two or more first operation data and second operation data. The server may further transmit the sorted first operation data and second operation data to the robot. The robot may further perform an operation based on the sorted first operation data and second operation data.

[0015] In an embodiment, the predetermined standard in the system can be set based on at least one of the time sequence of transmission of the first message data through the first terminal, the time sequence of reception of the first message data in the server, the time sequence determined according to the nature of the first message data, and any combination thereof.

[0016] In an embodiment, the server may further analyze at least one of the intent of the message, the emotion contained in the message, the importance of the message, and any combination thereof based on the first message data. The server may further convert the first message data into first operation data based on the analysis result.

[0017] In an embodiment, the first message data may include first user information, and the first user information includes at least one of a name of a first user corresponding to the first terminal, an ID of the first user, a nickname of the first user, an age of the first user, a gender of the first user, a number for specifying the first user, and any combination thereof. The server may store the first user information in a database.

[0018] In an embodiment, the server may further recommend a message phrase to the first user based on the first user information stored in the database.

[0019] In an embodiment, the robot may further perform a finishing operation indicating that the operation according to the first operation data received from the server is finished when the operation performed according to the first operation data is finished.

[0020] In an embodiment, the first message data may include first user information, the first user information including at least one of the name of the first user corresponding to the first terminal, the ID of the first user, the nickname of the first user, the age of the first user, the gender of the first user, a number for specifying the first user, and any combination thereof. The second message data may include second user information, the second user information including at least one of the name of the second user corresponding to the second terminal, the ID of the second user, the nickname of the second user, the age of the second user, the gender of the second user, a number for specifying the second user, and any combination thereof. The robot may further perform operations based on the first user information and the second user information by separating operations according to the first operation data and operations according to the second operation data.

[0021] In an embodiment, the robot may include a light emitting element. The robot may further perform an operation according to the first operation data together with light corresponding to a first color passing through the light emitting element. The robot may further perform an operation according to the second operation data together with light corresponding to a second color passing through the light emitting element.

[0022] In an embodiment, the robot may include a light emitting element, and may further perform an operation according to the first operation data together with at least one light represented by the light emitting element. The at least one light may indicate at least one of the intention of the message, the emotion contained in the message, the importance of the message, and any combination thereof.

[0023] In an embodiment, the first terminal may generate first message data including a color input by the first user. The robot may include a light emitting element, and may further perform an operation according to the first operation data together with light corresponding to the color input by the first user. The color is represented by the light emitting element.

[0024] In an embodiment, the system may further include a display. The first terminal may further generate first message data including at least one of a color input by the first user, an emotion input by the first user, and any combination thereof. The display may receive the first message data or the first operation data from the server, and may display information corresponding to at least one of a color input by the first user, an emotion input by the first user, and any combination thereof. The information is included in the first message data or the first operation data.

[0025] According to another aspect of the present disclosure, a method for providing a sign language service may include: generating, by a first terminal, at least one first message data corresponding to a message to be transmitted by a first user. The method for providing a sign language service may further include: converting, by a server, the first message data received from the first terminal into first operation data corresponding to the operation of a robot. The method for providing a sign language service may further include: by a server, when two or more first operation data are identified, sorting the two or more first operation data based on a transmission order according to a predetermined criterion. The method for providing a sign language service may further include: transmitting, by a server, the sorted first operation data to a robot; and, by a robot, performing an operation according to the first operation data received from the server. Performing, by a robot, an operation according to the first operation data received from the server may include: by a robot, performing an operation based on the sorted first operation data.

[0026] In the method according to the embodiment, the method may further include: generating at least one second message data corresponding to the message to be transmitted by the second user through the second terminal. Converting the first message data received from the first terminal to the first operation data corresponding to the operation of the robot through the server may include: converting the second message data received from the second terminal to the second operation data corresponding to the operation of the robot through the server. Sorting the two or more first operation data based on the transmission order according to a predetermined standard through the server when identifying two or more first operation data may include: sorting the first operation data and the second operation data based on the transmission order according to a predetermined standard through the server when identifying two or more first operation data and second operation data. Transmitting the sorted first operation data to the robot through the server may include: transmitting the sorted first operation data and the second operation data to the robot through the server. Performing the operation according to the first operation data received from the server through the robot may include: performing the operation based on the sorted first operation data and the second operation data through the robot.

[0027] In the method according to the embodiment, the predetermined standard in the method can be set based on at least one of the time sequence in which the first message data is transmitted through the first terminal, the time sequence in which the first message data is received in the server, the time sequence determined according to the nature of the first message data, and any combination thereof.

[0028] In the method according to the embodiment, converting the first message data received from the first terminal into the first operation data corresponding to the operation of the robot through the server may include: analyzing, through the server, at least one of the intention of the message, the emotion contained in the message, the importance of the message and any combination thereof based on the first message data; and converting, through the server, the first message data into the first operation data based on the analysis result.

[0029] In the method according to the embodiment, the first message data may include first user information, the first user information including at least one of the name of the first user corresponding to the first terminal, the ID of the first user, the nickname of the first user, the age of the first user, the gender of the first user, a number for specifying the first user, and any combination thereof. The method may further include: storing the first user information in a database through a server; and recommending a message phrase to the first user based on the first user information stored in the database through the server.

[0030] In the method according to the embodiment, the first message data may include first user information, the first user information including at least one of the name of the first user corresponding to the first terminal, the ID of the first user, the nickname of the first user, the age of the first user, the gender of the first user, a number for specifying the first user, and any combination thereof. The second message data may include second user information, the second user information including at least one of the name of the second user corresponding to the second terminal, the ID of the second user, the nickname of the second user, the age of the second user, the gender of the second user, a number for specifying the second user, and any combination thereof. By the robot, performing an operation according to the sorted first operation data and the second operation data may include: based on the first user information and the second user information, separating an operation according to the first operation data and an operation according to the second operation data to perform the operation.

[0031] In the method according to the embodiment, the robot may include a light emitting element. By the robot, based on the first user information and the second user information, separating the operation according to the first operation data and the operation according to the second operation data to perform the operation may include: by the robot, performing the operation according to the first operation data together with the light corresponding to the first color passing through the light emitting element; and by the robot, performing the operation according to the second operation data together with the light corresponding to the second color passing through the light emitting element.

[0032] In the method according to the embodiment, the robot may include a light emitting element. Performing the operation according to the sorted first operation data by the robot may include: performing the operation according to the first operation data together with at least one light represented by the light emitting element. The at least one light may indicate at least one of the intention of the message, the emotion contained in the message, the importance of the message, and any combination thereof. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] The above and other objects, features and advantages of the present disclosure will become more apparent from the following detailed description in conjunction with the accompanying drawings:

[0034] Figure 1 is a block diagram illustrating a system for providing a sign language service according to an embodiment of the present disclosure;

[0035] Figure 2 is a diagram showing an example in which the operation of a robot is implemented in the order of transmitting a plurality of messages in a system for providing a sign language service according to an embodiment of the present disclosure;

[0036] Figure 3 is a conceptual diagram showing an example of transmitting and receiving data between a terminal, a server, and a robot in a system for providing a sign language service according to an embodiment of the present disclosure;

[0037] Figure 4 is a diagram illustrating an example of converting message data into operation data in a system for providing a sign language service according to an embodiment of the present disclosure;

[0038] Figure 5 is a diagram illustrating an example of storing user information of a plurality of message data in a database in a system for providing a sign language service according to an embodiment of the present disclosure;

[0039] Fig. 6A is a conceptual diagram showing an example of converting message data into operation data in a server in a system for providing a sign language service according to another embodiment of the present disclosure;

[0040] Figure 6B is a conceptual diagram showing an example of converting message data into operation data in a robot in a system for providing a sign language service according to another embodiment of the present disclosure;

[0041] Figure 6C is a conceptual diagram showing an example of converting message data into operation data in a terminal in a system for providing a sign language service according to another embodiment of the present disclosure;

[0042] Figure 7 is a diagram illustrating an example of sorting a plurality of pieces of operation data based on a transmission order according to a predetermined standard in a system for providing a sign language service according to an embodiment of the present disclosure;

[0043] Figure 8 is a diagram illustrating an example in which a robot performs a tidying operation when the robot ends an operation according to each piece of operation data in a system for providing a sign language service according to an embodiment of the present disclosure;

[0044] Fig. 9 is a diagram illustrating an example of an operation of separating a message according to each user by a light emitting element of a robot emitting light of different colors in a system for providing a sign language service according to an embodiment of the present disclosure;

[0045] Fig.10 is a diagram illustrating an example of a color table indicating emotions and a screen on which a user can input a color and a message in a system for providing a sign language service according to an embodiment of the present disclosure;

[0046] Fig.11 is a diagram showing a screen in which a user can input emoticons and messages in a system for providing a sign language service according to an embodiment of the present disclosure, and showing an example in which the emoticons input by the user are displayed on a display;

[0047] Fig.12 is a conceptual diagram showing a general process in which a data message generated by a terminal is converted into operation data in a server to be implemented as an operation performed by a robot in a system for providing a sign language service according to another embodiment of the present disclosure;

[0048] Fig.13 is a flowchart for describing a process in which a message written by a user is implemented as an operation performed by a robot in a method for providing a sign language service according to another embodiment of the present disclosure; and

[0049] Fig.14 A computing system associated with a system for providing a sign language service or a method for providing a sign language service according to an embodiment of the present disclosure is shown.

[0050] Description of Reference Numerals

[0051] 410: Message data

[0052] 412: User Information

[0053] 414: Message content

[0054] 420: Operational Data

[0055] 424: Operation content

[0056] 510: First message data

[0057] 512: First user information

[0058] 520: Second message data

[0059] 522: Second user information

[0060] 530: First operation data

[0061] 540: Second operation data

[0062] 710: First operation data

[0063] 712: First user information

[0064] 714: First operation content

[0065] 720: Second operation data

[0066] 722: Second user information

[0067] 724: Second operation content

[0068] 730: Third operation data

[0069] 732: Third-party user information

[0070] 734: The third operation content

[0071] 740: Buffer

[0072] 760: Robot

[0073] 810: First operation data

[0074] 820: Second operation data DETAILED DESCRIPTION

[0075] Hereinafter, some embodiments of the present disclosure are described in detail with reference to the accompanying drawings. In the accompanying drawings, the same reference numerals are always used to represent the same or equivalent components. In addition, in order to avoid unnecessarily making the main points of the present disclosure unclear, detailed descriptions of well-known features or functions are omitted.

[0076] When describing the components of the embodiments of the present disclosure, the terms first, second, A, B, (a), (b), etc. may be used herein. These terms are only used to distinguish one component from another component, but do not limit the corresponding components, regardless of the order or priority of the corresponding components. In addition, unless otherwise defined, all terms (including technical terms and scientific terms) used herein should be interpreted according to the custom of the field to which the present disclosure belongs. It should be understood that the terms used herein should be interpreted as having a meaning consistent with the meaning of the present disclosure and the relevant technical background. It should also be understood that, unless clearly defined herein, the terms should not be interpreted in an idealized or overly formal sense. When the components, devices, elements, etc. of the present disclosure are described as having a certain purpose or performing a certain operation, function, etc., the components, devices, elements, etc. should be regarded as "configured to" meet the purpose or perform the operation or function. As part of a device, each of the components, devices, elements, etc. can be implemented as a processor and a memory (e.g., a non-temporary computer-readable medium) or include a processor and a memory separately.

[0077] In the following, reference is made to Figures 1 to 14 Embodiments of the present disclosure are described in detail.

[0078] Figure 1 is a block diagram illustrating a system for providing a sign language service according to an embodiment of the present disclosure.

[0079] According to an embodiment, a system 100 for providing a sign language service may include a first terminal 110 , a second terminal 120 , a server 150 , and a robot 160 . Figure 1 The components of the system 100 for providing a sign language service shown in FIG. 1 are exemplary, and the embodiments of the present disclosure are not limited thereto. For example, the system 100 for providing a sign language service may further include: Figure 1 Components not shown.

[0080] According to an embodiment, each of the first terminal 110 and the second terminal 120 may include at least one of a mobile phone, a smart phone, a tablet computer, a laptop computer, a smart watch, and any combination thereof. For example, each of the first terminal 110 and the second terminal 120 may include a terminal having a function of allowing a user to input a message.

[0081] As another example, the first terminal 110 and the second terminal 120 may be terminals used by different users. For example, the first terminal 110 may be a terminal used by a first user, and the second terminal 120 may be a terminal used by a second user.

[0082] According to an embodiment, the embodiments described below regarding the first terminal 110 may be described as embodiments regarding the second terminal 120 .

[0083] According to an embodiment, the first terminal 110 may generate at least one first message data corresponding to a message to be delivered by the first user.

[0084] For example, the first user may input a message to be delivered by the robot in sign language using the first terminal 110. As a detailed example, the message input by the first user may include at least one of text, voice, image, and any combination thereof.

[0085] According to an embodiment, the first terminal 110 may generate the first message data based on the message input by the first user. For example, the first message data may include first user information about the first user, the message content input by the first user, and the like.

[0086] For example, the first user information may include information that can specify the user of the first terminal. As a detailed example, the first user information may include at least one of the name of the first user corresponding to the first terminal, the ID of the first user, the nickname of the first user, the age of the first user, the gender of the first user, a number for specifying the first user, and any combination thereof.

[0087] According to an embodiment, the first terminal 110 may transmit the first message data to the server 150. For example, each of the first terminal 110 and the server 150 may include a communication circuit capable of sending and receiving data in a wired or wireless manner.

[0088] Here, the communication circuit may include a circuit for wireless Internet access. For example, the communication circuit may access a wireless communication network of a wireless communication operator to use wireless communication such as third generation mobile communication (3G), long term evolution (LTE), LTE-Advanced (LTE-A), or fifth generation mobile communication (5G). In addition, the communication circuit may be loaded into the telematics unit and may include a radio frequency (RF) antenna and a communication control module.

[0089] According to an embodiment, the server 150 may receive the first message data from the first terminal 110 .

[0090] According to an embodiment, the server 150 may convert the first message data received from the first terminal 110 into first operation data corresponding to the operation of the robot 160 .

[0091] For example, the first operation data may include data capable of controlling the operation of the robot 160. As a detailed example, the first operation data may include an operation of at least one of the shape of a hand and a finger, the direction of a palm, the position of a hand, the motion of a hand, and any combination thereof, performed when the first message data is converted into a sign language.

[0092] For example, the first operation data may include data conforming to the protocol of the robot 160. As a detailed example, the first operation data may include information conforming to the protocol of the robot 160 so that only the robot 160 receives the data.

[0093] For example, the first operation data may include robot information capable of specifying the robot 160. As a detailed example, the first operation data may include robot information that enables only the specified robot 160 to perform an operation of the corresponding message in a space where a plurality of robots 160 exist. In detail, the robot information may include at least one of an ID of a specified robot, a serial number of a specified robot, a nickname of a specified robot, and any combination thereof.

[0094] For another example, the first operation data may include first user information capable of specifying a user of the first terminal. As a detailed example, the first operation data may include first user information that is the same as the first user information included in the first message data.

[0095] According to an embodiment, when two or more pieces of first operation data and second operation data are identified, the server 150 may sort the first operation data and the second operation data based on a transmission order according to a predetermined standard.

[0096] For example, when the server 150 receives a plurality of message data, it may identify a plurality of operation data. In this case, the server 150 may convert the plurality of message data into a plurality of operation data, respectively.

[0097] As a detailed example, when receiving first message data and second message data and converting the first message data and the second message data into first operation data and second operation data, respectively, the server 150 may sort the first operation data and the second operation data based on a transmission order according to a predetermined criterion.

[0098] According to an embodiment, the predetermined criterion may be set based on at least one of a time sequence of transmitting message data through a terminal, a time sequence of receiving message data by the server 150, a time sequence determined according to properties of message data, and any combination thereof.

[0099] For example, when a predetermined standard is set based on the time sequence of receiving message data in the server 150, and when the first message data is received in the server 150 earlier than the second message data is received in the server 150, the server 150 may rank the first operation data converted from the first message to be earlier than the second operation data converted from the second message data. In other words, when the time when the server 150 receives the first message data is earlier than the time when the second message data is received, the server 150 may prioritize the first operation data relative to the second operation data. In this case, although the second message data is transmitted through the second terminal 120 before the first message data is transmitted through the first terminal 110, the server 150 may rank the first operation data to be earlier than the second operation data.

[0100] For example, when a predetermined standard is set based on the time order of message data transmission through terminals, and when the first message data is transmitted through the first terminal 110 before the second message data is transmitted through the second terminal 120, the server 150 can sort the first operation data converted from the first message data to be earlier than the second operation data converted from the second message data.

[0101] For another example, when a predetermined standard is set based on a time sequence determined according to the nature of the message data, when the first message data has an urgent or important nature and when the second message data has a general nature of being non-urgent or unimportant, the server 150 can sort the first operation data converted from the first message data to be earlier than the second operation data converted from the second message data.

[0102] According to an embodiment, the plurality of pieces of operation data may be sorted by a buffer memory. For example, the server 150 may temporarily store the plurality of pieces of data in a buffer memory based on a transmission order according to a predetermined standard. In this case, each piece of operation data may be transmitted to the robot 160 in the order in which it is stored in the buffer.

[0103] According to an embodiment, the server 150 may analyze the message data received by the terminal. For example, the server 150 may analyze at least one of the intent of the message, the emotion contained in the message, the importance of the message, and any combination thereof based on the message data. For another example, the server 150 may analyze the message data in a semantic manner.

[0104] As a detailed example, the server 150 may perform analysis to determine the user's intention to communicate via messaging, intention to communicate on a daily basis, intention to deliver information, intention to issue a notification, intention to ask a question, and the like.

[0105] As another detailed example, the server 150 may perform analysis to determine whether the emotion contained in the user message is a happy emotion, a sad emotion, an angry emotion, or the like.

[0106] As another detailed example, the server 150 may perform analysis to determine the importance of a message based on the urgency, risk, priority, etc. of the message.

[0107] According to an embodiment, the server 150 may convert the message data into operation data based on the result of analyzing the message data. In this case, the server 150 may sort the multiple operation data based on the transmission order according to the analysis result of each message data. For example, the server 150 may first sort the operation data with higher message importance.

[0108] According to an embodiment, the server 150 may store user information included in the message data in a database. In detail, the server 150 may store user information including at least one of the name of the user corresponding to the terminal, the ID of the user, the nickname of the user, the age of the user, the gender of the user, a number for specifying the user, and any combination thereof in the database. As a detailed example, the server 150 may store the first user information included in the first message data in the database.

[0109] According to an embodiment, the server 150 may analyze frequently used phrases according to age, gender, or specified users based on user information stored in a database.

[0110] For example, the server 150 may analyze phrases frequently used in messages by users in their 20s, 30s, 40s, or 50s. For example, the server 150 may analyze phrases frequently used in messages by male users or female users. For another example, the server 150 may analyze phrases frequently used in messages by a specified user.

[0111] According to an embodiment, the server 150 may recommend message phrases to the user based on the user information stored in the database. For example, the server 150 may recommend phrases frequently used by the user based on the result of analysis according to age, gender or a specified user. As a detailed example, the server 150 may recommend phrases frequently used by the first user through the first terminal 110 based on the first user information stored in the database. In addition, the server 150 may use the user information stored in the database in various ways.

[0112] According to an embodiment, the server 150 may transmit the plurality of pieces of operation data to the robot 160 in a sorted order. For example, when the plurality of pieces of operation data are sorted in a buffer based on a transmission order, each piece of operation data may be transmitted to the robot 160 in a sorted order.

[0113] According to an embodiment, the robot 160 may perform an operation according to the operation data received from the server 150. For example, when receiving the first operation data from the server 150, the robot 160 may perform the operation included in the first operation data.

[0114] As another example, when multiple pieces of operation data are received sequentially, the robot 160 may perform operations in the order in which each piece of operation data is received.

[0115] According to an embodiment, when receiving multiple pieces of operation data corresponding to messages of multiple users, the robot 160 can separate the multiple users to perform operations. For example, the robot 160 can separate the multiple users using different designated operations for each user, different colors of light emitted by the light emitting element, etc.

[0116] According to an embodiment, whenever the execution of the operation according to the received operation data ends, the robot 160 may perform a tidying operation indicating the end of the operation according to the operation data.

[0117] For example, when the first operation data, the second operation data, and the third operation data are sequentially received from the server 150, when the operation according to the first operation data ends, the robot 160 may perform a finishing operation. Then, the robot 160 may perform an operation according to the second operation data. Likewise, when the operation according to the second operation data ends, the robot 160 may perform a finishing operation and then may perform an operation according to the third operation data.

[0118] Therefore, the user who receives the message through the robot 160 can separate the multiple messages through the sorting operation of the robot 160.

[0119] According to an embodiment, the robot 160 may separate pieces of operation data for each user based on user information included in the operation data received from the server 150 .

[0120] According to an embodiment, when a plurality of pieces of operation data corresponding to a plurality of users are received, the robot 160 may perform a finishing operation for each user whenever an operation according to each piece of operation data ends.

[0121] For example, when performing the first operation to the third operation corresponding to the message from the first user to the third user, the robot 160 can perform the first sorting operation corresponding to the first user at the end of the first operation, can perform the second sorting operation corresponding to the second user at the end of the second operation, and can perform the third sorting operation corresponding to the third user at the end of the third operation.

[0122] Therefore, the user who receives the message through the robot 160 can separate the messages of multiple users through the different sorting operations of the robot 160 for each user.

[0123] According to an embodiment, the robot 160 may include a light emitting element. At this time, the light emitting element may be an element that converts electricity into light and emits light. For example, the light emitting element may include a light emitting diode (LED), an injection laser diode (ILD), etc. In addition, the light emitting element may emit light of various colors.

[0124] According to an embodiment, the light emitting element may be located at various positions of the robot 160. For example, the light emitting element may be located at a position where a user who receives a message through the sign language of the robot 160 can well recognize light. As a detailed example, the light emitting element may be located in a wrist portion, a finger, a palm, or the entire hand shape of the robot 160.

[0125] According to an embodiment, the robot 160 may separate operations according to a plurality of pieces of operation data based on the color of light passing through the light emitting element. For example, when the robot 160 performs an operation according to first operation data, the light emitting element may emit light of a first color. When the robot 160 performs an operation according to second operation data, the light emitting element may emit light of a second color. At this time, the first color and the second color may be divided into different colors.

[0126] According to an embodiment, the robot 160 may separate users based on the color of light passing through the light emitting element. For example, when the robot 160 performs an operation according to first operation data corresponding to the first user, the light emitting element may emit light of a first color. When the robot 160 performs an operation according to second operation data corresponding to the second user, the light emitting element may emit light of a second color. As a detailed example, when the robot 160 performs an operation according to a message transmitted by the first user, the light emitting element may emit light corresponding to blue. When the robot 160 performs an operation according to a message transmitted by the second user, the light emitting element may emit light corresponding to green.

[0127] Therefore, the user who receives the message through the robot 160 can separate the messages or users by the different colors of light emitted by the light emitting element.

[0128] According to an embodiment, the robot 160 may express at least one of the intention of the message, the emotion contained in the message, the importance of the message, and any combination thereof through the light of the light emitting element.

[0129] For example, the robot 160 can use different colors of light of the light emitting element to represent the emotions contained in the message, such as happy emotions, sad emotions, angry emotions, etc. As a detailed example, when the robot 160 performs an operation according to the message of happy emotions, it can emit light corresponding to yellow, and when performing an operation according to the message of angry emotions, it can emit light corresponding to red.

[0130] For example, the robot 160 can use different colors of light from the light emitting element to indicate the urgency, risk, importance, etc. of the message. As a detailed example, when the robot 160 performs an operation according to a message with higher urgency, the light emitting element can emit light corresponding to yellow, and when performing an operation according to a message with higher risk, the light emitting element can emit light corresponding to red.

[0131] According to an embodiment, the user may input in the terminal the color of light to be represented by the light emitting element of the robot 160. In this case, the robot 160 may perform an operation according to the operation data and the light corresponding to the color input by the user.

[0132] For example, when the user inputs red in the first terminal 110 to convey an angry emotion through a message, the first terminal 110 may transmit the first message data including information about the angry emotion according to the red input by the user to the server 150. Therefore, the robot 160 may emit light corresponding to red through the light emitting element and may perform an operation according to the first operation data.

[0133] Therefore, the user who receives the message through the robot 160 can determine the emotion of the user who sent the message, the importance of the message, etc. through the different colors of light of the light-emitting element.

[0134] According to an embodiment, the system 100 for providing a sign language service may further include a display. For example, the display may include an output device such as a television, a monitor, a beam projector, or a laptop.

[0135] According to an embodiment, the display may receive message data or operation data from the server 150. For example, the display may include a communication circuit capable of performing wired or wireless communication with the server 150.

[0136] According to an embodiment, the user can input information corresponding to at least one of a color, an emoticon, and any combination thereof through the terminal. For example, the color input by the user, the emoticon input by the user, etc. can represent the emoticon to be transmitted through the message, the importance of the message, etc. As a detailed example, when wanting to express an angry emotion, the user can input an angry emoticon.

[0137] According to an embodiment, the server 150 may transmit message data or operation data including information corresponding to at least one of a color input by a user, an emoticon input by a user, and any combination thereof to the display.

[0138] According to an embodiment, the display may display information corresponding to at least one of a color input by a user, an emoticon input by a user, and any combination thereof. For example, the display may display information corresponding to at least one of a color input by a user, an emoticon input by a user, and any combination thereof in the form of at least one of text, an image, a video, and any combination thereof.

[0139] For example, when an emoticon representing the first user's angry emotion is included in the first message data or the first operation data, the display may display the emoticon input by the user while the robot 160 performs an operation according to the first operation data.

[0140] As a detailed example, a user who receives a message through the robot 160 and the display can recognize an emoticon of an angry emotion displayed on the display and an operation performed by the robot 160. Therefore, the user who receives the message can recognize that the user who transmits the message is in an angry state.

[0141] Figure 2 is a diagram illustrating an example in which the operation of a robot is implemented in the order of transmitting a plurality of messages in a system for providing a sign language service according to an embodiment of the present disclosure.

[0142] According to an embodiment, Figure 2 The structure of the space where the user and the robot are located together Figure 2 Example 2Q where the operation of P and the robot is implemented in a sequence of transmitting multiple messages.

[0143] Reference Figure 2 The structure of the space where the user and the robot are located together Figure 2 P, the first user to the fourth user can transmit information through their respective first terminal to the fourth terminal communicating with each other. At this time, each user can transmit multiple messages during the mutual communication process.

[0144] According to an embodiment, the first to fourth terminals may transmit message data corresponding to the order of messages transmitted by the first to fourth users to the server through wired or wireless communication. Figure 2 Not shown, the message data transmitted by the terminal can be converted into operation data in the server for transmission to the robot.

[0145] For example, the first message data may include a message of the first user, the second message data may include a message of the second user, the third message data may include a message of the third user, the fourth message data may include a message of the second user, and the fifth message data may include a message of the fourth user.

[0146] Reference Figure 2 In Example 2Q of implementing robot operation in the order of transmission of multiple messages, the robot can sequentially perform operations corresponding to the message contents included in the first message data to the fifth message data. For example, the robot can perform an operation of converting the message of the first user included in the first message data into sign language, and then can perform an operation of converting the message of the second user included in the second message data into sign language. Thereafter, the robot can perform an operation of converting the message of the third user included in the third message data into sign language, and then can sequentially perform an operation of converting the message of the second user included in the fourth message data and the message of the fourth user included in the fifth message data into sign language.

[0147] according to Figure 2 In the illustrated embodiment, multiple users can communicate bidirectionally with each other through a robot.

[0148] Figure 3 is a conceptual diagram illustrating an example of transmitting and receiving data between a terminal, a server, and a robot in a system for providing a sign language service according to an embodiment of the present disclosure.

[0149] Reference Figure 3 According to an embodiment, a plurality of terminals may access the server 350 and transmit message data to the server 350 via wired or wireless communication. The server 350 may convert the received message data into operation data and transmit the operation data to the robot 360 via wired or wireless communication.

[0150] According to an embodiment, the first terminal 310 to the third terminal 330 may access the server 350 and may transmit the first message data to the third message data to the server 350. The server 350 may sequentially convert the first message data to the third message data transmitted by the first terminal 310 to the third terminal 330 into the first operation data to the third operation data, and may transmit the first message data to the third operation data to the robot 360. The robot 360 may perform corresponding operations according to the received first operation data to the third operation data.

[0151] according to Figure 3 In the embodiment, since the message data transmitted by multiple terminals can be converted into multiple operation data corresponding to the corresponding message data, and the multiple operation data can be transmitted to the robot 360, the message input by the user can be converted into sign language by the robot 360.

[0152] Figure 4 is a diagram illustrating an example of converting message data into operation data in a system for providing a sign language service according to an embodiment of the present disclosure.

[0153] According to an embodiment, the server may convert the message data 410 received from the terminal into the operation data 420 through a data analysis and conversion process.

[0154] According to an embodiment, the message data 410 may include user information 412 and message content 414 .

[0155] For example, user information 412 may include information that can specify a user of the terminal. As a detailed example, user information 412 may include at least one of the name of the user corresponding to the terminal, the user's ID, the user's nickname, the user's age, the user's gender, a number for specifying the user, and any combination thereof.

[0156] For example, the message content 414 may include the message content input by the user. As a detailed example, the message content 414 may be included in the form of text, voice, image, etc.

[0157] According to an embodiment, operational data 420 may include user information 412 and message content 424 .

[0158] For example, the user information 412 in the operation data 420 may be the same data as the user information 412 included in the message data 410. In other words, although the message data 410 undergoes the data analysis and conversion process, the user information 412 may remain unchanged. However, it is not necessarily limited to this. The message data 410 may be other types of data that can be matched with the operation data 420 while including the user information 412.

[0159] For example, the operation content 424 may include content about the operation of the robot. As a detailed example, the operation content 424 may include content about the operation of converting the message content 414 into sign language. In addition, the operation content 424 may include instructions for controlling the robot to perform the operation converted into sign language.

[0160] According to an embodiment, the data analysis and conversion process performed in the server may include a process of separating the user information 412 and the message content 414 and converting the message content 414 into the operation content 424 .

[0161] Figure 5 is a diagram illustrating an example of storing user information of a plurality of message data in a database in a system for providing a sign language service according to an embodiment of the present disclosure.

[0162] According to an embodiment, the message data may be converted into operational data through a data analysis and conversion process of the server, and the user information included in the message data may be stored in the database 570 .

[0163] For example, first message data 510 including first user information 512 may be converted into first operation data 530 including first user information 512. Also, second message data 520 including second user information 522 may be converted into second operation data 540 including second user information 522.

[0164] For example, in the process of converting the first message data 510 and the second message data 520 into the first operation data 530 and the second operation data 540 , the first user information 512 and the second user information 522 may be stored in the database 570 .

[0165] According to an embodiment, the server may recommend message phrases to the user using the user information stored in the database 570. For example, the server may recommend to the user phrases that the user frequently uses, which are analyzed based on the user's name, the user's ID, the user's nickname, the user's age, the user's gender, a number for specifying the user, etc. When inputting a message through the terminal, the user may use the message phrases recommended by the server.

[0166] For example, the server may recommend message phrases frequently used by the first user to the first user based on the first user information 512 stored in the database 570 , and may recommend message phrases frequently used by the second user to the second user based on the second user information 522 .

[0167] according to Figure 5 According to an embodiment of the present invention, when a user inputs a message using a message phrase recommended from a server, the convenience of inputting an input to be delivered can be improved.

[0168] Fig. 6A , Figure 6B and Figure 6C is a conceptual diagram illustrating a detailed example of converting message data into operation data in a system for providing a sign language service according to an embodiment of the present disclosure.

[0169] According to an embodiment, the server, robot or terminal may include a memory storing program instructions and a processor configured to execute the program instructions. For example, the processor may convert the message data into operation data through a data analysis and conversion process.

[0170] Fig. 6A is a conceptual diagram illustrating an example of converting message data into operation data in a server in a system for providing a sign language service according to an embodiment of the present disclosure.

[0171] According to an embodiment, the location where the message data is converted into operational data through the data analysis and conversion process may be the server 650 .

[0172] For example, the server 650 may convert the message data into operational data through a data analysis and conversion process.

[0173] As a detailed example, the server 650 may convert the first message data received from the first terminal 610, the second message data received from the second terminal 620, and the third message data received from the third terminal 630 into the first operation data, the second operation data, and the third operation data, respectively, through the data analysis and conversion process. The server 650 may sort and transmit the converted first operation data, the converted second operation data, or the converted third operation data to the robot 660.

[0174] For example, the robot 660 may sequentially perform respective operations according to the received first operation data, the received second operation data, and the received third operation data.

[0175] according to Fig. 6A In the embodiment, since data analysis and conversion are performed by the server, the burden on the processor of the user's terminal or robot can be reduced.

[0176] Figure 6B is a conceptual diagram illustrating an example of converting message data into operation data in a robot in a system for providing a sign language service according to an embodiment of the present disclosure.

[0177] According to an embodiment, the location where message data is converted into operational data through a data analysis and conversion process may be a robot 660 .

[0178] For example, the robot 660 may convert message data into actionable data through a data analysis and conversion process.

[0179] As a detailed example, the server 650 may transfer the first message data received from the first terminal 610 , the second message data received from the second terminal 620 , and the third message data received from the third terminal 630 to the robot 660 .

[0180] For example, the robot 660 may convert the first message data, the second message data, and the third message data received from the server 650 into the first operation data, the second operation data, and the third operation data, respectively, through the data analysis and conversion process.

[0181] For example, the robot 660 may sequentially perform respective operations according to the received first operation data, the received second operation data, and the received third operation data.

[0182] according to Figure 6B In the embodiment, the server may only be responsible for delivering the message data received from the terminal to the robot.

[0183] Figure 6C is a conceptual diagram illustrating an example of converting message data into operation data in a terminal in a system for providing a sign language service according to an embodiment of the present disclosure.

[0184] According to an embodiment, the location where message data is converted into operation data through the data analysis and conversion process may be a terminal.

[0185] For example, the terminal may convert the message data into operation data through a data analysis and conversion process. The terminal may transmit the operation data to the server 650 , and the server 650 may transmit the received operation data to the robot 660 .

[0186] As a detailed example, when a user inputs a message using the first terminal 610, the first terminal 610 may generate first message data, and may convert the first message data into first operation data through a data analysis and conversion process. Similarly, the second terminal 620 and the third terminal 630 may convert the second message data and the third message data into second operation data and the third operation data, respectively, through such a process.

[0187] For example, the server 650 may receive first, second, and third operation data from the first, second, and third terminals 610 , 620 , and 630 , respectively, and may transmit the first, second, and third operation data to the robot 660 .

[0188] For example, the robot 660 may sequentially perform respective operations according to the first operation data, the second operation data, and the third operation data.

[0189] according to Figure 6C In the embodiment, since the message data is converted into operation data in the terminal to be transmitted to the server, the server can only undertake the task of transmitting the received operation data to the robot.

[0190] Figure 7 is a diagram illustrating an example of sorting a plurality of pieces of operation data based on a transmission order according to a predetermined criterion in a system for providing a sign language service according to an embodiment of the present disclosure.

[0191] According to an embodiment, the server may sort the pieces of operation data into which the pieces of message data are converted according to a predetermined standard.

[0192] For example, the predetermined standard may be set based on at least one of a time sequence of message data transmission through a terminal, a time sequence of message data reception in a server, a time sequence determined according to properties of message data, and any combination thereof.

[0193] As a detailed example, when the predetermined criterion is the time sequence in which the message data is transmitted through the terminal, and when multiple message data are transmitted in the order of the first terminal, the second terminal, and the third terminal, the first operation data 710 corresponding to the first terminal is sorted as the first ("first time") in time sequence, the second operation data 720 corresponding to the second terminal is sorted as the second ("second time") in time sequence, and the third operation data 730 corresponding to the third terminal is sorted as the third ("third time") in time sequence. In this case, the first time, the second time, and the third time may be times in the order in which the multiple operation data are sorted.

[0194] According to an embodiment, the plurality of pieces of operation data may be sorted by the buffer 740. For example, the server may temporarily store the plurality of pieces of operation data in the buffer 740 based on a transmission order according to a predetermined standard. In this case, the pieces of operation data may be transmitted to the robot 760 in the order in which they are stored in the buffer 740.

[0195] According to an embodiment, the first operation data 710 may include first user information 712 and first operation content 714. The second operation data 720 may include second user information 722 and second operation content 724. The third operation data 730 may include third user information 732 and third operation content 734.

[0196] According to an embodiment, when the first operation data 710 , the second operation data 720 , and the third operation data 730 are multiple pieces of operation data of the same user, the first user information 712 , the second user information 722 , and the third user information 732 may include the same user information.

[0197] According to another embodiment, when the first operation data 710 , the second operation data 720 , and the third operation data 730 are pieces of operation data of different users, the first user information 712 , the second user information 722 , and the third user information 732 may include information of different users.

[0198] According to an embodiment, when the transmission order is determined in the order of the first operation data 710, the second operation data 720 and the third operation data 730, as a result of determining the transmission order of multiple operation data based on a predetermined standard in the server, the multiple operation data can be sorted in the order of the first operation data 710, the second operation data 720 and the third operation data 730.

[0199] For example, the first operation data 710 , the second operation data 720 , and the third operation data 730 may be temporarily stored in the buffer 740 in a sorted order and may then be transmitted to the robot 760 .

[0200] According to an embodiment, a plurality of operation data may be sorted in a state including user information. For example, the first operation data 710, the second operation data 720, and the third operation data 730 may include first user information 712, second user information 722, and third user information 732, respectively.

[0201] According to an embodiment, when a plurality of pieces of operation data are sorted in a state including user information and transmitted to the robot 760, the robot 760 may respectively perform operations according to the plurality of pieces of operation data based on the user information.

[0202] For example, when the first user information 712, the second user information 722, and the third user information 732 include multiple pieces of information of different users, the robot 760 may transmit the information of different users respectively by using different designated operations for each user or by using different colors of light emitted by the light emitting element.

[0203] according to Figure 7 In an embodiment, when multiple messages transmitted by multiple users are sorted in a certain order and transmitted to the robot, multiple users can communicate with each other through one robot.

[0204] Figure 8 is a diagram illustrating an example in which a robot performs a tidying operation when the robot finishes an operation according to each piece of operation data in a system for providing a sign language service according to an embodiment of the present disclosure.

[0205] According to an embodiment, when the operation according to the received operation data is finished, the robot 860 may perform a tidying operation indicating the end of the operation according to the operation data.

[0206] For example, the sorting operation 8F may include operations that do not correspond to designated sign language operations so that the user is not confused.

[0207] For another example, the sorting operation 8F may include a sorting operation 8F for each user respectively, so as to separate messages of different users.

[0208] According to an embodiment, when the first operation data 810 and the second operation data 820 are sequentially received from the server, the robot 860 may perform a finishing operation 8F when the operation 8A according to the first operation data 810 ends. Then, the robot 860 may perform an operation 8B according to the second operation data 820. Similarly, when the operation 8B according to the second operation data ends, the robot 860 may perform a finishing operation 8F to provide a notification of the end of the operation.

[0209] according to Figure 8 In an embodiment, a user who receives messages through the robot 860 can separate multiple messages through the sorting operation of the robot 860.

[0210] Fig. 9 is a diagram illustrating an example of separating operations according to a message for each user by a light emitting element of a robot emitting light of different colors in a system for providing a sign language service according to an embodiment of the present disclosure.

[0211] Fig. 9 The structure of the space where the user and the robot are located together Fig. 9 Example 9Q where the operations of P and the robot are implemented in a sequence of multiple message transmissions.

[0212] Reference Fig. 9 The structure of the space where the user and the robot are located together Fig. 9 P, the first user to the fourth user can transmit messages through their respective first terminals to the fourth terminals that communicate with each other.

[0213] For example, when the first user to the fourth user transmit their respective messages in the order of the first user, the second user, the third user and the fourth user, the message of the first user can be transmitted to the server as the first message data, the message of the second user can be transmitted to the server as the second message data, the message of the third user can be transmitted to the server as the third message data, and the message of the fourth user can be transmitted to the server as the fourth message data. The server can convert the received message data into multiple pieces of operation data respectively, and can transmit the multiple pieces of operation data to the robot. The robot can sequentially perform operations according to the multiple pieces of received operation data.

[0214] According to an embodiment, the robot may include a light emitting element, and the robot may separate different users based on the color of light through the light emitting element.

[0215] For example, the first user can be distinguished by using the light of the first color 9A, the second user can be distinguished by using the light of the second color 9B, the third user can be distinguished by using the light of the third color 9C, and the fourth user can be distinguished by using the light of the fourth color 9D. Therefore, when the robot performs an operation corresponding to the message of the first user, the light emitting element can emit the light of the first color 9A. In addition, when the robot performs an operation corresponding to the message of the second user, the light emitting element can emit the light of the second color 9B. Similarly, when the robot performs an operation corresponding to the messages of the third and fourth users, the light emitting element can emit the light of the third color 9C and the fourth color 9D.

[0216] For another example, the light emitting element can emit light of different colors, so that multiple users or multiple messages can be distinguished. In addition, the light emitting element can use different colors of light to indicate the result of analyzing the message. For example, the light emitting element can use different colors of light to indicate the intention of the message, the emotion contained in the message, or the importance of the message.

[0217] according to Fig. 9 In an embodiment, the robot can emit light of different colors and can separate multiple users or multiple messages, thereby facilitating two-way communication through one robot.

[0218] Fig.10 is a diagram illustrating an example of a color table indicating emotions and a screen on which a user can input a color and a message in a system for providing a sign language service according to an embodiment of the present disclosure.

[0219] According to an embodiment, Fig.10 A color table 10P indicating emotions and a screen 10Q where a user can input a color and a message are included.

[0220] Reference Fig.10 In the color table 10P indicating emotions, according to an embodiment, the user's emotions can be roughly divided into six categories of colors.

[0221] For example, excitement, optimism, confidence, peace of mind, honesty, creativity, etc. can be represented by different colors. However, this is just an embodiment. In addition, several emotions of the user can also be represented by different colors.

[0222] For example, emotions that can belong to similar categories can be represented by a specified series of colors.

[0223] As a detailed example, emotions such as excitement, passion, energy, desire, and action can be represented by red series colors. For example, the red series colors may include red, crimson, vermilion, magenta, or pink, etc.

[0224] As a detailed example, emotions such as hope, growth, balance, and freshness can be represented by green series colors. For example, the green series colors may include green, light green, turquoise, teal, or mint, etc.

[0225] Reference Fig.10 In the screen 10Q where the user can input a color and a message, the user can input a color that can indicate his or her emotion (10X). For example, the user can input a color when inputting a message, and can additionally input a color after inputting a message. As a detailed example, when wanting to transmit a hopeful message, the user can input a color corresponding to green.

[0226] According to an embodiment, the user can input a color corresponding to the importance of the message and his / her own emotions. For example, for a message including important content, the user can input a color corresponding to red.

[0227] according to Fig.10 In an embodiment, the user can input a color corresponding to his or her emotion along with a message, so that the emotion contained in the message can be transmitted together through the robot.

[0228] Fig.11 is a diagram illustrating an example of a screen on which a user can input emoticons and messages and an emoticon input by the user being displayed on a display in a system for providing a sign language service according to an embodiment of the present disclosure.

[0229] Reference Fig.11 In the screen 11P where the user can input emoticons and messages, the user can input emoticons 11Y indicating his / her emotions while inputting messages. For another example, the user can input moving emoticons corresponding to his / her emotions. For another example, the user can input image information corresponding to his / her emotions.

[0230] As a detailed example, when wanting to send a message with interesting contents, the user may input a smiling emoticon 11Y.

[0231] Reference Fig.11 In the example 11Q in which the emoticon input by the user is displayed on the display, the system for providing sign language services may further include a display. The display may include an output device such as a television, a monitor, a beam projector, or a laptop. In addition, the display may be included in the robot.

[0232] According to an embodiment, message data or operation data including information corresponding to at least one of a color input by a user or an emoticon input by a user, or any combination thereof may be transmitted to the display through the server.

[0233] For example, the server and the display may transmit data via wired or wireless communication. However, this is not necessarily limited to this. Data may be transmitted directly from the user's terminal to the display.

[0234] According to an embodiment, the emoticon input by the user can be displayed on the display. For example, when the user inputs a smiling emoticon while transmitting a message of interesting content, the smiling emoticon input by the user can be displayed on the display while the robot converts the message into sign language.

[0235] For another example, when the user inputs a photo, image, etc. instead of an emoticon, the photo, image, etc. input by the user may be displayed on the display.

[0236] according to Fig.11 In an embodiment, a user can receive message content through the robot's sign language operation, and can simultaneously recognize the emotions contained in the message through the display.

[0237] Fig.12 is a conceptual diagram showing a general process in which a data message generated by a terminal is converted into operation data in a server to be implemented as an operation performed by a robot in a system for providing a sign language service according to another embodiment of the present disclosure.

[0238] According to an embodiment, in S1210, a user may input a message to be delivered using a terminal. Here, a user and a terminal are described in the singular form according to an embodiment, but may be described as a plurality of users and a plurality of terminals.

[0239] According to an embodiment, the terminal may generate message data based on the message input by the user and the user information. In S1220, the terminal may transmit the message data to the server.

[0240] According to an embodiment, in S1230, the server may store the user information included in the message data in a database. Specifically, the server may store user information including at least one of the name of the user corresponding to the terminal, the ID of the user, the nickname of the user, the age of the user, the gender of the user, a number for specifying the user, and any combination thereof in the database. For another example, the server may store the message data itself in the database.

[0241] For example, in S1240, the server may recommend message phrases to the user using the user information stored in the database. Specifically, the server may recommend frequently used phrases based on age, gender, or a specified user based on the user information stored in the database. The message phrases recommended by the server may be transmitted to the user terminal. The user may input a message using the recommended message phrases.

[0242] According to an embodiment, the server may receive message data from the terminal, and may perform data analysis and conversion.

[0243] For example, in S1250, the server may analyze at least one of the intent of the message, the emotion contained in the message, the importance of the message, and any combination thereof based on the message data.

[0244] For example, in S1260, the server may convert the message data into operation data based on the result of analyzing the message data. Here, the operation data may include user information and operation content regarding the operation of converting the message content into sign language. In addition, the operation content included in the operation data may include instructions for controlling the robot to perform the operation converted into sign language.

[0245] For example, in S1270, the server may sort the operation data based on the transmission order according to a predetermined standard. For example, the server may sort the operation data based on the time order in which the message data is transmitted through the terminal, the time order in which the message data is received in the server, or the time order determined according to the nature of the message data.

[0246] For example, in S1280, the server may transmit the operation data to the robot based on the sorting order.

[0247] According to an embodiment, in S1290, the robot may perform an operation according to the operation data. For example, the operation performed by the robot may include an operation of converting a message into sign language.

[0248] For example, the robot can separate multiple users using different designated operations for each user or different colors of light emitted by a light emitting element, etc. In addition, the robot can separate multiple messages in this way.

[0249] In the following, reference is made to Fig.13 A method for providing a sign language service according to another embodiment of the present disclosure is described in detail.

[0250] Fig.13 is a flowchart for describing a process in which a message written by a user is implemented as an operation performed by a robot in a method for providing a sign language service according to an embodiment of the present disclosure.

[0251] According to an embodiment, in S1310, the first user may compose a message to be delivered via the first terminal.

[0252] According to an embodiment, in S1320, the first terminal may generate first message data corresponding to the message written by the first user and transmit it to the server. For example, the first message data may include first user information about the first user and message content input by the first user. For example, the first terminal may transmit the first message data to the server via wired or wireless communication.

[0253] According to an embodiment, in S1330, the server may convert the first message data received from the first terminal into first operation data. For example, the first operation data may include first user information and operation content regarding the operation of converting the message content into sign language.

[0254] According to an embodiment, when there are two or more pieces of first operation data, in S1340, the server may sort the two or more pieces of first operation data based on a transmission order according to a predetermined standard.

[0255] For example, the predetermined standard may be set based on at least one of a time sequence of message data transmission through a terminal, a time sequence of message data reception in a server, a time sequence determined according to properties of message data, and any combination thereof.

[0256] For example, two or more pieces of first operation data may be sorted by a buffer.For example, the server may temporarily store the plurality of pieces of first operation data in a buffer based on a transmission order according to a predetermined standard.

[0257] According to an embodiment, in S1350, the server may transmit a plurality of sorted first operation data to the robot. For example, each of the plurality of first operation data may be transmitted to the robot in the order stored in the buffer.

[0258] According to an embodiment, in S1360, the robot may perform operations according to the plurality of received first operation data.

[0259] For example, when receiving multiple pieces of first operation data, the robot may respectively perform operations according to the multiple pieces of first operation data. According to an embodiment, whenever the operation according to the first operation data is finished, the robot may perform a finishing operation indicating the end of the operation according to the first operation data. For another example, the robot may distinguish the multiple pieces of first operation data by using different colors of light emitted by a light emitting element.

[0260] according to Fig.13 In an embodiment, when a robot sequentially performs the operation of converting multiple messages into sign language, it can effectively deliver the messages to multiple users.

[0261] Fig.14 A computing system associated with a system for providing a sign language service or a method for providing a sign language service according to an embodiment of the present disclosure is shown.

[0262] Reference Fig.14 , the computing system 1000 may include at least one processor 1100 , a memory 1300 , a user interface input device 1400 , a user interface output device 1500 , a storage device 1600 , and a network interface 1700 connected to each other via a bus 1200 .

[0263] The processor 1100 may be a central processing unit (CPU) or a semiconductor device that processes instructions stored in the memory 1300 and / or the storage device 1600. The memory 1300 and the storage device 1600 may include various types of volatile or non-volatile storage media. For example, the memory 1300 may include a read-only memory (ROM) 1310 and a random access memory (RAM) 1320.

[0264] Therefore, the operations of the methods or algorithms described in conjunction with the embodiments disclosed in this specification may be directly implemented as a hardware module, a software module, or a combination of hardware and software modules executed by the processor 1100. The software module may reside on a storage medium (i.e., the memory 1300 and / or the storage device 1600) such as a RAM, a flash memory, a ROM, an EPROM, an EEPROM, a register, a hard disk, a removable disk, and a CD-ROM.

[0265] The storage medium may be coupled to the processor 1100. The processor 1100 may read information from the storage medium and may write information into the storage medium. Alternatively, the storage medium may be integrated with the processor 1100. The processor and the storage medium may reside in an application specific integrated circuit (ASIC). The ASIC may reside in a user terminal. In another case, the processor and the storage medium may reside in a user terminal as separate components.

[0266] The present technology can allow multiple users to perform two-way communication through one robot because one robot converts multiple messages transmitted by multiple users into sign language based on a certain sequence.

[0267] In addition, the present technology can transmit the emotion or intention to be conveyed through the user's message together with the message through the robot's light-emitting elements that emit light of different colors, thereby improving the accuracy of the message delivery.

[0268] Furthermore, the present technology can reduce costs because multiple users communicate with each other through one robot.

[0269] In addition, the present technology can deliver messages of high importance or urgency to multiple people at once, thereby improving convenience.

[0270] In addition, various effects directly or indirectly determined by the present disclosure can be provided.

[0271] In the above, although the present disclosure is described with reference to the embodiments and the accompanying drawings, the present disclosure is not limited thereto. The present disclosure may be variously modified and altered by a person skilled in the art without departing from the spirit and scope of the present disclosure as claimed in the appended claims.

[0272] Therefore, the embodiments of the present disclosure are not intended to limit the technical spirit of the present disclosure, but are provided for illustrative purposes only. The scope of the present disclosure should be interpreted based on the appended claims, and all technical ideas within the scope equivalent to the claims should be included in the scope of the present disclosure.

Claims

1. A system for providing sign language services, comprising: a first terminal, generating at least one first message data corresponding to a message to be delivered by a first user; The server converts the first message data received from the first terminal into first operation data corresponding to the operation of the robot; and The robot performs an operation according to first operation data received from the server, When the server further identifies two or more pieces of first operation data, it further sorts the two or more pieces of first operation data based on a transmission order according to a predetermined standard. The server further transmits the sorted first operation data to the robot, and The robot further performs an operation based on the sorted first operation data.

2. The system according to claim 1, further comprising: the second terminal generates at least one second message data corresponding to a message to be delivered by a second user, The server further converts the second message data received from the second terminal into second operation data corresponding to the operation of the robot, The server further sorts the first operation data and the second operation data based on the transmission order according to the predetermined standard when identifying two or more first operation data and the second operation data, The server further transmits the sorted first operation data and second operation data to the robot, and The robot further performs an operation based on the sorted first operation data and second operation data.

3. The system according to claim 1, wherein: The predetermined standard is set based on at least one of a time sequence in which the first message data is transmitted through the first terminal, a time sequence in which the first message data is received in the server, a time sequence determined according to properties of the first message data, and any combination thereof.

4. The system according to claim 1, wherein: The server further analyzes at least one of the intent of the message, the emotion contained in the message, the importance of the message, and any combination thereof based on the first message data, and The server further converts the first message data into the first operation data based on the analysis result.

5. The system according to claim 1, wherein: The first message data includes first user information, the first user information includes at least one of a name of a first user corresponding to the first terminal, an ID of the first user, a nickname of the first user, an age of the first user, a gender of the first user, a number for specifying the first user, and any combination thereof, and The server further stores the first user information in a database.

6. The system according to claim 5, wherein: The server further recommends a message phrase to the first user based on the first user information stored in the database.

7. The system according to claim 1, wherein: The robot further performs a finishing operation indicating the end of the operation according to the first operation data received from the server when the operation according to the first operation data ends.

8. The system according to claim 2, wherein: The first message data includes first user information, wherein the first user information includes at least one of a name of a first user corresponding to the first terminal, an ID of the first user, a nickname of the first user, an age of the first user, a gender of the first user, a number for specifying the first user, and any combination thereof, The second message data includes second user information, the second user information includes at least one of a name of a second user corresponding to the second terminal, an ID of the second user, a nickname of the second user, an age of the second user, a gender of the second user, a number for specifying the second user, and any combination thereof, and The robot further separates an operation according to the first operation data and an operation according to the second operation data to perform an operation based on the first user information and the second user information.

9. The system according to claim 8, wherein: The robot comprises a light emitting element, The robot further performs an operation according to the first operation data together with light corresponding to a first color passing through the light emitting element, and The robot further performs an operation according to the second operation data together with light corresponding to a second color passing through the light emitting element.

10. The system according to claim 4, wherein: The robot comprises a light emitting element, The robot further performs an operation according to the first operation data together with at least one light represented by the light emitting element, and The at least one light indicates at least one of the intent of the message, the emotion contained in the message, the importance of the message, and any combination thereof.

11. The system according to claim 1, wherein: The first terminal further generates first message data including a color input by the first user, The robot comprises a light emitting element, The robot further performs an operation according to the first operation data together with light of a color corresponding to the color input by the first user, and The color is represented by the light emitting element.

12. The system of claim 1, further comprising: monitor, wherein the first terminal generates first message data including at least one of a color input by the first user, an emotion input by the first user, and any combination thereof, The display receives the first message data or the first operation data from the server, and displays information corresponding to at least one of a color input by the first user, an emotion input by the first user, and any combination thereof, and The information is included in the first message data or the first operation data.

13. A method for providing a sign language service, comprising: generating, by the first terminal, at least one first message data corresponding to a message to be delivered by the first user; converting, by the server, first message data received from the first terminal into first operation data corresponding to the operation of the robot; By the server, when two or more pieces of first operation data are identified, sorting the two or more pieces of first operation data based on a transmission order according to a predetermined criterion; transmitting the sorted first operation data to the robot through the server; as well as performing, by the robot, an operation according to first operation data received from the server, The performing of an operation by the robot according to the first operation data received from the server includes: An operation is performed, by the robot, based on the sorted first operation data.

14. The method according to claim 13, further comprising: At least one second message data corresponding to a message to be delivered by a second user is generated through the second terminal, wherein: Converting, by the server, the first message data received from the first terminal into first operation data corresponding to the operation of the robot comprises: converting, by the server, second message data received from the second terminal into second operation data corresponding to the operation of the robot, By the server, when two or more pieces of first operation data are identified, sorting the two or more pieces of first operation data based on a transmission order according to a predetermined standard includes: By the server, when two or more pieces of first operation data and second operation data are identified, the first operation data and the second operation data are sorted based on the transmission order according to the predetermined standard, and Transmitting the sorted first operation data to the robot through the server comprises: transmitting the sorted first operation data and second operation data to the robot through the server, and The robot performing an operation according to the first operation data received from the server includes: An operation is performed, by the robot, based on the sorted first operation data and second operation data.

15. The method according to claim 13, wherein: The predetermined standard is set based on at least one of a time sequence in which the first message data is transmitted through the first terminal, a time sequence in which the first message data is received in the server, a time sequence determined according to properties of the first message data, and any combination thereof.

16. The method according to claim 13, wherein: Converting, by the server, the first message data received from the first terminal into first operation data corresponding to the operation of the robot comprises: By means of the server, analyzing at least one of the intention of the message, the emotion contained in the message, the importance of the message, and any combination thereof based on the first message data; and The server converts the first message data into the first operation data based on the analysis result.

17. The method according to claim 13, wherein: The first message data includes first user information, wherein the first user information includes at least one of a name of a first user corresponding to the first terminal, an ID of the first user, a nickname of the first user, an age of the first user, a gender of the first user, a number for specifying the first user, and any combination thereof, The method further comprises: By means of the server, storing the first user information in a database; and By the server, a message phrase is recommended to the first user based on the first user information stored in the database.

18. The method according to claim 14, wherein: The first message data includes first user information, wherein the first user information includes at least one of a name of a first user corresponding to the first terminal, an ID of the first user, a nickname of the first user, an age of the first user, a gender of the first user, a number for specifying the first user, and any combination thereof, The second message data includes second user information, the second user information includes at least one of a name of a second user corresponding to the second terminal, an ID of the second user, a nickname of the second user, an age of the second user, a gender of the second user, a number for specifying the second user, and any combination thereof, and The robot performing an operation based on the sorted first operation data and second operation data comprises: Based on the first user information and the second user information, an operation according to the first operation data and an operation according to the second operation data are separated to perform operations.

19. The method according to claim 18, wherein: The robot comprises a light emitting element, and By the robot, based on the first user information and the second user information, separating the operation according to the first operation data and the operation according to the second operation data to perform the operation includes: performing, by the robot, an operation according to the first operation data together with light corresponding to a first color passing through the light emitting element; and By the robot, an operation according to the second operation data is performed together with light corresponding to a second color passing through the light emitting element.

20. The method according to claim 16, wherein: The robot comprises a light emitting element, The robot performs an operation according to the sorted first operation data, including: performing an operation according to the first operation data together with at least one light represented by the light emitting element, and The at least one light indicates at least one of the intent of the message, the emotion contained in the message, the importance of the message, and any combination thereof.

Images