Cloud-based Artificial Intelligence Barrier-Free Universal Kiosk Platform

Abstract

The present invention provides a cloud-based artificial intelligence barrier-free universal kiosk integrated operation platform comprising: a cloud server operating a universal kiosk platform that receives user information from a kiosk, provides a user type interface suitable for a user type, communicates with the user through the corresponding user type interface via artificial intelligence to identify user requirements, and processes user requirements through linkage with a service agency that fulfills the user requirements; and a kiosk that recognizes the user's access and the user's disability, mediates communication between the cloud server and the user, and provides a service suitable for the user requirements by providing a user interface suitable for the user type using a multi-interface device.

Description

Technology Field

[0001] The present invention relates to a cloud-based artificial intelligence barrier-free universal kiosk integrated operation platform, and more specifically, to a cloud-based artificial intelligence barrier-free universal kiosk integrated operation platform that identifies the type of user and provides an interface suitable for the user type to enable communication tailored to user convenience. Background Technology

[0003] Currently, hardware technology is at the center of the global kiosk technology market, accounting for about half of total revenue, but the importance of system integration and kiosk application technology is expected to increase in the future.

[0004] Currently, kiosks offering various services are installed in diverse locations to provide convenience to users; however, kiosk technology that considers the needs of the disabled is significantly lacking. Notably, in the United States, accessibility is promoted through regulations on form factors rather than functional improvements, resulting in a minimal level of barrier-free technology incorporating welfare ICT.

[0005] In both domestic and international markets, there is a need for kiosk-based platforms that provide services for various types of disabilities, including visual, physical, hearing, and complex disabilities; however, there are not many specialized kiosk companies capable of meeting this need.

[0006] Therefore, there is a need for a platform that provides kiosks and services for people with disabilities; in particular, there is a need for a platform capable of providing services through kiosks that offer communication interfaces tailored to the user's disability type (visual, physical, or hearing). Prior art literature

[0008] Republic of Korea Registered Patent No. 10-2668098 (Method for Providing Wireless Communication Interconnection Service for Location-Based Kiosks for the Socially Vulnerable) The problem to be solved

[0009] The purpose of the present invention is to provide a cloud-based artificial intelligence barrier-free universal kiosk integrated operation platform capable of providing a communication method suitable for a user type by considering the user type.

[0010] Another objective of the present invention is to provide a cloud-based artificial intelligence barrier-free universal kiosk integrated operation platform that utilizes kiosks to provide various customized information to all citizens, including the socially vulnerable such as people with disabilities, the elderly, and children, and enables all private companies and public institutions to efficiently provide payment, ticketing, and guidance services.

[0011] Another objective of the present invention is to provide a cloud-based artificial intelligence barrier-free universal kiosk integrated operating platform that provides welfare ICT technology supporting the daily lives of people with disabilities by enabling the expanded application and utilization of services for people with disabilities on kiosks and mobile devices. means of solving the problem

[0013] The present invention provides a cloud-based artificial intelligence barrier-free universal kiosk integrated operation platform comprising: a cloud server that operates a universal kiosk platform that receives user information from a kiosk, provides a user type interface suitable for a user type, communicates with the user through the corresponding user type interface via artificial intelligence to identify user requirements, and processes the user requirements through linkage with a service agency that performs the user requirements; and a kiosk that recognizes the user's access and the user's disability, mediates communication between the cloud server and the user, and provides a service suitable for the user requirements by providing a user interface suitable for the user type using a multi-interface device.

[0014] Here, the cloud server may be characterized by comprising: a server communication unit that performs communication with the kiosk and other system devices; a communication processing unit that generates and provides communication information suitable for the user type interface and analyzes communication information performed with the user; a service agency linkage unit that performs linkage with a service agency that processes the user request; and a universal operation processing unit that controls the functions of each component of the cloud server, analyzes user information received from the kiosk to determine the type of failure of the user, processes linkage with an external platform that provides additional methods necessary for communication with the user to obtain methods necessary for communication, and manages and controls the kiosk.

[0015] Here, the communication processing unit may be characterized by including: a video algorithm processing unit that recognizes and processes the user's gestures and actions for communication with the user; a sign language algorithm processing unit that recognizes and processes the user's sign language for communication with the user; a voice algorithm processing unit that recognizes and processes the user's voice for communication with the user; and a braille algorithm processing unit that recognizes and processes braille for communication with the user.

[0016] Here, the image algorithm processing unit may be characterized by constructing a learning dataset that classifies the gesture and behavior patterns of the user when the user is one of a person with a mental or physical developmental disability, an elderly person, or a child, and correcting and processing the user's gesture and behavior.

[0017] Here, the sign language algorithm processing unit may be characterized by generating an avatar suitable for the user by considering the user information and processing sign language with the user.

[0018] Here, the voice algorithm processing unit may be characterized by processing the user's voice by performing noise correction suitable for the environment of the kiosk, taking into account the noise according to the environment of the kiosk.

[0019] Herein, the kiosk may be characterized by comprising: a user recognition unit that recognizes the user's approach and disability by including one or more of an image processing device and a proximity sensor; a multi-interface unit that performs information exchange with the user through one or more of a display device, a sound device, and a braille block device; a kiosk communication unit that communicates with the cloud server; a height adjustment unit that can adjust the height according to the physical condition of the user's disability; and a service provision unit that provides the service requested by the user.

[0020] Here, it may be characterized by further including a user terminal communication unit that performs communication with a user terminal and transmits and receives communication information provided by the cloud server to the user terminal. Effects of the invention

[0022] The present invention has the effect of improving kiosk accessibility and usability for people with disabilities and the elderly, thereby providing a digital-based barrier-free universal kiosk integrated operation platform for all citizens, including vulnerable groups.

[0023] This invention has the effect of contributing to the growth of related industries and the diffusion of welfare ICT technology by providing open software and standard interfaces that are easy to widely distribute to kiosks (ordering / ticketing / information provision) in the private sector.

[0024] The present invention has the effect of providing a low-cost, universal kiosk service through a customized interface that carefully considers the physical and psychological discomfort of the socially disadvantaged by improving information accessibility and digital usability / convenience for digitally vulnerable groups based on kiosks. Brief explanation of the drawing

[0026] FIG. 1 is a diagram showing the configuration of a cloud-based artificial intelligence barrier-free universal kiosk integrated operation platform as an embodiment of the present invention. FIG. 2 is a diagram illustrating the main areas of the cloud-based artificial intelligence barrier-free universal kiosk integrated operation platform of the present invention. FIG. 3 is a drawing illustrating the configuration of a kiosk as an embodiment of the present invention. FIG. 4 is a diagram illustrating the configuration of a cloud server as an embodiment of the present invention. FIG. 5 is a diagram illustrating the configuration of a communication processing unit as an embodiment of the present invention. FIG. 6 is a diagram illustrating the processing of communication with a user by performing sign language through an avatar as an embodiment of the present invention. FIG. 7 is a diagram illustrating the processing of communication with a user through voice as an embodiment of the present invention. FIG. 8 is a diagram illustrating a method for recognizing a user and determining a user's disability as an embodiment of the present invention. Specific details for implementing the invention

[0027] The advantages and features of the present invention and the methods for achieving them will become clear by referring to the embodiments described below in detail together with the accompanying drawings.

[0028] However, the present invention is not limited to the embodiments disclosed below but will be implemented in various different forms.

[0029] The embodiments described in this specification are provided to ensure that the disclosure of the invention is complete and to fully inform those skilled in the art of the scope of the invention.

[0030] And the present invention is defined only by the scope of the claims.

[0031] Accordingly, in some embodiments, well-known components, well-known operations, and well-known techniques are not specifically described to avoid the present invention being interpreted ambiguously.

[0032] Additionally, throughout the specification, the same reference numerals refer to the same components, and the terms used (mentioned) in this specification are for describing embodiments and are not intended to limit the invention.

[0033] In this specification, the singular form includes the plural form unless specifically stated otherwise in the text, and components and operations referred to as 'comprising (or comprising)' do not exclude the presence or addition of one or more other components and operations.

[0034] Unless otherwise defined, all terms used in this specification (including technical and scientific terms) may be used in a meaning that is commonly understood by those skilled in the art to which the present invention belongs.

[0035] Furthermore, terms defined in commonly used dictionaries are not interpreted ideally or excessively unless otherwise defined.

[0036] Hereinafter, preferred embodiments of the present invention will be described with reference to the attached drawings.

[0038] FIG. 1 is a diagram showing the configuration of a cloud-based artificial intelligence barrier-free universal kiosk integrated operation platform as an embodiment of the present invention.

[0039] The cloud-based artificial intelligence barrier-free universal kiosk integrated operation platform of the present invention comprises a client device kiosk (200) and a cloud server (300) that communicates with a user (10) through the kiosk (200) and provides services requested by the user (10).

[0040] The kiosk (200) can recognize the user's (10) access and the user's disability, and mediates communication between the cloud server (300) and the user by providing an interface suitable for the type of user disability.

[0041] The kiosk (200) includes a multi-interface device, and among the multi-interface devices, it uses a device that matches the type of user (10) to provide an interface that matches the type.

[0042] The cloud server (300) receives user information from the kiosk (200) and provides a user type interface suitable for the user type. Then, it communicates with the user through the interface suitable for the user type using artificial intelligence. Afterward, it identifies the user's needs through communication and provides the desired service to the user by linking with a service organization that fulfills the user's needs.

[0043] Here, the user type refers to the type of disability of the user (10) when the user is disabled. For example, it refers to a visually impaired person, a hearing impaired person, a speech impaired person, a wheelchair user, etc.

[0044] In addition, user types may refer to men, women, the elderly, children, foreigners, etc.

[0045] Therefore, the user type interface is an interface for communication suitable for the user's disability type; for example, if the user is visually impaired, it may be an interface for communication via Braille; if the user is hearing and speech impaired, it may be an interface for communication via text or sign language; and if the user is a foreigner, it may be an interface for communication via a language appropriate for that foreigner.

[0046] That is, the kiosk (200) recognizes the type of user (10), and the cloud server (300) provides a means of communication suitable for the user type interface to communicate with the user and provide the service requested by the user.

[0047] Here, communication means suitable for the user type interface refer to communication software via Braille, communication software via sign language, communication software via voice, gesture recognition software, image recognition software, communication software via foreign languages, etc.

[0049] FIG. 2 is a diagram illustrating the main areas of the cloud-based artificial intelligence barrier-free universal kiosk integrated operation platform of the present invention.

[0050] The operation of the cloud-based artificial intelligence barrier-free universal kiosk integrated operation platform of the present invention can be divided into a kiosk area, a cloud operation area, and a service linkage area.

[0051] The kiosk area is an area that directly provides interface means suitable for the type of user (10) performing at the kiosk (200), and provides the user with an interface for using voice, sign language, gestures, video, text, etc. according to the type of user, and finally provides the user with the service received from the institution performing the service requested by the user (e.g., guidance, purchase, reception, etc.).

[0052] The cloud operation area is an area where communication methods are performed through an interface suitable for the user type, which is executed on a cloud server (300). Depending on the user type, communication with the user is performed through various artificial intelligence communication methods, such as voice recognition software, sign language recognition software, non-contact / gesture recognition software, and image recognition software.

[0053] The service integration area is a domain that identifies user requirements through communication and performs integration with external organizations to provide the services requested by the user; depending on the service requested by the user, integration with various service providers can be performed to provide the services required by the user.

[0055] FIG. 3 is a drawing illustrating the configuration of a kiosk as an embodiment of the present invention.

[0056] The kiosk (200) of the present invention includes a user recognition unit (210), a multi-interface unit (220), a kiosk communication unit (230), a height adjustment unit (240), and a service provision unit (250).

[0057] The user recognition unit (210) includes one or more devices capable of recognizing a user, such as an image processing device, a proximity sensor, and an ultrasonic sensor, and performs the function of recognizing the user's approach and obstacles.

[0058] For example, when a user approaches the kiosk (200), the user’s image is recognized, or the user’s approach is recognized through an ultrasonic sensor or a proximity sensor, and when the user performs a login or action for use to use the kiosk, it is possible to determine whether the user has a disability through the user’s image and, if a disability is detected, to recognize what type of disability it is.

[0059] The multi-interface unit (220) includes various information exchange devices for exchanging information with the user (10), thereby providing the user with an information exchange device suitable for the user's disability type. For example, the multi-interface unit (220) includes one or more of a display device, a sound recognition and generation device, and a braille block device, so that the user (10) can provide an information exchange device that the user (10) wants according to the user's disability type.

[0060] The kiosk communication unit (230) performs the function of communicating with the cloud server (300).

[0061] The height adjustment unit (240) is a device capable of adjusting the height of the kiosk (200) and performs the function of adjusting the height of the kiosk (200) according to the physical condition of the user's disability.

[0062] The service provider (250) performs the function of providing the service requested by the user (200). Here, the service provider (250) may directly perform the user's request, but if the user's request is a task that can only be performed through an external agency, such as a task through a national agency, a banking task, or a reservation task through a specific agency, it performs the function of simply notifying or presenting the task performed and processed by linking with the external agency through the cloud server (300).

[0063] If multiple users wish to use the same kiosk (200), the kiosk (200) may further include a user terminal communication unit (260) to perform communication with the user's terminal and provide the services provided by the present invention to multiple users simultaneously.

[0065] FIG. 4 is a diagram illustrating the configuration of a cloud server as an embodiment of the present invention.

[0066] The cloud server (300) of the present invention includes a server communication unit (310), a communication processing unit (320), a service agency interfacing unit (330), and a universal operation processing unit (340).

[0067] The server communication unit (310) performs the function of communicating with the kiosk (200) and other system devices.

[0068] The communication processing unit (320) generates communication information suitable for the user type interface and provides it to the user through the kiosk (200).

[0069] Additionally, the communication processing unit (320) performs the function of processing algorithms for various communication methods and performs the function of analyzing communication information performed with the user.

[0070] The service agency linkage unit (330) performs the function of performing the service requested by the user by linking with a selected service agency that processes the user's request.

[0071] To this end, the service institution linkage unit (330) can perform linkage with the corresponding external institution through APIs (Application Programming Interfaces) provided by various institutions.

[0072] The universal operation processing unit (340) controls the functions of each of the above components of the cloud server and analyzes user information received from the kiosk (200) to determine the type of user failure. In addition, if there is an additional method required for communication with the user (10), it performs the function of controlling communication with the user through the communication processing unit (320) by processing integration with an external platform that provides the corresponding communication method to obtain the method required for communication.

[0073] For example, if the user is a foreigner, communication with the user is controlled by performing linkage with an external platform that analyzes and processes the voice of the corresponding foreign language through the communication processing unit (320), and if the user uses a foreign sign language, communication with the user is controlled by performing linkage with an external platform that analyzes and processes the corresponding sign language through the communication processing unit (320).

[0074] The universal operation processing unit (340) can be operated to use multiple protocols (MQTT, HTTPS, GRPC, etc.) for optimal interoperability with other platforms.

[0075] In addition, the universal operation processing unit (340) can determine the type of user's disability by analyzing the user image as described in FIG. 8, and can control communication with the user through the interface that matches the user's disability type by selecting a user type interface that matches the user's disability type, even without a request from the user.

[0077] FIG. 5 is a diagram illustrating the configuration of a communication processing unit as an embodiment of the present invention.

[0078] The communication processing unit (320) of the present invention includes an image algorithm processing unit (321), a sign language algorithm processing unit (322), a voice algorithm processing unit (323), and a Braille algorithm processing unit (324).

[0079] The image algorithm processing unit (321) performs the function of recognizing and processing the user's gestures and actions for communication with the user.

[0080] The sign language algorithm processing unit (322) performs the function of recognizing and processing the user's sign language for communication with the user.

[0081] The sign language algorithm processing unit (322) recognizes the user's sign language and generates and provides sign language that matches the sign language used by the user.

[0082] Here, the sign language algorithm processing unit generates an avatar suitable for the user to facilitate easier communication via sign language, and performs communication with the user via sign language through the avatar.

[0083] For example, if the user is a child, they can create an avatar of a character they like and communicate through sign language.

[0084] The voice algorithm processing unit (323) performs the function of recognizing and processing the user's voice for communication with the user.

[0085] The voice algorithm processing unit (323) can improve the Error Rate to 45% by generating a noise-resistant STT (Speech-To-Text) algorithm through artificial intelligence, considering the installation environment of the kiosk (200), and learning voice recognition based on noise data and noise space in the environment.

[0086] When receiving user voice from the kiosk (200), the user voice includes noise generated in the environment where the kiosk (200) is installed in addition to the user's voice.

[0087] If ambient noise is included in addition to the user's voice in this way, there is a very high possibility that the system will recognize the voice as incorrect and misinterpret the user's request.

[0088] To solve these problems, the noise-resistant STT algorithm method of the present invention performs the following steps.

[0089] The artificial intelligence of the voice algorithm processing unit (323) separates the user's voice received from the kiosk (200) into a user voice portion and a non-voice portion (noise generated around the kiosk) and stores only the non-voice portion.

[0090] Subsequently, the artificial intelligence learns from the stored non-voice portion as input data to determine the frequency characteristics of the non-voice portion of the corresponding kiosk.

[0091] Subsequently, the artificial intelligence generates an optimal noise reduction frequency filter capable of removing the frequency characteristics of non-speech portions through learning.

[0092] Subsequently, when user voice is received from the corresponding kiosk, a noise reduction frequency filter corresponding to the kiosk is immediately used to remove only the non-voice portion from the user voice received from the kiosk, thereby separating only the user voice portion.

[0093] In this way, by generating text using only the separated user voice portion, the user's voice can be accurately interpreted as text without being misinterpreted by noise.

[0094] By using the noise-resistant STT algorithm method of the present invention described above, there is an advantage in that user services can be provided more quickly and accurately as the number of times a user utilizes the service through the voice interface increases.

[0095] The Braille algorithm processing unit (324) performs the function of recognizing and processing Braille for communication with the user.

[0097] FIG. 6 is a diagram illustrating the processing of communication with a user by performing sign language through an avatar as an embodiment of the present invention.

[0098] When a user's sign language output sentence is input from the kiosk (200), the corresponding sign language player command is transmitted to the cloud server (300), and the sign language algorithm processing unit (322) analyzes and preprocesses the sign language to analyze the morphemes of the sign language sentence and searches the sign language DB to determine the meaning of the sign language. Afterwards, an appropriate sign language animation sentence is generated through the avatar animation generation module and transmitted to the kiosk (200), so that the sign language animation is displayed through the avatar via the display device of the kiosk (200).

[0100] FIG. 7 is a diagram illustrating the processing of communication with a user through voice as an embodiment of the present invention.

[0101] When a user (10) makes a service request to the kiosk (200) by voice, the kiosk transmits the user's voice to a cloud server, and the voice algorithm processing unit (323) converts the user's voice into text using a noise-resistant STT (Speech-To-Text) algorithm generated by learning voice recognition based on noise data and noise space in the environment through artificial intelligence, taking into account the installation environment of the kiosk, and performs STT post-correction based on conversation scenarios for each service domain to analyze the correct user's request, generates an answer suitable for the request, and transmits it to the kiosk. Afterwards, the kiosk provides the received answer to the user by voice.

[0103] FIG. 8 is a diagram illustrating a method for recognizing a user and determining a user's disability as an embodiment of the present invention.

[0104] When a user (10) approaches, the kiosk (200) recognizes the user through a user recognition sensor (image, proximity sensor, etc.) and generates a user image through a video device and transmits it to a cloud server (300).

[0105] The cloud server (300) analyzes the user video to detect important objects (e.g., wheelchair, cane, hearing aid, etc.) that can identify the user's disability type within the user video, and analyzes them to determine the user's disability type.

[0106] For example, if a wheelchair is detected in the user image, the user can be recognized as having a lower-body disability; if a cane for the visually impaired is detected, the user can be recognized as visually impaired; and if a hearing aid is detected, the user can be recognized as hearing impaired. If no object capable of identifying a person with a disability is detected, the user can be recognized as non-disabled.

[0108] The present invention is not limited to the specific preferred embodiments described above, and it is obvious that anyone with ordinary knowledge in the technical field to which the invention pertains can make various modifications without departing from the essence of the invention as claimed in the claims, and that such modifications fall within the scope of the claims. Explanation of the symbols

[0110] 10 : User 200 : Kiosk 210: User recognition unit 220 : Multi-interface section 230 : Kiosk Communications Unit 240 : Height adjustment part 250 : Service Provision Department 300 : Cloud Server 310 : Server Communications Unit 320 : Communication Processing Unit 330 : Service Agency Interfacing 340 : Universal Operation Processing Unit

Claims

Claim 1 A cloud-based artificial intelligence barrier-free universal kiosk integrated operation platform comprises: a cloud server that operates a universal kiosk platform that receives user information from a kiosk, provides a user type interface suitable for the user type, communicates with the user through the corresponding user type interface via artificial intelligence to identify user requirements, and processes the user requirements through linkage with a service agency that fulfills the user requirements; and a kiosk that recognizes the user's access and the user's disability, mediates communication between the cloud server and the user, and provides a service suitable for the user requirements by providing a user interface suitable for the user type using a multi-interface device; wherein the cloud server comprises: a server communication unit that communicates with the kiosk and other system devices; a communication processing unit that generates and provides communication information suitable for the user type interface and analyzes communication information performed with the user; and a service agency linkage unit that performs linkage with a service agency that processes the user requirements. A universal operation processing unit that controls the functions of each component of the cloud server, analyzes user information received from the kiosk to determine the type of disability of the user, processes integration with an external platform that provides additional methods necessary for communication with the user to obtain methods necessary for communication, and manages and controls the kiosk; wherein the communication processing unit comprises: a video algorithm processing unit that recognizes and processes the user's gestures and actions for communication with the user; a sign language algorithm processing unit that recognizes and processes the user's sign language for communication with the user; a voice algorithm processing unit that recognizes and processes the user's voice for communication with the user; and a braille algorithm processing unit that recognizes and processes braille for communication with the user.A cloud-based AI barrier-free universal kiosk integrated operation platform characterized by including, wherein the cloud server performs AI-based communication tailored to a user type through the communication processing unit, identifies the user's requirements as a result of communication with the user and performs integration with external organizations, and performs integration with service providers according to the services requested by the user. Claim 2 delete Claim 3 delete Claim 4 A cloud-based artificial intelligence barrier-free universal kiosk integrated operation platform according to claim 1, wherein the image algorithm processing unit constructs a learning dataset classifying the gesture and behavior patterns of the user when the user is one of a person with a mental or physical developmental disability, an elderly person, or a child, and processes the user's gesture and behavior by correcting them. Claim 5 A cloud-based artificial intelligence barrier-free universal kiosk integrated operation platform according to claim 1, wherein the sign language algorithm processing unit generates an avatar suitable for the user by considering the user information and processes sign language with the user. Claim 6 A cloud-based artificial intelligence barrier-free universal kiosk integrated operation platform according to claim 1, wherein the voice algorithm processing unit processes the user's voice by performing noise correction suitable for the environment of the kiosk, taking into account the noise according to the environment of the kiosk. Claim 7 A cloud-based artificial intelligence barrier-free universal kiosk integrated operating platform, characterized in that, in claim 1, the kiosk comprises: a user recognition unit that recognizes the user's approach and disability by including one or more of an image processing device and a proximity sensor; a multi-interface unit that performs information exchange with the user through one or more of a display device, a sound device, and a braille block device; a kiosk communication unit that communicates with the cloud server; a height adjustment unit that can adjust the height according to the physical condition of the user's disability; and a service provision unit that provides the service requested by the user. Claim 8 A cloud-based artificial intelligence barrier-free universal kiosk integrated operation platform according to claim 7, further comprising a user terminal communication unit that performs communication with a user terminal and transmits and receives communication information provided by the cloud server to and from the user terminal.

Images