System and method for providing reactive projectile using artificial intelligence

Abstract

To provide a system and method for providing a reactive projectile using artificial intelligence.SOLUTION: Pre-processing data collected from a terminal by a server, analyzing the pre-processed data to extract meaningful information from the data, generating a user profile based on the information extracted in advance by an AI cloud server, and generating a personalized projection based on the user profile and the user intention; It is possible to provide a more personalized and immersive educational environment to a user, provide a natural reaction to a user's input, and support an education vulnerability layer by processing a projectile generated by a server, projecting the processed projectile by a space computing device, and interacting with the user's reaction.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a reactive projectile providing system and method using artificial intelligence, and more particularly, to a reactive projectile providing system and method using artificial intelligence, which performs preprocessing on data collected from a terminal in a server, analyzes the preprocessed data to extract meaningful information from the data, generates a user profile based on the previously extracted information in an AI cloud server to understand the user's intention, generates a projectile customized for the user based on the user profile and user intention, processes the generated projectile in the server, and then projects the processed projectile in a spatial computing device, and interacts with the user's reaction. [Background technology]

[0002] Spatial computing is a technology that combines real space and digital content, allowing users to interact with computers in three-dimensional space rather than on a screen.

[0003] In spatial computing, interactions with users are performed using pre-produced digital content, and interaction using digital content that reflects the user's intentions is required. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Korean Patent Publication No. 10-2022-0030178 [Title: System and method for provisioning virtual computing resources based on cloud computing in a virtual environment] Summary of the Invention [Problem to be solved by the invention]

[0005] The object of the present invention is to provide a reactive projectile providing system and method using artificial intelligence, which performs preprocessing on data collected from a terminal in a server, analyzes the preprocessed data to extract meaningful information from the data, generates a user profile based on the information previously extracted in an AI cloud server to understand the user's intention, generates a projectile customized for the user based on the user profile and user intention, processes the projectile generated in the server, and then projects the processed projectile in a spatial computing device, and interacts with the user's reaction. [Means for solving the problem]

[0006] A system for providing a reactive projectile using artificial intelligence according to an embodiment of the present invention may include an AI cloud server that generates a user profile related to a terminal based on preprocessed data, analyzes the preprocessed data to understand the user's intention, performs AI-based learning based on the generated user profile and the understood user's intention, generates a reactive projectile customized for the user based on the learning results, and transmits the generated reactive projectile; a server that performs a preprocessing function on data transmitted from the terminal, transmits the preprocessed data to the AI ​​cloud server, receives a reactive projectile transmitted from the AI ​​cloud server in response to the transmitted preprocessed data, determines whether or not to process the reactive projectile, and transmits the reactive projectile directly to a spatial computing device or processes the reactive projectile and then transmits the processed reactive projectile to the spatial computing device depending on the determined whether or not to process it; and the spatial computing device that projects the reactive projectile or the processed reactive projectile.

[0007] As an example relevant to the present invention, the data may include image information, audio information, occupational information, and spatial information.

[0008] A method for providing a reactive projectile using artificial intelligence according to an embodiment of the present invention may include the steps of: performing a preprocessing function on data transmitted from a terminal by a server; transmitting the preprocessed data to an AI cloud server by the server; generating a user profile related to the terminal based on the preprocessed data by the AI ​​cloud server; analyzing the preprocessed data and understanding the user's intention by the AI ​​cloud server; performing artificial intelligence-based learning by the AI ​​cloud server based on the generated user profile and the understood user's intention, and generating a reactive projectile customized for the user based on the learning result; transmitting the generated reactive projectile to the server by the AI ​​cloud server; determining whether or not to process the reactive projectile by the server, and transmitting the reactive projectile directly to a spatial computing device or processing the reactive projectile and then transmitting the processed reactive projectile to the spatial computing device based on the determined whether or not to process it; and projecting the reactive projectile or the processed reactive projectile by the spatial computing device.

[0009] As an example related to the present invention, the step of performing a preprocessing function on the data may include at least one of the following steps: performing a data refinement function to remove error information and unnecessary information from the data; performing a data conversion function to convert the data into a predetermined format; and performing a data analysis function to extract one or more predetermined meaningful information from the data by applying a predetermined learning function through artificial intelligence or a predetermined vision processing function through computer vision to the data.

[0010] As an example related to the present invention, the step of generating the reactive projectile may involve performing learning using the generated user profile and the understood user intention as input values ​​for a preset generative artificial intelligence model, and generating the reactive projectile based on the learning result.

[0011] As an example related to the present invention, the method may further include collecting reaction data from users located within an area where the reactive projectile is projected by the spatial computing device; and interacting with the corresponding users based on the collected reaction data in conjunction with the server or the AI ​​cloud server by the spatial computing device.

[0012] As an example related to the present invention, the method may further include the steps of: collecting user interaction data resulting from interactions between the spatial computing device and the user by the server in conjunction with the spatial computing device; and mapping and storing the collected user interaction data with previously collected manuals and requests by the server. [Effects of the Invention]

[0013] The present invention performs preprocessing on data collected from a terminal in a server, analyzes the preprocessed data to extract meaningful information from the data, generates a user profile based on the previously extracted information in an AI cloud server to understand the user's intention, generates a projectile customized for the user based on the user profile and the user's intention, processes the projectile generated in the server, and then projects the processed projectile in a spatial computing device and interacts with the user's response, thereby providing a more personalized and immersive educational environment for the user, providing a natural response to the user's input, and potentially enabling support for vulnerable groups in education. [Brief explanation of the drawings]

[0014] [Figure 1] 1 is a block diagram showing the configuration of a reactive projectile providing system using artificial intelligence according to an embodiment of the present invention; [Figure 2] 1 is a flowchart illustrating a method for providing a reactive projectile using artificial intelligence according to an embodiment of the present invention. [Figure 3] 1 is a flowchart illustrating a method for providing a reactive projectile using artificial intelligence according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0015] The technical terms used in the present invention are merely used to describe specific embodiments and are not intended to limit the present invention. Furthermore, unless otherwise defined in the present invention, the technical terms used in the present invention shall be interpreted in a way that is commonly understood by a person of ordinary skill in the art to which the present invention pertains, and shall not be interpreted in an overly comprehensive or overly narrow sense. Furthermore, if a technical term used in the present invention is an incorrect technical term that does not accurately express the concept of the present invention, it shall be substituted with a technical term that is correctly understood by a person skilled in the art. Furthermore, general terms used in the present invention shall be interpreted in accordance with dictionary definitions or the context, and shall not be interpreted in an overly narrow sense.

[0016] Furthermore, singular expressions used in the present invention include plural expressions unless the context clearly dictates otherwise. Terms such as "comprise" or "include" in the present invention should not be construed as including all of the various components or steps described in the invention, and some of the components or steps may not be included, or additional components or steps may be included.

[0017] Furthermore, terms including ordinal numbers such as "first," "second," etc., used in the present invention may be used to describe elements, but elements are not limited by the terms. Terms are used only to distinguish one element from another. For example, a first element may be called a second element, and similarly, a second element may be called a first element, without departing from the scope of the present invention.

[0018] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. Regardless of the drawing numbers, identical or similar components will be given the same reference numbers, and redundant descriptions thereof will be omitted.

[0019] In addition, when it is determined that detailed descriptions of related prior art may obscure the gist of the present invention, the detailed descriptions will be omitted. Furthermore, the attached drawings are merely for the purpose of making the concept of the present invention easier to understand, and the concept of the present invention is not limited by the attached drawings.

[0020] FIG. 1 is a block diagram showing the configuration of a reactive projectile providing system 10 using artificial intelligence according to an embodiment of the present invention.

[0021] As shown in FIG. 1, the reactive projectile providing system 10 using artificial intelligence includes a terminal 100, a server 200, an AI cloud server 300, and a spatial computing device 400. Not all of the components of the reactive projectile providing system 10 using artificial intelligence shown in FIG. 1 are essential components, and the reactive projectile providing system 10 using artificial intelligence may be implemented with more components than those shown in FIG. 1, or may be implemented with fewer components.

[0022] The terminal 100 may be a smartphone, a portable terminal, a mobile terminal, a foldable terminal, a personal digital assistant (PDA), a portable multimedia player (PMP) terminal, a telematics terminal, a navigation terminal, a personal computer, a notebook computer, a slate PC, a tablet PC, an ultrabook, a wearable device (including a smartwatch, a smart glass, a head mounted display (HMD), etc.), a wireless broadband (Wibro) terminal, an Internet Protocol Television (IPTV) terminal, a smart TV, a digital broadcasting terminal, an audio video navigation (AVN) terminal, an audio / video (A / V) system, a flexible terminal, etc. It can be applied to various terminals such as a digital signage device, an AI speaker, etc.

[0023] The server 200 and the AI ​​cloud server 300 may be implemented as a web server, database server, proxy server, etc. The server 200 and the AI ​​cloud server 300 may be installed with a network load balancing mechanism or one or more of various software programs that enable the server 200 and the AI ​​cloud server 300 to operate on the Internet or other networks, and may be implemented as a computerized system through such mechanisms. The network may be an HTTP network, a private line, an intranet, or any other network. The terminal 100, the server 200, the AI ​​cloud server 300, and the spatial computing device 400 may be connected via a security network to prevent data from being attacked by hackers or other third parties. The server 200 and the AI ​​cloud server 300 may include multiple database servers, which may be separately connected to the server 200 and the AI ​​cloud server 300 through any type of network connection, including a distributed database server architecture.

[0024] The terminal 100, the server 200, the AI ​​cloud server 300, and the spatial computing device 400 may each include a communication unit (not shown) for performing communication functions with other terminals, a storage unit (not shown) for storing various information and programs (or applications), a display unit (not shown) for displaying various information and program execution results, an audio output unit (not shown) for outputting audio information corresponding to the various information and program execution results, and a control unit (not shown) for controlling various components and functions of each terminal.

[0025] The terminal (or client device / client terminal) 100 communicates with the server 200, the AI ​​cloud server 300, the spatial computing device 400, etc. In this case, the terminal 100 may be a terminal carried by a user to perform educational functions, training functions, etc. using a reactive projectile in conjunction with the server 200, the AI ​​cloud server 300, and the spatial computing device 400 based on data provided by the terminal 100.

[0026] In addition, the terminal 100, in conjunction with the server 200, registers a user as a member to receive educational functions, training functions, subscription functions, etc. using a reactive projectile through a dedicated app and / or website provided by the server 200, and registers personal information, etc. in the server 200. At this time, the personal information includes ID, email address, password (or password), name, sex, date of birth, contact information, address (or address information), etc.

[0027] In addition, the terminal 100 registers a personal information usage agreement in the form of an electronic document, etc., pre-set in the terminal 100, in the server 200 in order to use the functions (or services) provided by the server 200 in conjunction with the server 200.

[0028] In addition, the terminal 100 may register the user as a member of the server 200 using information on an SNS account to which the user of the terminal 100 has subscribed, information on an account on another site, or information on a mobile messenger account. Here, the SNS account may be information related to Facebook, Twitter (registered trademark), Instagram, Kakao Story, Naver Blog, etc. In addition, the account on another site may be information related to YouTube, Kakao, Naver, etc. In addition, the mobile messenger account may be information related to KakaoTalk, Line, Viber, WeChat, WhatsApp, Telegram, Snapchat, etc.

[0029] In addition, when performing the membership registration procedure, the terminal 100 must complete the authentication function through a personal authentication means (e.g., mobile phone, credit card, i-PIN, simple authentication, etc.) in order to successfully complete the membership registration procedure for the server 200.

[0030] After completing the membership registration, the terminal 100 installs a dedicated app (or application / application program / specific app) provided by the server 200 on the terminal 100 in order to use the services provided by the server 200. At this time, the dedicated app may include a native app, a mobile web app, a responsive web app (Mobile Web App Design: RWD), an adaptive web app (Adaptive Web Design: AWD), a hybrid app, etc., and may be an app for performing an education function, a training function, a subscription function, etc. using a responsive projectile.

[0031] After completing the membership registration, the terminal 100 can display the discount coupon provided by the server 200 through the corresponding dedicated app. At this time, the discount coupon may be a discount coupon including a certain percentage discount information when using an education function, a training function, a subscription function, etc. using a reactive projectile.

[0032] In addition, the terminal 100 performs a payment function through a subscription function in conjunction with the server 200 and a payment server (not shown) to perform functions provided by the server 200. At this time, the server 200 can perform the payment function through card payment, automatic transfer through linkage with a bank payment account, payment using cash points or cash remaining in the account of the terminal 100 that has registered as a member with the server 200, and easy payment including Kakao Pay and Naver Pay.

[0033] If the payment fails, the terminal 100 receives information indicating that the payment has failed (e.g., insufficient balance, exceeded limit, etc.) transmitted from the server 200 (or the payment server), and outputs (or displays) the received information indicating that the payment has failed.

[0034] After the payment function is normally performed, the terminal 100 receives a payment function performance result transmitted from the server 200. Here, the payment function performance result includes information such as the subscription period, payment amount, payment date and time.

[0035] The terminal 100 also collects data related to any user, manuals, requests, etc., related to the data. Here, the data (or user data) includes information for the user to receive education or training for a specific intention (or purpose), such as image / video information (e.g., the user's face image, the image of the surrounding environment, the image of an object, the screen the user is viewing, the image of a document the user is viewing, the image of a book the user is viewing, etc.), audio information (e.g., the user's voice, ambient noise, etc.), human body information (e.g., the user's body movements, posture, gestures, etc.), occupational information (or personal information) (e.g., the user's occupation, job, specialty, gender, age, etc.), spatial information (e.g., the user's location information, information about the characteristics of the surrounding environment, etc.). The manual also includes learning information, training information, etc., pre-stored in the server 200 in correspondence with the data (or information for the user to receive education or training for a specific intention / purpose). In addition, the requests (or requirements) include information collected through user interviews (for example, information obtained by conducting interviews with users who will use the system to understand their requests and needs).

[0036] In addition, the terminal 100 transmits the collected data, manuals, requests, and identification information of the terminal 100 to the server 200. Here, the identification information of the terminal 100 includes MDN (Mobile Directory Number), mobile IP, mobile MAC, SIM (Subscriber Identity Module) card specific information, serial number, etc.

[0037] In addition, the terminal 100 (or the user of the terminal 100) interacts with the reactive projectile (or a processed reactive projectile) by projecting it through the spatial computing device 400 installed (or placed) in the area (or region) where the user of the terminal 100 is located in response to the transmitted data, thereby performing educational functions, training functions, etc. corresponding to the intention (or purpose) of the data.

[0038] That is, the terminal 100 (or the user of the terminal 100) can more intuitively understand the learning content through the 3D image and the responsive projectile.

[0039] In addition, the terminal 100 (or the user of the terminal 100) can interact in real time with a virtual teacher or other students associated with the reactive projectile to participate in learning (or education), training, etc.

[0040] Furthermore, the terminal 100 (or the user of the terminal 100) can receive a customized learning experience for each student through learning data analysis.

[0041] Furthermore, the terminal 100 (or the user of the terminal 100) can receive learning content in various formats such as text, image, video, and audio.

[0042] In an embodiment of the present invention, the terminal 100 can perform various functions provided by the server 200 in the form of a dedicated app or website (for example, an educational function using a reactive projectile, a training function, a subscription function, etc.).

[0043] The server 200 communicates with the terminal 100, the AI ​​cloud server 300, the spatial computing device 400, etc.

[0044] In addition, the server 200 performs a membership registration procedure for the user of the terminal 100, etc.

[0045] In addition, the server 200 registers personal information related to the user of the terminal 100. At this time, the server 200 may register (or manage) the personal information in a DB server (not shown) and may have received a personal information usage consent form in electronic form from the user of the terminal 100 in advance.

[0046] In addition, the server 200 performs a member management function for users of the terminals 100 and the like.

[0047] In addition, the server 200 provides the terminal 100 with a dedicated app and / or website that provides educational functions, training functions, subscription functions, etc. using a reactive projectile.

[0048] The server 200 also provides a bulletin board function for announcements, events, and the like.

[0049] In addition, the server 200 is linked with the terminal 100 and the payment server to perform a payment function by performing a subscription function on the corresponding terminal 100 for an education function, a training function, etc. using a reactive projectile provided by the corresponding server 200.

[0050] If the payment function fails, the server 200 provides the terminal 100 with payment failure information (including, for example, the payment date, the payment amount, and failure information (including, for example, insufficient balance, exceeding the limit, etc.)) (or information indicating that the payment has failed).

[0051] After the payment function with the terminals 100, etc. is normally performed, the server 200 transmits the payment function performance result provided by the payment server to each of the terminals 100, etc. Here, the payment function performance result includes information such as the subscription period, payment amount, payment date and time.

[0052] In addition, the server 200 maps (or matches / links) the results of the payment function to the corresponding terminal 100 (or account information related to the corresponding terminal 100), etc., and manages (or stores / registers) them.

[0053] In addition, the server 200 provides various information for performing educational functions, training functions, etc. using the reactive projectile provided by the server 200 through the corresponding dedicated app or corresponding dedicated website on the terminal 100, etc., by performing the subscription function.

[0054] In addition, the server 200 receives data, manuals, requests, identification information of the terminal 100, and the like transmitted from the terminal 100.

[0055] In the embodiment of the present invention, the server 200 is mainly described as receiving manuals, requests, etc. related to the data from the terminal 100, but this is not limited to this. When the server 200 receives data from the terminal 100 while previously managing (or storing / collecting) manuals, requests, etc. for each data in relation to a plurality of data, the server 200 may check (or use) the manuals, requests, etc. related to the received data from the plurality of data-specific manuals, requests, etc. that it is managing.

[0056] The server 200 also performs preprocessing functions on the received data, including data refinement (e.g., removing errors and unnecessary information from data), data conversion (e.g., converting data into a predefined format that can be processed by the system), and data analysis (e.g., extracting meaningful information from data using technologies such as artificial intelligence and computer vision). If encrypted data is received, the server 200 decrypts the encrypted data using a predefined public key or private key and manages (or processes / generates) the decrypted data.

[0057] That is, the server 200 performs a data purification function to remove error information, unnecessary information, etc. from the received data.

[0058] In addition, the server 200 performs a data conversion function to convert the received data (or data on which the data refinement function has been performed) into a pre-set format that can be processed (or used) by the system (e.g., including the server 200, the AI ​​cloud server 300, etc.).

[0059] In addition, the server 200 performs a data analysis function to extract one or more meaningful pieces of information (or information corresponding to items pre-set in the data) (e.g., the user's face, surrounding environment, object, screen the user is looking at, image of document the user is looking at, image of book the user is looking at, user's voice, noise around the user, user's body movements, posture, gestures, user's occupation, user's job, user's field of expertise, user's gender, user's age, user's location information, characteristic information of the user's surrounding environment, etc.) by applying a learning function through artificial intelligence or a vision processing function through computer vision pre-set in the received data (or data on which the data refinement function has been performed / data on which the data conversion function has been performed).

[0060] In this manner, the server 200 can perform a pre-processing function on the received data and generate (or manage) pre-processed data.

[0061] In this manner, the server 200 can analyze, process, modify and provide data received from the terminal 100 .

[0062] In addition, the server 200 transmits the preprocessed data (or the result data after performing the data refinement function, the data conversion function, the data analysis function, etc.) to the AI ​​cloud server 300. At this time, the server 200 (or a logical server (not shown) included in the corresponding server 200) can transmit the preprocessed data directly to the AI ​​cloud server 300 based on the received manual, requests, etc., or can transmit part of the preprocessed data to the AI ​​cloud server 300.

[0063] In addition, the server 200 receives a reactive projectile transmitted from the AI ​​cloud server 300 in response to previously transmitted preprocessed data.

[0064] In addition, the server 200 transmits the received reactive projectile directly to the spatial computing device 400 based on the previously received manual, request, etc., or applies (or mixes) the relevant manual, request, etc. to the relevant reactive projectile to generate a processed reactive projectile, and transmits the generated processed reactive projectile directly to the spatial computing device 400. At this time, the server 200 transmits the reactive projectile to the spatial computing device 400 corresponding to the preset space (or location) where the user of the relevant terminal is located, among the multiple spatial computing devices 400 managed by the server 200.

[0065] That is, the server 200 checks (or determines) whether the received reactive projectile needs to be processed based on the previously received manual, requirements, etc.

[0066] If the confirmation result (or the judgment result) indicates that the received reactive projectile does not require processing, the server 200 transmits (or provides) the received reactive projectile (a reactive projectile customized for the user) to the spatial computing device 400 as is.

[0067] Furthermore, if the confirmation result (or the judgment result) determines that the received reactive projectile requires processing, the server 200 applies (or mixes) manuals, requirements, etc. to the reactive projectile to generate a processed reactive projectile (or a processed reactive projectile / a reactive projectile customized for the user), and transmits (or provides) the generated processed reactive projectile (or a processed reactive projectile / a reactive projectile customized for the user) to the spatial computing device 400.

[0068] In this way, the server 200 determines whether or not to process the corresponding reactive projectile based on the manual, requirements, etc. related to the data, and depending on the determined whether or not to process it, it can either transmit the reactive projectile as is to the spatial computing device 400 or process the reactive projectile and then transmit the processed reactive projectile to the spatial computing device 400.

[0069] In the embodiments of the present invention, the terminal 100 and the spatial computing device 400 are described separately, but when the terminal 100 is a spatial computing device 400, the server 200 can transmit the generated reactive projectile (or the generated processed reactive projectile) to the terminal 100.

[0070] Accordingly, the terminal 100 receives the reactive projectile (or the processed reactive projectile) transmitted from the server 200 and projects (or displays / outputs) the received reactive projectile (or the processed reactive projectile).

[0071] Also, if the terminal 100 is a smartphone, the server 200 transmits the generated reactive projectile to the terminal 100. At this time, the reactive projectile may be a reactive projectile in the form of augmented reality or mixed reality (or augmented reality / mixed reality realistic content / 3D content) generated by the corresponding AI cloud server 300 or processed by the server 200.

[0072] Accordingly, the terminal 100 receives a responsive projectile (or immersive content / 3D content) in the form of augmented reality or mixed reality transmitted from the server 200, and displays (or outputs) the received responsive projectile (or immersive content / 3D content) in the form of augmented reality or mixed reality.

[0073] Also, if the terminal 100 is a glasses-type terminal, a head mounted display (HMD), or the like, the server 200 transmits the generated responsive projectile to the terminal 100. At this time, the responsive projectile may be an augmented reality or mixed reality type responsive projectile (or augmented reality / mixed reality type immersive content / 3D content) generated by the corresponding AI cloud server 300 or processed by the server 200.

[0074] Accordingly, the terminal 100 receives a responsive projectile (or immersive content / 3D content) in the form of augmented reality or mixed reality transmitted from the server 200, and displays (or outputs) the received responsive projectile (or immersive content / 3D content) in the form of augmented reality or mixed reality.

[0075] In addition, the server 200 interacts with the spatial computing device 400 and performs an interaction with the corresponding user based on the reaction data collected by the spatial computing device 400 .

[0076] That is, the server 200 works in conjunction with the spatial computing device 400 to project the action (or movement) of a corresponding reactive projectile that corresponds to (or responds to) the corresponding reaction data based on the reaction data collected by the spatial computing device 400, and outputs voice information (or acoustic information) that corresponds to (or responds to) the corresponding reaction data.

[0077] In this way, the server 200 works in conjunction with the spatial computing device 400 to facilitate interaction between the user and the reactive projectile (or processed reactive projectile) being projected, thereby providing the user (e.g., including students, staff, etc.) with a more immersive and effective learning experience and providing the knowledge and skills necessary for practical application.

[0078] In addition, the server 200 collects user interaction data resulting from interactions between the spatial computing device 400 and the user in conjunction with the spatial computing device 400. Here, the user interaction data includes image information, audio information, reaction data, projectile operation data, etc. resulting from interactions between the corresponding reactive projectile and the corresponding user.

[0079] The server 200 also analyzes the user interaction data and provides (or progresses) lessons (or learning / education) that match the student's level.

[0080] In addition, the server 200 (or the reactive projectile providing system 10) manages (or stores / maps / matches / links) the collected user interaction data together with pre-collected (or input / stored) manuals, requests, etc., and uses the user interaction data, manuals, requests, etc. to improve the reactive projectile providing system 10. Here, the manuals include learning information, training information, etc. pre-stored in the server 200 corresponding to the data (or information for the user to receive education or training for a specific intention / purpose). In addition, the requests (or requirements) include information collected through user interviews (e.g., information obtained by conducting interviews with users who will use the system to understand the user's requests and needs).

[0081] That is, the server 200 (or the reactive projectile providing system 10) generates a requirements document to which requirements for system functions, performance, usability, etc. are applied (or reflected / described) based on the collected requirements, and performs the overall design of the corresponding reactive projectile providing system 10 based on the generated requirements document. Here, the design of the reactive projectile providing system 10 includes system architecture, hardware and software requirements, database design, etc.

[0082] In addition, the server 200 (or the reactive projectile providing system 10) grasps the requirements of the user who uses the reactive projectile providing system 10, and then analyzes the user interviews, questionnaire surveys, user observations, and curriculum for desired learning subjects according to the user's requirements.

[0083] In addition, the server 200 (or the reactive projectile providing system 10) defines the functions that the reactive projectile providing system 10 must provide (for example, it divides required functions and optional functions based on the user requirements and defines detailed specifications for each function).

[0084] In addition, the server 200 (or the reactive projectile providing system 10) designs interactions with the main components of the reactive projectile providing system 10.

[0085] That is, the server 200 (or the reactive projectile providing system 10) defines the main elements that constitute the reactive projectile providing system 10, including client applications, server applications, AI cloud services, spatial computing devices, etc., and designs the data flow and interaction method between each element.

[0086] In addition, the server 200 (or the reactive projectile providing system 10) designs a database to be used in the corresponding reactive projectile providing system 10.

[0087] That is, the server 200 (or the reactive projectile providing system 10) designs a database structure and schema and selects a database management system (not shown) taking into consideration the type, amount, and frequency of use of data to be used.

[0088] In addition, the server 200 (or the reactive projectile providing system 10) designs a method for a user to interact with the corresponding reactive projectile providing system 10.

[0089] That is, the server 200 (or the reactive projectile providing system 10) designs a user-friendly and intuitive interface in accordance with (or based on) the interface design guidelines requested by the user, and designs an interface to optimize the user experience.

[0090] In addition, the server 200 (or the reactive projectile providing system 10) designs an algorithm to be used in the corresponding reactive projectile providing system 10.

[0091] That is, the server 200 (or the reactive projectile providing system 10) designs algorithms necessary to realize the core functions of the reactive projectile providing system 10, including machine learning, computer vision, natural language processing, signal processing, etc., and optimizes the performance of the algorithms.

[0092] In addition, the server 200 (or the reactive projectile providing system 10) develops a client application for users to use the reactive projectile providing system 10.

[0093] That is, the server 200 (or the reactive projectile providing system 10) embodies the main functions of a client application including a user interface, a data collection module, a network communication module, etc., and is developed to suit a mobile operating system and / or a desktop operating system.

[0094] In addition, the server 200 (or the reactive projectile providing system 10) processes the collected data and develops a server application that interacts with the corresponding AI cloud server 300.

[0095] That is, the server 200 (or the reactive projectile providing system 10) embodies the main functions of a server application, including a data processing module, an AI cloud service linking module, a database management module, etc., and is designed and developed with scalability and stability in mind.

[0096] In addition, the server 200 (or the reactive projectile providing system 10) selects an AI cloud service for machine learning model training and execution, and develops API connectivity between the server application and the AI ​​cloud service.

[0097] In addition, the server 200 (or the reactive projectile providing system 10) defines the API calling method, data format, error handling method, etc. by referring to the API document, and develops the linkage with security in mind.

[0098] In addition, the server 200 (or the reactive projectile providing system 10) develops a driver for controlling the spatial computing device 400 and displaying (or projecting / outputting) the projectile (or reactive projectile).

[0099] In addition, the server 200 (or the reactive projectile providing system 10) develops a driver by referring to the hardware specifications and API of the spatial computing device 400 and verifies compatibility with the corresponding reactive projectile providing system 10.

[0100] The AI ​​cloud server 300 communicates with the terminal 100, the server 200, the spatial computing device 400, etc.

[0101] The AI ​​cloud server 300 also utilizes previously collected user profiles, user intentions (or user goals), etc. as data for continuous learning (or machine learning / deep learning). Here, the input data set for learning can perform training and testing functions by dividing the user profiles, user intentions, etc. into a training set and a test set at a preset ratio (e.g., 7:3, 8:2, etc.). The input data set for learning also includes user profiles, user intentions, etc. that will be collected in the future. The output data set for learning also includes a reactive projectile customized for a corresponding user that is learned based on the user profiles, user intentions, etc. as a portion to be predicted, and predicts this in the future.

[0102] That is, the AI ​​cloud server 300 performs a learning function for generating a reactive projectile customized for a user using the user profile, user intention, etc. included in the specific raw data in relation to the specific raw data for the generative artificial intelligence model through the preset learning data.

[0103] In this case, the AI ​​cloud server 300 stores raw data such as the user profiles and the user intentions in parallel and distributed manner, refines unstructured data, structured data, and semi-structured data contained in the stored raw data (including learning data, etc.), performs preprocessing including classification using metadata, and analyzes the preprocessed data including data mining to construct big data by learning, training, and testing based on at least one type of machine learning. In this case, the at least one type of machine learning may be any one or a combination of supervised learning, semi-supervised learning, unsupervised learning, reinforcement learning, and deep reinforcement learning. Data mining can involve performing classification, which explores inherent relationships between preprocessed data and predicts the class of new data by learning a training dataset whose classes are known, or clustering, which groups data based on similarity without class information.

[0104] In this way, the AI ​​cloud server 300 performs a learning function on the generative artificial intelligence model in the form of a neural network (or a feedforward neural network) or an artificial neural network through the learning data, etc.

[0105] In addition, the AI ​​cloud server 300 monitors, requests, or modifies attendance management functions, learning status management functions, learning management functions, etc. in real time for the user of the corresponding device 100 in order to provide a user-centered design and a personalized experience according to the user's individual requests and circumstances.

[0106] In addition, the AI ​​cloud server 300 provides learning (or education) functions in a natural and immersive way between the user and the reactive projectile for real-time interaction.

[0107] In addition, the AI ​​cloud server 300 is based on artificial intelligence and can improve learning efficiency by requesting learning materials and grasping progress.

[0108] In addition, the AI ​​cloud server 300 can utilize various data such as photos, images, voice information, human body information, occupation information, and spatial information.

[0109] In addition, the AI ​​cloud server 300 receives the pre-processed data transmitted from the server 200.

[0110] In addition, the AI ​​cloud server 300 generates a user profile related to the corresponding terminal 100 based on the received pre-processed data.

[0111] That is, the AI ​​cloud server 300 generates a user profile related to the user based on image information (or video information), audio information, occupation information, etc. included in the received pre-processed data.

[0112] In addition, the AI ​​cloud server 300 analyzes the received pre-processed data to understand (or confirm) the user's intention (or user intent / user purpose).

[0113] That is, the AI ​​cloud server 300 grasps the user's intention based on image information (or video information), audio information, human body information, spatial information, etc. included in the received preprocessed data.

[0114] In addition, the AI ​​cloud server 300 performs AI-based learning (artificial neural network / machine learning / deep learning) based on the generated user profile and the understood (or confirmed) user intention, and generates a responsive projectile customized for the user based on the learning result. Here, the responsive projectile may be a 3D individual (or 3D object), digital content, an avatar, etc.

[0115] That is, the AI ​​cloud server 300 performs learning (or artificial intelligence / machine learning / deep learning) using the generated user profile, the understood (or confirmed) user intention, etc. as input values ​​for a pre-set generative artificial intelligence model, and generates a reactive projectile customized for the corresponding user based on the learning result (or artificial intelligence result / machine learning result / deep learning result).

[0116] In addition, the AI ​​cloud server 300 transmits (or provides) the generated reactive projectile to the server 200.

[0117] In the embodiments of the present invention, the server 200 and the AI ​​cloud server 300 are described as being separate, but this is not limited thereto, and multiple functions performed by the server 200 and the AI ​​cloud server 300 may be performed by a single server 200 or a single AI cloud server 300.

[0118] The spatial computing device 400 communicates with the terminal 100, the server 200, the AI ​​cloud server 300, etc. At this time, if a single spatial computing device 400 is configured, the corresponding spatial computing device 400 is arranged (or installed) in a predetermined area (or region). Also, if a plurality of spatial computing devices 400 are configured, the plurality of spatial computing devices 400 are respectively arranged in a plurality of predetermined areas. Here, the spatial computing device 400 includes unique identification information (or shared ID), and each individual spatial computing device 400 may be arranged in a fixed state at a predetermined position or may be configured to be portable and mobile and arranged in a mobile state.

[0119] The spatial computing device 400 also includes a hologram fan (not shown) that provides Pepper's Ghost, stereoscopy, autostereoscopy, volume holograms, rotational holograms, and the like.

[0120] In addition, the spatial computing device 400 receives a reactive projectile (or a reactive projectile / processed reactive projectile) customized for the corresponding user transmitted from the server 200.

[0121] The spatial computing device 400 may also project (or output) the received reactive projectile. At this time, the spatial computing device 400 may confirm the location of a user located within a predetermined area covered (or managed) by the spatial computing device 400, and project (or output) the reactive projectile around the confirmed user's location (or within a predetermined radius from the confirmed user's location). Here, the spatial computing device 400 may project the reactive projectile to a predetermined area (e.g., a wall, ceiling, floor, specific space, etc.) around the user's location.

[0122] In addition, the spatial computing device 400 collects reaction data from a user (or an object) located within a corresponding area (or an area into which the reactive projectile is projected), where the reaction data includes voice information, movement information (or gestures), etc. of the user.

[0123] That is, the spatial computing device 400 collects reaction data including voice information, motion information, etc. related to a user located within a corresponding area (or an area into which the reactive projectile is projected) through a sensor unit (not shown) included in (or linked to) the spatial computing device. Here, the sensor unit includes a microphone (not shown) for collecting voice information, a motion recognition sensor (not shown) for detecting the user's motion (or gesture / movement), a camera unit (not shown) for collecting (or capturing / acquiring) video information related to the user, etc.

[0124] In addition, the spatial computing device 400 interacts with the server 200 and / or the AI ​​cloud server 300 to interact with the corresponding user based on the collected reaction data.

[0125] That is, the spatial computing device 400 works in conjunction with the server 200 and / or the AI ​​cloud server 300 to project the action (or movement) of a corresponding reactive projectile that corresponds to (or responds to) the corresponding reaction data based on the collected reaction data, and output voice information (or acoustic information) that corresponds to (or responds to) the corresponding reaction data.

[0126] In this manner, the spatial computing device 400 projects (or outputs) a projectile into the space around the user.

[0127] In the embodiment of the present invention, the spatial computing device 400 mainly performs an interaction between the corresponding reactive projectile and the user based on the reaction data collected from the sensor unit configured in the corresponding spatial computing device, but is not limited thereto. The AI ​​cloud server 300 may be configured to project the operation of the corresponding reactive projectile and output audio information in conjunction with the corresponding spatial computing device 400 based on the reaction data collected through the sensor unit independently configured in the corresponding area.

[0128] In this way, the spatial computing device 400 works in conjunction with the server 200 to perform interaction between the user and the reactive projectile being projected, thereby providing the user (e.g., student, staff, etc.) with a more immersive and effective learning experience and providing the knowledge and skills necessary for practical application.

[0129] In addition, the spatial computing device 400 collects user interaction data resulting from interactions between the spatial computing device 400 and the user, where the user interaction data includes image information, audio information, reaction data, projectile operation data, etc. resulting from interactions between the corresponding reactive projectile and the corresponding user.

[0130] In addition, the spatial computing device 400 transmits (or provides) the collected user interaction data, identification information of the spatial computing device 400, and the like to the server 200.

[0131] In this way, the server performs preprocessing on data collected from the terminal, analyzes the preprocessed data and extracts meaningful information from the data, generates a user profile based on the previously extracted information in the AI ​​cloud server to understand the user's intention, generates a projectile customized for the user based on the user profile and the user's intention, processes the projectile generated in the server, and then projects the processed projectile in the spatial computing device to interact with the user's response.

[0132] Hereinafter, a method for providing a reactive projectile using artificial intelligence according to the present invention will be described in detail with reference to FIGS.

[0133] 2 and 3 are flowcharts illustrating a method for providing a reactive projectile using artificial intelligence according to an embodiment of the present invention.

[0134] First, the terminal 100 collects data related to a user, a manual related to the data, and requests, etc. Here, the data (or user data) includes image / video information (e.g., an image of the user's face, an image of the surrounding environment, an image of an object, a screen the user is viewing, an image of a document the user is viewing, an image of a book the user is viewing, etc.), audio information (e.g., the user's voice, ambient noise, etc.), human body information (e.g., the user's body movements, posture, gestures, etc.), occupational information (or personal information) (e.g., the user's occupation, job, specialty, gender, age, etc.), spatial information (e.g., the user's location information, information on characteristics of the surrounding environment, etc.), etc. In addition, the manual includes learning information, training information, etc. pre-stored in the server 200 corresponding to the data (or information for the user to receive education or training for a specific purpose). In addition, the requests (or requirements) include information collected through user interviews (e.g., information obtained by conducting interviews with users who will use the system to understand the user's needs and requirements, etc.).

[0135] In addition, the terminal 100 transmits the collected data, manuals, requests, identification information of the terminal 100, etc. to the server 200. Here, the identification information of the terminal 100 includes MDN, mobile IP, mobile MAC, SIM card specific information, serial number, etc. At this time, the transmitted data may be transmitted in an encrypted state based on a preset public key or private key, or in an unencrypted state.

[0136] For example, the first terminal 100 collects first data including a first image, first voice information, first occupation information, first space information, etc., related to a first user of the first terminal.

[0137] In addition, the first terminal collects a first manual, a first request, etc. related to the corresponding first data.

[0138] In addition, the first terminal transmits the collected first data, the first manual, the first request, the identification information of the first terminal, etc. to the server 200 (S210).

[0139] Thereafter, the server 200 receives data, manuals, requests, identification information of the terminal 100, and the like transmitted from the terminal 100.

[0140] The server 200 also performs preprocessing functions on the received data, including data refinement (e.g., removing errors and unnecessary information from data), data conversion (e.g., converting data into a predefined format that can be processed by the system), and data analysis (e.g., extracting meaningful information from data using technologies such as artificial intelligence and computer vision). If encrypted data is received, the server 200 decrypts the encrypted data using a predefined public key or private key and manages (or processes / generates) the decrypted data.

[0141] That is, the server 200 performs a data purification function to remove error information, unnecessary information, etc. from the received data.

[0142] In addition, the server 200 performs a data conversion function to convert the received data (or data on which the data refinement function has been performed) into a pre-set format that can be processed (or used) by the system (e.g., including the server 200, the AI ​​cloud server 300, etc.).

[0143] In addition, the server 200 performs a data analysis function to extract one or more predetermined meaningful information (or information corresponding to predetermined items) from the received data by applying a learning function through artificial intelligence, a vision processing function through computer vision, etc. to the received data (or data on which a data refinement function has been performed / data on which a data conversion function has been performed).

[0144] In this manner, the server 200 can perform a pre-processing function on the received data and generate (or manage) pre-processed data.

[0145] In addition, the server 200 transmits the preprocessed data (or the result data after performing the data refinement function, the data conversion function, the data analysis function, etc.) to the AI ​​cloud server 300. At this time, the server 200 (or a logical server (not shown) included in the corresponding server 200) can transmit the preprocessed data directly to the AI ​​cloud server 300 based on the received manual, requests, etc., or can transmit part of the preprocessed data to the AI ​​cloud server 300.

[0146] For example, the server 200 receives the first data, the first manual, the first request, the identification information of the first terminal, etc. transmitted from the first terminal.

[0147] In addition, the server 200 performs preprocessing, including the data refinement function, the data conversion function, the data analysis function, etc., on the received first data to generate first preprocessed data, and transmits the generated first preprocessed data to the AI ​​cloud server 300 (S220).

[0148] Thereafter, the AI ​​cloud server 300 receives the preprocessed data transmitted from the server 200.

[0149] In addition, the AI ​​cloud server 300 generates a user profile related to the corresponding terminal 100 based on the received pre-processed data.

[0150] That is, the AI ​​cloud server 300 generates a user profile related to the user based on image information (or video information), audio information, occupation information, etc. included in the received pre-processed data.

[0151] For example, the AI ​​cloud server 300 receives the first pre-processed data transmitted from the server 200 .

[0152] In addition, the AI ​​cloud server 300 generates a first user profile related to the corresponding first user based on the first image, first voice information, first occupation information, etc. included in the received first preprocessed data (S230).

[0153] Thereafter, the AI ​​cloud server 300 analyzes the received pre-processed data to understand (or confirm) the user's intention (or user intent / user purpose).

[0154] That is, the AI ​​cloud server 300 grasps the user's intention based on image information (or video information), audio information, human body information, spatial information, etc. included in the received preprocessed data.

[0155] For example, the AI ​​cloud server 300 determines the intention of the corresponding first user (e.g., learning to dance) based on the first image, first voice information, first person activity information, first spatial information, etc. included in the received first preprocessed data (S240).

[0156] Thereafter, the AI ​​cloud server 300 performs AI-based learning (artificial neural network / machine learning / deep learning) based on the generated user profile and the understood (or confirmed) user's intention, and generates a responsive projectile customized for the user based on the learning result. Here, the responsive projectile may be a 3D individual (or 3D object), digital content, an avatar, etc.

[0157] That is, the AI ​​cloud server 300 performs learning (or artificial intelligence / machine learning / deep learning) using the generated user profile, the understood (or confirmed) user intention, etc. as input values ​​for a pre-set generative artificial intelligence model, and generates a reactive projectile customized for the corresponding user based on the learning result (or artificial intelligence result / machine learning result / deep learning result).

[0158] In addition, the AI ​​cloud server 300 transmits (or provides) the generated reactive projectile to the server 200.

[0159] As an example, the AI ​​cloud server 300 performs learning using the generated first user profile and the understood first user's intention (e.g., dance learning) as input values ​​for the generative artificial intelligence model, and generates a first responsive projectile customized for the first user in relation to dance learning based on the learning results.

[0160] In addition, the AI ​​cloud server 300 transmits the generated first reaction type projectile to the server 200 (S250).

[0161] Thereafter, the server 200 receives a reactive projectile transmitted from the AI ​​cloud server 300 in response to the previously transmitted preprocessed data.

[0162] In addition, the server 200 transmits the received reactive projectile directly to the spatial computing device 400 based on the previously received manual, request, etc., or applies (or mixes) the relevant manual, request, etc. to the relevant reactive projectile to generate a processed reactive projectile, and transmits the generated processed reactive projectile directly to the spatial computing device 400. At this time, the server 200 transmits the reactive projectile to the spatial computing device 400 corresponding to the preset space (or location) where the user of the relevant terminal is located, among the multiple spatial computing devices 400 managed by the server 200.

[0163] That is, the server 200 checks (or determines) whether the received reactive projectile needs to be processed based on the previously received manual, requirements, etc.

[0164] If the confirmation result (or the judgment result) indicates that the received reactive projectile does not require processing, the server 200 transmits (or provides) the received reactive projectile (a reactive projectile customized for the user) to the spatial computing device 400 as is.

[0165] Furthermore, if the confirmation result (or the judgment result) determines that the received reactive projectile requires processing, the server 200 applies (or mixes) manuals, requirements, etc. to the reactive projectile to generate a processed reactive projectile (or a processed reactive projectile / a reactive projectile customized for the user), and transmits (or provides) the generated processed reactive projectile (or a processed reactive projectile / a reactive projectile customized for the user) to the spatial computing device 400.

[0166] In this way, the server 200 determines whether or not to process the corresponding reactive projectile based on the manual, requirements, etc. related to the data, and depending on the determined whether or not to process it, it can either transmit the reactive projectile as is to the spatial computing device 400 or process the reactive projectile and then transmit the processed reactive projectile to the spatial computing device 400.

[0167] For example, the server 200 receives a first reactive projectile transmitted from the AI ​​cloud server 300 in response to previously transmitted first pre-processed data.

[0168] In addition, the server 200 processes the received first reactive projectile based on the first manual, first requirements, etc. related to the corresponding first data previously received, and generates the processed first reactive projectile.

[0169] In addition, the server 200 transmits the generated processed first reactive projectile to a fourth spatial computing device 400 corresponding to the area where the first user is located among the plurality of spatial computing devices 400 (S260).

[0170] Thereafter, the spatial computing device 400 receives a reactive projectile (or a reactive projectile / processed reactive projectile) customized for the corresponding user transmitted from the server 200.

[0171] The spatial computing device 400 may also project (or output) the received reactive projectile. At this time, the spatial computing device 400 may confirm the location of a user located within a predetermined area covered (or managed) by the spatial computing device 400, and project (or output) the reactive projectile around the confirmed user's location (or within a predetermined radius from the confirmed user's location). Here, the spatial computing device 400 may project the reactive projectile to a predetermined area (e.g., a wall, ceiling, floor, specific space, etc.) around the user's location.

[0172] As an example, the fourth spatial computing device receives the processed first reactive projectile transmitted from the server 200.

[0173] In addition, the fourth spatial computing device confirms the position of the first user within a predetermined area covered by the fourth spatial computing device, and projects the processed first reactive projectile within a predetermined radius (e.g., 3 meters) from the confirmed position of the first user (S270).

[0174] Thereafter, the spatial computing device 400 collects reaction data from a user (or an object) located within a corresponding area (or an area into which the reaction projector is projected), where the reaction data includes voice information, movement information (or gestures), etc. of the user.

[0175] That is, the spatial computing device 400 collects reaction data including voice information, motion information, etc. related to a user located within a corresponding area (or an area into which the reactive projectile is projected) through a sensor unit (not shown) included in (or linked to) the spatial computing device. Here, the sensor unit includes a microphone (not shown) for collecting voice information, a motion recognition sensor (not shown) for detecting the user's motion (or gesture / movement), a camera unit (not shown) for collecting (or capturing / acquiring) video information related to the user, etc.

[0176] For example, while the processed first responsive projectile is being projected, the fourth spatial computing device collects first voice information related to the first user through a microphone included in the sensor unit and collects first action information related to the first user through a motion recognition sensor included in the sensor unit, where the collected first voice information, the first action information, etc. are included in first response data (S280).

[0177] Thereafter, the spatial computing device 400 interacts with the server 200 and / or the AI ​​cloud server 300 to interact with the corresponding user based on the collected reaction data.

[0178] That is, the spatial computing device 400 works in conjunction with the server 200 and / or the AI ​​cloud server 300 to project the action (or movement) of a corresponding reactive projectile that corresponds to (or responds to) the corresponding reaction data based on the collected reaction data, and output voice information (or acoustic information) that corresponds to (or responds to) the corresponding reaction data.

[0179] In this way, the spatial computing device 400 works in conjunction with the server 200 and / or the AI ​​cloud server 300 to perform interaction between the reactive projectile being projected and the user, thereby providing the user (e.g., including students, staff, etc.) with a more immersive and effective learning experience and providing the knowledge and skills necessary for practical application.

[0180] As an example, the fourth space computing device interacts with the server 200 and / or the AI ​​cloud server 300 to modify and project the motion of the processed first reaction type projectile currently being projected in response to the collected first reaction data, and outputs second audio information responsive to the corresponding first reaction data through a speaker (not shown) configured in the corresponding space (S290).

[0181] Thereafter, the server 200 collects user interaction data resulting from interactions between the spatial computing device 400 and the user in conjunction with the spatial computing device 400. Here, the user interaction data includes image information, audio information, reaction data, projectile operation data, etc. resulting from interactions between the corresponding reactive projectile and the corresponding user.

[0182] In addition, the server 200 manages (or stores / maps / matches / links) the collected user interaction data together with previously collected (or previously received / input / stored) manuals, requests, etc., and uses the corresponding user interaction data, manuals, requests, etc. to improve the reactive projectile providing system 10.

[0183] As an example, the server 200 may interact with the fourth spatial computing device to collect first user interaction data during the interaction between the processed first reactive projectile and the first user.

[0184] In addition, the server 200 stores the collected first user interaction data during the interaction process between the processed first reactive projectile and the first user, along with the previously received first manual, first requests, etc. (S300).

[0185] As previously described, the embodiment of the present invention performs preprocessing on data collected from the terminal in the server, analyzes the preprocessed data to extract meaningful information from the data, generates a user profile based on the previously extracted information in the AI ​​cloud server and understands the user's intention, generates a projectile customized for the user based on the user profile and the user's intention, processes the projectile generated in the server, and then projects the processed projectile in the spatial computing device, interacting with the user's response to provide the user with a more personalized and immersive educational environment, providing a natural response to the user's input, and enabling support for educationally vulnerable groups.

[0186] The above content can be modified and changed by a person skilled in the art to which the present invention pertains without departing from the essential characteristics of the present invention. Therefore, the embodiments disclosed in the present invention are for illustrative purposes only and do not limit the technical idea of ​​the present invention. The scope of the present invention should be interpreted by the following claims, and all technical ideas within the scope of the claims are included in the scope of the present invention. [Explanation of symbols]

[0187] 10: Reactive projectile delivery system using artificial intelligence 100: Terminal 200:Server 300: AI cloud server 400: Spatial Computing Device

Claims

1. an AI cloud server that generates a user profile in relation to the terminal based on the preprocessed data, analyzes the preprocessed data to understand the user's intention, performs artificial intelligence-based learning based on the generated user profile and the understood user's intention, generates a reactive projectile customized for the user based on the learning result, and transmits the generated reactive projectile; A server that performs a preprocessing function on data transmitted from the terminal, transmits the preprocessed data to the AI ​​cloud server, receives a reactive projectile transmitted from the AI ​​cloud server in response to the transmitted preprocessed data, determines whether or not the reactive projectile needs to be processed, and transmits the reactive projectile directly to a spatial computing device according to the determined whether or not it needs to be processed, or processes the reactive projectile and then transmits the processed reactive projectile to the spatial computing device; and the spatial computing device that projects the reactive projectile or the processed reactive projectile; The data is including image information, audio information, occupational information and spatial information, The server A data refinement function is performed to remove error information and unnecessary information from the data, a data conversion function is performed to convert the data into a predetermined format, and a data analysis function is performed to extract one or more predetermined meaningful information from the data by applying a predetermined learning function through artificial intelligence or a predetermined vision processing function through computer vision to the data. A reactive projectile delivery system utilizing artificial intelligence.

2. performing a pre-processing function on data transmitted from the terminal by the server; transmitting the pre-processed data to an AI cloud server by the server; generating, by the AI ​​cloud server, a user profile associated with the device based on the preprocessed data; analyzing the pre-processed data by the AI ​​cloud server to understand the user's intention; performing artificial intelligence-based learning by the AI ​​cloud server based on the generated user profile and the understood user intention, and generating a reactive projectile customized for the user based on a learning result; transmitting the generated reactive projectile to the server by the AI ​​cloud server; The server determines whether or not the reactive projectile needs to be processed, and transmits the reactive projectile directly to the spatial computing device according to the determined whether or not it needs to be processed, or processes the reactive projectile and then transmits the processed reactive projectile to the spatial computing device; and projecting the reactive projectile or the processed reactive projectile by the spatial computing device; The data is including image information, audio information, occupational information and spatial information, performing a preprocessing function on the data, performing a data refinement function to remove erroneous information and unnecessary information from the data; performing a data conversion function to convert the data into a predetermined format; and and performing a data analysis function to extract one or more pieces of meaningful information from the data by applying a predetermined learning function through artificial intelligence or a predetermined vision processing function through computer vision to the data. A reactive projectile providing method using artificial intelligence.

3. The step of generating a reactive projectile comprises: The generated user profile and the grasped user intention are used as input values ​​for a pre-set generative artificial intelligence model to perform learning, and the reactive projectile is generated based on the learning result.

3. The method for providing a reactive projectile using artificial intelligence according to claim 2.

4. collecting, by the spatial computing device, reaction data from users located within an area into which the reaction projectile is projected; and The method further includes a step of performing an interaction with the corresponding user based on the collected reaction data in conjunction with the server or the AI ​​cloud server through the spatial computing device.

3. The method for providing a reactive projectile using artificial intelligence according to claim 2.

5. collecting, by the server, user interaction data associated with the spatial computing device from interactions between the spatial computing device and the user; and The method further includes a step of mapping and storing the collected user interaction data and the pre-collected manuals and requests by the server.

5. The method for providing a reactive projectile using artificial intelligence according to claim 4.

Images