System
The system addresses low fan engagement by allowing direct communication with AI athlete characters, offering real-time game results and AR interactions, and facilitating merchandise purchases, thereby enhancing user satisfaction and local economic contributions.
Patent Information
- Application Number
- JP2024116564
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-07-19
- Publication Date
- 2026-01-29
AI Technical Summary
Sports spectators have limited direct communication with athletes, leading to low fan engagement and unsatisfied enjoyment, with few opportunities for interaction and engagement around the stadium, limiting the contribution to the local economy.
A system allowing users to chat one-on-one with AI athlete characters, providing real-time game results and original content, enabling AR photo-taking, and facilitating the purchase of athlete-recommended merchandise.
Enhances fan engagement by enabling private communication with athletes, providing real-time game information, and promoting local economic activity through AR interactions and merchandise purchases.
Smart Images

Figure 2026015090000001_ABST
Abstract
Description
[Technical Field]
[0001] The technology of the present disclosure relates to a system. [Background technology]
[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]
[0004] Traditionally, sports spectators have mainly watched games on television or the internet, with little direct communication with athletes and teams. This has resulted in low fan engagement and often hesitation to visit the stadium. Furthermore, the provision of live game results and original content has been limited, meaning fans' enjoyment has not been fully satisfied. Furthermore, there have been few opportunities to connect with consumer activity around the stadium, limiting its contribution to the local economy. [Means for solving the problem]
[0005] This invention is a system that allows users to chat one-on-one with an AI character of a specific athlete. This allows users to enjoy private communication with the athlete and hear their pre-match enthusiasm and post-match impressions directly. The system also provides real-time game results and original content, allowing users to instantly receive the latest game information and unique content. Furthermore, the system offers a feature that allows users to take and share photos with athletes using AR functionality, thereby increasing fan engagement. Additionally, the system allows users to easily purchase athlete-recommended gourmet food and official support merchandise, promoting consumer activity around the stadium and contributing to the local economy.
[0006] An "AI athlete character" is an artificial intelligence program modeled after a specific athlete, and communicates with users in natural language through chat.
[0007] A "User" is a person who uses the System to chat with an AI character of a particular athlete or to use other features.
[0008] "Chat" means that the user and the athlete's AI character communicate via text messages.
[0009] "Live Match Results" is a function that instantly delivers the results of sports matches that are being played in real time.
[0010] "Original content" refers to media such as independently created videos or articles related to a particular sports team or athlete.
[0011] The "AR function" is a function that uses augmented reality technology to display virtual objects superimposed on real-world scenery.
[0012] "Gourmet" is a general term for food served at specific events or places.
[0013] "Official cheering merchandise" refers to cheering items that are officially approved and sold by sports teams or athletes.
[0014] A "login screen" is a screen where a user enters their ID and password to access the system.
[0015] "Authentication" is the process of verifying that a user has valid access to a system.
[0016] "Profile Information" means basic information about a particular athlete, including their name, image, biography, etc.
[0017] "Push notification" is a function that sends information from the system to the user's device in real time.
[0018] "Streaming" is a technology for playing digital content in real time.
[0019] "Photography" refers to the act of recording images or videos using a camera.
[0020] "SNS" stands for Social Networking Service, a web platform for users to interact online.
[0021] A "content list" is a list of original content that users can view.
[0022] The "item list" is a list of gourmet foods and goods that users can purchase.
[0023] A "purchase request" refers to a user requesting the system to purchase a specific gourmet food or merchandise. [Brief explanation of the drawings]
[0024] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION
[0025] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.
[0026] First, the terms used in the following description will be explained.
[0027] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).
[0028] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.
[0029] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.
[0030] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.
[0031] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."
[0032] [First embodiment]
[0033] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.
[0034] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.
[0035] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0036] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.
[0037] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.
[0038] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
[0039] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.
[0040] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.
[0041] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0042] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0043] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0044] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0045] This invention relates to a system that increases fan engagement by allowing users to communicate with AI characters of athletes. This system is realized by the following programs and processes.
[0046] User server connection and authentication
[0047] When a user uses a terminal to access the system, they first go to the login screen. The user enters their ID and password and attempts to log in. The terminal sends the entered authentication information to the server, which then compares the received information with a database to authenticate the user. If authentication is successful, the user proceeds to the main menu.
[0048] Player Selection
[0049] When a user selects the "Select Player" option from the main menu, the device displays a list of players. The user taps on a specific player they want to chat with and sends the player ID to the server. The server retrieves the player's profile information from its database and returns it to the device, which then displays it, allowing the user to view information about that player.
[0050] Start chatting with AI characters
[0051] When a specific player is selected, a chat screen appears and the user can enter a message. When the user presses the send button, the device sends the message to the server, which then relays the message to the AI chatbot. The AI chatbot analyzes the received message and generates a response in the style of the player. The server returns the generated response to the device, which then displays it on the chat screen.
[0052] Notification of match results
[0053] While the match is in progress, the server retrieves the match results in real time. When the server retrieves new match results, it sends them to the user's device via push notification. The device receives the notification and displays the match results to the user.
[0054] Original content distribution
[0055] When a user selects the "Original Content" option from the main menu, the device requests a content list from the server. The server retrieves the list of original content from the content database and returns it to the device. The device displays the list, and when the user selects a specific content, the server provides that content to the device in streaming format.
[0056] AR photo taking and sharing
[0057] When a user selects the "AR Photo Shoot" option, the device's camera activates and allows the user to take a photo with the player using the AR function. Once the user has finished taking the photo, the device uploads the photo data to the server. The server saves the photo and generates a sharing link that is returned to the device. The user can then use the link to share the photo on social media, etc.
[0058] Purchase recommended gourmet foods and goods
[0059] When a user selects the "Recommended Food & Goods" option from the menu, the device sends a request to the server, which retrieves recommended food and goods information from a database and returns it to the device. The device displays the list, and when the user selects a specific item, a purchase request is sent to the server. The server completes the purchase process and arranges for delivery.
[0060] Specific examples
[0061] For example, a user logs in, selects a specific athlete (Athlete A), and sends a message saying, "Please tell us your thoughts before the game." The server receives the message and passes it to an AI chatbot, which then generates a response such as, "My goal this season is to win!" This response is displayed on the user's chat screen. If a game is in progress, real-time game results are sent to the user's device via push notification. The user can then view original content from the main menu or take photos with the athlete using the AR function.
[0062] In this way, the system allows users to enjoy private communication with athletes while receiving match results and original content in real time. Furthermore, by utilizing the AR and merchandise purchasing functions, it is possible to increase engagement with fans and promote contributions to the local economy.
[0063] The processing flow will be explained below.
[0064] Program processing steps
[0065] User server connection and authentication
[0066] Step 1:
[0067] The user launches the Hawks Connection app and goes to the login screen.
[0068] Step 2:
[0069] The user enters their ID and password on the login screen and clicks the login button.
[0070] Step 3:
[0071] The device sends the ID and password authentication information to the server.
[0072] Step 4:
[0073] The server compares the received ID and password with the database and performs authentication.
[0074] Step 5:
[0075] If the authentication is successful, the server returns a message indicating successful authentication to the terminal, and the terminal displays the main menu.
[0076] Player Selection
[0077] Step 1:
[0078] The user selects the "Player Selection" option from the main menu.
[0079] Step 2:
[0080] The device will display a player list screen, and the user can tap on the player they want to chat with.
[0081] Step 3:
[0082] The device sends the player ID to the server.
[0083] Step 4:
[0084] The server retrieves the player's profile information from the database and returns it to the terminal.
[0085] Step 5:
[0086] The device displays the received player profile information to the user.
[0087] Start chatting with AI characters
[0088] Step 1:
[0089] The user types a message in the chat input field and presses the send button.
[0090] Step 2:
[0091] The device sends the user's message to the server.
[0092] Step 3:
[0093] The server passes the message to the AI chatbot.
[0094] Step 4:
[0095] The AI chatbot analyzes the messages it receives and generates responses in the style of a player.
[0096] Step 5:
[0097] The server returns the generated response to the terminal, which displays the response on the chat screen.
[0098] Notification of match results
[0099] Step 1:
[0100] The server retrieves the match results in real time.
[0101] Step 2:
[0102] The server that obtains the match results will send a push notification to the user's device.
[0103] Step 3:
[0104] The device receives the notification and displays the match results to the user.
[0105] Original content distribution
[0106] Step 1:
[0107] The user selects the "Original Content" option from the main menu.
[0108] Step 2:
[0109] The terminal requests the server to acquire a content list.
[0110] Step 3:
[0111] The server obtains a list of original contents from the content database and returns it to the terminal.
[0112] Step 4:
[0113] The device displays a content list, and the user selects a specific content.
[0114] Step 5:
[0115] The terminal requests the data of the selected content from the server, and the server streams the data.
[0116] AR photo taking and sharing
[0117] Step 1:
[0118] The user selects the "Take AR Photo" option from the menu.
[0119] Step 2:
[0120] The device's camera function will be activated, and the AR function will be used to take photos with the player.
[0121] Step 3:
[0122] Once the user has taken a photo, the device uploads the photo data to the server.
[0123] Step 4:
[0124] The server stores the photo data, generates a sharing link, and returns it to the device.
[0125] Step 5:
[0126] Users can use the link to share photos on social media etc.
[0127] Purchase recommended gourmet foods and goods
[0128] Step 1:
[0129] The user selects the "Recommended Food & Goods" option from the main menu.
[0130] Step 2:
[0131] The terminal sends a request to the server, which retrieves information from the database.
[0132] Step 3:
[0133] The server returns a list of recommended gourmet foods and goods to the device.
[0134] Step 4:
[0135] The device displays a list and the user selects a specific item.
[0136] Step 5:
[0137] The terminal sends a purchase request to the server, and the server carries out the purchase procedure.
[0138] Step 6:
[0139] The server handles purchase confirmation and shipping arrangements.
[0140] Example 1
[0141] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0142] Conventional sports fan engagement systems are limited to providing information about athletes and distributing content, and lack the means for fans to interact one-on-one with athletes, receive real-time game results, take photos using augmented reality features, or purchase recommended meals or official support merchandise. This makes it difficult to increase user satisfaction and engagement.
[0143] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0144] In this invention, the server includes a means for a user to chat one-on-one with a specific avatar, a means for providing game results and content in real time, a means for a user to take and share photos with the avatar using augmented reality functions, a means for a user to purchase recommended meals and official support merchandise, a means for a user to input login authentication information and be authenticated by the server, a means for providing information about an avatar selected by the user, a means for the avatar to generate a response to the user's message, and a means for displaying the generated response to the user. This allows users to enjoy multifaceted engagement with athletes, improving satisfaction with the system.
[0145] "User" refers to any individual or organization that uses this system.
[0146] An "avatar" is a virtual character based on a particular athlete that is intended to interact one-on-one with the user.
[0147] "Server" refers to the computer system used to manage and provide user authentication information, avatar data, match results, and other content.
[0148] "Database" refers to the system for storing and managing data used in the system, such as athlete profile information, match results, and content.
[0149] "Response" refers to an answer or reaction generated by an avatar in response to a message from a user.
[0150] "Game Results" refers to the results data of ongoing or completed sports games.
[0151] "Content" refers to media information provided to users, such as original videos, articles, images, etc.
[0152] "Augmented reality (AR)" refers to a technology that uses a device's camera to overlay virtual objects onto real-world images.
[0153] "Recommended Meals" means any diet-related product or service recommended by an Athlete or the System to a User.
[0154] "Official Support Merchandise" refers to official goods and merchandise related to an athlete's team or brand.
[0155] "Login Credentials" refers to the ID and password combination required for a User to access the System.
[0156] "Authentication" refers to the process by which the server verifies that the login credentials provided by the user are accurate.
[0157] This invention provides a system that increases fan engagement by allowing users to communicate with AI characters of athletes. This system is realized through the following specific hardware and software configuration and processing.
[0158] First, the user accesses the system using a device (smartphone, tablet, PC, etc.) and goes to the login screen. The user enters their ID and password and attempts to log in. The device sends the entered authentication information to the server. The server verifies the received information against a database (e.g., MySQL) and, if authentication is successful, proceeds to the main menu.
[0159] When a user selects the "Player Selection" option from the main menu, the device requests a list of players from the server. The server retrieves the list of players from the database and sends it to the device. The user can then tap or click to select a specific player and view their profile information.
[0160] Once a player is selected, the user can begin chatting with the AI character. The user types a message and presses the send button. The device sends the message to the server, which then passes it to an AI chatbot (such as GPT-3, a generative AI model). The AI chatbot analyzes the message and generates a response in the style of the player. The server then sends the response back to the device and displays it on the user's chat screen.
[0161] Additionally, while the match is in progress, the server obtains match results in real time via external APIs such as sports data APIs. When new match results are available, the server sends them to the user's device via push notification, and the device receives the notification and displays it to the user.
[0162] Furthermore, if the user selects the "original content" option, the terminal will request a content list from the server. The server will retrieve the content data from the database and send it to the terminal. When the user selects a specific content, the server will provide the content in streaming format.
[0163] When a user selects "AR Photo Shooting" in the AR photo option, the device activates the camera function and AR library (e.g., ARKit) to take a photo with the player's virtual character. After taking the photo, the device uploads the photo data to the server, which saves the photo and generates a sharing link that is returned to the device. The user can then use this link to share the photo on social media, etc.
[0164] Finally, when the user selects the "Recommended Food & Goods" option, the device sends a request to the server, which retrieves information about recommended meals and official support products from the database and returns it to the device. When the user selects a specific item, a purchase request is sent to the server, which handles the purchase process and arranges delivery.
[0165] Prompt Sentence Examples
[0166] Please tell us your thoughts before the match
[0167] What are your goals for this season?
[0168] What do you think about the next match?
[0169] In this way, the system allows users to enjoy private communication with athletes while receiving match results and original content in real time. Furthermore, by utilizing the AR and merchandise purchasing functions, it is possible to increase engagement with fans and promote contributions to the local economy.
[0170] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0171] Step 1:
[0172] The user uses a terminal to go to the login screen and enters their ID and password. Input: User's ID and password. The terminal sends this authentication information to the server. The server compares the received information with the database for authentication. If authentication is successful, Output: An instruction to proceed to the main menu is returned. Specific operation: The server uses an SQL query to search the database for authentication information, and returns success if it matches, or an error message if it does not match.
[0173] Step 2:
[0174] The user selects the "Select Player" option from the main menu. Input: The user requests to select a player. The device requests a list of players from the server. The server retrieves the list of players from the database and returns it to the device. Output: The list of players is displayed on the device. Specific behavior: The server retrieves player information using an SQL query and returns it to the device in JSON format.
[0175] Step 3:
[0176] The user selects a specific player and starts chatting with that player. Input: The user's player selection and message. When the user enters a message and presses the send button, the device sends the message to the server. The server passes the message to the AI chatbot, and output: the response generated by the chatbot. Specific operation: The server invokes an AI model (e.g., GPT-3) to analyze the message and generate a response. The response is returned to the device in JSON format and displayed on the chat screen.
[0177] Step 4:
[0178] While the match is in progress, the server retrieves match results in real time from an external API (for example, a sports data API). Input: Updated data on the match status. If there are new match results, the server sends them to the user's device as a push notification. Output: Push notification of match results. Specific operation: The server periodically calls the API and notifies the user via WebSocket or Firebase Cloud Messaging if there is new data.
[0179] Step 5:
[0180] The user selects the "Original Content" option from the main menu. Input: The user requests content. The device sends a request to the server, which retrieves the content data from the database and sends it to the device. Output: The content list is displayed on the device. When the user selects a specific content, the server provides it in streaming format. Specific behavior: The server provides the media file in HLS format, and the device plays it in the appropriate player.
[0181] Step 6:
[0182] When a user selects the "AR Photo Shoot" option, the device activates the camera function and AR library (e.g., ARKit). Input: User's photo request. A photo is taken with the player's virtual character. After the photo is taken, the device uploads the photo data to the server, which saves the photo and generates a sharing link that is returned to the device. Output: Shared link. Specific operation: A photo is taken using the device's camera and AR library, and uploaded to the server via REST API. The server generates a link and returns it.
[0183] Step 7:
[0184] When the user selects the "Recommended Food & Goods" option, the device sends a request to the server. Input: User's item selection request. The server retrieves information about recommended meals and official support products from the database and returns it to the device. Output: A product list is displayed on the device. When the user selects a specific item, a purchase request is sent to the server, which completes the purchase and arranges for delivery. Specific operation: The server retrieves the product information, completes the purchase through a payment gateway (e.g., Stripe), and notifies the user of the order information.
[0185] (Application example 1)
[0186] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0187] Today's sports fans want to interact more closely with their favorite athletes, get real-time game information, and watch original content. However, conventional systems struggle to provide these services comprehensively, limiting the means to increase fan engagement. This has created a growing need for systems that provide virtual communication with athletes, real-time game information notifications, AR photography, original content distribution, and the ability to purchase recommended products.
[0188] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0189] In this invention, the server includes: a means for enabling a user to chat one-on-one with an AI character of a specific athlete; a means for providing real-time game results and original video content; a means for a user to take and share photos with the athlete using an AR function; a means for a user to purchase food and drink recommended by the athlete and official support merchandise; a means for a user to log in from their device and select a specific athlete and generate and display athlete-style responses using a generative AI model; a means for obtaining game progress in real time and notifying the user; and a means for a user to view original content via their device. This enables deep engagement with athletes, allowing fans to enjoy game information and original content in real time, and further increasing satisfaction through the AR function and recommended merchandise.
[0190] An "athlete" is a person who competes in a particular sport and is virtually reproduced as an AI character within the system.
[0191] "One-on-one chat" means that users can engage in individual two-way messaging with an AI character of a specific athlete.
[0192] "Live Match Results" means the latest game status and results provided to a User in real time for ongoing or completed sports matches.
[0193] "Original video content" refers to independently created video data about athletes and related events that is distributed to users.
[0194] The "AR function" uses augmented reality technology to allow users to synthesize and photograph virtual images of athletes in real-world scenes.
[0195] "Athlete-recommended foods, beverages, and official support products" refers to foods and beverages recommended by athletes and products officially approved for support, which can be purchased by users.
[0196] "Generative AI model" refers to artificial intelligence technology that generates athlete-style responses based on a user's message.
[0197] "Get in real time" means that the progress of the match is continuously monitored and the user is notified immediately.
[0198] A "terminal" is a device that a user uses to access and operate the system, such as a smartphone or tablet.
[0199] This invention relates to a system that increases fan engagement by allowing users to communicate with AI characters of athletes. This system is realized by the following programs and processes.
[0200] First, a user must log in to access the system using a terminal. The user enters their ID and password on the login screen and sends the authentication information to the server. The server authenticates the received authentication information by checking it against a database, and if authentication is successful, the user can proceed to the main menu. The hardware used is a smartphone, and the software used is a back-end server and database management system.
[0201] Next, the user selects the "Select Athlete" option from the main menu, and the device displays a list of athletes. The user taps on the specific athlete they want to chat with and sends the athlete ID to the server. The server retrieves the athlete's profile information from the database and returns it to the device, which then displays it, allowing the user to view information about the athlete. The hardware used is a smartphone, and the software used is a back-end server and database management system.
[0202] Once a specific athlete is selected, a chat screen appears, allowing the user to enter a message. When the user presses the send button, the device sends the message to the server, which uses the generative AI model to analyze the message and generate a response in the style of the athlete. This response is returned from the server to the device, which displays it on the chat screen. The hardware used is a smartphone, and the software used is the generative AI model and a back-end server.
[0203] Also, while a match is in progress, the server obtains the match status in real time and sends it to the user's device via push notification. The device receives the notification and displays the match results to the user. The hardware used is a smartphone, and the software used is a server with real-time data acquisition capabilities.
[0204] Furthermore, when the user selects the "Original Content" option from the main menu, the device requests a content list from the server. The server retrieves a list of original video content from the content database and returns it to the device. The device displays the list, and when the user selects specific content, the server provides that content to the device in streaming format. The hardware used is a smartphone, and the software used is a streaming server.
[0205] When a user selects the "AR Photo Shoot" option, the device's camera function is activated, allowing the user to take a photo with the athlete using AR functionality. Once the user has finished taking the photo, the device uploads the photo data to the server. The server saves the photo, generates a sharing link, and returns it to the device. The user can then use the link to share the photo on social media, etc. The hardware used is a smartphone (with a camera function), and the software used is an application that uses AR technology and a back-end server.
[0206] For example, a user can generate an athlete-like response using a prompt like the following: "Tell us your thoughts before the game," and the generative AI model can generate a response such as "My goal this season is to win!", which will be displayed in the user's chat screen.
[0207] In this way, a system will be realized that allows for deep engagement with athletes, allows fans to enjoy real-time game information and original content, and further enhances satisfaction through AR functions and recommended products.
[0208] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0209] Step 1:
[0210] A user accesses the system using a terminal. The user enters their ID and password on the login screen and sends the input data to the terminal. The terminal sends the authentication information to the server, which then collates it with a database for authentication. The server returns the authentication result to the terminal, and the terminal displays the main menu if authentication is successful, or an error message if authentication is unsuccessful.
[0211] Input: User ID, Password
[0212] Data processing: Sending authentication information and checking the database
[0213] Output: Authentication result (success / failure)
[0214] Step 2:
[0215] The user selects the "Select Player" option from the main menu. The device sends a request for a player list to the server, which retrieves the player list from the database and returns it to the device. The device displays the player list, and when the user taps on a specific athlete, it sends the athlete ID to the server. The server retrieves the player's profile information and returns it to the device, which displays it.
[0216] Input: Player selection request, player ID
[0217] Data processing: Acquisition of player list and profile information
[0218] Output: Player list, player profile information
[0219] Step 3:
[0220] When the user selects a player, a chat screen is displayed. When the user enters a message and presses the send button, the device sends the message to the server. The server uses a generative AI model to analyze the message, generate an athlete-like response, and return the response to the device. The device then displays the athlete-like response on the chat screen.
[0221] Input: User message
[0222] Data processing: Message analysis and response generation using generative AI models
[0223] Output: Athlete-like response
[0224] Step 4:
[0225] When a match is in progress, the server will continue to obtain the match status in real time. Every time the server detects a new match status, it will push the match result to the user's device. The device will receive the notification and display the match result to the user.
[0226] Input: Real-time match status data
[0227] Data processing: monitoring the match situation
[0228] Output: Match results via push notification
[0229] Step 5:
[0230] When a user selects the "Original Content" option from the main menu, the device requests a content list from the server. The server retrieves a list of original video content from the database and returns it to the device. The device displays the list, and when the user selects a specific content, the server provides that content to the device in streaming format.
[0231] Input: Original Content Request
[0232] Data processing: Acquisition of content list and content data
[0233] Output: Original content list, streaming content
[0234] Step 6:
[0235] When a user selects the "AR Photo Shoot" option, the device's camera activates and takes a photo of the athlete using the AR function. Once the user has finished taking the photo, the device uploads the photo data to the server. The server saves the photo and generates a sharing link that is returned to the device. The user can then use the link to share the photo on social media, etc.
[0236] Input: Photo request, photo data
[0237] Data processing: Upload and save photo data, generate share links
[0238] Output: Shared link
[0239] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.
[0240] This invention achieves a higher level of fan engagement by combining an emotion engine with a system in which users communicate with AI athlete characters. This system is realized by the following programs and processes.
[0241] User server connection and authentication
[0242] When a user uses a terminal to access the system, they first go to the login screen. The user enters their ID and password and attempts to log in. The terminal sends the entered authentication information to the server, which then compares the received information with a database to authenticate the user. If authentication is successful, the user proceeds to the main menu.
[0243] Player Selection
[0244] When a user selects the "Select Player" option from the main menu, the device displays a list of players and the user taps on a specific player they want to chat with. The device sends the player's ID to the server, which retrieves the player's profile information from its database and returns it to the device, which displays it and allows the user to view information about that player.
[0245] Start chatting with AI characters
[0246] Once a specific player is selected, a chat screen appears and the user can enter a message. When the user presses the send button, the device sends the message to the server, which then relays the message to the AI chatbot. The AI chatbot analyzes the received message and also uses an emotion engine to generate a player-like response. The emotion engine analyzes the emotion from the user's message and generates an optimal response based on that emotion. The server returns the generated response to the device, which then displays it on the chat screen.
[0247] The role of the emotional engine
[0248] The emotion engine analyzes the messages and actions entered by the user and recognizes their emotions. For example, if a user enters "I had so much fun today!", the emotion engine recognizes the user's emotion as "joy." Based on this information, the AI chatbot generates a response that corresponds to joy, such as "That's great! Please come again!"
[0249] Notification of match results
[0250] As the match progresses, the server retrieves the match results in real time. When the server receives new match results, it sends them to the user's device via push notification. The device receives the notification and displays the match results to the user. The emotion engine analyzes the user's emotions and can optimize the response to the match results.
[0251] Original content distribution
[0252] When a user selects the "Original Content" option from the main menu, the device requests a content list from the server. The server retrieves the list of original content from the content database and returns it to the device. The device displays the list, and when the user selects a specific content, the server provides that content to the device in streaming format. The emotion engine can also recommend appropriate content based on the user's emotions.
[0253] AR photo taking and sharing
[0254] When a user selects the "AR Photo Shoot" option, the device's camera activates and allows the user to take a photo with the player using the AR function. Once the user has finished taking the photo, the device uploads the photo data to the server. The server saves the photo and generates a sharing link that is returned to the device. The user can then use the link to share the photo on social media, etc.
[0255] Purchase recommended gourmet foods and goods
[0256] When a user selects the "Recommended Food and Goods" option from the menu, the device sends a request to the server, which retrieves recommended food and goods information from a database and returns it to the device. The device displays a list, and when the user selects a specific item, a purchase request is sent to the server. The server completes the purchase and arranges for delivery. The emotion engine can present recommended items taking into account the user's emotional state.
[0257] Specific examples
[0258] For example, suppose a user logs in, selects a specific athlete (Athlete A), and sends a message on the chat screen saying, "I'm so happy today!" The server receives this message, and the emotion engine analyzes the emotion of "joy." Based on this information, the AI chatbot generates a response such as, "That's great! I'll do my best in the next game!" This response is then displayed on the user's chat screen. If a game is in progress, real-time game results are sent to the user's device via push notification. Users can also watch original content from the main menu and take photos with players using the AR function.
[0259] With the introduction of the emotion engine, the system can provide flexible and personalized responses based on user emotions, further increasing engagement, improving the fan experience and driving more visitors to stadiums and related facilities.
[0260] The processing flow will be explained below.
[0261] Program processing steps
[0262] User server connection and authentication
[0263] Step 1:
[0264] The user launches the Hawks Connection app and goes to the login screen.
[0265] Step 2:
[0266] The user enters their ID and password on the login screen and clicks the login button.
[0267] Step 3:
[0268] The device sends the ID and password authentication information to the server.
[0269] Step 4:
[0270] The server compares the received ID and password with the database and performs authentication.
[0271] Step 5:
[0272] If the authentication is successful, the server returns a message indicating successful authentication to the terminal, and the terminal displays the main menu.
[0273] Player Selection
[0274] Step 1:
[0275] The user selects the "Player Selection" option from the main menu.
[0276] Step 2:
[0277] The device will display a player list screen, and the user can tap on the player they want to chat with.
[0278] Step 3:
[0279] The device sends the player ID to the server.
[0280] Step 4:
[0281] The server retrieves the player's profile information from the database and returns it to the terminal.
[0282] Step 5:
[0283] The device displays the received player profile information to the user.
[0284] Start chatting with AI characters
[0285] Step 1:
[0286] The user types a message in the chat input field and presses the send button.
[0287] Step 2:
[0288] The device sends the user's message to the server.
[0289] Step 3:
[0290] The server sends the message to the emotion engine, which analyzes the user's emotions.
[0291] Step 4:
[0292] The server passes the analysis results to the AI chatbot.
[0293] Step 5:
[0294] The AI chatbot generates appropriate responses based on the results of emotion analysis.
[0295] Step 6:
[0296] The server returns the generated response to the terminal, which displays the response on the chat screen.
[0297] Notification of match results
[0298] Step 1:
[0299] The server retrieves the match results in real time.
[0300] Step 2:
[0301] The server sends the match results to the user's device via push notification.
[0302] Step 3:
[0303] The device receives the notification and displays the match results to the user.
[0304] Original content distribution
[0305] Step 1:
[0306] The user selects the "Original Content" option from the main menu.
[0307] Step 2:
[0308] The terminal requests the server to acquire a content list.
[0309] Step 3:
[0310] The server obtains a list of original contents from the content database and returns it to the terminal.
[0311] Step 4:
[0312] The device displays a content list, and the user selects a specific content.
[0313] Step 5:
[0314] The terminal requests the data of the selected content from the server, and the server streams the data.
[0315] AR photo taking and sharing
[0316] Step 1:
[0317] The user selects the "Take AR Photo" option from the menu.
[0318] Step 2:
[0319] The device's camera function will be activated, and the AR function will be used to take photos with the player.
[0320] Step 3:
[0321] Once the user has taken a photo, the device uploads the photo data to the server.
[0322] Step 4:
[0323] The server stores the photo data, generates a sharing link, and returns it to the device.
[0324] Step 5:
[0325] Users can use the link to share photos on social media etc.
[0326] Purchase recommended gourmet foods and goods
[0327] Step 1:
[0328] The user selects the "Recommended Food & Goods" option from the main menu.
[0329] Step 2:
[0330] The terminal sends a request to the server, which retrieves information from the database.
[0331] Step 3:
[0332] The server returns a list of recommended gourmet foods and goods to the device.
[0333] Step 4:
[0334] The device displays a list and the user selects a specific item.
[0335] Step 5:
[0336] The terminal sends a purchase request to the server, and the server carries out the purchase procedure.
[0337] Step 6:
[0338] The server handles purchase confirmation and shipping arrangements.
[0339] Use of emotion engine
[0340] Step 1:
[0341] When a user sends a message, the server receives the message and sends it to the emotion engine.
[0342] Step 2:
[0343] The emotion engine analyzes messages and recognizes the user's emotions.
[0344] Step 3:
[0345] The emotion engine returns the recognized emotion to the server.
[0346] Step 4:
[0347] The server communicates the emotion analysis results to the AI chatbot.
[0348] Step 5:
[0349] The AI chatbot generates appropriate responses based on the results of sentiment analysis.
[0350] Step 6:
[0351] The server returns the generated response to the terminal, which displays the response to the user.
[0352] Specific examples
[0353] For example, suppose a user logs in, selects a specific athlete (Athlete A), and sends a message on the chat screen saying, "I'm so happy today!" The server receives this message, and the emotion engine analyzes it for the emotion of "joy." Based on this information, the AI chatbot generates a response such as, "That's great! I'll do my best in the next game!" This response is then displayed on the user's chat screen. While a game is in progress, real-time game results are sent to the user's device via push notification. Users can also watch original content from the main menu and take photos with players using the AR function. With the introduction of the emotion engine, the system can provide flexible and personalized responses based on the user's emotions, further increasing engagement. This improves the fan experience and increases visitor numbers to stadiums and related facilities.
[0354] Example 2
[0355] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0356] The problem this invention aims to solve is to realize more natural and emotional dialogue in a system that enhances fan engagement between users and athletes, and to respond to users' real-time and individual needs. Conventional systems have not been able to provide responses that reflect the user's emotions, and have not provided sufficient real-time game results or original content. Furthermore, the user experience, such as taking photos using AR functions or purchasing recommended gourmet food or merchandise, is limited. It is necessary to solve these problems and improve user satisfaction.
[0357] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[0358] In this invention, the server includes means for enabling a user to chat one-on-one with an AI character of a specific athlete, means for authenticating the ID and password entered by the user on the login screen, means for providing profile information of the athlete selected by the user, means for the AI character to receive the user's message, analyze the emotion using an emotion engine, and generate a response based on the emotion, means for displaying the generated response to the user, means for providing real-time game results and original content, means for the user to take and share photos with the athlete using an AR function, means for the user to purchase gourmet food recommended by the athlete and official cheering merchandise, means for the emotion engine to analyze the user's message and recognize the emotion, means for the AI chatbot to generate an optimal response based on the recognized emotion, and means for the server to obtain game results in real time while the game is in progress and send them to the device via push notification. This allows the user to receive personalized responses based on their emotion, providing real-time information and a diverse entertainment experience.
[0359] An "AI athlete character" is a virtual character created by artificial intelligence that mimics an athlete and can chat one-on-one with users.
[0360] "Users" refer to the people who use this system and communicate with the AI athlete characters within the system.
[0361] An "emotion engine" is a software component that analyzes emotions from messages entered by users and generates responses based on those emotions.
[0362] An "AI chatbot" is an artificial intelligence program that receives messages from users, analyzes them, and generates appropriate responses.
[0363] An "ID" is identification information used to identify a user, and is usually composed of a unique string of characters or numbers.
[0364] A "password" is a secret string of characters used in combination with an ID to authenticate a user.
[0365] "Authentication information" refers to the combination of ID and password that a user enters when logging in.
[0366] A "database" is a collection of electronically managed data that stores user information, athlete profile information, and the like.
[0367] "Main Menu" refers to the screen that serves as the entrance to the main functions of the system, which the user can access after successful authentication.
[0368] "Profile information" is detailed data about a particular athlete, including the athlete's background, performance, characteristics, etc.
[0369] "Real-time" refers to data being generated or transmitted instantly, without delay.
[0370] "Match Results Update" is a means of providing information to users quickly about the results of ongoing or completed matches.
[0371] "Original content" refers to digital content such as original video, audio, and text that the system provides to users.
[0372] The "AR function" is an augmented reality technology that displays digital information overlaid on real-world scenery.
[0373] "Means for taking a photo" refers to a method by which a user generates image data using the camera function of the device.
[0374] "Sharing methods" are the ways in which users can share photos they take or content they generate with other users online.
[0375] "Gourmet" refers to high-quality food and beverages endorsed by athletes.
[0376] "Official cheering goods" refers to cheering items and accessories officially approved by athletes or organizations.
[0377] "Means of purchase" refers to the mechanism by which users order and pay for gourmet food and official support goods through the system.
[0378] "Push notification" is a method by which a server sends important information to a user's device in real time.
[0379] The system of the present invention is an advanced fan engagement system that combines multiple technologies to enable users to communicate with AI athlete characters. The system includes hardware and software for implementing specific methods.
[0380] System Configuration
[0381] The system mainly consists of the following components:
[0382] (Server): Database server, AI chatbot, emotion engine, push notification system
[0383] (Device): A device (smartphone, tablet, PC, etc.) that accepts user operations and displays information accordingly.
[0384] (User): The person who operates the system and communicates with the athlete AI character.
[0385] Overview of the main technical components and processes
[0386] User authentication and login
[0387] When a user accesses the system using a terminal, they first go to a login screen. The user enters their ID and password, and if authentication is successful, they proceed to the main menu. Here, databases such as MySQL and PostgreSQL are used.
[0388] Player selection and profile display
[0389] The user selects the "Player Selection" option from the main menu and chooses a specific player from the displayed player list. The device sends the player ID to the server, which retrieves the player's profile information from the database and returns it to the device, allowing the user to view the player's details.
[0390] Chat with AI characters
[0391] When a user wants to chat with a selected player, they enter a message on the chat screen and press the send button. The device sends the message to the server, which then forwards it to the AI chatbot. The AI chatbot uses a generative AI model (e.g., GPT-4) to analyze the message's sentiment with an emotion engine. Based on this analysis, it generates an optimal response and returns it to the device. The device then displays the generated response on the chat screen.
[0392] Notification of match results
[0393] While the match is in progress, the server retrieves the match results in real time, and if important results are obtained, they are sent to the user's device as push notifications. This notification function uses push notification services such as Firebase Cloud Messaging (FCM).
[0394] Original content distribution
[0395] When a user selects the "Original Content" option, the terminal requests a content list from the server, which retrieves the list from the content database and returns it to the terminal, providing the content selected by the user in streaming format.
[0396] AR photo taking and sharing
[0397] When a user selects the "AR Photo Shoot" option, the device's camera activates and the user can take a photo with the player using the AR function. After taking the photo, the device uploads the photo data to the server, which then generates a sharing link and returns it to the device. The user can then share the link on social media, etc.
[0398] Purchase recommended gourmet foods and goods
[0399] When a user selects the "Recommended Food and Goods" option, the device sends a request to the server, which retrieves information about recommended foods and goods from the database and returns it to the device. When the user selects a specific item and sends a purchase request to the server, the server completes the purchase process and arranges for delivery.
[0400] Specific examples
[0401] For example, the following shows the process flow when a user logs in, selects a specific athlete (Athlete A), and sends the message "I'm so happy today!" on the chat screen. The server receives this message, and the emotion engine analyzes the "joy." Based on this information, the AI chatbot generates a response such as "That's great! I'll do my best in the next game!" This response is displayed on the user's chat screen. Additionally, if a game is in progress, real-time game results are sent to the user's device via push notification. Furthermore, users can view original content from the main menu and take photos with the players using the AR function.
[0402] Prompt Sentence Examples
[0403] "I want to send a message to a specific athlete (Athlete A) and get an emotional response. For example, if I send a message saying, 'I'm so happy today!' I want to generate an appropriate reply."
[0404] By implementing this invention, users can receive personalized responses based on their emotions, and real-time information provision and diverse entertainment experiences are possible.
[0405] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0406] Step 1:
[0407] The user boots up using a terminal and accesses the system login screen.
[0408] Step 2:
[0409] The user enters their ID and password into the login screen. This information is sent to the server by the terminal. The input data is sent to the server in the form of "user ID" and "password."
[0410] Step 3:
[0411] The server checks the received ID and password against a database containing pre-registered user information. The result of the check determines whether authentication was successful.
[0412] Step 4:
[0413] The server sends the authentication result to the terminal. If the authentication is successful, a success message is sent along with information on how to access the main menu. If the authentication fails, an authentication error message is sent.
[0414] Step 5:
[0415] Based on the authentication result received by the device from the server, if authentication is successful, the device displays the main menu screen, where the user can select their next action.
[0416] Step 6:
[0417] The user selects the "Select Player" option from the main menu. A request for a player list is sent from the terminal to the server.
[0418] Step 7:
[0419] The server retrieves the player list from the database and returns the data to the device, including player names and profile photos.
[0420] Step 8:
[0421] The terminal displays the player list received from the server to the user, who then selects a specific player from the list with whom he or she wants to chat.
[0422] Step 9:
[0423] When the user selects a particular player, the player's ID is sent by the device to the server, which retrieves the player's details from the database and returns them to the device.
[0424] Step 10:
[0425] The device displays the detailed player profile received from the server to the user, and transitions to a screen where the user can start chatting with the player.
[0426] Step 11:
[0427] The user enters a message on the chat screen and presses the send button, which sends the message from the device to the server.
[0428] Step 12:
[0429] The server forwards the received message to the AI chatbot, which then analyzes the message using a generative AI model (e.g., GPT-4).
[0430] Step 13:
[0431] The AI chatbot analyzes the content of the message and uses an emotion engine to recognize emotions. Emotional analysis data is obtained in the form of "happiness" or "sadness," etc.
[0432] Step 14:
[0433] Based on the analysis results of the emotion engine, the AI chatbot generates a response message. For example, if the emotion of "joy" is recognized, the response message generated will be "That's great!"
[0434] Step 15:
[0435] The server sends the generated response message to the terminal.
[0436] Step 16:
[0437] The terminal displays the response message on the chat screen so that the user can check it.
[0438] Step 17:
[0439] While the match is in progress, the server retrieves the match results in real time, for example, by using an API to retrieve the match status data.
[0440] Step 18:
[0441] When the server obtains new match results, it sends them to the user's device via push notification.
[0442] Step 19:
[0443] The device receives the notification and displays the match results to the user, while the emotion engine analyzes the user's reaction and provides appropriate feedback.
[0444] Step 20:
[0445] If the user selects the "original content" option, the terminal requests a content list from the server.
[0446] Step 20:
[0447] The server retrieves a list of original content from the content database and returns it to the device. The retrieved data includes video thumbnails and titles.
[0448] Step 21:
[0449] The terminal displays the received list to the user, allowing the user to select content.
[0450] Step 22:
[0451] Once the user selects the content they wish to view, the server provides that content in streaming format.
[0452] Step 23:
[0453] The terminal receives the streaming data, allowing the user to view the content.
[0454] Step 24:
[0455] When a user selects the "AR Photo Shoot" option, the device's camera function is activated, enabling the AR function and allowing the user to take photos with the players.
[0456] Step 25:
[0457] Once the user has taken a photo, the device uploads the photo data to the server.
[0458] Step 26:
[0459] The server stores the uploaded photos and generates a sharing link that is returned to the device.
[0460] Step 27:
[0461] The device displays the received link information to the user, who can then use the link to share the photo on social media platforms.
[0462] Step 28:
[0463] The user selects the "Recommended Food and Goods" option. The device sends a request to the server, which retrieves information about recommended foods and goods from the database and returns it to the device.
[0464] Step 29:
[0465] The terminal displays the received list to the user, allowing the user to select a particular item.
[0466] Step 30:
[0467] Once the user selects a particular item, a purchase request is sent from the terminal to the server, containing user information and details of the selected item.
[0468] Step 31:
[0469] The server processes the purchase request, completes the purchase through the payment system, and then arranges for delivery.
[0470] Step 32:
[0471] The emotion engine analyzes the user's emotional state and recommends appropriate items based on the state. For example, if the user is in a "joy" state, it will recommend related fun goods.
[0472] Step 33:
[0473] The recommended items will be displayed on the device, allowing the user to re-initiate the purchase process.
[0474] The above are the specific processing steps of this system.
[0475] (Application example 2)
[0476] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0477] Traditional methods of interaction between athletes and fans make it difficult to respond flexibly to fans' emotions, and the provision of personalized content is limited. Furthermore, notifications of game results and recommendations of related content are not optimized to take user emotions into account. This situation has led to challenges in improving fan engagement and deepening the fan experience.
[0478] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: a means for allowing a user to have a one-on-one conversation with an AI character of a specific athlete; a means for providing real-time game progress updates and unique content; a means for a user to take and share photos with the athlete using an augmented reality function; a means for a user to purchase athlete-recommended food and beverages and official support merchandise; a means for recognizing a user's emotions using an emotion analysis engine and personalizing and recommending content based on the emotions; a means for authenticating identification information and a password entered by the user on the login screen; a means for providing profile information of the athlete selected by the user; a means for recommending and delivering personalized sports-related content based on the user's emotions; a means for an AI character to generate a response to a user's message; a means for displaying the generated response; and a means for obtaining game results in real time and generating and notifying a response based on the user's emotions. This makes it possible to provide personalized content based on the user's emotions, improving fan engagement and deepening the fan experience.
[0479] An "AI character of a specific athlete" is a virtual character with artificial intelligence created to imitate a specific athlete, and which communicates with users.
[0480] "User" refers to an individual, fan, or user of this system.
[0481] "Means for dialogue" means a mechanism that allows users to exchange messages with the AI character of a specific athlete and for them to respond to each other.
[0482] "Match progress updates" refers to information that provides the progress and results of a match in real time.
[0483] "Original Content" refers to videos, articles, interviews, behind-the-scenes footage, and other information that is specifically created and hosted by the System.
[0484] "Means of providing information in real time" refers to technologies and mechanisms that deliver information to users instantly.
[0485] "Augmented reality" refers to a technology that displays digital information overlaid on the real world, for example, by synthesizing virtual characters onto the scenery seen through a camera.
[0486] An "emotion analysis engine" refers to an algorithm or software that analyzes messages and actions entered by users and recognizes their emotions.
[0487] "Personalized content" refers to information that is optimized and customized based on a user's interests and emotional state.
[0488] "Identification information" refers to information that uniquely identifies a user, and typically refers to a user ID and password.
[0489] "Cryptography" means secret information used to protect identity information, including passwords and PIN codes.
[0490] "Profile Information" refers to details about an athlete, such as their name, biography, statistics, and photograph.
[0491] A "generated response" is a response created by an AI character based on a user's message.
[0492] "Means of notification" refers to the technology or mechanism for informing users of new information, such as push notifications or email.
[0493] "Food and Drinks" means any food or drink recommended by the Competitor.
[0494] "Official Merchandise" refers to cheering goods and related merchandise authorized by an athlete or team.
[0495] This invention is a system that allows users to have one-on-one conversations with an AI character of a specific athlete, and includes functions such as providing real-time updates on game progress and original content, using augmented reality to take and share photos with athletes, purchasing food and drink and official support merchandise, and using an emotion analysis engine to recognize users' emotions and personalize and recommend content based on those emotions. Each element of the system and its function are described below.
[0496] Overall structure
[0497] The system consists of a user's device, a central server, a database, an AI character, an emotion analysis engine, and various software that integrates them. Users access the system using a smartphone application.
[0498] Authentication Process
[0499] The user enters their identification information (ID) and password into the login screen. The information is sent from the terminal to a central server, which then checks it against a database for authentication. This process authenticates the user.
[0500] Player selection and profile information
[0501] Once a user selects a particular athlete, the selected athlete's profile information is retrieved from the database and displayed on the user's device, including the athlete's name, biography, photo, and statistics.
[0502] Interactive features
[0503] Users interact with the AI character of the player they have selected. When the user presses the send button, a message is sent to a central server, which analyzes the message using an emotion analysis engine. Based on the emotional information analyzed by the emotion analysis engine, the AI character generates an appropriate response, which is then displayed on the user's device.
[0504] Match progress notifications and content distribution
[0505] The progress and results of matches are collected in real time by a central server and pushed to users' devices. In addition, personalized sports-related content is recommended and delivered based on the results of user sentiment analysis.
[0506] Augmented reality features
[0507] Users can take photos with athletes using the augmented reality function. By activating the device's camera function, they can take photos with virtual athletes superimposed on real-world scenery. The photos are then uploaded to a central server and a sharing link is generated. These links can then be used to share the photos on social media.
[0508] Product purchase function
[0509] When a user purchases food and drink recommended by an athlete or official support merchandise, the device sends a request to the server to retrieve product information from the database. When the user selects a specific item and submits a purchase request, the server completes the purchase process and arranges for delivery.
[0510] Hardware and software used
[0511] Hardware: Smartphone (iOS or Android)
[0512] Software: Python, Emotion Analysis Engine (EmotionAnalyzer), Content Database (ContentDatabase)
[0513] Server: Cloud service (AWS, Azure, etc.)
[0514] Examples of concrete examples and prompts
[0515] For example, if a user logs in, selects a specific athlete, and sends a message saying, "I'm so happy today!", the emotion analysis engine will analyze the emotion as "joy." As a result, the AI character will generate a response such as, "That's great! I'll do my best in the next game!" This response will then be displayed on the user's chat screen.
[0516] Example prompt sentence:
[0517] I'm really happy today!
[0518] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0519] Step 1:
[0520] The user enters an identification (ID) and password into a login screen on a terminal. The terminal sends this to a central server, which then authenticates the user by checking it against a database. This process authenticates the user. The input is the identification and password, and the output is the authentication result. The process involves querying the database and analyzing the results.
[0521] Step 2:
[0522] When a user selects a specific athlete, the profile information of the selected athlete is retrieved from the database and displayed on the device. The input is the athlete ID, and the output is the athlete's profile information. As part of the process, the server queries the database and returns the results to the device.
[0523] Step 3:
[0524] The user starts a conversation with an AI character. When the user enters a message and presses the send button, the device sends the message to the server. The server analyzes this message using an emotion analysis engine (EmotionAnalyzer). The input is the user's message, and the output is the analyzed emotion. As part of the process, the server calls the emotion analysis engine and analyzes the message.
[0525] Step 4:
[0526] Based on the emotional information analyzed by the emotion analysis engine, the AI character generates an appropriate response. The server sends the generated response to the device, which then displays it to the user. The input is the analyzed emotion, and the output is the generated response. As part of the processing, the AI character's response generation algorithm is executed.
[0527] Step 5:
[0528] The server retrieves match progress and results in real time and pushes them to the user's device. The input is real-time match data, and the output is notification messages. The server retrieves data from an external match data provider and sends it to the user's device as a push notification.
[0529] Step 6:
[0530] Based on the results of the user's emotion analysis, personalized sports-related content is recommended and delivered. The server retrieves content related to the user's emotion from the database and sends it to the device for display. The input is the user's emotion analysis results, and the output is the recommended content. As part of the process, the server queries the content database based on the emotion analysis results to retrieve appropriate content and send it to the user's device.
[0531] Step 7:
[0532] The user takes a photo with the competitor using the augmented reality function, and the device uploads the photo to the server. The server saves the photo, generates a sharing link, and returns it to the device. The input is the AR photo, and the output is the sharing link. As part of the process, the device collects camera data and uploads it to the server, which saves it in a storage service and generates a link.
[0533] Step 8:
[0534] When a user purchases athlete-recommended food and drink or official support merchandise, the terminal sends a request to the server, which retrieves product information from a database. When the user selects a specific item and submits a purchase request, the server processes the purchase and arranges for delivery. The input is the purchase request, and the output is a notification that the purchase has been completed. As part of the process, the server processes the order information, checks inventory, and arranges for delivery.
[0535] In this way, each step works together to create a system that provides users with an advanced and personalized fan engagement experience.
[0536] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0537] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0538] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.
[0539] [Second embodiment]
[0540] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.
[0541] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.
[0542] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0543] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.
[0544] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[0545] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[0546] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[0547] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[0548] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0549] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0550] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0551] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."
[0552] This invention relates to a system that increases fan engagement by allowing users to communicate with AI characters of athletes. This system is realized by the following programs and processes.
[0553] User server connection and authentication
[0554] When a user uses a terminal to access the system, they first go to the login screen. The user enters their ID and password and attempts to log in. The terminal sends the entered authentication information to the server, which then compares the received information with a database to authenticate the user. If authentication is successful, the user proceeds to the main menu.
[0555] Player Selection
[0556] When a user selects the "Select Player" option from the main menu, the device displays a list of players. The user taps on a specific player they want to chat with and sends the player ID to the server. The server retrieves the player's profile information from its database and returns it to the device, which then displays it, allowing the user to view information about that player.
[0557] Start chatting with AI characters
[0558] When a specific player is selected, a chat screen appears and the user can enter a message. When the user presses the send button, the device sends the message to the server, which then relays the message to the AI chatbot. The AI chatbot analyzes the received message and generates a response in the style of the player. The server returns the generated response to the device, which then displays it on the chat screen.
[0559] Notification of match results
[0560] While the match is in progress, the server retrieves the match results in real time. When the server retrieves new match results, it sends them to the user's device via push notification. The device receives the notification and displays the match results to the user.
[0561] Original content distribution
[0562] When a user selects the "Original Content" option from the main menu, the device requests a content list from the server. The server retrieves the list of original content from the content database and returns it to the device. The device displays the list, and when the user selects a specific content, the server provides that content to the device in streaming format.
[0563] AR photo taking and sharing
[0564] When a user selects the "AR Photo Shoot" option, the device's camera activates and allows the user to take a photo with the player using the AR function. Once the user has finished taking the photo, the device uploads the photo data to the server. The server saves the photo and generates a sharing link that is returned to the device. The user can then use the link to share the photo on social media, etc.
[0565] Purchase recommended gourmet foods and goods
[0566] When a user selects the "Recommended Food & Goods" option from the menu, the device sends a request to the server, which retrieves recommended food and goods information from a database and returns it to the device. The device displays the list, and when the user selects a specific item, a purchase request is sent to the server. The server completes the purchase process and arranges for delivery.
[0567] Specific examples
[0568] For example, a user logs in, selects a specific athlete (Athlete A), and sends a message saying, "Please tell us your thoughts before the game." The server receives the message and passes it to an AI chatbot, which then generates a response such as, "My goal this season is to win!" This response is displayed on the user's chat screen. If a game is in progress, real-time game results are sent to the user's device via push notification. The user can then view original content from the main menu or take photos with the athlete using the AR function.
[0569] In this way, the system allows users to enjoy private communication with athletes while receiving match results and original content in real time. Furthermore, by utilizing the AR and merchandise purchasing functions, it is possible to increase engagement with fans and promote contributions to the local economy.
[0570] The processing flow will be explained below.
[0571] Program processing steps
[0572] User server connection and authentication
[0573] Step 1:
[0574] The user launches the Hawks Connection app and goes to the login screen.
[0575] Step 2:
[0576] The user enters their ID and password on the login screen and clicks the login button.
[0577] Step 3:
[0578] The device sends the ID and password authentication information to the server.
[0579] Step 4:
[0580] The server compares the received ID and password with the database and performs authentication.
[0581] Step 5:
[0582] If the authentication is successful, the server returns a message indicating successful authentication to the terminal, and the terminal displays the main menu.
[0583] Player Selection
[0584] Step 1:
[0585] The user selects the "Player Selection" option from the main menu.
[0586] Step 2:
[0587] The device will display a player list screen, and the user can tap on the player they want to chat with.
[0588] Step 3:
[0589] The device sends the player ID to the server.
[0590] Step 4:
[0591] The server retrieves the player's profile information from the database and returns it to the terminal.
[0592] Step 5:
[0593] The device displays the received player profile information to the user.
[0594] Start chatting with AI characters
[0595] Step 1:
[0596] The user types a message in the chat input field and presses the send button.
[0597] Step 2:
[0598] The device sends the user's message to the server.
[0599] Step 3:
[0600] The server passes the message to the AI chatbot.
[0601] Step 4:
[0602] The AI chatbot analyzes the messages it receives and generates responses in the style of a player.
[0603] Step 5:
[0604] The server returns the generated response to the terminal, which displays the response on the chat screen.
[0605] Notification of match results
[0606] Step 1:
[0607] The server retrieves the match results in real time.
[0608] Step 2:
[0609] The server that obtains the match results will send a push notification to the user's device.
[0610] Step 3:
[0611] The device receives the notification and displays the match results to the user.
[0612] Original content distribution
[0613] Step 1:
[0614] The user selects the "Original Content" option from the main menu.
[0615] Step 2:
[0616] The terminal requests the server to acquire a content list.
[0617] Step 3:
[0618] The server obtains a list of original contents from the content database and returns it to the terminal.
[0619] Step 4:
[0620] The device displays a content list, and the user selects a specific content.
[0621] Step 5:
[0622] The terminal requests the data of the selected content from the server, and the server streams the data.
[0623] AR photo taking and sharing
[0624] Step 1:
[0625] The user selects the "Take AR Photo" option from the menu.
[0626] Step 2:
[0627] The device's camera function will be activated, and the AR function will be used to take photos with the player.
[0628] Step 3:
[0629] Once the user has taken a photo, the device uploads the photo data to the server.
[0630] Step 4:
[0631] The server stores the photo data, generates a sharing link, and returns it to the device.
[0632] Step 5:
[0633] Users can use the link to share photos on social media etc.
[0634] Purchase recommended gourmet foods and goods
[0635] Step 1:
[0636] The user selects the "Recommended Food & Goods" option from the main menu.
[0637] Step 2:
[0638] The terminal sends a request to the server, which retrieves information from the database.
[0639] Step 3:
[0640] The server returns a list of recommended gourmet foods and goods to the device.
[0641] Step 4:
[0642] The device displays a list and the user selects a specific item.
[0643] Step 5:
[0644] The terminal sends a purchase request to the server, and the server carries out the purchase procedure.
[0645] Step 6:
[0646] The server handles purchase confirmation and shipping arrangements.
[0647] Example 1
[0648] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0649] Conventional sports fan engagement systems are limited to providing information about athletes and distributing content, and lack the means for fans to interact one-on-one with athletes, receive real-time game results, take photos using augmented reality features, or purchase recommended meals or official support merchandise. This makes it difficult to increase user satisfaction and engagement.
[0650] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0651] In this invention, the server includes a means for a user to chat one-on-one with a specific avatar, a means for providing game results and content in real time, a means for a user to take and share photos with the avatar using augmented reality functions, a means for a user to purchase recommended meals and official support merchandise, a means for a user to input login authentication information and be authenticated by the server, a means for providing information about an avatar selected by the user, a means for the avatar to generate a response to the user's message, and a means for displaying the generated response to the user. This allows users to enjoy multifaceted engagement with athletes, improving satisfaction with the system.
[0652] "User" refers to any individual or organization that uses this system.
[0653] An "avatar" is a virtual character based on a particular athlete that is intended to interact one-on-one with the user.
[0654] "Server" refers to the computer system used to manage and provide user authentication information, avatar data, match results, and other content.
[0655] "Database" refers to the system for storing and managing data used in the system, such as athlete profile information, match results, and content.
[0656] "Response" refers to an answer or reaction generated by an avatar in response to a message from a user.
[0657] "Game Results" refers to the results data of ongoing or completed sports games.
[0658] "Content" refers to media information provided to users, such as original videos, articles, images, etc.
[0659] "Augmented reality (AR)" refers to a technology that uses a device's camera to overlay virtual objects onto real-world images.
[0660] "Recommended Meals" means any diet-related product or service recommended by an Athlete or the System to a User.
[0661] "Official Support Merchandise" refers to official goods and merchandise related to an athlete's team or brand.
[0662] "Login Credentials" refers to the ID and password combination required for a User to access the System.
[0663] "Authentication" refers to the process by which the server verifies that the login credentials provided by the user are accurate.
[0664] This invention provides a system that increases fan engagement by allowing users to communicate with AI characters of athletes. This system is realized through the following specific hardware and software configuration and processing.
[0665] First, the user accesses the system using a device (smartphone, tablet, PC, etc.) and goes to the login screen. The user enters their ID and password and attempts to log in. The device sends the entered authentication information to the server. The server verifies the received information against a database (e.g., MySQL) and, if authentication is successful, proceeds to the main menu.
[0666] When a user selects the "Player Selection" option from the main menu, the device requests a list of players from the server. The server retrieves the list of players from the database and sends it to the device. The user can then tap or click to select a specific player and view their profile information.
[0667] Once a player is selected, the user can begin chatting with the AI character. The user types a message and presses the send button. The device sends the message to the server, which then passes it to an AI chatbot (such as GPT-3, a generative AI model). The AI chatbot analyzes the message and generates a response in the style of the player. The server then sends the response back to the device and displays it on the user's chat screen.
[0668] Additionally, while the match is in progress, the server obtains match results in real time via external APIs such as sports data APIs. When new match results are available, the server sends them to the user's device via push notification, and the device receives the notification and displays it to the user.
[0669] Furthermore, if the user selects the "original content" option, the terminal will request a content list from the server. The server will retrieve the content data from the database and send it to the terminal. When the user selects a specific content, the server will provide the content in streaming format.
[0670] When a user selects "AR Photo Shooting" in the AR photo option, the device activates the camera function and AR library (e.g., ARKit) to take a photo with the player's virtual character. After taking the photo, the device uploads the photo data to the server, which saves the photo and generates a sharing link that is returned to the device. The user can then use this link to share the photo on social media, etc.
[0671] Finally, when the user selects the "Recommended Food & Goods" option, the device sends a request to the server, which retrieves information about recommended meals and official support products from the database and returns it to the device. When the user selects a specific item, a purchase request is sent to the server, which handles the purchase process and arranges delivery.
[0672] Prompt Sentence Examples
[0673] Please tell us your thoughts before the match
[0674] What are your goals for this season?
[0675] What do you think about the next match?
[0676] In this way, the system allows users to enjoy private communication with athletes while receiving match results and original content in real time. Furthermore, by utilizing the AR and merchandise purchasing functions, it is possible to increase engagement with fans and promote contributions to the local economy.
[0677] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0678] Step 1:
[0679] The user uses a terminal to go to the login screen and enters their ID and password. Input: User's ID and password. The terminal sends this authentication information to the server. The server compares the received information with the database for authentication. If authentication is successful, Output: An instruction to proceed to the main menu is returned. Specific operation: The server uses an SQL query to search the database for authentication information, and returns success if it matches, or an error message if it does not match.
[0680] Step 2:
[0681] The user selects the "Select Player" option from the main menu. Input: The user requests to select a player. The device requests a list of players from the server. The server retrieves the list of players from the database and returns it to the device. Output: The list of players is displayed on the device. Specific behavior: The server retrieves player information using an SQL query and returns it to the device in JSON format.
[0682] Step 3:
[0683] The user selects a specific player and starts chatting with that player. Input: The user's player selection and message. When the user enters a message and presses the send button, the device sends the message to the server. The server passes the message to the AI chatbot, and output: the response generated by the chatbot. Specific operation: The server invokes an AI model (e.g., GPT-3) to analyze the message and generate a response. The response is returned to the device in JSON format and displayed on the chat screen.
[0684] Step 4:
[0685] While the match is in progress, the server retrieves match results in real time from an external API (for example, a sports data API). Input: Updated data on the match status. If there are new match results, the server sends them to the user's device as a push notification. Output: Push notification of match results. Specific operation: The server periodically calls the API and notifies the user via WebSocket or Firebase Cloud Messaging if there is new data.
[0686] Step 5:
[0687] The user selects the "Original Content" option from the main menu. Input: The user requests content. The device sends a request to the server, which retrieves the content data from the database and sends it to the device. Output: The content list is displayed on the device. When the user selects a specific content, the server provides it in streaming format. Specific behavior: The server provides the media file in HLS format, and the device plays it in the appropriate player.
[0688] Step 6:
[0689] When a user selects the "AR Photo Shoot" option, the device activates the camera function and AR library (e.g., ARKit). Input: User's photo request. A photo is taken with the player's virtual character. After the photo is taken, the device uploads the photo data to the server, which saves the photo and generates a sharing link that is returned to the device. Output: Shared link. Specific operation: A photo is taken using the device's camera and AR library, and uploaded to the server via REST API. The server generates a link and returns it.
[0690] Step 7:
[0691] When the user selects the "Recommended Food & Goods" option, the device sends a request to the server. Input: User's item selection request. The server retrieves information about recommended meals and official support products from the database and returns it to the device. Output: A product list is displayed on the device. When the user selects a specific item, a purchase request is sent to the server, which completes the purchase and arranges for delivery. Specific operation: The server retrieves the product information, completes the purchase through a payment gateway (e.g., Stripe), and notifies the user of the order information.
[0692] (Application example 1)
[0693] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0694] Today's sports fans want to interact more closely with their favorite athletes, get real-time game information, and watch original content. However, conventional systems struggle to provide these services comprehensively, limiting the means to increase fan engagement. This has created a growing need for systems that provide virtual communication with athletes, real-time game information notifications, AR photography, original content distribution, and the ability to purchase recommended products.
[0695] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0696] In this invention, the server includes: a means for enabling a user to chat one-on-one with an AI character of a specific athlete; a means for providing real-time game results and original video content; a means for a user to take and share photos with the athlete using an AR function; a means for a user to purchase food and drink recommended by the athlete and official support merchandise; a means for a user to log in from their device and select a specific athlete and generate and display athlete-style responses using a generative AI model; a means for obtaining game progress in real time and notifying the user; and a means for a user to view original content via their device. This enables deep engagement with athletes, allowing fans to enjoy game information and original content in real time, and further increasing satisfaction through the AR function and recommended merchandise.
[0697] An "athlete" is a person who competes in a particular sport and is virtually reproduced as an AI character within the system.
[0698] "One-on-one chat" means that users can engage in individual two-way messaging with an AI character of a specific athlete.
[0699] "Live Match Results" means the latest game status and results provided to a User in real time for ongoing or completed sports matches.
[0700] "Original video content" refers to independently created video data about athletes and related events that is distributed to users.
[0701] The "AR function" uses augmented reality technology to allow users to synthesize and photograph virtual images of athletes in real-world scenes.
[0702] "Athlete-recommended foods, beverages, and official support products" refers to foods and beverages recommended by athletes and products officially approved for support, which can be purchased by users.
[0703] "Generative AI model" refers to artificial intelligence technology that generates athlete-style responses based on a user's message.
[0704] "Get in real time" means that the progress of the match is continuously monitored and the user is notified immediately.
[0705] A "terminal" is a device that a user uses to access and operate the system, such as a smartphone or tablet.
[0706] This invention relates to a system that increases fan engagement by allowing users to communicate with AI characters of athletes. This system is realized by the following programs and processes.
[0707] First, a user must log in to access the system using a terminal. The user enters their ID and password on the login screen and sends the authentication information to the server. The server authenticates the received authentication information by checking it against a database, and if authentication is successful, the user can proceed to the main menu. The hardware used is a smartphone, and the software used is a back-end server and database management system.
[0708] Next, the user selects the "Select Athlete" option from the main menu, and the device displays a list of athletes. The user taps on the specific athlete they want to chat with and sends the athlete ID to the server. The server retrieves the athlete's profile information from the database and returns it to the device, which then displays it, allowing the user to view information about the athlete. The hardware used is a smartphone, and the software used is a back-end server and database management system.
[0709] Once a specific athlete is selected, a chat screen appears, allowing the user to enter a message. When the user presses the send button, the device sends the message to the server, which uses the generative AI model to analyze the message and generate a response in the style of the athlete. This response is returned from the server to the device, which displays it on the chat screen. The hardware used is a smartphone, and the software used is the generative AI model and a back-end server.
[0710] Also, while a match is in progress, the server obtains the match status in real time and sends it to the user's device via push notification. The device receives the notification and displays the match results to the user. The hardware used is a smartphone, and the software used is a server with real-time data acquisition capabilities.
[0711] Furthermore, when the user selects the "Original Content" option from the main menu, the device requests a content list from the server. The server retrieves a list of original video content from the content database and returns it to the device. The device displays the list, and when the user selects specific content, the server provides that content to the device in streaming format. The hardware used is a smartphone, and the software used is a streaming server.
[0712] When a user selects the "AR Photo Shoot" option, the device's camera function is activated, allowing the user to take a photo with the athlete using AR functionality. Once the user has finished taking the photo, the device uploads the photo data to the server. The server saves the photo, generates a sharing link, and returns it to the device. The user can then use the link to share the photo on social media, etc. The hardware used is a smartphone (with a camera function), and the software used is an application that uses AR technology and a back-end server.
[0713] For example, a user can generate an athlete-like response using a prompt like the following: "Tell us your thoughts before the game," and the generative AI model can generate a response such as "My goal this season is to win!", which will be displayed in the user's chat screen.
[0714] In this way, a system will be realized that allows for deep engagement with athletes, allows fans to enjoy real-time game information and original content, and further enhances satisfaction through AR functions and recommended products.
[0715] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0716] Step 1:
[0717] A user accesses the system using a terminal. The user enters their ID and password on the login screen and sends the input data to the terminal. The terminal sends the authentication information to the server, which then collates it with a database for authentication. The server returns the authentication result to the terminal, and the terminal displays the main menu if authentication is successful, or an error message if authentication is unsuccessful.
[0718] Input: User ID, Password
[0719] Data processing: Sending authentication information and checking the database
[0720] Output: Authentication result (success / failure)
[0721] Step 2:
[0722] The user selects the "Select Player" option from the main menu. The device sends a request for a player list to the server, which retrieves the player list from the database and returns it to the device. The device displays the player list, and when the user taps on a specific athlete, it sends the athlete ID to the server. The server retrieves the player's profile information and returns it to the device, which displays it.
[0723] Input: Player selection request, player ID
[0724] Data processing: Acquisition of player list and profile information
[0725] Output: Player list, player profile information
[0726] Step 3:
[0727] When the user selects a player, a chat screen is displayed. When the user enters a message and presses the send button, the device sends the message to the server. The server uses a generative AI model to analyze the message, generate an athlete-like response, and return the response to the device. The device then displays the athlete-like response on the chat screen.
[0728] Input: User message
[0729] Data processing: Message analysis and response generation using generative AI models
[0730] Output: Athlete-like response
[0731] Step 4:
[0732] When a match is in progress, the server will continue to obtain the match status in real time. Every time the server detects a new match status, it will push the match result to the user's device. The device will receive the notification and display the match result to the user.
[0733] Input: Real-time match status data
[0734] Data processing: monitoring the match situation
[0735] Output: Match results via push notification
[0736] Step 5:
[0737] When a user selects the "Original Content" option from the main menu, the device requests a content list from the server. The server retrieves a list of original video content from the database and returns it to the device. The device displays the list, and when the user selects a specific content, the server provides that content to the device in streaming format.
[0738] Input: Original Content Request
[0739] Data processing: Acquisition of content list and content data
[0740] Output: Original content list, streaming content
[0741] Step 6:
[0742] When a user selects the "AR Photo Shoot" option, the device's camera activates and takes a photo of the athlete using the AR function. Once the user has finished taking the photo, the device uploads the photo data to the server. The server saves the photo and generates a sharing link that is returned to the device. The user can then use the link to share the photo on social media, etc.
[0743] Input: Photo request, photo data
[0744] Data processing: Upload and save photo data, generate share links
[0745] Output: Shared link
[0746] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[0747] This invention achieves a higher level of fan engagement by combining an emotion engine with a system in which users communicate with AI athlete characters. This system is realized by the following programs and processes.
[0748] User server connection and authentication
[0749] When a user uses a terminal to access the system, they first go to the login screen. The user enters their ID and password and attempts to log in. The terminal sends the entered authentication information to the server, which then compares the received information with a database to authenticate the user. If authentication is successful, the user proceeds to the main menu.
[0750] Player Selection
[0751] When a user selects the "Select Player" option from the main menu, the device displays a list of players and the user taps on a specific player they want to chat with. The device sends the player's ID to the server, which retrieves the player's profile information from its database and returns it to the device, which displays it and allows the user to view information about that player.
[0752] Start chatting with AI characters
[0753] Once a specific player is selected, a chat screen appears and the user can enter a message. When the user presses the send button, the device sends the message to the server, which then relays the message to the AI chatbot. The AI chatbot analyzes the received message and also uses an emotion engine to generate a player-like response. The emotion engine analyzes the emotion from the user's message and generates an optimal response based on that emotion. The server returns the generated response to the device, which then displays it on the chat screen.
[0754] The role of the emotional engine
[0755] The emotion engine analyzes the messages and actions entered by the user and recognizes their emotions. For example, if a user enters "I had so much fun today!", the emotion engine recognizes the user's emotion as "joy." Based on this information, the AI chatbot generates a response that corresponds to joy, such as "That's great! Please come again!"
[0756] Notification of match results
[0757] As the match progresses, the server retrieves the match results in real time. When the server receives new match results, it sends them to the user's device via push notification. The device receives the notification and displays the match results to the user. The emotion engine analyzes the user's emotions and can optimize the response to the match results.
[0758] Original content distribution
[0759] When a user selects the "Original Content" option from the main menu, the device requests a content list from the server. The server retrieves the list of original content from the content database and returns it to the device. The device displays the list, and when the user selects a specific content, the server provides that content to the device in streaming format. The emotion engine can also recommend appropriate content based on the user's emotions.
[0760] AR photo taking and sharing
[0761] When a user selects the "AR Photo Shoot" option, the device's camera activates and allows the user to take a photo with the player using the AR function. Once the user has finished taking the photo, the device uploads the photo data to the server. The server saves the photo and generates a sharing link that is returned to the device. The user can then use the link to share the photo on social media, etc.
[0762] Purchase recommended gourmet foods and goods
[0763] When a user selects the "Recommended Food and Goods" option from the menu, the device sends a request to the server, which retrieves recommended food and goods information from a database and returns it to the device. The device displays a list, and when the user selects a specific item, a purchase request is sent to the server. The server completes the purchase and arranges for delivery. The emotion engine can present recommended items taking into account the user's emotional state.
[0764] Specific examples
[0765] For example, suppose a user logs in, selects a specific athlete (Athlete A), and sends a message on the chat screen saying, "I'm so happy today!" The server receives this message, and the emotion engine analyzes the emotion of "joy." Based on this information, the AI chatbot generates a response such as, "That's great! I'll do my best in the next game!" This response is then displayed on the user's chat screen. If a game is in progress, real-time game results are sent to the user's device via push notification. Users can also watch original content from the main menu and take photos with players using the AR function.
[0766] With the introduction of the emotion engine, the system can provide flexible and personalized responses based on user emotions, further increasing engagement, improving the fan experience and driving more visitors to stadiums and related facilities.
[0767] The processing flow will be explained below.
[0768] Program processing steps
[0769] User server connection and authentication
[0770] Step 1:
[0771] The user launches the Hawks Connection app and goes to the login screen.
[0772] Step 2:
[0773] The user enters their ID and password on the login screen and clicks the login button.
[0774] Step 3:
[0775] The device sends the ID and password authentication information to the server.
[0776] Step 4:
[0777] The server compares the received ID and password with the database and performs authentication.
[0778] Step 5:
[0779] If the authentication is successful, the server returns a message indicating successful authentication to the terminal, and the terminal displays the main menu.
[0780] Player Selection
[0781] Step 1:
[0782] The user selects the "Player Selection" option from the main menu.
[0783] Step 2:
[0784] The device will display a player list screen, and the user can tap on the player they want to chat with.
[0785] Step 3:
[0786] The device sends the player ID to the server.
[0787] Step 4:
[0788] The server retrieves the player's profile information from the database and returns it to the terminal.
[0789] Step 5:
[0790] The device displays the received player profile information to the user.
[0791] Start chatting with AI characters
[0792] Step 1:
[0793] The user types a message in the chat input field and presses the send button.
[0794] Step 2:
[0795] The device sends the user's message to the server.
[0796] Step 3:
[0797] The server sends the message to the emotion engine, which analyzes the user's emotions.
[0798] Step 4:
[0799] The server passes the analysis results to the AI chatbot.
[0800] Step 5:
[0801] The AI chatbot generates appropriate responses based on the results of emotion analysis.
[0802] Step 6:
[0803] The server returns the generated response to the terminal, which displays the response on the chat screen.
[0804] Notification of match results
[0805] Step 1:
[0806] The server retrieves the match results in real time.
[0807] Step 2:
[0808] The server sends the match results to the user's device via push notification.
[0809] Step 3:
[0810] The device receives the notification and displays the match results to the user.
[0811] Original content distribution
[0812] Step 1:
[0813] The user selects the "Original Content" option from the main menu.
[0814] Step 2:
[0815] The terminal requests the server to acquire a content list.
[0816] Step 3:
[0817] The server obtains a list of original contents from the content database and returns it to the terminal.
[0818] Step 4:
[0819] The device displays a content list, and the user selects a specific content.
[0820] Step 5:
[0821] The terminal requests the data of the selected content from the server, and the server streams the data.
[0822] AR photo taking and sharing
[0823] Step 1:
[0824] The user selects the "Take AR Photo" option from the menu.
[0825] Step 2:
[0826] The device's camera function will be activated, and the AR function will be used to take photos with the player.
[0827] Step 3:
[0828] Once the user has taken a photo, the device uploads the photo data to the server.
[0829] Step 4:
[0830] The server stores the photo data, generates a sharing link, and returns it to the device.
[0831] Step 5:
[0832] Users can use the link to share photos on social media etc.
[0833] Purchase recommended gourmet foods and goods
[0834] Step 1:
[0835] The user selects the "Recommended Food & Goods" option from the main menu.
[0836] Step 2:
[0837] The terminal sends a request to the server, which retrieves information from the database.
[0838] Step 3:
[0839] The server returns a list of recommended gourmet foods and goods to the device.
[0840] Step 4:
[0841] The device displays a list and the user selects a specific item.
[0842] Step 5:
[0843] The terminal sends a purchase request to the server, and the server carries out the purchase procedure.
[0844] Step 6:
[0845] The server handles purchase confirmation and shipping arrangements.
[0846] Use of emotion engine
[0847] Step 1:
[0848] When a user sends a message, the server receives the message and sends it to the emotion engine.
[0849] Step 2:
[0850] The emotion engine analyzes messages and recognizes the user's emotions.
[0851] Step 3:
[0852] The emotion engine returns the recognized emotion to the server.
[0853] Step 4:
[0854] The server communicates the emotion analysis results to the AI chatbot.
[0855] Step 5:
[0856] The AI chatbot generates appropriate responses based on the results of sentiment analysis.
[0857] Step 6:
[0858] The server returns the generated response to the terminal, which displays the response to the user.
[0859] Specific examples
[0860] For example, suppose a user logs in, selects a specific athlete (Athlete A), and sends a message on the chat screen saying, "I'm so happy today!" The server receives this message, and the emotion engine analyzes it for the emotion of "joy." Based on this information, the AI chatbot generates a response such as, "That's great! I'll do my best in the next game!" This response is then displayed on the user's chat screen. While a game is in progress, real-time game results are sent to the user's device via push notification. Users can also watch original content from the main menu and take photos with players using the AR function. With the introduction of the emotion engine, the system can provide flexible and personalized responses based on the user's emotions, further increasing engagement. This improves the fan experience and increases visitor numbers to stadiums and related facilities.
[0861] Example 2
[0862] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0863] The problem this invention aims to solve is to realize more natural and emotional dialogue in a system that enhances fan engagement between users and athletes, and to respond to users' real-time and individual needs. Conventional systems have not been able to provide responses that reflect the user's emotions, and have not provided sufficient real-time game results or original content. Furthermore, the user experience, such as taking photos using AR functions or purchasing recommended gourmet food or merchandise, is limited. It is necessary to solve these problems and improve user satisfaction.
[0864] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[0865] In this invention, the server includes means for enabling a user to chat one-on-one with an AI character of a specific athlete, means for authenticating the ID and password entered by the user on the login screen, means for providing profile information of the athlete selected by the user, means for the AI character to receive the user's message, analyze the emotion using an emotion engine, and generate a response based on the emotion, means for displaying the generated response to the user, means for providing real-time game results and original content, means for the user to take and share photos with the athlete using an AR function, means for the user to purchase gourmet food recommended by the athlete and official cheering merchandise, means for the emotion engine to analyze the user's message and recognize the emotion, means for the AI chatbot to generate an optimal response based on the recognized emotion, and means for the server to obtain game results in real time while the game is in progress and send them to the device via push notification. This allows the user to receive personalized responses based on their emotion, providing real-time information and a diverse entertainment experience.
[0866] An "AI athlete character" is a virtual character created by artificial intelligence that mimics an athlete and can chat one-on-one with users.
[0867] "Users" refer to the people who use this system and communicate with the AI athlete characters within the system.
[0868] An "emotion engine" is a software component that analyzes emotions from messages entered by users and generates responses based on those emotions.
[0869] An "AI chatbot" is an artificial intelligence program that receives messages from users, analyzes them, and generates appropriate responses.
[0870] An "ID" is identification information used to identify a user, and is usually composed of a unique string of characters or numbers.
[0871] A "password" is a secret string of characters used in combination with an ID to authenticate a user.
[0872] "Authentication information" refers to the combination of ID and password that a user enters when logging in.
[0873] A "database" is a collection of electronically managed data that stores user information, athlete profile information, and the like.
[0874] "Main Menu" refers to the screen that serves as the entrance to the main functions of the system, which the user can access after successful authentication.
[0875] "Profile information" is detailed data about a particular athlete, including the athlete's background, performance, characteristics, etc.
[0876] "Real-time" refers to data being generated or transmitted instantly, without delay.
[0877] "Match Results Update" is a means of providing information to users quickly about the results of ongoing or completed matches.
[0878] "Original content" refers to digital content such as original video, audio, and text that the system provides to users.
[0879] The "AR function" is an augmented reality technology that displays digital information overlaid on real-world scenery.
[0880] "Means for taking a photo" refers to a method by which a user generates image data using the camera function of the device.
[0881] "Sharing methods" are the ways in which users can share photos they take or content they generate with other users online.
[0882] "Gourmet" refers to high-quality food and beverages endorsed by athletes.
[0883] "Official cheering goods" refers to cheering items and accessories officially approved by athletes or organizations.
[0884] "Means of purchase" refers to the mechanism by which users order and pay for gourmet food and official support goods through the system.
[0885] "Push notification" is a method by which a server sends important information to a user's device in real time.
[0886] The system of the present invention is an advanced fan engagement system that combines multiple technologies to enable users to communicate with AI athlete characters. The system includes hardware and software for implementing specific methods.
[0887] System Configuration
[0888] The system mainly consists of the following components:
[0889] (Server): Database server, AI chatbot, emotion engine, push notification system
[0890] (Device): A device (smartphone, tablet, PC, etc.) that accepts user operations and displays information accordingly.
[0891] (User): The person who operates the system and communicates with the athlete AI character.
[0892] Overview of the main technical components and processes
[0893] User authentication and login
[0894] When a user accesses the system using a terminal, they first go to a login screen. The user enters their ID and password, and if authentication is successful, they proceed to the main menu. Here, databases such as MySQL and PostgreSQL are used.
[0895] Player selection and profile display
[0896] The user selects the "Player Selection" option from the main menu and chooses a specific player from the displayed player list. The device sends the player ID to the server, which retrieves the player's profile information from the database and returns it to the device, allowing the user to view the player's details.
[0897] Chat with AI characters
[0898] When a user wants to chat with a selected player, they enter a message on the chat screen and press the send button. The device sends the message to the server, which then forwards it to the AI chatbot. The AI chatbot uses a generative AI model (e.g., GPT-4) to analyze the message's sentiment with an emotion engine. Based on this analysis, it generates an optimal response and returns it to the device. The device then displays the generated response on the chat screen.
[0899] Notification of match results
[0900] While the match is in progress, the server retrieves the match results in real time, and if important results are obtained, they are sent to the user's device as push notifications. This notification function uses push notification services such as Firebase Cloud Messaging (FCM).
[0901] Original content distribution
[0902] When a user selects the "Original Content" option, the terminal requests a content list from the server, which retrieves the list from the content database and returns it to the terminal, providing the content selected by the user in streaming format.
[0903] AR photo taking and sharing
[0904] When a user selects the "AR Photo Shoot" option, the device's camera activates and the user can take a photo with the player using the AR function. After taking the photo, the device uploads the photo data to the server, which then generates a sharing link and returns it to the device. The user can then share the link on social media, etc.
[0905] Purchase recommended gourmet foods and goods
[0906] When a user selects the "Recommended Food and Goods" option, the device sends a request to the server, which retrieves information about recommended foods and goods from the database and returns it to the device. When the user selects a specific item and sends a purchase request to the server, the server completes the purchase process and arranges for delivery.
[0907] Specific examples
[0908] For example, the following shows the process flow when a user logs in, selects a specific athlete (Athlete A), and sends the message "I'm so happy today!" on the chat screen. The server receives this message, and the emotion engine analyzes the "joy." Based on this information, the AI chatbot generates a response such as "That's great! I'll do my best in the next game!" This response is displayed on the user's chat screen. Additionally, if a game is in progress, real-time game results are sent to the user's device via push notification. Furthermore, users can view original content from the main menu and take photos with the players using the AR function.
[0909] Prompt Sentence Examples
[0910] "I want to send a message to a specific athlete (Athlete A) and get an emotional response. For example, if I send a message saying, 'I'm so happy today!' I want to generate an appropriate reply."
[0911] By implementing this invention, users can receive personalized responses based on their emotions, and real-time information provision and diverse entertainment experiences are possible.
[0912] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0913] Step 1:
[0914] The user boots up using a terminal and accesses the system login screen.
[0915] Step 2:
[0916] The user enters their ID and password into the login screen. This information is sent to the server by the terminal. The input data is sent to the server in the form of "user ID" and "password."
[0917] Step 3:
[0918] The server checks the received ID and password against a database containing pre-registered user information. The result of the check determines whether authentication was successful.
[0919] Step 4:
[0920] The server sends the authentication result to the terminal. If the authentication is successful, a success message is sent along with information on how to access the main menu. If the authentication fails, an authentication error message is sent.
[0921] Step 5:
[0922] Based on the authentication result received by the device from the server, if authentication is successful, the device displays the main menu screen, where the user can select their next action.
[0923] Step 6:
[0924] The user selects the "Select Player" option from the main menu. A request for a player list is sent from the terminal to the server.
[0925] Step 7:
[0926] The server retrieves the player list from the database and returns the data to the device, including player names and profile photos.
[0927] Step 8:
[0928] The terminal displays the player list received from the server to the user, who then selects a specific player from the list with whom he or she wants to chat.
[0929] Step 9:
[0930] When the user selects a particular player, the player's ID is sent by the device to the server, which retrieves the player's details from the database and returns them to the device.
[0931] Step 10:
[0932] The device displays the detailed player profile received from the server to the user, and transitions to a screen where the user can start chatting with the player.
[0933] Step 11:
[0934] The user enters a message on the chat screen and presses the send button, which sends the message from the device to the server.
[0935] Step 12:
[0936] The server forwards the received message to the AI chatbot, which then analyzes the message using a generative AI model (e.g., GPT-4).
[0937] Step 13:
[0938] The AI chatbot analyzes the content of the message and uses an emotion engine to recognize emotions. Emotional analysis data is obtained in the form of "happiness" or "sadness," etc.
[0939] Step 14:
[0940] Based on the analysis results of the emotion engine, the AI chatbot generates a response message. For example, if the emotion of "joy" is recognized, the response message generated will be "That's great!"
[0941] Step 15:
[0942] The server sends the generated response message to the terminal.
[0943] Step 16:
[0944] The terminal displays the response message on the chat screen so that the user can check it.
[0945] Step 17:
[0946] While the match is in progress, the server retrieves the match results in real time, for example, by using an API to retrieve the match status data.
[0947] Step 18:
[0948] When the server obtains new match results, it sends them to the user's device via push notification.
[0949] Step 19:
[0950] The device receives the notification and displays the match results to the user, while the emotion engine analyzes the user's reaction and provides appropriate feedback.
[0951] Step 20:
[0952] If the user selects the "original content" option, the terminal requests a content list from the server.
[0953] Step 20:
[0954] The server retrieves a list of original content from the content database and returns it to the device. The retrieved data includes video thumbnails and titles.
[0955] Step 21:
[0956] The terminal displays the received list to the user, allowing the user to select content.
[0957] Step 22:
[0958] Once the user selects the content they wish to view, the server provides that content in streaming format.
[0959] Step 23:
[0960] The terminal receives the streaming data, allowing the user to view the content.
[0961] Step 24:
[0962] When a user selects the "AR Photo Shoot" option, the device's camera function is activated, enabling the AR function and allowing the user to take photos with the players.
[0963] Step 25:
[0964] Once the user has taken a photo, the device uploads the photo data to the server.
[0965] Step 26:
[0966] The server stores the uploaded photos and generates a sharing link that is returned to the device.
[0967] Step 27:
[0968] The device displays the received link information to the user, who can then use the link to share the photo on social media platforms.
[0969] Step 28:
[0970] The user selects the "Recommended Food and Goods" option. The device sends a request to the server, which retrieves information about recommended foods and goods from the database and returns it to the device.
[0971] Step 29:
[0972] The terminal displays the received list to the user, allowing the user to select a particular item.
[0973] Step 30:
[0974] Once the user selects a particular item, a purchase request is sent from the terminal to the server, containing user information and details of the selected item.
[0975] Step 31:
[0976] The server processes the purchase request, completes the purchase through the payment system, and then arranges for delivery.
[0977] Step 32:
[0978] The emotion engine analyzes the user's emotional state and recommends appropriate items based on the state. For example, if the user is in a "joy" state, it will recommend related fun goods.
[0979] Step 33:
[0980] The recommended items will be displayed on the device, allowing the user to re-initiate the purchase process.
[0981] The above are the specific processing steps of this system.
[0982] (Application example 2)
[0983] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0984] Traditional methods of interaction between athletes and fans make it difficult to respond flexibly to fans' emotions, and the provision of personalized content is limited. Furthermore, notifications of game results and recommendations of related content are not optimized to take user emotions into account. This situation has led to challenges in improving fan engagement and deepening the fan experience.
[0985] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: a means for allowing a user to have a one-on-one conversation with an AI character of a specific athlete; a means for providing real-time game progress updates and unique content; a means for a user to take and share photos with the athlete using an augmented reality function; a means for a user to purchase athlete-recommended food and beverages and official support merchandise; a means for recognizing a user's emotions using an emotion analysis engine and personalizing and recommending content based on the emotions; a means for authenticating identification information and a password entered by the user on the login screen; a means for providing profile information of the athlete selected by the user; a means for recommending and delivering personalized sports-related content based on the user's emotions; a means for an AI character to generate a response to a user's message; a means for displaying the generated response; and a means for obtaining game results in real time and generating and notifying a response based on the user's emotions. This makes it possible to provide personalized content based on the user's emotions, improving fan engagement and deepening the fan experience.
[0986] An "AI character of a specific athlete" is a virtual character with artificial intelligence created to imitate a specific athlete, and which communicates with users.
[0987] "User" refers to an individual, fan, or user of this system.
[0988] "Means for dialogue" means a mechanism that allows users to exchange messages with the AI character of a specific athlete and for them to respond to each other.
[0989] "Match progress updates" refers to information that provides the progress and results of a match in real time.
[0990] "Original Content" refers to videos, articles, interviews, behind-the-scenes footage, and other information that is specifically created and hosted by the System.
[0991] "Means of providing information in real time" refers to technologies and mechanisms that deliver information to users instantly.
[0992] "Augmented reality" refers to a technology that displays digital information overlaid on the real world, for example, by synthesizing virtual characters onto the scenery seen through a camera.
[0993] An "emotion analysis engine" refers to an algorithm or software that analyzes messages and actions entered by users and recognizes their emotions.
[0994] "Personalized content" refers to information that is optimized and customized based on a user's interests and emotional state.
[0995] "Identification information" refers to information that uniquely identifies a user, and typically refers to a user ID and password.
[0996] "Cryptography" means secret information used to protect identity information, including passwords and PIN codes.
[0997] "Profile Information" refers to details about an athlete, such as their name, biography, statistics, and photograph.
[0998] A "generated response" is a response created by an AI character based on a user's message.
[0999] "Means of notification" refers to the technology or mechanism for informing users of new information, such as push notifications or email.
[1000] "Food and Drinks" means any food or drink recommended by the Competitor.
[1001] "Official Merchandise" refers to cheering goods and related merchandise authorized by an athlete or team.
[1002] This invention is a system that allows users to have one-on-one conversations with an AI character of a specific athlete, and includes functions such as providing real-time updates on game progress and original content, using augmented reality to take and share photos with athletes, purchasing food and drink and official support merchandise, and using an emotion analysis engine to recognize users' emotions and personalize and recommend content based on those emotions. Each element of the system and its function are described below.
[1003] Overall structure
[1004] The system consists of a user's device, a central server, a database, an AI character, an emotion analysis engine, and various software that integrates them. Users access the system using a smartphone application.
[1005] Authentication Process
[1006] The user enters their identification information (ID) and password into the login screen. The information is sent from the terminal to a central server, which then checks it against a database for authentication. This process authenticates the user.
[1007] Player selection and profile information
[1008] Once a user selects a particular athlete, the selected athlete's profile information is retrieved from the database and displayed on the user's device, including the athlete's name, biography, photo, and statistics.
[1009] Interactive features
[1010] Users interact with the AI character of the player they have selected. When the user presses the send button, a message is sent to a central server, which analyzes the message using an emotion analysis engine. Based on the emotional information analyzed by the emotion analysis engine, the AI character generates an appropriate response, which is then displayed on the user's device.
[1011] Match progress notifications and content distribution
[1012] The progress and results of matches are collected in real time by a central server and pushed to users' devices. In addition, personalized sports-related content is recommended and delivered based on the results of user sentiment analysis.
[1013] Augmented reality features
[1014] Users can take photos with athletes using the augmented reality function. By activating the device's camera function, they can take photos with virtual athletes superimposed on real-world scenery. The photos are then uploaded to a central server and a sharing link is generated. These links can then be used to share the photos on social media.
[1015] Product purchase function
[1016] When a user purchases food and drink recommended by an athlete or official support merchandise, the device sends a request to the server to retrieve product information from the database. When the user selects a specific item and submits a purchase request, the server completes the purchase process and arranges for delivery.
[1017] Hardware and software used
[1018] Hardware: Smartphone (iOS or Android)
[1019] Software: Python, Emotion Analysis Engine (EmotionAnalyzer), Content Database (ContentDatabase)
[1020] Server: Cloud service (AWS, Azure, etc.)
[1021] Examples of concrete examples and prompts
[1022] For example, if a user logs in, selects a specific athlete, and sends a message saying, "I'm so happy today!", the emotion analysis engine will analyze the emotion as "joy." As a result, the AI character will generate a response such as, "That's great! I'll do my best in the next game!" This response will then be displayed on the user's chat screen.
[1023] Example prompt sentence:
[1024] I'm really happy today!
[1025] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1026] Step 1:
[1027] The user enters an identification (ID) and password into a login screen on a terminal. The terminal sends this to a central server, which then authenticates the user by checking it against a database. This process authenticates the user. The input is the identification and password, and the output is the authentication result. The process involves querying the database and analyzing the results.
[1028] Step 2:
[1029] When a user selects a specific athlete, the profile information of the selected athlete is retrieved from the database and displayed on the device. The input is the athlete ID, and the output is the athlete's profile information. As part of the process, the server queries the database and returns the results to the device.
[1030] Step 3:
[1031] The user starts a conversation with an AI character. When the user enters a message and presses the send button, the device sends the message to the server. The server analyzes this message using an emotion analysis engine (EmotionAnalyzer). The input is the user's message, and the output is the analyzed emotion. As part of the process, the server calls the emotion analysis engine and analyzes the message.
[1032] Step 4:
[1033] Based on the emotional information analyzed by the emotion analysis engine, the AI character generates an appropriate response. The server sends the generated response to the device, which then displays it to the user. The input is the analyzed emotion, and the output is the generated response. As part of the processing, the AI character's response generation algorithm is executed.
[1034] Step 5:
[1035] The server retrieves match progress and results in real time and pushes them to the user's device. The input is real-time match data, and the output is notification messages. The server retrieves data from an external match data provider and sends it to the user's device as a push notification.
[1036] Step 6:
[1037] Based on the results of the user's emotion analysis, personalized sports-related content is recommended and delivered. The server retrieves content related to the user's emotion from the database and sends it to the device for display. The input is the user's emotion analysis results, and the output is the recommended content. As part of the process, the server queries the content database based on the emotion analysis results to retrieve appropriate content and send it to the user's device.
[1038] Step 7:
[1039] The user takes a photo with the competitor using the augmented reality function, and the device uploads the photo to the server. The server saves the photo, generates a sharing link, and returns it to the device. The input is the AR photo, and the output is the sharing link. As part of the process, the device collects camera data and uploads it to the server, which saves it in a storage service and generates a link.
[1040] Step 8:
[1041] When a user purchases athlete-recommended food and drink or official support merchandise, the terminal sends a request to the server, which retrieves product information from a database. When the user selects a specific item and submits a purchase request, the server processes the purchase and arranges for delivery. The input is the purchase request, and the output is a notification that the purchase has been completed. As part of the process, the server processes the order information, checks inventory, and arranges for delivery.
[1042] In this way, each step works together to create a system that provides users with an advanced and personalized fan engagement experience.
[1043] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[1044] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1045] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.
[1046] [Third embodiment]
[1047] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.
[1048] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.
[1049] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1050] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.
[1051] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[1052] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[1053] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[1054] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[1055] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1056] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1057] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[1058] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."
[1059] This invention relates to a system that increases fan engagement by allowing users to communicate with AI characters of athletes. This system is realized by the following programs and processes.
[1060] User server connection and authentication
[1061] When a user uses a terminal to access the system, they first go to the login screen. The user enters their ID and password and attempts to log in. The terminal sends the entered authentication information to the server, which then compares the received information with a database to authenticate the user. If authentication is successful, the user proceeds to the main menu.
[1062] Player Selection
[1063] When a user selects the "Select Player" option from the main menu, the device displays a list of players. The user taps on a specific player they want to chat with and sends the player ID to the server. The server retrieves the player's profile information from its database and returns it to the device, which then displays it, allowing the user to view information about that player.
[1064] Start chatting with AI characters
[1065] When a specific player is selected, a chat screen appears and the user can enter a message. When the user presses the send button, the device sends the message to the server, which then relays the message to the AI chatbot. The AI chatbot analyzes the received message and generates a response in the style of the player. The server returns the generated response to the device, which then displays it on the chat screen.
[1066] Notification of match results
[1067] While the match is in progress, the server retrieves the match results in real time. When the server retrieves new match results, it sends them to the user's device via push notification. The device receives the notification and displays the match results to the user.
[1068] Original content distribution
[1069] When a user selects the "Original Content" option from the main menu, the device requests a content list from the server. The server retrieves the list of original content from the content database and returns it to the device. The device displays the list, and when the user selects a specific content, the server provides that content to the device in streaming format.
[1070] AR photo taking and sharing
[1071] When a user selects the "AR Photo Shoot" option, the device's camera activates and allows the user to take a photo with the player using the AR function. Once the user has finished taking the photo, the device uploads the photo data to the server. The server saves the photo and generates a sharing link that is returned to the device. The user can then use the link to share the photo on social media, etc.
[1072] Purchase recommended gourmet foods and goods
[1073] When a user selects the "Recommended Food & Goods" option from the menu, the device sends a request to the server, which retrieves recommended food and goods information from a database and returns it to the device. The device displays the list, and when the user selects a specific item, a purchase request is sent to the server. The server completes the purchase process and arranges for delivery.
[1074] Specific examples
[1075] For example, a user logs in, selects a specific athlete (Athlete A), and sends a message saying, "Please tell us your thoughts before the game." The server receives the message and passes it to an AI chatbot, which then generates a response such as, "My goal this season is to win!" This response is displayed on the user's chat screen. If a game is in progress, real-time game results are sent to the user's device via push notification. The user can then view original content from the main menu or take photos with the athlete using the AR function.
[1076] In this way, the system allows users to enjoy private communication with athletes while receiving match results and original content in real time. Furthermore, by utilizing the AR and merchandise purchasing functions, it is possible to increase engagement with fans and promote contributions to the local economy.
[1077] The processing flow will be explained below.
[1078] Program processing steps
[1079] User server connection and authentication
[1080] Step 1:
[1081] The user launches the Hawks Connection app and goes to the login screen.
[1082] Step 2:
[1083] The user enters their ID and password on the login screen and clicks the login button.
[1084] Step 3:
[1085] The device sends the ID and password authentication information to the server.
[1086] Step 4:
[1087] The server compares the received ID and password with the database and performs authentication.
[1088] Step 5:
[1089] If the authentication is successful, the server returns a message indicating successful authentication to the terminal, and the terminal displays the main menu.
[1090] Player Selection
[1091] Step 1:
[1092] The user selects the "Player Selection" option from the main menu.
[1093] Step 2:
[1094] The device will display a player list screen, and the user can tap on the player they want to chat with.
[1095] Step 3:
[1096] The device sends the player ID to the server.
[1097] Step 4:
[1098] The server retrieves the player's profile information from the database and returns it to the terminal.
[1099] Step 5:
[1100] The device displays the received player profile information to the user.
[1101] Start chatting with AI characters
[1102] Step 1:
[1103] The user types a message in the chat input field and presses the send button.
[1104] Step 2:
[1105] The device sends the user's message to the server.
[1106] Step 3:
[1107] The server passes the message to the AI chatbot.
[1108] Step 4:
[1109] The AI chatbot analyzes the messages it receives and generates responses in the style of a player.
[1110] Step 5:
[1111] The server returns the generated response to the terminal, which displays the response on the chat screen.
[1112] Notification of match results
[1113] Step 1:
[1114] The server retrieves the match results in real time.
[1115] Step 2:
[1116] The server that obtains the match results will send a push notification to the user's device.
[1117] Step 3:
[1118] The device receives the notification and displays the match results to the user.
[1119] Original content distribution
[1120] Step 1:
[1121] The user selects the "Original Content" option from the main menu.
[1122] Step 2:
[1123] The terminal requests the server to acquire a content list.
[1124] Step 3:
[1125] The server obtains a list of original contents from the content database and returns it to the terminal.
[1126] Step 4:
[1127] The device displays a content list, and the user selects a specific content.
[1128] Step 5:
[1129] The terminal requests the data of the selected content from the server, and the server streams the data.
[1130] AR photo taking and sharing
[1131] Step 1:
[1132] The user selects the "Take AR Photo" option from the menu.
[1133] Step 2:
[1134] The device's camera function will be activated, and the AR function will be used to take photos with the player.
[1135] Step 3:
[1136] Once the user has taken a photo, the device uploads the photo data to the server.
[1137] Step 4:
[1138] The server stores the photo data, generates a sharing link, and returns it to the device.
[1139] Step 5:
[1140] Users can use the link to share photos on social media etc.
[1141] Purchase recommended gourmet foods and goods
[1142] Step 1:
[1143] The user selects the "Recommended Food & Goods" option from the main menu.
[1144] Step 2:
[1145] The terminal sends a request to the server, which retrieves information from the database.
[1146] Step 3:
[1147] The server returns a list of recommended gourmet foods and goods to the device.
[1148] Step 4:
[1149] The device displays a list and the user selects a specific item.
[1150] Step 5:
[1151] The terminal sends a purchase request to the server, and the server carries out the purchase procedure.
[1152] Step 6:
[1153] The server handles purchase confirmation and shipping arrangements.
[1154] Example 1
[1155] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1156] Conventional sports fan engagement systems are limited to providing information about athletes and distributing content, and lack the means for fans to interact one-on-one with athletes, receive real-time game results, take photos using augmented reality features, or purchase recommended meals or official support merchandise. This makes it difficult to increase user satisfaction and engagement.
[1157] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1158] In this invention, the server includes a means for a user to chat one-on-one with a specific avatar, a means for providing game results and content in real time, a means for a user to take and share photos with the avatar using augmented reality functions, a means for a user to purchase recommended meals and official support merchandise, a means for a user to input login authentication information and be authenticated by the server, a means for providing information about an avatar selected by the user, a means for the avatar to generate a response to the user's message, and a means for displaying the generated response to the user. This allows users to enjoy multifaceted engagement with athletes, improving satisfaction with the system.
[1159] "User" refers to any individual or organization that uses this system.
[1160] An "avatar" is a virtual character based on a particular athlete that is intended to interact one-on-one with the user.
[1161] "Server" refers to the computer system used to manage and provide user authentication information, avatar data, match results, and other content.
[1162] "Database" refers to the system for storing and managing data used in the system, such as athlete profile information, match results, and content.
[1163] "Response" refers to an answer or reaction generated by an avatar in response to a message from a user.
[1164] "Game Results" refers to the results data of ongoing or completed sports games.
[1165] "Content" refers to media information provided to users, such as original videos, articles, images, etc.
[1166] "Augmented reality (AR)" refers to a technology that uses a device's camera to overlay virtual objects onto real-world images.
[1167] "Recommended Meals" means any diet-related product or service recommended by an Athlete or the System to a User.
[1168] "Official Support Merchandise" refers to official goods and merchandise related to an athlete's team or brand.
[1169] "Login Credentials" refers to the ID and password combination required for a User to access the System.
[1170] "Authentication" refers to the process by which the server verifies that the login credentials provided by the user are accurate.
[1171] This invention provides a system that increases fan engagement by allowing users to communicate with AI characters of athletes. This system is realized through the following specific hardware and software configuration and processing.
[1172] First, the user accesses the system using a device (smartphone, tablet, PC, etc.) and goes to the login screen. The user enters their ID and password and attempts to log in. The device sends the entered authentication information to the server. The server verifies the received information against a database (e.g., MySQL) and, if authentication is successful, proceeds to the main menu.
[1173] When a user selects the "Player Selection" option from the main menu, the device requests a list of players from the server. The server retrieves the list of players from the database and sends it to the device. The user can then tap or click to select a specific player and view their profile information.
[1174] Once a player is selected, the user can begin chatting with the AI character. The user types a message and presses the send button. The device sends the message to the server, which then passes it to an AI chatbot (such as GPT-3, a generative AI model). The AI chatbot analyzes the message and generates a response in the style of the player. The server then sends the response back to the device and displays it on the user's chat screen.
[1175] Additionally, while the match is in progress, the server obtains match results in real time via external APIs such as sports data APIs. When new match results are available, the server sends them to the user's device via push notification, and the device receives the notification and displays it to the user.
[1176] Furthermore, if the user selects the "original content" option, the terminal will request a content list from the server. The server will retrieve the content data from the database and send it to the terminal. When the user selects a specific content, the server will provide the content in streaming format.
[1177] When a user selects "AR Photo Shooting" in the AR photo option, the device activates the camera function and AR library (e.g., ARKit) to take a photo with the player's virtual character. After taking the photo, the device uploads the photo data to the server, which saves the photo and generates a sharing link that is returned to the device. The user can then use this link to share the photo on social media, etc.
[1178] Finally, when the user selects the "Recommended Food & Goods" option, the device sends a request to the server, which retrieves information about recommended meals and official support products from the database and returns it to the device. When the user selects a specific item, a purchase request is sent to the server, which handles the purchase process and arranges delivery.
[1179] Prompt Sentence Examples
[1180] Please tell us your thoughts before the match
[1181] What are your goals for this season?
[1182] What do you think about the next match?
[1183] In this way, the system allows users to enjoy private communication with athletes while receiving match results and original content in real time. Furthermore, by utilizing the AR and merchandise purchasing functions, it is possible to increase engagement with fans and promote contributions to the local economy.
[1184] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1185] Step 1:
[1186] The user uses a terminal to go to the login screen and enters their ID and password. Input: User's ID and password. The terminal sends this authentication information to the server. The server compares the received information with the database for authentication. If authentication is successful, Output: An instruction to proceed to the main menu is returned. Specific operation: The server uses an SQL query to search the database for authentication information, and returns success if it matches, or an error message if it does not match.
[1187] Step 2:
[1188] The user selects the "Select Player" option from the main menu. Input: The user requests to select a player. The device requests a list of players from the server. The server retrieves the list of players from the database and returns it to the device. Output: The list of players is displayed on the device. Specific behavior: The server retrieves player information using an SQL query and returns it to the device in JSON format.
[1189] Step 3:
[1190] The user selects a specific player and starts chatting with that player. Input: The user's player selection and message. When the user enters a message and presses the send button, the device sends the message to the server. The server passes the message to the AI chatbot, and output: the response generated by the chatbot. Specific operation: The server invokes an AI model (e.g., GPT-3) to analyze the message and generate a response. The response is returned to the device in JSON format and displayed on the chat screen.
[1191] Step 4:
[1192] While the match is in progress, the server retrieves match results in real time from an external API (for example, a sports data API). Input: Updated data on the match status. If there are new match results, the server sends them to the user's device as a push notification. Output: Push notification of match results. Specific operation: The server periodically calls the API and notifies the user via WebSocket or Firebase Cloud Messaging if there is new data.
[1193] Step 5:
[1194] The user selects the "Original Content" option from the main menu. Input: The user requests content. The device sends a request to the server, which retrieves the content data from the database and sends it to the device. Output: The content list is displayed on the device. When the user selects a specific content, the server provides it in streaming format. Specific behavior: The server provides the media file in HLS format, and the device plays it in the appropriate player.
[1195] Step 6:
[1196] When a user selects the "AR Photo Shoot" option, the device activates the camera function and AR library (e.g., ARKit). Input: User's photo request. A photo is taken with the player's virtual character. After the photo is taken, the device uploads the photo data to the server, which saves the photo and generates a sharing link that is returned to the device. Output: Shared link. Specific operation: A photo is taken using the device's camera and AR library, and uploaded to the server via REST API. The server generates a link and returns it.
[1197] Step 7:
[1198] When the user selects the "Recommended Food & Goods" option, the device sends a request to the server. Input: User's item selection request. The server retrieves information about recommended meals and official support products from the database and returns it to the device. Output: A product list is displayed on the device. When the user selects a specific item, a purchase request is sent to the server, which completes the purchase and arranges for delivery. Specific operation: The server retrieves the product information, completes the purchase through a payment gateway (e.g., Stripe), and notifies the user of the order information.
[1199] (Application example 1)
[1200] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1201] Today's sports fans want to interact more closely with their favorite athletes, get real-time game information, and watch original content. However, conventional systems struggle to provide these services comprehensively, limiting the means to increase fan engagement. This has created a growing need for systems that provide virtual communication with athletes, real-time game information notifications, AR photography, original content distribution, and the ability to purchase recommended products.
[1202] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1203] In this invention, the server includes: a means for enabling a user to chat one-on-one with an AI character of a specific athlete; a means for providing real-time game results and original video content; a means for a user to take and share photos with the athlete using an AR function; a means for a user to purchase food and drink recommended by the athlete and official support merchandise; a means for a user to log in from their device and select a specific athlete and generate and display athlete-style responses using a generative AI model; a means for obtaining game progress in real time and notifying the user; and a means for a user to view original content via their device. This enables deep engagement with athletes, allowing fans to enjoy game information and original content in real time, and further increasing satisfaction through the AR function and recommended merchandise.
[1204] An "athlete" is a person who competes in a particular sport and is virtually reproduced as an AI character within the system.
[1205] "One-on-one chat" means that users can engage in individual two-way messaging with an AI character of a specific athlete.
[1206] "Live Match Results" means the latest game status and results provided to a User in real time for ongoing or completed sports matches.
[1207] "Original video content" refers to independently created video data about athletes and related events that is distributed to users.
[1208] The "AR function" uses augmented reality technology to allow users to synthesize and photograph virtual images of athletes in real-world scenes.
[1209] "Athlete-recommended foods, beverages, and official support products" refers to foods and beverages recommended by athletes and products officially approved for support, which can be purchased by users.
[1210] "Generative AI model" refers to artificial intelligence technology that generates athlete-style responses based on a user's message.
[1211] "Get in real time" means that the progress of the match is continuously monitored and the user is notified immediately.
[1212] A "terminal" is a device that a user uses to access and operate the system, such as a smartphone or tablet.
[1213] This invention relates to a system that increases fan engagement by allowing users to communicate with AI characters of athletes. This system is realized by the following programs and processes.
[1214] First, a user must log in to access the system using a terminal. The user enters their ID and password on the login screen and sends the authentication information to the server. The server authenticates the received authentication information by checking it against a database, and if authentication is successful, the user can proceed to the main menu. The hardware used is a smartphone, and the software used is a back-end server and database management system.
[1215] Next, the user selects the "Select Athlete" option from the main menu, and the device displays a list of athletes. The user taps on the specific athlete they want to chat with and sends the athlete ID to the server. The server retrieves the athlete's profile information from the database and returns it to the device, which then displays it, allowing the user to view information about the athlete. The hardware used is a smartphone, and the software used is a back-end server and database management system.
[1216] Once a specific athlete is selected, a chat screen appears, allowing the user to enter a message. When the user presses the send button, the device sends the message to the server, which uses the generative AI model to analyze the message and generate a response in the style of the athlete. This response is returned from the server to the device, which displays it on the chat screen. The hardware used is a smartphone, and the software used is the generative AI model and a back-end server.
[1217] Also, while a match is in progress, the server obtains the match status in real time and sends it to the user's device via push notification. The device receives the notification and displays the match results to the user. The hardware used is a smartphone, and the software used is a server with real-time data acquisition capabilities.
[1218] Furthermore, when the user selects the "Original Content" option from the main menu, the device requests a content list from the server. The server retrieves a list of original video content from the content database and returns it to the device. The device displays the list, and when the user selects specific content, the server provides that content to the device in streaming format. The hardware used is a smartphone, and the software used is a streaming server.
[1219] When a user selects the "AR Photo Shoot" option, the device's camera function is activated, allowing the user to take a photo with the athlete using AR functionality. Once the user has finished taking the photo, the device uploads the photo data to the server. The server saves the photo, generates a sharing link, and returns it to the device. The user can then use the link to share the photo on social media, etc. The hardware used is a smartphone (with a camera function), and the software used is an application that uses AR technology and a back-end server.
[1220] For example, a user can generate an athlete-like response using a prompt like the following: "Tell us your thoughts before the game," and the generative AI model can generate a response such as "My goal this season is to win!", which will be displayed in the user's chat screen.
[1221] In this way, a system will be realized that allows for deep engagement with athletes, allows fans to enjoy real-time game information and original content, and further enhances satisfaction through AR functions and recommended products.
[1222] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1223] Step 1:
[1224] A user accesses the system using a terminal. The user enters their ID and password on the login screen and sends the input data to the terminal. The terminal sends the authentication information to the server, which then collates it with a database for authentication. The server returns the authentication result to the terminal, and the terminal displays the main menu if authentication is successful, or an error message if authentication is unsuccessful.
[1225] Input: User ID, Password
[1226] Data processing: Sending authentication information and checking the database
[1227] Output: Authentication result (success / failure)
[1228] Step 2:
[1229] The user selects the "Select Player" option from the main menu. The device sends a request for a player list to the server, which retrieves the player list from the database and returns it to the device. The device displays the player list, and when the user taps on a specific athlete, it sends the athlete ID to the server. The server retrieves the player's profile information and returns it to the device, which displays it.
[1230] Input: Player selection request, player ID
[1231] Data processing: Acquisition of player list and profile information
[1232] Output: Player list, player profile information
[1233] Step 3:
[1234] When the user selects a player, a chat screen is displayed. When the user enters a message and presses the send button, the device sends the message to the server. The server uses a generative AI model to analyze the message, generate an athlete-like response, and return the response to the device. The device then displays the athlete-like response on the chat screen.
[1235] Input: User message
[1236] Data processing: Message analysis and response generation using generative AI models
[1237] Output: Athlete-like response
[1238] Step 4:
[1239] When a match is in progress, the server will continue to obtain the match status in real time. Every time the server detects a new match status, it will push the match result to the user's device. The device will receive the notification and display the match result to the user.
[1240] Input: Real-time match status data
[1241] Data processing: monitoring the match situation
[1242] Output: Match results via push notification
[1243] Step 5:
[1244] When a user selects the "Original Content" option from the main menu, the device requests a content list from the server. The server retrieves a list of original video content from the database and returns it to the device. The device displays the list, and when the user selects a specific content, the server provides that content to the device in streaming format.
[1245] Input: Original Content Request
[1246] Data processing: Acquisition of content list and content data
[1247] Output: Original content list, streaming content
[1248] Step 6:
[1249] When a user selects the "AR Photo Shoot" option, the device's camera activates and takes a photo of the athlete using the AR function. Once the user has finished taking the photo, the device uploads the photo data to the server. The server saves the photo and generates a sharing link that is returned to the device. The user can then use the link to share the photo on social media, etc.
[1250] Input: Photo request, photo data
[1251] Data processing: Upload and save photo data, generate share links
[1252] Output: Shared link
[1253] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1254] This invention achieves a higher level of fan engagement by combining an emotion engine with a system in which users communicate with AI athlete characters. This system is realized by the following programs and processes.
[1255] User server connection and authentication
[1256] When a user uses a terminal to access the system, they first go to the login screen. The user enters their ID and password and attempts to log in. The terminal sends the entered authentication information to the server, which then compares the received information with a database to authenticate the user. If authentication is successful, the user proceeds to the main menu.
[1257] Player Selection
[1258] When a user selects the "Select Player" option from the main menu, the device displays a list of players and the user taps on a specific player they want to chat with. The device sends the player's ID to the server, which retrieves the player's profile information from its database and returns it to the device, which displays it and allows the user to view information about that player.
[1259] Start chatting with AI characters
[1260] Once a specific player is selected, a chat screen appears and the user can enter a message. When the user presses the send button, the device sends the message to the server, which then relays the message to the AI chatbot. The AI chatbot analyzes the received message and also uses an emotion engine to generate a player-like response. The emotion engine analyzes the emotion from the user's message and generates an optimal response based on that emotion. The server returns the generated response to the device, which then displays it on the chat screen.
[1261] The role of the emotional engine
[1262] The emotion engine analyzes the messages and actions entered by the user and recognizes their emotions. For example, if a user enters "I had so much fun today!", the emotion engine recognizes the user's emotion as "joy." Based on this information, the AI chatbot generates a response that corresponds to joy, such as "That's great! Please come again!"
[1263] Notification of match results
[1264] As the match progresses, the server retrieves the match results in real time. When the server receives new match results, it sends them to the user's device via push notification. The device receives the notification and displays the match results to the user. The emotion engine analyzes the user's emotions and can optimize the response to the match results.
[1265] Original content distribution
[1266] When a user selects the "Original Content" option from the main menu, the device requests a content list from the server. The server retrieves the list of original content from the content database and returns it to the device. The device displays the list, and when the user selects a specific content, the server provides that content to the device in streaming format. The emotion engine can also recommend appropriate content based on the user's emotions.
[1267] AR photo taking and sharing
[1268] When a user selects the "AR Photo Shoot" option, the device's camera activates and allows the user to take a photo with the player using the AR function. Once the user has finished taking the photo, the device uploads the photo data to the server. The server saves the photo and generates a sharing link that is returned to the device. The user can then use the link to share the photo on social media, etc.
[1269] Purchase recommended gourmet foods and goods
[1270] When a user selects the "Recommended Food and Goods" option from the menu, the device sends a request to the server, which retrieves recommended food and goods information from a database and returns it to the device. The device displays a list, and when the user selects a specific item, a purchase request is sent to the server. The server completes the purchase and arranges for delivery. The emotion engine can present recommended items taking into account the user's emotional state.
[1271] Specific examples
[1272] For example, suppose a user logs in, selects a specific athlete (Athlete A), and sends a message on the chat screen saying, "I'm so happy today!" The server receives this message, and the emotion engine analyzes the emotion of "joy." Based on this information, the AI chatbot generates a response such as, "That's great! I'll do my best in the next game!" This response is then displayed on the user's chat screen. If a game is in progress, real-time game results are sent to the user's device via push notification. Users can also watch original content from the main menu and take photos with players using the AR function.
[1273] With the introduction of the emotion engine, the system can provide flexible and personalized responses based on user emotions, further increasing engagement, improving the fan experience and driving more visitors to stadiums and related facilities.
[1274] The processing flow will be explained below.
[1275] Program processing steps
[1276] User server connection and authentication
[1277] Step 1:
[1278] The user launches the Hawks Connection app and goes to the login screen.
[1279] Step 2:
[1280] The user enters their ID and password on the login screen and clicks the login button.
[1281] Step 3:
[1282] The device sends the ID and password authentication information to the server.
[1283] Step 4:
[1284] The server compares the received ID and password with the database and performs authentication.
[1285] Step 5:
[1286] If the authentication is successful, the server returns a message indicating successful authentication to the terminal, and the terminal displays the main menu.
[1287] Player Selection
[1288] Step 1:
[1289] The user selects the "Player Selection" option from the main menu.
[1290] Step 2:
[1291] The device will display a player list screen, and the user can tap on the player they want to chat with.
[1292] Step 3:
[1293] The device sends the player ID to the server.
[1294] Step 4:
[1295] The server retrieves the player's profile information from the database and returns it to the terminal.
[1296] Step 5:
[1297] The device displays the received player profile information to the user.
[1298] Start chatting with AI characters
[1299] Step 1:
[1300] The user types a message in the chat input field and presses the send button.
[1301] Step 2:
[1302] The device sends the user's message to the server.
[1303] Step 3:
[1304] The server sends the message to the emotion engine, which analyzes the user's emotions.
[1305] Step 4:
[1306] The server passes the analysis results to the AI chatbot.
[1307] Step 5:
[1308] The AI chatbot generates appropriate responses based on the results of emotion analysis.
[1309] Step 6:
[1310] The server returns the generated response to the terminal, which displays the response on the chat screen.
[1311] Notification of match results
[1312] Step 1:
[1313] The server retrieves the match results in real time.
[1314] Step 2:
[1315] The server sends the match results to the user's device via push notification.
[1316] Step 3:
[1317] The device receives the notification and displays the match results to the user.
[1318] Original content distribution
[1319] Step 1:
[1320] The user selects the "Original Content" option from the main menu.
[1321] Step 2:
[1322] The terminal requests the server to acquire a content list.
[1323] Step 3:
[1324] The server obtains a list of original contents from the content database and returns it to the terminal.
[1325] Step 4:
[1326] The device displays a content list, and the user selects a specific content.
[1327] Step 5:
[1328] The terminal requests the data of the selected content from the server, and the server streams the data.
[1329] AR photo taking and sharing
[1330] Step 1:
[1331] The user selects the "Take AR Photo" option from the menu.
[1332] Step 2:
[1333] The device's camera function will be activated, and the AR function will be used to take photos with the player.
[1334] Step 3:
[1335] Once the user has taken a photo, the device uploads the photo data to the server.
[1336] Step 4:
[1337] The server stores the photo data, generates a sharing link, and returns it to the device.
[1338] Step 5:
[1339] Users can use the link to share photos on social media etc.
[1340] Purchase recommended gourmet foods and goods
[1341] Step 1:
[1342] The user selects the "Recommended Food & Goods" option from the main menu.
[1343] Step 2:
[1344] The terminal sends a request to the server, which retrieves information from the database.
[1345] Step 3:
[1346] The server returns a list of recommended gourmet foods and goods to the device.
[1347] Step 4:
[1348] The device displays a list and the user selects a specific item.
[1349] Step 5:
[1350] The terminal sends a purchase request to the server, and the server carries out the purchase procedure.
[1351] Step 6:
[1352] The server handles purchase confirmation and shipping arrangements.
[1353] Use of emotion engine
[1354] Step 1:
[1355] When a user sends a message, the server receives the message and sends it to the emotion engine.
[1356] Step 2:
[1357] The emotion engine analyzes messages and recognizes the user's emotions.
[1358] Step 3:
[1359] The emotion engine returns the recognized emotion to the server.
[1360] Step 4:
[1361] The server communicates the emotion analysis results to the AI chatbot.
[1362] Step 5:
[1363] The AI chatbot generates appropriate responses based on the results of sentiment analysis.
[1364] Step 6:
[1365] The server returns the generated response to the terminal, which displays the response to the user.
[1366] Specific examples
[1367] For example, suppose a user logs in, selects a specific athlete (Athlete A), and sends a message on the chat screen saying, "I'm so happy today!" The server receives this message, and the emotion engine analyzes it for the emotion of "joy." Based on this information, the AI chatbot generates a response such as, "That's great! I'll do my best in the next game!" This response is then displayed on the user's chat screen. While a game is in progress, real-time game results are sent to the user's device via push notification. Users can also watch original content from the main menu and take photos with players using the AR function. With the introduction of the emotion engine, the system can provide flexible and personalized responses based on the user's emotions, further increasing engagement. This improves the fan experience and increases visitor numbers to stadiums and related facilities.
[1368] Example 2
[1369] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1370] The problem this invention aims to solve is to realize more natural and emotional dialogue in a system that enhances fan engagement between users and athletes, and to respond to users' real-time and individual needs. Conventional systems have not been able to provide responses that reflect the user's emotions, and have not provided sufficient real-time game results or original content. Furthermore, the user experience, such as taking photos using AR functions or purchasing recommended gourmet food or merchandise, is limited. It is necessary to solve these problems and improve user satisfaction.
[1371] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[1372] In this invention, the server includes means for enabling a user to chat one-on-one with an AI character of a specific athlete, means for authenticating the ID and password entered by the user on the login screen, means for providing profile information of the athlete selected by the user, means for the AI character to receive the user's message, analyze the emotion using an emotion engine, and generate a response based on the emotion, means for displaying the generated response to the user, means for providing real-time game results and original content, means for the user to take and share photos with the athlete using an AR function, means for the user to purchase gourmet food recommended by the athlete and official cheering merchandise, means for the emotion engine to analyze the user's message and recognize the emotion, means for the AI chatbot to generate an optimal response based on the recognized emotion, and means for the server to obtain game results in real time while the game is in progress and send them to the device via push notification. This allows the user to receive personalized responses based on their emotion, providing real-time information and a diverse entertainment experience.
[1373] An "AI athlete character" is a virtual character created by artificial intelligence that mimics an athlete and can chat one-on-one with users.
[1374] "Users" refer to the people who use this system and communicate with the AI athlete characters within the system.
[1375] An "emotion engine" is a software component that analyzes emotions from messages entered by users and generates responses based on those emotions.
[1376] An "AI chatbot" is an artificial intelligence program that receives messages from users, analyzes them, and generates appropriate responses.
[1377] An "ID" is identification information used to identify a user, and is usually composed of a unique string of characters or numbers.
[1378] A "password" is a secret string of characters used in combination with an ID to authenticate a user.
[1379] "Authentication information" refers to the combination of ID and password that a user enters when logging in.
[1380] A "database" is a collection of electronically managed data that stores user information, athlete profile information, and the like.
[1381] "Main Menu" refers to the screen that serves as the entrance to the main functions of the system, which the user can access after successful authentication.
[1382] "Profile information" is detailed data about a particular athlete, including the athlete's background, performance, characteristics, etc.
[1383] "Real-time" refers to data being generated or transmitted instantly, without delay.
[1384] "Match Results Update" is a means of providing information to users quickly about the results of ongoing or completed matches.
[1385] "Original content" refers to digital content such as original video, audio, and text that the system provides to users.
[1386] The "AR function" is an augmented reality technology that displays digital information overlaid on real-world scenery.
[1387] "Means for taking a photo" refers to a method by which a user generates image data using the camera function of the device.
[1388] "Sharing methods" are the ways in which users can share photos they take or content they generate with other users online.
[1389] "Gourmet" refers to high-quality food and beverages endorsed by athletes.
[1390] "Official cheering goods" refers to cheering items and accessories officially approved by athletes or organizations.
[1391] "Means of purchase" refers to the mechanism by which users order and pay for gourmet food and official support goods through the system.
[1392] "Push notification" is a method by which a server sends important information to a user's device in real time.
[1393] The system of the present invention is an advanced fan engagement system that combines multiple technologies to enable users to communicate with AI athlete characters. The system includes hardware and software for implementing specific methods.
[1394] System Configuration
[1395] The system mainly consists of the following components:
[1396] (Server): Database server, AI chatbot, emotion engine, push notification system
[1397] (Device): A device (smartphone, tablet, PC, etc.) that accepts user operations and displays information accordingly.
[1398] (User): The person who operates the system and communicates with the athlete AI character.
[1399] Overview of the main technical components and processes
[1400] User authentication and login
[1401] When a user accesses the system using a terminal, they first go to a login screen. The user enters their ID and password, and if authentication is successful, they proceed to the main menu. Here, databases such as MySQL and PostgreSQL are used.
[1402] Player selection and profile display
[1403] The user selects the "Player Selection" option from the main menu and chooses a specific player from the displayed player list. The device sends the player ID to the server, which retrieves the player's profile information from the database and returns it to the device, allowing the user to view the player's details.
[1404] Chat with AI characters
[1405] When a user wants to chat with a selected player, they enter a message on the chat screen and press the send button. The device sends the message to the server, which then forwards it to the AI chatbot. The AI chatbot uses a generative AI model (e.g., GPT-4) to analyze the message's sentiment with an emotion engine. Based on this analysis, it generates an optimal response and returns it to the device. The device then displays the generated response on the chat screen.
[1406] Notification of match results
[1407] While the match is in progress, the server retrieves the match results in real time, and if important results are obtained, they are sent to the user's device as push notifications. This notification function uses push notification services such as Firebase Cloud Messaging (FCM).
[1408] Original content distribution
[1409] When a user selects the "Original Content" option, the terminal requests a content list from the server, which retrieves the list from the content database and returns it to the terminal, providing the content selected by the user in streaming format.
[1410] AR photo taking and sharing
[1411] When a user selects the "AR Photo Shoot" option, the device's camera activates and the user can take a photo with the player using the AR function. After taking the photo, the device uploads the photo data to the server, which then generates a sharing link and returns it to the device. The user can then share the link on social media, etc.
[1412] Purchase recommended gourmet foods and goods
[1413] When a user selects the "Recommended Food and Goods" option, the device sends a request to the server, which retrieves information about recommended foods and goods from the database and returns it to the device. When the user selects a specific item and sends a purchase request to the server, the server completes the purchase process and arranges for delivery.
[1414] Specific examples
[1415] For example, the following shows the process flow when a user logs in, selects a specific athlete (Athlete A), and sends the message "I'm so happy today!" on the chat screen. The server receives this message, and the emotion engine analyzes the "joy." Based on this information, the AI chatbot generates a response such as "That's great! I'll do my best in the next game!" This response is displayed on the user's chat screen. Additionally, if a game is in progress, real-time game results are sent to the user's device via push notification. Furthermore, users can view original content from the main menu and take photos with the players using the AR function.
[1416] Prompt Sentence Examples
[1417] "I want to send a message to a specific athlete (Athlete A) and get an emotional response. For example, if I send a message saying, 'I'm so happy today!' I want to generate an appropriate reply."
[1418] By implementing this invention, users can receive personalized responses based on their emotions, and real-time information provision and diverse entertainment experiences are possible.
[1419] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1420] Step 1:
[1421] The user boots up using a terminal and accesses the system login screen.
[1422] Step 2:
[1423] The user enters their ID and password into the login screen. This information is sent to the server by the terminal. The input data is sent to the server in the form of "user ID" and "password."
[1424] Step 3:
[1425] The server checks the received ID and password against a database containing pre-registered user information. The result of the check determines whether authentication was successful.
[1426] Step 4:
[1427] The server sends the authentication result to the terminal. If the authentication is successful, a success message is sent along with information on how to access the main menu. If the authentication fails, an authentication error message is sent.
[1428] Step 5:
[1429] Based on the authentication result received by the device from the server, if authentication is successful, the device displays the main menu screen, where the user can select their next action.
[1430] Step 6:
[1431] The user selects the "Select Player" option from the main menu. A request for a player list is sent from the terminal to the server.
[1432] Step 7:
[1433] The server retrieves the player list from the database and returns the data to the device, including player names and profile photos.
[1434] Step 8:
[1435] The terminal displays the player list received from the server to the user, who then selects a specific player from the list with whom he or she wants to chat.
[1436] Step 9:
[1437] When the user selects a particular player, the player's ID is sent by the device to the server, which retrieves the player's details from the database and returns them to the device.
[1438] Step 10:
[1439] The device displays the detailed player profile received from the server to the user, and transitions to a screen where the user can start chatting with the player.
[1440] Step 11:
[1441] The user enters a message on the chat screen and presses the send button, which sends the message from the device to the server.
[1442] Step 12:
[1443] The server forwards the received message to the AI chatbot, which then analyzes the message using a generative AI model (e.g., GPT-4).
[1444] Step 13:
[1445] The AI chatbot analyzes the content of the message and uses an emotion engine to recognize emotions. Emotional analysis data is obtained in the form of "happiness" or "sadness," etc.
[1446] Step 14:
[1447] Based on the analysis results of the emotion engine, the AI chatbot generates a response message. For example, if the emotion of "joy" is recognized, the response message generated will be "That's great!"
[1448] Step 15:
[1449] The server sends the generated response message to the terminal.
[1450] Step 16:
[1451] The terminal displays the response message on the chat screen so that the user can check it.
[1452] Step 17:
[1453] While the match is in progress, the server retrieves the match results in real time, for example, by using an API to retrieve the match status data.
[1454] Step 18:
[1455] When the server obtains new match results, it sends them to the user's device via push notification.
[1456] Step 19:
[1457] The device receives the notification and displays the match results to the user, while the emotion engine analyzes the user's reaction and provides appropriate feedback.
[1458] Step 20:
[1459] If the user selects the "original content" option, the terminal requests a content list from the server.
[1460] Step 20:
[1461] The server retrieves a list of original content from the content database and returns it to the device. The retrieved data includes video thumbnails and titles.
[1462] Step 21:
[1463] The terminal displays the received list to the user, allowing the user to select content.
[1464] Step 22:
[1465] Once the user selects the content they wish to view, the server provides that content in streaming format.
[1466] Step 23:
[1467] The terminal receives the streaming data, allowing the user to view the content.
[1468] Step 24:
[1469] When a user selects the "AR Photo Shoot" option, the device's camera function is activated, enabling the AR function and allowing the user to take photos with the players.
[1470] Step 25:
[1471] Once the user has taken a photo, the device uploads the photo data to the server.
[1472] Step 26:
[1473] The server stores the uploaded photos and generates a sharing link that is returned to the device.
[1474] Step 27:
[1475] The device displays the received link information to the user, who can then use the link to share the photo on social media platforms.
[1476] Step 28:
[1477] The user selects the "Recommended Food and Goods" option. The device sends a request to the server, which retrieves information about recommended foods and goods from the database and returns it to the device.
[1478] Step 29:
[1479] The terminal displays the received list to the user, allowing the user to select a particular item.
[1480] Step 30:
[1481] Once the user selects a particular item, a purchase request is sent from the terminal to the server, containing user information and details of the selected item.
[1482] Step 31:
[1483] The server processes the purchase request, completes the purchase through the payment system, and then arranges for delivery.
[1484] Step 32:
[1485] The emotion engine analyzes the user's emotional state and recommends appropriate items based on the state. For example, if the user is in a "joy" state, it will recommend related fun goods.
[1486] Step 33:
[1487] The recommended items will be displayed on the device, allowing the user to re-initiate the purchase process.
[1488] The above are the specific processing steps of this system.
[1489] (Application example 2)
[1490] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1491] Traditional methods of interaction between athletes and fans make it difficult to respond flexibly to fans' emotions, and the provision of personalized content is limited. Furthermore, notifications of game results and recommendations of related content are not optimized to take user emotions into account. This situation has led to challenges in improving fan engagement and deepening the fan experience.
[1492] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: a means for allowing a user to have a one-on-one conversation with an AI character of a specific athlete; a means for providing real-time game progress updates and unique content; a means for a user to take and share photos with the athlete using an augmented reality function; a means for a user to purchase athlete-recommended food and beverages and official support merchandise; a means for recognizing a user's emotions using an emotion analysis engine and personalizing and recommending content based on the emotions; a means for authenticating identification information and a password entered by the user on the login screen; a means for providing profile information of the athlete selected by the user; a means for recommending and delivering personalized sports-related content based on the user's emotions; a means for an AI character to generate a response to a user's message; a means for displaying the generated response; and a means for obtaining game results in real time and generating and notifying a response based on the user's emotions. This makes it possible to provide personalized content based on the user's emotions, improving fan engagement and deepening the fan experience.
[1493] An "AI character of a specific athlete" is a virtual character with artificial intelligence created to imitate a specific athlete, and which communicates with users.
[1494] "User" refers to an individual, fan, or user of this system.
[1495] "Means for dialogue" means a mechanism that allows users to exchange messages with the AI character of a specific athlete and for them to respond to each other.
[1496] "Match progress updates" refers to information that provides the progress and results of a match in real time.
[1497] "Original Content" refers to videos, articles, interviews, behind-the-scenes footage, and other information that is specifically created and hosted by the System.
[1498] "Means of providing information in real time" refers to technologies and mechanisms that deliver information to users instantly.
[1499] "Augmented reality" refers to a technology that displays digital information overlaid on the real world, for example, by synthesizing virtual characters onto the scenery seen through a camera.
[1500] An "emotion analysis engine" refers to an algorithm or software that analyzes messages and actions entered by users and recognizes their emotions.
[1501] "Personalized content" refers to information that is optimized and customized based on a user's interests and emotional state.
[1502] "Identification information" refers to information that uniquely identifies a user, and typically refers to a user ID and password.
[1503] "Cryptography" means secret information used to protect identity information, including passwords and PIN codes.
[1504] "Profile Information" refers to details about an athlete, such as their name, biography, statistics, and photograph.
[1505] A "generated response" is a response created by an AI character based on a user's message.
[1506] "Means of notification" refers to the technology or mechanism for informing users of new information, such as push notifications or email.
[1507] "Food and Drinks" means any food or drink recommended by the Competitor.
[1508] "Official Merchandise" refers to cheering goods and related merchandise authorized by an athlete or team.
[1509] This invention is a system that allows users to have one-on-one conversations with an AI character of a specific athlete, and includes functions such as providing real-time updates on game progress and original content, using augmented reality to take and share photos with athletes, purchasing food and drink and official support merchandise, and using an emotion analysis engine to recognize users' emotions and personalize and recommend content based on those emotions. Each element of the system and its function are described below.
[1510] Overall structure
[1511] The system consists of a user's device, a central server, a database, an AI character, an emotion analysis engine, and various software that integrates them. Users access the system using a smartphone application.
[1512] Authentication Process
[1513] The user enters their identification information (ID) and password into the login screen. The information is sent from the terminal to a central server, which then checks it against a database for authentication. This process authenticates the user.
[1514] Player selection and profile information
[1515] Once a user selects a particular athlete, the selected athlete's profile information is retrieved from the database and displayed on the user's device, including the athlete's name, biography, photo, and statistics.
[1516] Interactive features
[1517] Users interact with the AI character of the player they have selected. When the user presses the send button, a message is sent to a central server, which analyzes the message using an emotion analysis engine. Based on the emotional information analyzed by the emotion analysis engine, the AI character generates an appropriate response, which is then displayed on the user's device.
[1518] Match progress notifications and content distribution
[1519] The progress and results of matches are collected in real time by a central server and pushed to users' devices. In addition, personalized sports-related content is recommended and delivered based on the results of user sentiment analysis.
[1520] Augmented reality features
[1521] Users can take photos with athletes using the augmented reality function. By activating the device's camera function, they can take photos with virtual athletes superimposed on real-world scenery. The photos are then uploaded to a central server and a sharing link is generated. These links can then be used to share the photos on social media.
[1522] Product purchase function
[1523] When a user purchases food and drink recommended by an athlete or official support merchandise, the device sends a request to the server to retrieve product information from the database. When the user selects a specific item and submits a purchase request, the server completes the purchase process and arranges for delivery.
[1524] Hardware and software used
[1525] Hardware: Smartphone (iOS or Android)
[1526] Software: Python, Emotion Analysis Engine (EmotionAnalyzer), Content Database (ContentDatabase)
[1527] Server: Cloud service (AWS, Azure, etc.)
[1528] Examples of concrete examples and prompts
[1529] For example, if a user logs in, selects a specific athlete, and sends a message saying, "I'm so happy today!", the emotion analysis engine will analyze the emotion as "joy." As a result, the AI character will generate a response such as, "That's great! I'll do my best in the next game!" This response will then be displayed on the user's chat screen.
[1530] Example prompt sentence:
[1531] I'm really happy today!
[1532] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1533] Step 1:
[1534] The user enters an identification (ID) and password into a login screen on a terminal. The terminal sends this to a central server, which then authenticates the user by checking it against a database. This process authenticates the user. The input is the identification and password, and the output is the authentication result. The process involves querying the database and analyzing the results.
[1535] Step 2:
[1536] When a user selects a specific athlete, the profile information of the selected athlete is retrieved from the database and displayed on the device. The input is the athlete ID, and the output is the athlete's profile information. As part of the process, the server queries the database and returns the results to the device.
[1537] Step 3:
[1538] The user starts a conversation with an AI character. When the user enters a message and presses the send button, the device sends the message to the server. The server analyzes this message using an emotion analysis engine (EmotionAnalyzer). The input is the user's message, and the output is the analyzed emotion. As part of the process, the server calls the emotion analysis engine and analyzes the message.
[1539] Step 4:
[1540] Based on the emotional information analyzed by the emotion analysis engine, the AI character generates an appropriate response. The server sends the generated response to the device, which then displays it to the user. The input is the analyzed emotion, and the output is the generated response. As part of the processing, the AI character's response generation algorithm is executed.
[1541] Step 5:
[1542] The server retrieves match progress and results in real time and pushes them to the user's device. The input is real-time match data, and the output is notification messages. The server retrieves data from an external match data provider and sends it to the user's device as a push notification.
[1543] Step 6:
[1544] Based on the results of the user's emotion analysis, personalized sports-related content is recommended and delivered. The server retrieves content related to the user's emotion from the database and sends it to the device for display. The input is the user's emotion analysis results, and the output is the recommended content. As part of the process, the server queries the content database based on the emotion analysis results to retrieve appropriate content and send it to the user's device.
[1545] Step 7:
[1546] The user takes a photo with the competitor using the augmented reality function, and the device uploads the photo to the server. The server saves the photo, generates a sharing link, and returns it to the device. The input is the AR photo, and the output is the sharing link. As part of the process, the device collects camera data and uploads it to the server, which saves it in a storage service and generates a link.
[1547] Step 8:
[1548] When a user purchases athlete-recommended food and drink or official support merchandise, the terminal sends a request to the server, which retrieves product information from a database. When the user selects a specific item and submits a purchase request, the server processes the purchase and arranges for delivery. The input is the purchase request, and the output is a notification that the purchase has been completed. As part of the process, the server processes the order information, checks inventory, and arranges for delivery.
[1549] In this way, each step works together to create a system that provides users with an advanced and personalized fan engagement experience.
[1550] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[1551] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1552] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.
[1553] [Fourth embodiment]
[1554] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.
[1555] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.
[1556] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1557] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.
[1558] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[1559] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[1560] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[1561] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.
[1562] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[1563] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1564] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1565] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[1566] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1567] This invention relates to a system that increases fan engagement by allowing users to communicate with AI characters of athletes. This system is realized by the following programs and processes.
[1568] User server connection and authentication
[1569] When a user uses a terminal to access the system, they first go to the login screen. The user enters their ID and password and attempts to log in. The terminal sends the entered authentication information to the server, which then compares the received information with a database to authenticate the user. If authentication is successful, the user proceeds to the main menu.
[1570] Player Selection
[1571] When a user selects the "Select Player" option from the main menu, the device displays a list of players. The user taps on a specific player they want to chat with and sends the player ID to the server. The server retrieves the player's profile information from its database and returns it to the device, which then displays it, allowing the user to view information about that player.
[1572] Start chatting with AI characters
[1573] When a specific player is selected, a chat screen appears and the user can enter a message. When the user presses the send button, the device sends the message to the server, which then relays the message to the AI chatbot. The AI chatbot analyzes the received message and generates a response in the style of the player. The server returns the generated response to the device, which then displays it on the chat screen.
[1574] Notification of match results
[1575] While the match is in progress, the server retrieves the match results in real time. When the server retrieves new match results, it sends them to the user's device via push notification. The device receives the notification and displays the match results to the user.
[1576] Original content distribution
[1577] When a user selects the "Original Content" option from the main menu, the device requests a content list from the server. The server retrieves the list of original content from the content database and returns it to the device. The device displays the list, and when the user selects a specific content, the server provides that content to the device in streaming format.
[1578] AR photo taking and sharing
[1579] When a user selects the "AR Photo Shoot" option, the device's camera activates and allows the user to take a photo with the player using the AR function. Once the user has finished taking the photo, the device uploads the photo data to the server. The server saves the photo and generates a sharing link that is returned to the device. The user can then use the link to share the photo on social media, etc.
[1580] Purchase recommended gourmet foods and goods
[1581] When a user selects the "Recommended Food & Goods" option from the menu, the device sends a request to the server, which retrieves recommended food and goods information from a database and returns it to the device. The device displays the list, and when the user selects a specific item, a purchase request is sent to the server. The server completes the purchase process and arranges for delivery.
[1582] Specific examples
[1583] For example, a user logs in, selects a specific athlete (Athlete A), and sends a message saying, "Please tell us your thoughts before the game." The server receives the message and passes it to an AI chatbot, which then generates a response such as, "My goal this season is to win!" This response is displayed on the user's chat screen. If a game is in progress, real-time game results are sent to the user's device via push notification. The user can then view original content from the main menu or take photos with the athlete using the AR function.
[1584] In this way, the system allows users to enjoy private communication with athletes while receiving match results and original content in real time. Furthermore, by utilizing the AR and merchandise purchasing functions, it is possible to increase engagement with fans and promote contributions to the local economy.
[1585] The processing flow will be explained below.
[1586] Program processing steps
[1587] User server connection and authentication
[1588] Step 1:
[1589] The user launches the Hawks Connection app and goes to the login screen.
[1590] Step 2:
[1591] The user enters their ID and password on the login screen and clicks the login button.
[1592] Step 3:
[1593] The device sends the ID and password authentication information to the server.
[1594] Step 4:
[1595] The server compares the received ID and password with the database and performs authentication.
[1596] Step 5:
[1597] If the authentication is successful, the server returns a message indicating successful authentication to the terminal, and the terminal displays the main menu.
[1598] Player Selection
[1599] Step 1:
[1600] The user selects the "Player Selection" option from the main menu.
[1601] Step 2:
[1602] The device will display a player list screen, and the user can tap on the player they want to chat with.
[1603] Step 3:
[1604] The device sends the player ID to the server.
[1605] Step 4:
[1606] The server retrieves the player's profile information from the database and returns it to the terminal.
[1607] Step 5:
[1608] The device displays the received player profile information to the user.
[1609] Start chatting with AI characters
[1610] Step 1:
[1611] The user types a message in the chat input field and presses the send button.
[1612] Step 2:
[1613] The device sends the user's message to the server.
[1614] Step 3:
[1615] The server passes the message to the AI chatbot.
[1616] Step 4:
[1617] The AI chatbot analyzes the messages it receives and generates responses in the style of a player.
[1618] Step 5:
[1619] The server returns the generated response to the terminal, which displays the response on the chat screen.
[1620] Notification of match results
[1621] Step 1:
[1622] The server retrieves the match results in real time.
[1623] Step 2:
[1624] The server that obtains the match results will send a push notification to the user's device.
[1625] Step 3:
[1626] The device receives the notification and displays the match results to the user.
[1627] Original content distribution
[1628] Step 1:
[1629] The user selects the "Original Content" option from the main menu.
[1630] Step 2:
[1631] The terminal requests the server to acquire a content list.
[1632] Step 3:
[1633] The server obtains a list of original contents from the content database and returns it to the terminal.
[1634] Step 4:
[1635] The device displays a content list, and the user selects a specific content.
[1636] Step 5:
[1637] The terminal requests the data of the selected content from the server, and the server streams the data.
[1638] AR photo taking and sharing
[1639] Step 1:
[1640] The user selects the "Take AR Photo" option from the menu.
[1641] Step 2:
[1642] The device's camera function will be activated, and the AR function will be used to take photos with the player.
[1643] Step 3:
[1644] Once the user has taken a photo, the device uploads the photo data to the server.
[1645] Step 4:
[1646] The server stores the photo data, generates a sharing link, and returns it to the device.
[1647] Step 5:
[1648] Users can use the link to share photos on social media etc.
[1649] Purchase recommended gourmet foods and goods
[1650] Step 1:
[1651] The user selects the "Recommended Food & Goods" option from the main menu.
[1652] Step 2:
[1653] The terminal sends a request to the server, which retrieves information from the database.
[1654] Step 3:
[1655] The server returns a list of recommended gourmet foods and goods to the device.
[1656] Step 4:
[1657] The device displays a list and the user selects a specific item.
[1658] Step 5:
[1659] The terminal sends a purchase request to the server, and the server carries out the purchase procedure.
[1660] Step 6:
[1661] The server handles purchase confirmation and shipping arrangements.
[1662] Example 1
[1663] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1664] Conventional sports fan engagement systems are limited to providing information about athletes and distributing content, and lack the means for fans to interact one-on-one with athletes, receive real-time game results, take photos using augmented reality features, or purchase recommended meals or official support merchandise. This makes it difficult to increase user satisfaction and engagement.
[1665] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1666] In this invention, the server includes a means for a user to chat one-on-one with a specific avatar, a means for providing game results and content in real time, a means for a user to take and share photos with the avatar using augmented reality functions, a means for a user to purchase recommended meals and official support merchandise, a means for a user to input login authentication information and be authenticated by the server, a means for providing information about an avatar selected by the user, a means for the avatar to generate a response to the user's message, and a means for displaying the generated response to the user. This allows users to enjoy multifaceted engagement with athletes, improving satisfaction with the system.
[1667] "User" refers to any individual or organization that uses this system.
[1668] An "avatar" is a virtual character based on a particular athlete that is intended to interact one-on-one with the user.
[1669] "Server" refers to the computer system used to manage and provide user authentication information, avatar data, match results, and other content.
[1670] "Database" refers to the system for storing and managing data used in the system, such as athlete profile information, match results, and content.
[1671] "Response" refers to an answer or reaction generated by an avatar in response to a message from a user.
[1672] "Game Results" refers to the results data of ongoing or completed sports games.
[1673] "Content" refers to media information provided to users, such as original videos, articles, images, etc.
[1674] "Augmented reality (AR)" refers to a technology that uses a device's camera to overlay virtual objects onto real-world images.
[1675] "Recommended Meals" means any diet-related product or service recommended by an Athlete or the System to a User.
[1676] "Official Support Merchandise" refers to official goods and merchandise related to an athlete's team or brand.
[1677] "Login Credentials" refers to the ID and password combination required for a User to access the System.
[1678] "Authentication" refers to the process by which the server verifies that the login credentials provided by the user are accurate.
[1679] This invention provides a system that increases fan engagement by allowing users to communicate with AI characters of athletes. This system is realized through the following specific hardware and software configuration and processing.
[1680] First, the user accesses the system using a device (smartphone, tablet, PC, etc.) and goes to the login screen. The user enters their ID and password and attempts to log in. The device sends the entered authentication information to the server. The server verifies the received information against a database (e.g., MySQL) and, if authentication is successful, proceeds to the main menu.
[1681] When a user selects the "Player Selection" option from the main menu, the device requests a list of players from the server. The server retrieves the list of players from the database and sends it to the device. The user can then tap or click to select a specific player and view their profile information.
[1682] Once a player is selected, the user can begin chatting with the AI character. The user types a message and presses the send button. The device sends the message to the server, which then passes it to an AI chatbot (such as GPT-3, a generative AI model). The AI chatbot analyzes the message and generates a response in the style of the player. The server then sends the response back to the device and displays it on the user's chat screen.
[1683] Additionally, while the match is in progress, the server obtains match results in real time via external APIs such as sports data APIs. When new match results are available, the server sends them to the user's device via push notification, and the device receives the notification and displays it to the user.
[1684] Furthermore, if the user selects the "original content" option, the terminal will request a content list from the server. The server will retrieve the content data from the database and send it to the terminal. When the user selects a specific content, the server will provide the content in streaming format.
[1685] When a user selects "AR Photo Shooting" in the AR photo option, the device activates the camera function and AR library (e.g., ARKit) to take a photo with the player's virtual character. After taking the photo, the device uploads the photo data to the server, which saves the photo and generates a sharing link that is returned to the device. The user can then use this link to share the photo on social media, etc.
[1686] Finally, when the user selects the "Recommended Food & Goods" option, the device sends a request to the server, which retrieves information about recommended meals and official support products from the database and returns it to the device. When the user selects a specific item, a purchase request is sent to the server, which handles the purchase process and arranges delivery.
[1687] Prompt Sentence Examples
[1688] Please tell us your thoughts before the match
[1689] What are your goals for this season?
[1690] What do you think about the next match?
[1691] In this way, the system allows users to enjoy private communication with athletes while receiving match results and original content in real time. Furthermore, by utilizing the AR and merchandise purchasing functions, it is possible to increase engagement with fans and promote contributions to the local economy.
[1692] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1693] Step 1:
[1694] The user uses a terminal to go to the login screen and enters their ID and password. Input: User's ID and password. The terminal sends this authentication information to the server. The server compares the received information with the database for authentication. If authentication is successful, Output: An instruction to proceed to the main menu is returned. Specific operation: The server uses an SQL query to search the database for authentication information, and returns success if it matches, or an error message if it does not match.
[1695] Step 2:
[1696] The user selects the "Select Player" option from the main menu. Input: The user requests to select a player. The device requests a list of players from the server. The server retrieves the list of players from the database and returns it to the device. Output: The list of players is displayed on the device. Specific behavior: The server retrieves player information using an SQL query and returns it to the device in JSON format.
[1697] Step 3:
[1698] The user selects a specific player and starts chatting with that player. Input: The user's player selection and message. When the user enters a message and presses the send button, the device sends the message to the server. The server passes the message to the AI chatbot, and output: the response generated by the chatbot. Specific operation: The server invokes an AI model (e.g., GPT-3) to analyze the message and generate a response. The response is returned to the device in JSON format and displayed on the chat screen.
[1699] Step 4:
[1700] While the match is in progress, the server retrieves match results in real time from an external API (for example, a sports data API). Input: Updated data on the match status. If there are new match results, the server sends them to the user's device as a push notification. Output: Push notification of match results. Specific operation: The server periodically calls the API and notifies the user via WebSocket or Firebase Cloud Messaging if there is new data.
[1701] Step 5:
[1702] The user selects the "Original Content" option from the main menu. Input: The user requests content. The device sends a request to the server, which retrieves the content data from the database and sends it to the device. Output: The content list is displayed on the device. When the user selects a specific content, the server provides it in streaming format. Specific behavior: The server provides the media file in HLS format, and the device plays it in the appropriate player.
[1703] Step 6:
[1704] When a user selects the "AR Photo Shoot" option, the device activates the camera function and AR library (e.g., ARKit). Input: User's photo request. A photo is taken with the player's virtual character. After the photo is taken, the device uploads the photo data to the server, which saves the photo and generates a sharing link that is returned to the device. Output: Shared link. Specific operation: A photo is taken using the device's camera and AR library, and uploaded to the server via REST API. The server generates a link and returns it.
[1705] Step 7:
[1706] When the user selects the "Recommended Food & Goods" option, the device sends a request to the server. Input: User's item selection request. The server retrieves information about recommended meals and official support products from the database and returns it to the device. Output: A product list is displayed on the device. When the user selects a specific item, a purchase request is sent to the server, which completes the purchase and arranges for delivery. Specific operation: The server retrieves the product information, completes the purchase through a payment gateway (e.g., Stripe), and notifies the user of the order information.
[1707] (Application example 1)
[1708] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1709] Today's sports fans want to interact more closely with their favorite athletes, get real-time game information, and watch original content. However, conventional systems struggle to provide these services comprehensively, limiting the means to increase fan engagement. This has created a growing need for systems that provide virtual communication with athletes, real-time game information notifications, AR photography, original content distribution, and the ability to purchase recommended products.
[1710] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1711] In this invention, the server includes: a means for enabling a user to chat one-on-one with an AI character of a specific athlete; a means for providing real-time game results and original video content; a means for a user to take and share photos with the athlete using an AR function; a means for a user to purchase food and drink recommended by the athlete and official support merchandise; a means for a user to log in from their device and select a specific athlete and generate and display athlete-style responses using a generative AI model; a means for obtaining game progress in real time and notifying the user; and a means for a user to view original content via their device. This enables deep engagement with athletes, allowing fans to enjoy game information and original content in real time, and further increasing satisfaction through the AR function and recommended merchandise.
[1712] An "athlete" is a person who competes in a particular sport and is virtually reproduced as an AI character within the system.
[1713] "One-on-one chat" means that users can engage in individual two-way messaging with an AI character of a specific athlete.
[1714] "Live Match Results" means the latest game status and results provided to a User in real time for ongoing or completed sports matches.
[1715] "Original video content" refers to independently created video data about athletes and related events that is distributed to users.
[1716] The "AR function" uses augmented reality technology to allow users to synthesize and photograph virtual images of athletes in real-world scenes.
[1717] "Athlete-recommended foods, beverages, and official support products" refers to foods and beverages recommended by athletes and products officially approved for support, which can be purchased by users.
[1718] "Generative AI model" refers to artificial intelligence technology that generates athlete-style responses based on a user's message.
[1719] "Get in real time" means that the progress of the match is continuously monitored and the user is notified immediately.
[1720] A "terminal" is a device that a user uses to access and operate the system, such as a smartphone or tablet.
[1721] This invention relates to a system that increases fan engagement by allowing users to communicate with AI characters of athletes. This system is realized by the following programs and processes.
[1722] First, a user must log in to access the system using a terminal. The user enters their ID and password on the login screen and sends the authentication information to the server. The server authenticates the received authentication information by checking it against a database, and if authentication is successful, the user can proceed to the main menu. The hardware used is a smartphone, and the software used is a back-end server and database management system.
[1723] Next, the user selects the "Select Athlete" option from the main menu, and the device displays a list of athletes. The user taps on the specific athlete they want to chat with and sends the athlete ID to the server. The server retrieves the athlete's profile information from the database and returns it to the device, which then displays it, allowing the user to view information about the athlete. The hardware used is a smartphone, and the software used is a back-end server and database management system.
[1724] Once a specific athlete is selected, a chat screen appears, allowing the user to enter a message. When the user presses the send button, the device sends the message to the server, which uses the generative AI model to analyze the message and generate a response in the style of the athlete. This response is returned from the server to the device, which displays it on the chat screen. The hardware used is a smartphone, and the software used is the generative AI model and a back-end server.
[1725] Also, while a match is in progress, the server obtains the match status in real time and sends it to the user's device via push notification. The device receives the notification and displays the match results to the user. The hardware used is a smartphone, and the software used is a server with real-time data acquisition capabilities.
[1726] Furthermore, when the user selects the "Original Content" option from the main menu, the device requests a content list from the server. The server retrieves a list of original video content from the content database and returns it to the device. The device displays the list, and when the user selects specific content, the server provides that content to the device in streaming format. The hardware used is a smartphone, and the software used is a streaming server.
[1727] When a user selects the "AR Photo Shoot" option, the device's camera function is activated, allowing the user to take a photo with the athlete using AR functionality. Once the user has finished taking the photo, the device uploads the photo data to the server. The server saves the photo, generates a sharing link, and returns it to the device. The user can then use the link to share the photo on social media, etc. The hardware used is a smartphone (with a camera function), and the software used is an application that uses AR technology and a back-end server.
[1728] For example, a user can generate an athlete-like response using a prompt like the following: "Tell us your thoughts before the game," and the generative AI model can generate a response such as "My goal this season is to win!", which will be displayed in the user's chat screen.
[1729] In this way, a system will be realized that allows for deep engagement with athletes, allows fans to enjoy real-time game information and original content, and further enhances satisfaction through AR functions and recommended products.
[1730] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1731] Step 1:
[1732] A user accesses the system using a terminal. The user enters their ID and password on the login screen and sends the input data to the terminal. The terminal sends the authentication information to the server, which then collates it with a database for authentication. The server returns the authentication result to the terminal, and the terminal displays the main menu if authentication is successful, or an error message if authentication is unsuccessful.
[1733] Input: User ID, Password
[1734] Data processing: Sending authentication information and checking the database
[1735] Output: Authentication result (success / failure)
[1736] Step 2:
[1737] The user selects the "Select Player" option from the main menu. The device sends a request for a player list to the server, which retrieves the player list from the database and returns it to the device. The device displays the player list, and when the user taps on a specific athlete, it sends the athlete ID to the server. The server retrieves the player's profile information and returns it to the device, which displays it.
[1738] Input: Player selection request, player ID
[1739] Data processing: Acquisition of player list and profile information
[1740] Output: Player list, player profile information
[1741] Step 3:
[1742] When the user selects a player, a chat screen is displayed. When the user enters a message and presses the send button, the device sends the message to the server. The server uses a generative AI model to analyze the message, generate an athlete-like response, and return the response to the device. The device then displays the athlete-like response on the chat screen.
[1743] Input: User message
[1744] Data processing: Message analysis and response generation using generative AI models
[1745] Output: Athlete-like response
[1746] Step 4:
[1747] When a match is in progress, the server will continue to obtain the match status in real time. Every time the server detects a new match status, it will push the match result to the user's device. The device will receive the notification and display the match result to the user.
[1748] Input: Real-time match status data
[1749] Data processing: monitoring the match situation
[1750] Output: Match results via push notification
[1751] Step 5:
[1752] When a user selects the "Original Content" option from the main menu, the device requests a content list from the server. The server retrieves a list of original video content from the database and returns it to the device. The device displays the list, and when the user selects a specific content, the server provides that content to the device in streaming format.
[1753] Input: Original Content Request
[1754] Data processing: Acquisition of content list and content data
[1755] Output: Original content list, streaming content
[1756] Step 6:
[1757] When a user selects the "AR Photo Shoot" option, the device's camera activates and takes a photo of the athlete using the AR function. Once the user has finished taking the photo, the device uploads the photo data to the server. The server saves the photo and generates a sharing link that is returned to the device. The user can then use the link to share the photo on social media, etc.
[1758] Input: Photo request, photo data
[1759] Data processing: Upload and save photo data, generate share links
[1760] Output: Shared link
[1761] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1762] This invention achieves a higher level of fan engagement by combining an emotion engine with a system in which users communicate with AI athlete characters. This system is realized by the following programs and processes.
[1763] User server connection and authentication
[1764] When a user uses a terminal to access the system, they first go to the login screen. The user enters their ID and password and attempts to log in. The terminal sends the entered authentication information to the server, which then compares the received information with a database to authenticate the user. If authentication is successful, the user proceeds to the main menu.
[1765] Player Selection
[1766] When a user selects the "Select Player" option from the main menu, the device displays a list of players and the user taps on a specific player they want to chat with. The device sends the player's ID to the server, which retrieves the player's profile information from its database and returns it to the device, which displays it and allows the user to view information about that player.
[1767] Start chatting with AI characters
[1768] Once a specific player is selected, a chat screen appears and the user can enter a message. When the user presses the send button, the device sends the message to the server, which then relays the message to the AI chatbot. The AI chatbot analyzes the received message and also uses an emotion engine to generate a player-like response. The emotion engine analyzes the emotion from the user's message and generates an optimal response based on that emotion. The server returns the generated response to the device, which then displays it on the chat screen.
[1769] The role of the emotional engine
[1770] The emotion engine analyzes the messages and actions entered by the user and recognizes their emotions. For example, if a user enters "I had so much fun today!", the emotion engine recognizes the user's emotion as "joy." Based on this information, the AI chatbot generates a response that corresponds to joy, such as "That's great! Please come again!"
[1771] Notification of match results
[1772] As the match progresses, the server retrieves the match results in real time. When the server receives new match results, it sends them to the user's device via push notification. The device receives the notification and displays the match results to the user. The emotion engine analyzes the user's emotions and can optimize the response to the match results.
[1773] Original content distribution
[1774] When a user selects the "Original Content" option from the main menu, the device requests a content list from the server. The server retrieves the list of original content from the content database and returns it to the device. The device displays the list, and when the user selects a specific content, the server provides that content to the device in streaming format. The emotion engine can also recommend appropriate content based on the user's emotions.
[1775] AR photo taking and sharing
[1776] When a user selects the "AR Photo Shoot" option, the device's camera activates and allows the user to take a photo with the player using the AR function. Once the user has finished taking the photo, the device uploads the photo data to the server. The server saves the photo and generates a sharing link that is returned to the device. The user can then use the link to share the photo on social media, etc.
[1777] Purchase recommended gourmet foods and goods
[1778] When a user selects the "Recommended Food and Goods" option from the menu, the device sends a request to the server, which retrieves recommended food and goods information from a database and returns it to the device. The device displays a list, and when the user selects a specific item, a purchase request is sent to the server. The server completes the purchase and arranges for delivery. The emotion engine can present recommended items taking into account the user's emotional state.
[1779] Specific examples
[1780] For example, suppose a user logs in, selects a specific athlete (Athlete A), and sends a message on the chat screen saying, "I'm so happy today!" The server receives this message, and the emotion engine analyzes the emotion of "joy." Based on this information, the AI chatbot generates a response such as, "That's great! I'll do my best in the next game!" This response is then displayed on the user's chat screen. If a game is in progress, real-time game results are sent to the user's device via push notification. Users can also watch original content from the main menu and take photos with players using the AR function.
[1781] With the introduction of the emotion engine, the system can provide flexible and personalized responses based on user emotions, further increasing engagement, improving the fan experience and driving more visitors to stadiums and related facilities.
[1782] The processing flow will be explained below.
[1783] Program processing steps
[1784] User server connection and authentication
[1785] Step 1:
[1786] The user launches the Hawks Connection app and goes to the login screen.
[1787] Step 2:
[1788] The user enters their ID and password on the login screen and clicks the login button.
[1789] Step 3:
[1790] The device sends the ID and password authentication information to the server.
[1791] Step 4:
[1792] The server compares the received ID and password with the database and performs authentication.
[1793] Step 5:
[1794] If the authentication is successful, the server returns a message indicating successful authentication to the terminal, and the terminal displays the main menu.
[1795] Player Selection
[1796] Step 1:
[1797] The user selects the "Player Selection" option from the main menu.
[1798] Step 2:
[1799] The device will display a player list screen, and the user can tap on the player they want to chat with.
[1800] Step 3:
[1801] The device sends the player ID to the server.
[1802] Step 4:
[1803] The server retrieves the player's profile information from the database and returns it to the terminal.
[1804] Step 5:
[1805] The device displays the received player profile information to the user.
[1806] Start chatting with AI characters
[1807] Step 1:
[1808] The user types a message in the chat input field and presses the send button.
[1809] Step 2:
[1810] The device sends the user's message to the server.
[1811] Step 3:
[1812] The server sends the message to the emotion engine, which analyzes the user's emotions.
[1813] Step 4:
[1814] The server passes the analysis results to the AI chatbot.
[1815] Step 5:
[1816] The AI chatbot generates appropriate responses based on the results of emotion analysis.
[1817] Step 6:
[1818] The server returns the generated response to the terminal, which displays the response on the chat screen.
[1819] Notification of match results
[1820] Step 1:
[1821] The server retrieves the match results in real time.
[1822] Step 2:
[1823] The server sends the match results to the user's device via push notification.
[1824] Step 3:
[1825] The device receives the notification and displays the match results to the user.
[1826] Original content distribution
[1827] Step 1:
[1828] The user selects the "Original Content" option from the main menu.
[1829] Step 2:
[1830] The terminal requests the server to acquire a content list.
[1831] Step 3:
[1832] The server obtains a list of original contents from the content database and returns it to the terminal.
[1833] Step 4:
[1834] The device displays a content list, and the user selects a specific content.
[1835] Step 5:
[1836] The terminal requests the data of the selected content from the server, and the server streams the data.
[1837] AR photo taking and sharing
[1838] Step 1:
[1839] The user selects the "Take AR Photo" option from the menu.
[1840] Step 2:
[1841] The device's camera function will be activated, and the AR function will be used to take photos with the player.
[1842] Step 3:
[1843] Once the user has taken a photo, the device uploads the photo data to the server.
[1844] Step 4:
[1845] The server stores the photo data, generates a sharing link, and returns it to the device.
[1846] Step 5:
[1847] Users can use the link to share photos on social media etc.
[1848] Purchase recommended gourmet foods and goods
[1849] Step 1:
[1850] The user selects the "Recommended Food & Goods" option from the main menu.
[1851] Step 2:
[1852] The terminal sends a request to the server, which retrieves information from the database.
[1853] Step 3:
[1854] The server returns a list of recommended gourmet foods and goods to the device.
[1855] Step 4:
[1856] The device displays a list and the user selects a specific item.
[1857] Step 5:
[1858] The terminal sends a purchase request to the server, and the server carries out the purchase procedure.
[1859] Step 6:
[1860] The server handles purchase confirmation and shipping arrangements.
[1861] Use of emotion engine
[1862] Step 1:
[1863] When a user sends a message, the server receives the message and sends it to the emotion engine.
[1864] Step 2:
[1865] The emotion engine analyzes messages and recognizes the user's emotions.
[1866] Step 3:
[1867] The emotion engine returns the recognized emotion to the server.
[1868] Step 4:
[1869] The server communicates the emotion analysis results to the AI chatbot.
[1870] Step 5:
[1871] The AI chatbot generates appropriate responses based on the results of sentiment analysis.
[1872] Step 6:
[1873] The server returns the generated response to the terminal, which displays the response to the user.
[1874] Specific examples
[1875] For example, suppose a user logs in, selects a specific athlete (Athlete A), and sends a message on the chat screen saying, "I'm so happy today!" The server receives this message, and the emotion engine analyzes it for the emotion of "joy." Based on this information, the AI chatbot generates a response such as, "That's great! I'll do my best in the next game!" This response is then displayed on the user's chat screen. While a game is in progress, real-time game results are sent to the user's device via push notification. Users can also watch original content from the main menu and take photos with players using the AR function. With the introduction of the emotion engine, the system can provide flexible and personalized responses based on the user's emotions, further increasing engagement. This improves the fan experience and increases visitor numbers to stadiums and related facilities.
[1876] Example 2
[1877] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1878] The problem this invention aims to solve is to realize more natural and emotional dialogue in a system that enhances fan engagement between users and athletes, and to respond to users' real-time and individual needs. Conventional systems have not been able to provide responses that reflect the user's emotions, and have not provided sufficient real-time game results or original content. Furthermore, the user experience, such as taking photos using AR functions or purchasing recommended gourmet food or merchandise, is limited. It is necessary to solve these problems and improve user satisfaction.
[1879] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[1880] In this invention, the server includes means for enabling a user to chat one-on-one with an AI character of a specific athlete, means for authenticating the ID and password entered by the user on the login screen, means for providing profile information of the athlete selected by the user, means for the AI character to receive the user's message, analyze the emotion using an emotion engine, and generate a response based on the emotion, means for displaying the generated response to the user, means for providing real-time game results and original content, means for the user to take and share photos with the athlete using an AR function, means for the user to purchase gourmet food recommended by the athlete and official cheering merchandise, means for the emotion engine to analyze the user's message and recognize the emotion, means for the AI chatbot to generate an optimal response based on the recognized emotion, and means for the server to obtain game results in real time while the game is in progress and send them to the device via push notification. This allows the user to receive personalized responses based on their emotion, providing real-time information and a diverse entertainment experience.
[1881] An "AI athlete character" is a virtual character created by artificial intelligence that mimics an athlete and can chat one-on-one with users.
[1882] "Users" refer to the people who use this system and communicate with the AI athlete characters within the system.
[1883] An "emotion engine" is a software component that analyzes emotions from messages entered by users and generates responses based on those emotions.
[1884] An "AI chatbot" is an artificial intelligence program that receives messages from users, analyzes them, and generates appropriate responses.
[1885] An "ID" is identification information used to identify a user, and is usually composed of a unique string of characters or numbers.
[1886] A "password" is a secret string of characters used in combination with an ID to authenticate a user.
[1887] "Authentication information" refers to the combination of ID and password that a user enters when logging in.
[1888] A "database" is a collection of electronically managed data that stores user information, athlete profile information, and the like.
[1889] "Main Menu" refers to the screen that serves as the entrance to the main functions of the system, which the user can access after successful authentication.
[1890] "Profile information" is detailed data about a particular athlete, including the athlete's background, performance, characteristics, etc.
[1891] "Real-time" refers to data being generated or transmitted instantly, without delay.
[1892] "Match Results Update" is a means of providing information to users quickly about the results of ongoing or completed matches.
[1893] "Original content" refers to digital content such as original video, audio, and text that the system provides to users.
[1894] The "AR function" is an augmented reality technology that displays digital information overlaid on real-world scenery.
[1895] "Means for taking a photo" refers to a method by which a user generates image data using the camera function of the device.
[1896] "Sharing methods" are the ways in which users can share photos they take or content they generate with other users online.
[1897] "Gourmet" refers to high-quality food and beverages endorsed by athletes.
[1898] "Official cheering goods" refers to cheering items and accessories officially approved by athletes or organizations.
[1899] "Means of purchase" refers to the mechanism by which users order and pay for gourmet food and official support goods through the system.
[1900] "Push notification" is a method by which a server sends important information to a user's device in real time.
[1901] The system of the present invention is an advanced fan engagement system that combines multiple technologies to enable users to communicate with AI athlete characters. The system includes hardware and software for implementing specific methods.
[1902] System Configuration
[1903] The system mainly consists of the following components:
[1904] (Server): Database server, AI chatbot, emotion engine, push notification system
[1905] (Device): A device (smartphone, tablet, PC, etc.) that accepts user operations and displays information accordingly.
[1906] (User): The person who operates the system and communicates with the athlete AI character.
[1907] Overview of the main technical components and processes
[1908] User authentication and login
[1909] When a user accesses the system using a terminal, they first go to a login screen. The user enters their ID and password, and if authentication is successful, they proceed to the main menu. Here, databases such as MySQL and PostgreSQL are used.
[1910] Player selection and profile display
[1911] The user selects the "Player Selection" option from the main menu and chooses a specific player from the displayed player list. The device sends the player ID to the server, which retrieves the player's profile information from the database and returns it to the device, allowing the user to view the player's details.
[1912] Chat with AI characters
[1913] When a user wants to chat with a selected player, they enter a message on the chat screen and press the send button. The device sends the message to the server, which then forwards it to the AI chatbot. The AI chatbot uses a generative AI model (e.g., GPT-4) to analyze the message's sentiment with an emotion engine. Based on this analysis, it generates an optimal response and returns it to the device. The device then displays the generated response on the chat screen.
[1914] Notification of match results
[1915] While the match is in progress, the server retrieves the match results in real time, and if important results are obtained, they are sent to the user's device as push notifications. This notification function uses push notification services such as Firebase Cloud Messaging (FCM).
[1916] Original content distribution
[1917] When a user selects the "Original Content" option, the terminal requests a content list from the server, which retrieves the list from the content database and returns it to the terminal, providing the content selected by the user in streaming format.
[1918] AR photo taking and sharing
[1919] When a user selects the "AR Photo Shoot" option, the device's camera activates and the user can take a photo with the player using the AR function. After taking the photo, the device uploads the photo data to the server, which then generates a sharing link and returns it to the device. The user can then share the link on social media, etc.
[1920] Purchase recommended gourmet foods and goods
[1921] When a user selects the "Recommended Food and Goods" option, the device sends a request to the server, which retrieves information about recommended foods and goods from the database and returns it to the device. When the user selects a specific item and sends a purchase request to the server, the server completes the purchase process and arranges for delivery.
[1922] Specific examples
[1923] For example, the following shows the process flow when a user logs in, selects a specific athlete (Athlete A), and sends the message "I'm so happy today!" on the chat screen. The server receives this message, and the emotion engine analyzes the "joy." Based on this information, the AI chatbot generates a response such as "That's great! I'll do my best in the next game!" This response is displayed on the user's chat screen. Additionally, if a game is in progress, real-time game results are sent to the user's device via push notification. Furthermore, users can view original content from the main menu and take photos with the players using the AR function.
[1924] Prompt Sentence Examples
[1925] "I want to send a message to a specific athlete (Athlete A) and get an emotional response. For example, if I send a message saying, 'I'm so happy today!' I want to generate an appropriate reply."
[1926] By implementing this invention, users can receive personalized responses based on their emotions, and real-time information provision and diverse entertainment experiences are possible.
[1927] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1928] Step 1:
[1929] The user boots up using a terminal and accesses the system login screen.
[1930] Step 2:
[1931] The user enters their ID and password into the login screen. This information is sent to the server by the terminal. The input data is sent to the server in the form of "user ID" and "password."
[1932] Step 3:
[1933] The server checks the received ID and password against a database containing pre-registered user information. The result of the check determines whether authentication was successful.
[1934] Step 4:
[1935] The server sends the authentication result to the terminal. If the authentication is successful, a success message is sent along with information on how to access the main menu. If the authentication fails, an authentication error message is sent.
[1936] Step 5:
[1937] Based on the authentication result received by the device from the server, if authentication is successful, the device displays the main menu screen, where the user can select their next action.
[1938] Step 6:
[1939] The user selects the "Select Player" option from the main menu. A request for a player list is sent from the terminal to the server.
[1940] Step 7:
[1941] The server retrieves the player list from the database and returns the data to the device, including player names and profile photos.
[1942] Step 8:
[1943] The terminal displays the player list received from the server to the user, who then selects a specific player from the list with whom he or she wants to chat.
[1944] Step 9:
[1945] When the user selects a particular player, the player's ID is sent by the device to the server, which retrieves the player's details from the database and returns them to the device.
[1946] Step 10:
[1947] The device displays the detailed player profile received from the server to the user, and transitions to a screen where the user can start chatting with the player.
[1948] Step 11:
[1949] The user enters a message on the chat screen and presses the send button, which sends the message from the device to the server.
[1950] Step 12:
[1951] The server forwards the received message to the AI chatbot, which then analyzes the message using a generative AI model (e.g., GPT-4).
[1952] Step 13:
[1953] The AI chatbot analyzes the content of the message and uses an emotion engine to recognize emotions. Emotional analysis data is obtained in the form of "happiness" or "sadness," etc.
[1954] Step 14:
[1955] Based on the analysis results of the emotion engine, the AI chatbot generates a response message. For example, if the emotion of "joy" is recognized, the response message generated will be "That's great!"
[1956] Step 15:
[1957] The server sends the generated response message to the terminal.
[1958] Step 16:
[1959] The terminal displays the response message on the chat screen so that the user can check it.
[1960] Step 17:
[1961] While the match is in progress, the server retrieves the match results in real time, for example, by using an API to retrieve the match status data.
[1962] Step 18:
[1963] When the server obtains new match results, it sends them to the user's device via push notification.
[1964] Step 19:
[1965] The device receives the notification and displays the match results to the user, while the emotion engine analyzes the user's reaction and provides appropriate feedback.
[1966] Step 20:
[1967] If the user selects the "original content" option, the terminal requests a content list from the server.
[1968] Step 20:
[1969] The server retrieves a list of original content from the content database and returns it to the device. The retrieved data includes video thumbnails and titles.
[1970] Step 21:
[1971] The terminal displays the received list to the user, allowing the user to select content.
[1972] Step 22:
[1973] Once the user selects the content they wish to view, the server provides that content in streaming format.
[1974] Step 23:
[1975] The terminal receives the streaming data, allowing the user to view the content.
[1976] Step 24:
[1977] When a user selects the "AR Photo Shoot" option, the device's camera function is activated, enabling the AR function and allowing the user to take photos with the players.
[1978] Step 25:
[1979] Once the user has taken a photo, the device uploads the photo data to the server.
[1980] Step 26:
[1981] The server stores the uploaded photos and generates a sharing link that is returned to the device.
[1982] Step 27:
[1983] The device displays the received link information to the user, who can then use the link to share the photo on social media platforms.
[1984] Step 28:
[1985] The user selects the "Recommended Food and Goods" option. The device sends a request to the server, which retrieves information about recommended foods and goods from the database and returns it to the device.
[1986] Step 29:
[1987] The terminal displays the received list to the user, allowing the user to select a particular item.
[1988] Step 30:
[1989] Once the user selects a particular item, a purchase request is sent from the terminal to the server, containing user information and details of the selected item.
[1990] Step 31:
[1991] The server processes the purchase request, completes the purchase through the payment system, and then arranges for delivery.
[1992] Step 32:
[1993] The emotion engine analyzes the user's emotional state and recommends appropriate items based on the state. For example, if the user is in a "joy" state, it will recommend related fun goods.
[1994] Step 33:
[1995] The recommended items will be displayed on the device, allowing the user to re-initiate the purchase process.
[1996] The above are the specific processing steps of this system.
[1997] (Application example 2)
[1998] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1999] Traditional methods of interaction between athletes and fans make it difficult to respond flexibly to fans' emotions, and the provision of personalized content is limited. Furthermore, notifications of game results and recommendations of related content are not optimized to take user emotions into account. This situation has led to challenges in improving fan engagement and deepening the fan experience.
[2000] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: a means for allowing a user to have a one-on-one conversation with an AI character of a specific athlete; a means for providing real-time game progress updates and unique content; a means for a user to take and share photos with the athlete using an augmented reality function; a means for a user to purchase athlete-recommended food and beverages and official support merchandise; a means for recognizing a user's emotions using an emotion analysis engine and personalizing and recommending content based on the emotions; a means for authenticating identification information and a password entered by the user on the login screen; a means for providing profile information of the athlete selected by the user; a means for recommending and delivering personalized sports-related content based on the user's emotions; a means for an AI character to generate a response to a user's message; a means for displaying the generated response; and a means for obtaining game results in real time and generating and notifying a response based on the user's emotions. This makes it possible to provide personalized content based on the user's emotions, improving fan engagement and deepening the fan experience.
[2001] An "AI character of a specific athlete" is a virtual character with artificial intelligence created to imitate a specific athlete, and which communicates with users.
[2002] "User" refers to an individual, fan, or user of this system.
[2003] "Means for dialogue" means a mechanism that allows users to exchange messages with the AI character of a specific athlete and for them to respond to each other.
[2004] "Match progress updates" refers to information that provides the progress and results of a match in real time.
[2005] "Original Content" refers to videos, articles, interviews, behind-the-scenes footage, and other information that is specifically created and hosted by the System.
[2006] "Means of providing information in real time" refers to technologies and mechanisms that deliver information to users instantly.
[2007] "Augmented reality" refers to a technology that displays digital information overlaid on the real world, for example, by synthesizing virtual characters onto the scenery seen through a camera. 【20...
Claims
1. A means for users to chat one-on-one with AI characters of specific athletes, A means to provide real-time game results and original content, Users can take and share photos with athletes using the AR feature, The system includes a means for users to purchase athlete-recommended gourmet food and official support merchandise.
2. A means to authenticate the ID and password entered by the user on the login screen, 10. The system of claim 1, further comprising means for providing profile information for a user-selected athlete.
3. A means for the AI character to generate responses to user messages; 10. The system of claim 1, further comprising means for displaying the generated response to a user.
Citation Information
Patent Citations
Persona chatbot control method and system
JP2022180282A