system

Abstract

We provide the system. [Solution] A means for receiving user authentication information, comparing it with a database, and performing authentication, A method for receiving SNS account information and linking via the corresponding SNS API, A means of filtering content based on user settings, A means of providing filtered content to the user's terminal, We provide an internal billing option and a means to enable additional features, A social networking service browsing system that includes [unclear text].

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Current social networking services (SNS) may contain defamatory, sexual, and violent content, which causes significant problems for users who require a safe and comfortable browsing environment. Also, managing a large number of SNS accounts is time-consuming and inconvenient. The present invention aims to solve these problems and provide an environment in which users can safely and comfortably browse multiple SNS within one application.

Means for Solving the Problems

[0005] The present invention solves the above problems by the following means: providing a social networking service browsing system that includes means for receiving user authentication information and authenticating it by matching it with a database; means for receiving SNS account information and linking it via the corresponding SNS API; means for filtering defamatory, sexual, and violent content based on user settings; means for providing filtered content to the user's terminal; and means for providing internal billing options and enabling additional functions. This enables users to use multiple SNS safely and comfortably.

[0006] "User authentication information" refers to an email address, password, or other authentication method used to identify a user and grant them access rights.

[0007] A "database" is a structured data storage system that stores user information and settings, and allows for searching and matching.

[0008] "SNS account information" refers to the username, password, or other authentication information used to access social networking services (SNS).

[0009] "API" stands for Application Programming Interface, and it is a defined interface for exchanging data and functions between different software applications.

[0010] "Filtering" is the process of excluding unwanted or harmful content based on specific criteria.

[0011] "Defamatory content" refers to content that attacks, damages the reputation of, or negatively evaluates others.

[0012] "Sexual content" refers to content that contains erotic or sexually explicit elements.

[0013] "Violent content" refers to content that includes or suggests physical injury or acts of violence.

[0014] An "internal billing option" is a system that charges users an additional fee to use extra features or benefits beyond the basic functionality.

[0015] A "user terminal" refers to a computing device (e.g., smartphone, tablet, PC) used by a user to access social networking services. [Brief explanation of the drawing]

[0016] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11]It is a sequence diagram showing the processing flow of the data processing system in Embodiment 1. [Figure 12] It is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] It is a sequence diagram showing the processing flow of the data processing system in Embodiment 2 when the emotion engine is combined. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when the emotion engine is combined.

Mode for Carrying Out the Invention

[0017] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0018] First, the terms used in the following description will be explained.

[0019] In the following embodiments, the numbered processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0020] In the following embodiments, the numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0021] In the following embodiments, the signed storage is one or more non-volatile storage devices that store various programs and various parameters. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes.

[0022] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0023] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0024] [First Embodiment]

[0025] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0026] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0027] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0028] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0029] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0030] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0031] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0032] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0033] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0034] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0035] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0036] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0037] This invention is a "social networking service browsing system" aimed at enabling users to safely and comfortably use multiple social networking services (SNS). This system provides secure access using user authentication information, allows for centralized management of multiple SNS accounts, and includes functions to filter defamatory, sexual, and violent content. Furthermore, it offers additional filtering and SNS account management functions through internal billing options.

[0038] Overall System Overview

[0039] User Authentication

[0040] To use the application, users must first enter their authentication information (email address and password). The device sends this authentication information to the server. The server compares it with the database and authenticates the user. If authentication is successful, the user interface is displayed, and the user can link additional social media accounts.

[0041] Linking social media accounts

[0042] The user enters their social media account information through the application. The device sends this information to the server, which then performs account linking via the corresponding social media API. If successful, the information is stored in the database.

[0043] Filter settings

[0044] Users can set filters for content such as "defamation," "sexual content," and "violent content." The device sends this setting information to the server, which stores this information in a database.

[0045] Content retrieval and filtering

[0046] The device sends a request to the server to retrieve the latest posts from its linked social media accounts. The server uses each social media API to retrieve the content, analyzes it, and filters it. Inappropriate content is excluded, and the filtered, clean content is returned to the device.

[0047] Internal billing feature

[0048] Users can choose an in-app purchase option to enable additional filtering features and management of new social media accounts. This will allow users to access a wider range of services.

[0049] Specific processing examples

[0050] Specific examples of authentication

[0051] The user enters their email address and password and clicks the "Login" button. The device sends the entered information to the server, which verifies the database. If authentication is successful, the user interface is displayed, and options such as "Link SNS account" are shown.

[0052] Examples of linking social media accounts

[0053] If a user wants to link their Instagram account, they enter their Instagram username and password into the app. The device sends this information to the server, which attempts to link using the Instagram API. If successful, the information is stored in the database, and the user can then view Instagram content within the app.

[0054] Specific examples of filter settings

[0055] If a user selects the "defamation" filter, that setting is sent to the server and stored in the database. From then on, all retrieved content is analyzed based on this filter setting, and posts containing defamation are excluded.

[0056] Examples of content retrieval and filtering

[0057] When a user clicks the "View" button, their device sends a request to the server. The server uses the Instagram API to retrieve the latest posts and analyzes them with a filtering engine. As a result, defamatory, sexual, and violent content is filtered out, and clean content is returned to the device.

[0058] Examples of internal billing features

[0059] If a user wants to use additional filtering features, they select the option in the app's settings screen and proceed with the payment process. The device sends the payment information to the server, which then authenticates the transaction in conjunction with the payment system. If successful, the new filtering feature is enabled, and the user can use the added filters.

[0060] Thus, the present invention is designed to enable users to safely and comfortably use multiple social networking services (SNS), and is a system that improves the user experience through a function to filter inappropriate content and an in-app purchase option.

[0061] The following describes the processing flow.

[0062] Step 1:

[0063] The user enters their email address and password on the application's login screen.

[0064] Step 2:

[0065] The device sends the entered authentication information (email address and password) to the server.

[0066] Step 3:

[0067] The server compares the received authentication information with the registered information in the database and attempts to authenticate the user.

[0068] Step 4:

[0069] If authentication is successful, the server sends an authentication success message back to the terminal. If authentication fails, an error message is sent back.

[0070] Step 5:

[0071] If authentication is successful, the device will display the user interface for linking the social media account.

[0072] Step 6:

[0073] The user enters their social media account information (e.g., username, password).

[0074] Step 7:

[0075] The device sends the entered SNS account information to the server.

[0076] Step 8:

[0077] The server performs the integration process via the SNS API, and if successful, saves the information to the database.

[0078] Step 9:

[0079] The server sends a success message to the device when linking the social media account.

[0080] Step 10:

[0081] On the filter settings screen, users can select filter settings for defamation, sexual content, and violent content.

[0082] Step 11:

[0083] The terminal sends the configured filter information to the server.

[0084] Step 12:

[0085] The server saves the received filter settings information to the database.

[0086] Step 13:

[0087] The user clicks the "Browse" button.

[0088] Step 14:

[0089] The device sends a request to the server to retrieve content from the linked social media account.

[0090] Step 15:

[0091] The server uses the APIs of each social networking service to send the retrieved content to a filtering engine, which then analyzes and filters it based on the user's filter settings.

[0092] Step 16:

[0093] The server generates filtered, clean content and sends it back to the terminal.

[0094] Step 17:

[0095] The device displays filtered content in the user interface.

[0096] Step 18:

[0097] Users can select a paid option in the app's settings screen to enable additional filtering features or new social media accounts.

[0098] Step 19:

[0099] The device sends the selected billing information to the server.

[0100] Step 20:

[0101] The server interacts with the payment system, performs billing, and, if successful, updates the database to enable the new feature.

[0102] Step 21:

[0103] The server sends a notification to the device confirming the successful completion of the billing process.

[0104] Step 22:

[0105] The device will display a notification to the user that the payment was successful and enable new filtering and social media account management features.

[0106] (Example 1)

[0107] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0108] In modern times, users often have multiple social networking service (SNS) accounts. However, there is a lack of safe and convenient ways to manage them all in one place. Furthermore, the presence of inappropriate content (defamatory, sexual, or violent material) can damage the user experience. Additionally, the limited means users have access to additional features makes flexible customization difficult. There is a need to provide an environment where users can safely and securely use multiple SNS platforms.

[0109] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0110] In this invention, the server includes means for receiving user authentication information and authenticating it by matching it with a database, means for receiving social networking service account information and coordinating it via a corresponding application programming interface, and means for filtering digital media content based on user settings. This allows users to securely centrally manage multiple SNS accounts and use them in a clean state with inappropriate content removed. Furthermore, flexible customization features are provided through internal billing options, which will improve the user experience.

[0111] "User authentication information" refers to information (primarily email address and password) that a user provides to prove their identity.

[0112] A "database" is a structured collection of data that a system uses to efficiently store, manage, and retrieve data.

[0113] An "Application Programming Interface (API)" is an interface that allows different software systems to access specific functions.

[0114] A "social networking service (SNS)" is a web-based platform designed for user interaction.

[0115] "Digital media content" refers to information that has been digitized in various forms, such as text, images, audio, and video.

[0116] "Filtering" is the process of removing unnecessary or inappropriate elements from data based on specific criteria.

[0117] A "user terminal" refers to an electronic device such as a computer, smartphone, or tablet that a user uses to access the system.

[0118] An "internal billing option" is a payment method that users use to access additional features or services provided within the software.

[0119] "Additional features" are supplementary functions provided in addition to the basic functions, and are intended to improve the user experience.

[0120] "Defamatory, sexual, and violent content" refers to digital media content that contains inappropriate language that attacks users, content that is considered sexually inappropriate, and content that promotes violence.

[0121] This invention relates to a "social networking service browsing system" that enables users to safely and comfortably use multiple social networking services (SNS). This system provides user authentication, SNS account linking, content filtering, and additional functions.

[0122] Hardware and software configuration

[0123] This system consists primarily of a server and user terminals. The server is a high-performance computer and includes a database server, application server, and content filtering engine. User terminals consist of smartphones, tablets, or personal computers.

[0124] The specific software used includes purchased commercial or open-source database management systems (DBMS), RESTful API frameworks for API calls, and natural language processing (NLP) or machine learning models as content filtering engines.

[0125] User Authentication

[0126] The user enters an email address and password to use the system. The device sends this authentication information to the server. The server compares it with the authentication information in the database, and if successful, generates an authentication token and returns it to the device. For example, if the user enters "user@example.com" and "password123", the device sends this to the server, and the server returns a token after authentication.

[0127] Linking social media accounts

[0128] The user enters their social media account information (e.g., Instagram username and password). The device sends this information to the server, which attempts to establish a connection via the corresponding social media API. For example, when a user enters their Instagram account information, the server calls the Instagram API and establishes the connection.

[0129] Content filtering

[0130] Users can set filters such as "defamation," "sexual," and "violent." The device sends this setting information to the server, which filters digital media content based on the settings. For example, if a user selects the "defamation" filter, the server analyzes the retrieved content and excludes posts containing defamation.

[0131] Internal billing option

[0132] Users can select an internal billing option to enable additional filtering features or manage new social media accounts. The device sends billing information to the server, which then processes the billing in conjunction with the payment system. For example, if a user selects an additional filtering feature and enters billing information, the server processes the billing through the payment system, and the new filtering feature is enabled.

[0133] Example of a prompt

[0134] Please describe the overview of the social networking service browsing system using the following steps:

[0135] 1. The user launches the application and enters their login information.

[0136] 2. Explain the authentication process.

[0137] 3. We will explain how to link your social media accounts.

[0138] 4. Instructions for setting up filters are shown.

[0139] 5. Explain the content retrieval and filtering process.

[0140] 6. Explain how to use the in-app purchase feature.

[0141] ---

[0142] Thus, the present invention is a system that allows users to securely manage multiple SNS accounts in a centralized manner, eliminate inappropriate content, and provide flexible customization functions.

[0143] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0144] Step 1:

[0145] User Authentication

[0146] Specific actions: The user launches the application and is redirected to the login screen. The user enters their email address and password.

[0147] Input: The email address and password entered by the user.

[0148] Data processing: The terminal sends these authentication credentials to the server. The server compares the received authentication credentials with the database.

[0149] Output: The server returns the authentication result, and if successful, generates an authentication token and returns it to the terminal.

[0150] Example: When a user enters the email address "user@example.com" and password "password123" and presses the "Login" button, the device sends this information to the server. The server verifies the information against its database and returns an authentication token upon successful authentication.

[0151] Step 2:

[0152] Linking social media accounts

[0153] Specific action: The user is redirected to the account linking screen and enters their social media account information.

[0154] Input: Username and password for the social networking service entered by the user.

[0155] Data processing: The terminal sends the entered SNS account information to the server. The server attempts to link the account via the corresponding application programming interface (API).

[0156] Output: If the connection is successful, the server saves the account information to the database and sends a connection confirmation message to the device.

[0157] Specific example: When a user enters their Instagram account username "insta_user" and password "insta_pass", the device sends this information to the server. The server attempts to connect using the Instagram API, and if successful, notifies the device of the successful connection.

[0158] Step 3:

[0159] Filter settings

[0160] Specific action: The user navigates to the filter settings screen and selects filter options such as "defamation," "sexual," or "violent."

[0161] Input: The filter options selected by the user.

[0162] Data processing: The terminal sends the selected filter settings to the server. The server records this information in its database.

[0163] Output: The server notifies the terminal that the filter settings were successful.

[0164] Specific example: When a user selects the "defamation" filter, the device sends this setting information to the server, which then stores it in a database. Upon successful saving, the server notifies the device that the filter settings have been completed.

[0165] Step 4:

[0166] Content retrieval and filtering

[0167] Specific action: The user clicks the content viewing button.

[0168] Input: User's content retrieval request.

[0169] Data processing: The device sends a content retrieval request to the server. The server uses the corresponding SNS API to retrieve the latest posts and analyzes and filters the content based on the configured filters.

[0170] Output: Returns filtered, clean content to the device.

[0171] Specific example: When a user clicks the "View" button, their device sends a request to the server. The server uses the Instagram API to retrieve the latest posts and analyzes them with a filtering engine. Defamatory, sexual, and violent content is filtered out, and safe content is returned to the device.

[0172] Step 5:

[0173] Internal billing option

[0174] Specific operation: The user selects options to enable additional filtering functions or new social media account management functions.

[0175] Input: Billing information entered by the user.

[0176] Data processing: The terminal sends billing information to the server. The server works with the payment system to process the billing.

[0177] Output: The server checks the billing process and, if successful, notifies the device that the new feature has been enabled.

[0178] Specific example: When a user selects the "additional filter function" and enters billing information, the device sends this information to the server, which then uses the payment system to process the payment. After success, the server notifies the device that the new filter function is now available.

[0179] (Application Example 1)

[0180] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0181] Many modern users utilize multiple social networking services (SNS), requiring them to manage separate authentication credentials to access each service. Furthermore, SNS platforms often contain defamatory, sexually explicit, and violent content, posing a challenge in protecting users from this inappropriate material. Moreover, providing a safe browsing environment necessitates the integration of the real and digital worlds through the use of smart devices.

[0182] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0183] In this invention, the server includes means for receiving user authentication information and authenticating it by matching it with a database, means for receiving service account information and coordinating with the corresponding service via an API, and means for filtering information based on user settings. This makes it possible to centrally manage multiple services and provide a secure browsing environment by filtering inappropriate content. Furthermore, by integrating real-world information and digital content via smart devices, the user experience can be improved.

[0184] "User authentication information" refers to the identification information necessary for a user to access a system, and generally consists of things like an email address and password.

[0185] A "database" is a collection of data that is systematically structured to allow for the efficient collection, management, and retrieval of information.

[0186] "Authentication" is the process of verifying that the information entered by the user (authentication information) is accurate and that the user has the authority to access the system.

[0187] "Service account information" refers to information about accounts for various social networking services (SNS) and other online services, and usually includes usernames and passwords.

[0188] "API" stands for Application Programming Interface, and it is an interface that allows one piece of software to communicate with other pieces of software.

[0189] "User settings" refer to various settings that users can configure to customize their own usage environment, including filtering targets and display methods.

[0190] "Filtering information" is the process of selecting and removing inappropriate or unnecessary content based on specific criteria.

[0191] A "user terminal" is a device that a user can directly operate, and includes smartphones, smart glasses, tablets, and other similar devices.

[0192] An "internal billing option" is a system where users pay an additional fee to use extra features within an application or service.

[0193] "Integrating real-world information with digital content" means providing an environment where the physical real world and digital information can be linked and used interactively through smart devices.

[0194] This invention is a system that enables users to safely and comfortably use multiple social networking services (SNS). This system includes functions for user authentication, SNS account linking, information filtering, provision of filtered information, provision of in-app purchase options, and integration of real-world information and digital content via smart devices.

[0195] First, the user enters their authentication information (email address and password) and sends it from their device to the server. The server then verifies this information against its database and performs authentication. If authentication is successful, the user enters their service account information (username and password for various social networking services) and sends it to the server. The server attempts to connect via the API of the specific service, and if successful, saves that information to its database.

[0196] Next, the user selects their desired filtering conditions (e.g., defamatory, sexual, or violent content) on the settings screen and sends the settings information to the server. This settings information is stored in a database and used for subsequent content filtering. When a user wants to view the latest posts from social media, they send a request from their device to the server. The server retrieves the content using the API of each social media platform, analyzes it with a filtering engine, and removes inappropriate content. The filtered, clean content is returned to the device and provided to the user.

[0197] When using the in-app purchase option, users select the option in the app's settings screen and proceed with the purchase. The device sends the purchase information to the server, which then authenticates the transaction in conjunction with the payment system. If successful, the new filtering feature is enabled, allowing users to enjoy enhanced security and convenience.

[0198] Furthermore, smart devices (such as smartphones and smart glasses) can be used to interactively integrate information from the real world with digital content. This can improve the user experience, for example, by overlaying digital information in front of the user's eyes.

[0199] For example, if a user has set up a defamation filter and linked their Instagram and Twitter accounts, when the user opens the app and views the latest posts, their account information will first be authenticated. Then, the latest posts will be retrieved using the APIs of each social media platform, and posts containing defamation will be filtered out. Ultimately, only clean content will be provided to the user.

[0200] Example of a prompt:

[0201] For example, a user might link their Instagram and Twitter accounts and set up a defamation filter. When the user opens the app and tries to view the latest posts, user authentication is first successful, and then the latest posts are retrieved via the APIs of each social media platform. After that, the retrieved content is filtered, and only clean content is displayed to the user.

[0202] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0203] Step 1:

[0204] The user enters their authentication information (email address and password) into the device. The device sends this authentication information to the server. The server compares it with the database and returns the result. If authentication is successful, the user is granted access to the next step; if it fails, an error message is returned.

[0205] Enter: Email address, password

[0206] Output: Authentication result (success / failure)

[0207] Step 2:

[0208] The user enters the service account information they want to link (e.g., SNS username and password) into their device. The device sends this information to the server. The server attempts to link the account via the corresponding service's API and saves the result to a database. It also notifies the user of the success or failure of the linking.

[0209] Input: Service account information

[0210] Output: Integration result (success / failure)

[0211] Step 3:

[0212] The user selects filter settings options on their device (e.g., filtering for defamatory, sexual, or violent content). The device sends this setting information to the server. The server stores this information in a database and notifies the user when the filtering settings are updated.

[0213] Input: Filter settings options

[0214] Output: Saved filter settings

[0215] Step 4:

[0216] The user clicks the "Get Content" button on their device. The device sends a request to the server. The server uses the APIs of each connected social networking service to retrieve the latest content. The retrieved content is filtered, and inappropriate content is removed. Clean content is returned to the device and displayed to the user.

[0217] Input: Content Retrieval Request

[0218] Output: Filtered content

[0219] Step 5:

[0220] If a user wants to use additional filtering features, they select a payment option within the app and initiate the payment process. The device sends the payment information to the server. The server then works with an external payment system to process the payment. If the payment is successful, the new filtering feature is enabled, and the user receives a notification.

[0221] Input: Select billing option, billing information

[0222] Output: Results of enabling the new filter function

[0223] Step 6:

[0224] When a user wants to integrate real-world information with digital content using a smart device (e.g., smart glasses), they send a request from the device to a server. The server integrates the user's current location and surrounding information with the digital content and sends that information back to the device. This allows the user to visually experience the fused content in real time.

[0225] Input: Integration request, current location information

[0226] Output: Integrated digital content

[0227] These steps enable the system of the present invention to provide users with a safe and comfortable SNS usage environment.

[0228] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0229] This invention is a "social networking service browsing system" aimed at enabling users to safely and comfortably use multiple social networking services (SNS). The system provides secure access using user authentication information, allows for centralized management of multiple SNS accounts, and includes functions to filter defamatory, sexual, and violent content. Furthermore, it offers additional filtering and SNS account management functions through internal billing options. In addition, the invention incorporates an emotion engine that recognizes user emotions, providing additional functions to improve the user experience.

[0230] Overall System Overview

[0231] User Authentication

[0232] To use the application, users must first enter their authentication information (email address and password). The device sends this information to the server, which attempts to authenticate the user by comparing it against its database. If authentication is successful, the user interface is displayed, and the user can link additional social media accounts.

[0233] Linking social media accounts

[0234] The user enters their social media account information through the application. The device sends this information to the server, which then performs account linking via the corresponding social media API. If this linking process is successful, the information is stored in the database.

[0235] Filter settings

[0236] Users can set filters for content such as "defamation," "sexual content," and "violent content." The device sends this setting information to the server, which stores it in a database.

[0237] Content retrieval and filtering

[0238] The device sends a request to the server to retrieve the latest posts from its linked social media accounts. The server uses each social media API to retrieve the content, analyzes it, and filters it. Inappropriate content is excluded, and the filtered, clean content is returned to the device.

[0239] Internal billing feature

[0240] Users can choose an in-app purchase option to enable additional filtering features and management of new social media accounts. This will allow users to access a wider range of services.

[0241] Implementation of an emotion engine

[0242] This invention incorporates an emotion engine that recognizes the user's emotions. The emotion engine determines the user's emotional state by analyzing the user's behavior and input data (e.g., text, facial expressions, voice).

[0243] Specific processing examples

[0244] Adjusting the filtering strength by the emotion engine

[0245] If a user is emotionally agitated, the sentiment engine detects this and instructs the server to strengthen the filtering. For example, posts that would normally be allowed may be filtered in this case.

[0246] Adjusting content display using an emotion engine

[0247] If the sentiment engine determines that a user is likely feeling down, the server will adjust its display to prioritize more positive content and posts that encourage the user.

[0248] Customized feedback powered by an emotion engine

[0249] If the emotion engine detects that the user is feeling stressed, the server will display advice and recommended content that can help with relaxation and stress relief.

[0250] Specific examples of authentication

[0251] The user enters their email address and password and clicks the "Login" button. The device sends the entered information to the server, which verifies the database. If authentication is successful, the user interface is displayed, and options such as "Link SNS account" are shown.

[0252] Examples of linking social media accounts

[0253] If a user wants to link their social media account (e.g., an Instagram account), they enter their account information into the app. The device sends this information to the server, which attempts to link the account using the social media API. If successful, the information is stored in the database, and the user can then view social media content within the app.

[0254] Specific examples of filter settings

[0255] When a user selects the "defamation" filter, that setting is sent to the server and stored in the database. From then on, all retrieved content is analyzed based on this filter setting, and posts containing defamation are excluded.

[0256] Examples of internal billing

[0257] To utilize additional filtering features, the user selects a billing option in the app's settings screen. The device sends this selection information to the server, which then authenticates the user in conjunction with the payment system. Upon success, the database is updated and the new feature is enabled.

[0258] This invention provides a system that allows users to safely and comfortably use multiple social networking services, and by incorporating an emotion engine, it can provide an even more personalized user experience.

[0259] The following describes the processing flow.

[0260] Step 1:

[0261] The user enters their email address and password on the application's login screen.

[0262] Step 2:

[0263] The device sends the entered authentication information (email address and password) to the server.

[0264] Step 3:

[0265] The server compares the received authentication information with the registered information in the database and attempts to authenticate the user.

[0266] Step 4:

[0267] If authentication is successful, the server sends an authentication success message back to the terminal. If authentication fails, an error message is sent back.

[0268] Step 5:

[0269] If authentication is successful, the device will display the user interface for linking the social media account.

[0270] Step 6:

[0271] The user enters their social media account information (e.g., username, password).

[0272] Step 7:

[0273] The terminal sends the input SNS account information to the server.

[0274] Step 8:

[0275] The server performs the cooperation process via the SNS API and, if successful, saves the information in the database.

[0276] Step 9:

[0277] The server returns a success message of SNS account cooperation to the terminal.

[0278] Step 10:

[0279] The user selects the filter settings for slander, sexual, and violent content on the filter settings screen.

[0280] Step 11:

[0281] The terminal sends the set filter information to the server.

[0282] Step 12:

[0283] The server saves the received filter setting information in the database.

[0284] Step 13:

[0285] The user clicks the "Browse" button.

[0286] Step 14:

[0287] The terminal sends a request to the server to obtain content from the linked SNS account.

[0288] Step 15:

[0289] The server uses the APIs of each social networking service to send the retrieved content to a filtering engine, which then analyzes and filters it based on the user's filter settings.

[0290] Step 16:

[0291] The server generates filtered, clean content and sends it back to the terminal.

[0292] Step 17:

[0293] The device displays filtered content in the user interface.

[0294] Step 18:

[0295] The emotion engine analyzes the user's emotions.

[0296] Step 19:

[0297] If a user is emotionally agitated, the emotion engine instructs the server to increase the filtering strength.

[0298] Step 20:

[0299] If the emotion engine determines that a user is feeling down, the server will prioritize displaying positive content and posts that encourage the user.

[0300] Step 21:

[0301] Based on the analysis results of the emotion engine, the server provides customized feedback and recommended content to the user's device.

[0302] Step 22:

[0303] The device displays feedback and recommended content to the user, following instructions from the emotion engine.

[0304] Step 23:

[0305] The user selects a billing option on the settings screen within the app to enable additional filtering features or a new SNS account.

[0306] Step 24:

[0307] The terminal sends the selected billing information to the server.

[0308] Step 25:

[0309] The server cooperates with the payment system to perform the billing process. If successful, it updates the database to enable the new feature.

[0310] Step 26:

[0311] The server returns a success notification of the billing process to the terminal.

[0312] Step 27:

[0313] The terminal displays the billing success notification to the user and enables the new filtering feature and SNS account management feature.

[0314] (Example 2)

[0315] Next, Example 2 will be described. In the following description, the data processing device 12 is referred to as the "server", and the smart device 14 is referred to as the "terminal".

[0316] Currently, in order to use multiple social networking services (SNS) safely and comfortably, users need to manage separate accounts for each SNS and operate multiple applications. Furthermore, filtering settings for defamatory, sexual, and violent content are inadequate, making it highly likely that users will have an unpleasant experience. In addition, current systems are not adequately able to adjust the filtering strength and content display according to the user's emotional state.

[0317] The identification processing performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for receiving user authentication information and authenticating it by comparing it with a database, means for receiving multiple SNS account information and coordinating with each SNS via its API, means for filtering content based on user settings, means for providing filtered content to the user terminal, means for providing internal billing options and enabling additional functions, and means for analyzing the user's emotional state using an emotion engine and adjusting the filtering strength and content display. As a result, users can centrally manage multiple SNS and use them safely and comfortably, and flexible filtering and content display according to the user's emotional state are possible.

[0318] "User authentication information" refers to the identification information (e.g., email address and password) that a user uses to access the system.

[0319] A "database" is a storage device used by a system to store data such as user authentication information, social media account information, and filter settings.

[0320] "SNS account information" refers to the authentication information that users use to log in to various social networking services (e.g., Facebook and Twitter).

[0321] "API" stands for Application Programming Interface, which is an interface that allows different software components to interact with each other.

[0322] "Filtering" refers to the process of excluding inappropriate content (e.g., defamatory, sexual, or violent content) based on user preferences.

[0323] An "internal billing option" refers to a billing option that users can choose to enable additional features.

[0324] An "emotion engine" is a software component that analyzes user behavior and input data (e.g., text, facial expressions, voice) to determine the user's emotional state.

[0325] A "user terminal" refers to a device used by a user, such as a computer or smartphone.

[0326] "Filtering strength" is a measure that indicates the strictness of the filtering process.

[0327] "Content display" refers to the display format used when providing filtered information or posts to users.

[0328] This invention provides a system that allows users to safely and comfortably use multiple social networking services (SNS). The system provides secure access using user authentication information and enables centralized management of multiple SNS accounts. It also includes a function to filter defamatory, sexual, and violent content, and offers additional filtering and SNS account management functions through internal billing options. Furthermore, it incorporates an emotion engine that recognizes the user's emotions and adjusts the filtering strength and content display accordingly.

[0329] The user sends authentication information from their device to the server by entering their email address and password. The server checks its database and verifies the authentication information. If authentication is successful, the user interface is displayed on the device, and the user can link additional social media accounts.

[0330] In SNS account linking, the user enters their SNS account information, and the device sends that information to the server. The server uses the API of each SNS to perform the account linking, and if successful, the information is saved in the database. For example, if a user wants to link their Instagram account, they enter their account information into the application, the device sends the information to the server, and the server attempts to link via the Instagram API. If successful, the information is saved in the database, and the user can view SNS content within the application.

[0331] In the filter settings, users select filters such as "defamation," "sexual content," and "violent content." The device sends this setting information to the server, which stores the settings information in a database. Based on this setting, the server analyzes the content retrieved from social media and filters out inappropriate content. Filtered, clean content is provided to the device, allowing users to browse social media safely.

[0332] In the internal billing option, the user selects a billing option to enable additional features. The device sends this selection information to the server, which then works with the payment system to process the billing. If the process is successful, the database is updated and the new feature is enabled. For example, if a user selects a billing option to use an additional filter feature, that information is sent to the server, the payment system authenticates it, and if successful, the new filter feature is enabled.

[0333] The emotion engine analyzes user behavior and input data (text, facial expressions, voice) to determine the user's emotional state. If the user is emotionally agitated, the emotion engine instructs the server to strengthen the filtering. If the user is depressed, the server adjusts to prioritize displaying positive content.

[0334] Examples of specific cases and prompt statements

[0335] For example, if a user logs in, enters the email address "example@example.com" and password "password123," and clicks the "Login" button, the device sends this information to the server. The server checks the information in its database, and if authentication is successful, the option to "Link SNS account" appears on the user interface.

[0336] Additionally, the user enters their Instagram account information ("username: example_user, password: 123456"), the device sends this information to the server, the server processes it via API, and if successful, the information is saved to the database. The user can then view Instagram content within the app.

[0337] Example of a prompt

[0338] "When a user is emotionally agitated, we will strengthen the filtering intensity and configure the system to prioritize displaying positive content."

[0339] This system allows users to centrally manage multiple social media platforms, enabling them to use them safely and conveniently, and also provides a more personalized experience by leveraging an emotion engine.

[0340] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0341] Step 1: User Authentication

[0342] The user enters their email address and password and clicks the "Login" button.

[0343] Input: The user enters their email address and password.

[0344] Terminal operation: The terminal sends the entered authentication information to the server.

[0345] Server operation: The server checks the database and verifies the submitted authentication information. In this process, it verifies whether the email address and password combination matches.

[0346] Output: Notification of authentication success or failure.

[0347] Device behavior: If authentication is successful, the device will display "Authentication successful" on the user interface and provide the option to "Link SNS account".

[0348] Step 2: Linking SNS accounts

[0349] The user enters their social media account information.

[0350] Input: Social media account information (e.g., username and password).

[0351] Terminal operation: The terminal sends the entered account information to the server.

[0352] Server operation: The server attempts to link accounts using the APIs of each social networking service. If the linking is successful, the information is saved to the database.

[0353] Output: Notification of successful or unsuccessful account linking.

[0354] Device operation: Display a notification to the user that the connection was successful and make the SNS content viewable.

[0355] Step 3: Filter settings

[0356] The user selects the filter settings.

[0357] Input: Filter settings selected by the user (e.g., "defamation", "sexual", "violent").

[0358] Terminal operation: The terminal sends the selected filter settings to the server.

[0359] Server operation: The server saves the filter settings to the database.

[0360] Output: Notification that filter settings are complete.

[0361] Terminal action: Notify the user that the filter settings have been completed.

[0362] Step 4: Retrieve and filter content

[0363] The device retrieves the latest posts from linked social media accounts.

[0364] Input: A request sent from the device to retrieve the latest posts.

[0365] Server operation: The server calls the APIs of each social networking service to retrieve the latest posts. The retrieved content is analyzed based on the filter settings, and inappropriate content is excluded.

[0366] Output: Filtered, clean content.

[0367] Device operation: Display clean content to the user.

[0368] Step 5: Internal billing feature

[0369] Users select a billing option to enable additional features.

[0370] Input: The billing option selected by the user.

[0371] Device operation: The device sends billing option information to the server.

[0372] Server operation: The server works in conjunction with the payment system to process payments. If the payment is successful, it updates the database and enables the new feature.

[0373] Output: Notification of successful or failed billing, information on the availability of new features.

[0374] Device operation: If the charge is successful, the user will be notified that a new feature is available.

[0375] Step 6: Implementing the Emotion Engine

[0376] The emotion engine analyzes user behavior and input data (text, facial expressions, voice).

[0377] Input: Behavioral and input data collected from users.

[0378] Server operation: The server uses an emotion engine to analyze data and determine the user's emotional state. It adjusts the filtering strength and content display according to the emotional state.

[0379] Output: Adjusted filtering strength, personalized content display.

[0380] Device operation: Displays appropriately filtered content and personalized information to the user.

[0381] Through these steps, users can manage multiple social media platforms in a centralized, safe, and convenient environment, and utilize an emotion engine for flexible filtering and content display.

[0382] (Application Example 2)

[0383] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0384] In recent years, as many users utilize multiple content distribution services, there is a risk of exposure to defamatory, sexually explicit, and violent content. Furthermore, centralized management of account information across these services is difficult, and there is a lack of methods to appropriately provide content that aligns with users' emotional states. This makes it challenging to provide a safe and comfortable viewing environment. Moreover, the inability to provide content that considers users' emotional states may lead to decreased user satisfaction.

[0385] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0386] In this invention, the server includes means for receiving user authentication information and authenticating it by matching it with a database, means for receiving SNS account information and coordinating with the corresponding SNS via its API, means for filtering content based on user settings, means for providing filtered content to the user's terminal, means for providing internal billing options and enabling additional functions, means for detecting the user's emotional state, means for adjusting the filtering strength according to the emotional state, means for providing recommended content based on the emotional state, and means for centrally managing accounts for multiple content distribution services. This enables users to use multiple content distribution services in a safe and comfortable viewing environment. Furthermore, personalized content provision according to the emotional state can improve user satisfaction.

[0387] "User authentication information" refers to individual authentication credentials used to identify a user and grant them access to the system.

[0388] A "database" is an information management system used to manage and store user authentication information, social media account information, and other similar data.

[0389] "SNS account information" refers to information about the accounts that a user uses on social networking services.

[0390] An API (Application Programming Interface) is an interface for exchanging information between different software and services.

[0391] "Filtering" refers to the operation or process of removing unnecessary information or inappropriate content based on specific conditions.

[0392] "Filtering strength" is an indicator that shows the strictness or leniency of the filtering process.

[0393] A "content distribution service" is a service that provides digital content such as videos, music, and text via the internet.

[0394] A "user terminal" refers to a device used by a user, such as a smartphone, tablet, or computer.

[0395] An "internal billing option" is an option to provide additional features or services within an application for a fee.

[0396] "Emotional state" refers to the user's current emotional or mood state.

[0397] An "emotion engine" is an algorithm or system that analyzes a user's emotional state and provides appropriate content.

[0398] "Recommended content" refers to content that is specifically recommended based on the user's preferences and emotional state.

[0399] "Centralized management" means managing multiple services or systems together in one place.

[0400] Modes for carrying out the invention

[0401] System Overview

[0402] This invention is a "content distribution management system" that allows users to safely and comfortably utilize multiple content distribution services. This system provides secure access using user authentication information, enables centralized management of accounts for multiple distribution services, and includes functions for filtering defamatory, sexual, and violent content. It also provides additional filtering and service management functions through internal billing options. Furthermore, the invention incorporates an emotion engine that recognizes user emotions, providing additional functions to enhance the user experience.

[0403] Program Overview

[0404] The server will have the following features implemented:

[0405] 1. User Authentication: The server receives the user's authentication information (email address and password), compares it with the database, and authenticates the user. Communication with the server is performed using the Python requests library.

[0406] 2. Social Media Account Integration: The server uses the APIs of various content distribution services to integrate user account information. Examples include the APIs of YouTube® and Netflix.

[0407] 3. Filtering Settings: The server receives the filtering information set by the user and stores it in the database. Filtering targets defamatory, sexual, and violent content.

[0408] 4. Emotion Engine: The server detects the user's emotional state and adjusts the filtering strength accordingly. The emotion engine is implemented using Python's natural language processing library (e.g., NLTK) and machine learning library (e.g., TENSORFLOW®).

[0409] 5. Content Acquisition and Filtering: The server retrieves the latest content from the linked distribution service and filters it based on user settings. The filtered content is then provided to the user's device.

[0410] 6. Internal billing function: The server provides an internal billing system that allows users to purchase additional features and filtering functions.

[0411] Hardware and software to use

[0412] Hardware: Servers (cloud-based servers, e.g., Amazon Web Services), user devices (smartphones, tablets, computers)

[0413] Software: Python, requests library, natural language processing library (NLTK), machine learning library (TensorFlow)

[0414] Specific example

[0415] The following is a concrete example of a system that allows users to link their Netflix and YouTube accounts and enjoy safely filtered content.

[0416] User scenario:

[0417] 1. The user launches the app and enters their email address and password to authenticate.

[0418] 2. Once authentication is successful, the user will enter their Netflix and YouTube account information to link them.

[0419] 3. The user enables the "defamation" filtering in the app's settings screen.

[0420] 4. If the emotion engine detects that the user is experiencing stress, the "defamation" filtering strength will be increased.

[0421] 5. The server retrieves the latest filtered content and provides it to the user.

[0422] Examples of prompts for a generative AI model:

[0423] Functional requirements for content delivery applications

[0424] A feature that filters out defamatory, sexual, and violent content.

[0425] A feature that adjusts the filtering strength according to the user's emotional state.

[0426] A feature that allows you to manage accounts for multiple content distribution services all in one place.

[0427] Please generate pseudocode for an application that meets these requirements.

[0428] Through the above processing, the system of the present invention enables users to safely and comfortably utilize multiple content distribution services and improves the user experience through personalized content delivery based on emotional state.

[0429] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0430] Step 1:

[0431] The user launches the application and enters their email address and password on the login screen.

[0432] Input: Email address, password

[0433] Data processing: Send the entered authentication information to the server.

[0434] Output: Authentication success or failure message

[0435] Step 2:

[0436] The server compares the received user authentication information with the database and returns the authentication result.

[0437] Input: Email address, password

[0438] Data processing: Database matching

[0439] Output: Authentication success message or error message

[0440] Step 3:

[0441] Once the user successfully authenticates, a screen for linking social media accounts will appear, where they will enter the corresponding account information.

[0442] Input: Social media account information (e.g., User ID, Token)

[0443] Data processing: Send the entered SNS account information to the server.

[0444] Output: Message indicating success or failure in linking SNS accounts.

[0445] Step 4:

[0446] The server uses the APIs of the corresponding social networking services to link the user's social networking service account with the app.

[0447] Input: SNS account information

[0448] Data processing: Communicate with SNS APIs and link accounts.

[0449] Output: Integration success message

[0450] Step 5:

[0451] Users can set filters such as "defamation," "sexual content," and "violent content" on the filtering settings screen.

[0452] Input: Filter settings information

[0453] Data processing: Send the entered filter settings to the server.

[0454] Output: Filter settings saved message

[0455] Step 6:

[0456] The server retrieves the latest content from linked social media accounts and analyzes it based on the filtering settings.

[0457] Input: SNS account information, filter settings information

[0458] Data processing: Content retrieval and filtering using SNS APIs.

[0459] Output: Filtered, clean content

[0460] Step 7:

[0461] The server detects the user's emotional state and adjusts the filtering strength accordingly.

[0462] Input: User behavior and input data (e.g., text, facial expressions, voice)

[0463] Data processing: Sentiment analysis using an emotion engine

[0464] Output: Adjusted filtering strength

[0465] Step 8:

[0466] The server generates and provides recommended content to the user's terminal based on their emotional state.

[0467] Input: User's emotional state, filtered content

[0468] Data processing: Application of sentiment-based content recommendation algorithms

[0469] Output: Recommended content

[0470] Step 9:

[0471] Users can select in-app purchase options and enable additional filters and features.

[0472] Input: Internal billing selection information

[0473] Data processing: Send billing information to the server and process payments in conjunction with the payment system.

[0474] Output: Billing success message, Additional feature activation message

[0475] Step 10:

[0476] Users can comfortably enjoy filtered content and sentiment-based recommendations.

[0477] Input: Filtered content, recommended content

[0478] Data processing: Displaying content

[0479] Output: Improved user experience, increased satisfaction

[0480] Through the processing steps described above, the system of the present invention enables users to safely and comfortably utilize multiple content distribution services and to provide personalized content based on their emotional state.

[0481] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0482] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0483] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0484] [Second Embodiment]

[0485] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0486] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0487] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0488] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0489] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0490] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0491] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0492] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0493] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0494] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0495] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0496] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0497] This invention is a "social networking service browsing system" aimed at enabling users to safely and comfortably use multiple social networking services (SNS). This system provides secure access using user authentication information, allows for centralized management of multiple SNS accounts, and includes functions to filter defamatory, sexual, and violent content. Furthermore, it offers additional filtering and SNS account management functions through internal billing options.

[0498] Overall System Overview

[0499] User Authentication

[0500] To use the application, users must first enter their authentication information (email address and password). The device sends this authentication information to the server. The server compares it with the database and authenticates the user. If authentication is successful, the user interface is displayed, and the user can link additional social media accounts.

[0501] Linking social media accounts

[0502] The user enters their social media account information through the application. The device sends this information to the server, which then performs account linking via the corresponding social media API. If successful, the information is stored in the database.

[0503] Filter settings

[0504] Users can set filters for content such as "defamation," "sexual content," and "violent content." The device sends this setting information to the server, which stores this information in a database.

[0505] Content retrieval and filtering

[0506] The device sends a request to the server to retrieve the latest posts from its linked social media accounts. The server uses each social media API to retrieve the content, analyzes it, and filters it. Inappropriate content is excluded, and the filtered, clean content is returned to the device.

[0507] Internal billing feature

[0508] Users can choose an in-app purchase option to enable additional filtering features and management of new social media accounts. This will allow users to access a wider range of services.

[0509] Specific processing examples

[0510] Specific examples of authentication

[0511] The user enters their email address and password and clicks the "Login" button. The device sends the entered information to the server, which verifies the database. If authentication is successful, the user interface is displayed, and options such as "Link SNS account" are shown.

[0512] Examples of linking social media accounts

[0513] If a user wants to link their Instagram account, they enter their Instagram username and password into the app. The device sends this information to the server, which attempts to link using the Instagram API. If successful, the information is stored in the database, and the user can then view Instagram content within the app.

[0514] Specific examples of filter settings

[0515] If a user selects the "defamation" filter, that setting is sent to the server and stored in the database. From then on, all retrieved content is analyzed based on this filter setting, and posts containing defamation are excluded.

[0516] Examples of content retrieval and filtering

[0517] When a user clicks the "View" button, their device sends a request to the server. The server uses the Instagram API to retrieve the latest posts and analyzes them with a filtering engine. As a result, defamatory, sexual, and violent content is filtered out, and clean content is returned to the device.

[0518] Examples of internal billing features

[0519] If a user wants to use additional filtering features, they select the option in the app's settings screen and proceed with the payment process. The device sends the payment information to the server, which then authenticates the transaction in conjunction with the payment system. If successful, the new filtering feature is enabled, and the user can use the added filters.

[0520] Thus, the present invention is designed to enable users to safely and comfortably use multiple social networking services (SNS), and is a system that improves the user experience through a function to filter inappropriate content and an in-app purchase option.

[0521] The following describes the processing flow.

[0522] Step 1:

[0523] The user enters their email address and password on the application's login screen.

[0524] Step 2:

[0525] The device sends the entered authentication information (email address and password) to the server.

[0526] Step 3:

[0527] The server compares the received authentication information with the registered information in the database and attempts to authenticate the user.

[0528] Step 4:

[0529] If authentication is successful, the server sends an authentication success message back to the terminal. If authentication fails, an error message is sent back.

[0530] Step 5:

[0531] If authentication is successful, the device will display the user interface for linking the social media account.

[0532] Step 6:

[0533] The user enters their social media account information (e.g., username, password).

[0534] Step 7:

[0535] The device sends the entered SNS account information to the server.

[0536] Step 8:

[0537] The server performs the integration process via the SNS API, and if successful, saves the information to the database.

[0538] Step 9:

[0539] The server sends a success message to the device when linking the social media account.

[0540] Step 10:

[0541] On the filter settings screen, users can select filter settings for defamation, sexual content, and violent content.

[0542] Step 11:

[0543] The terminal sends the configured filter information to the server.

[0544] Step 12:

[0545] The server saves the received filter settings information to the database.

[0546] Step 13:

[0547] The user clicks the "Browse" button.

[0548] Step 14:

[0549] The device sends a request to the server to retrieve content from the linked social media account.

[0550] Step 15:

[0551] The server uses the APIs of each social networking service to send the retrieved content to a filtering engine, which then analyzes and filters it based on the user's filter settings.

[0552] Step 16:

[0553] The server generates filtered, clean content and sends it back to the terminal.

[0554] Step 17:

[0555] The device displays filtered content in the user interface.

[0556] Step 18:

[0557] Users can select a paid option in the app's settings screen to enable additional filtering features or new social media accounts.

[0558] Step 19:

[0559] The device sends the selected billing information to the server.

[0560] Step 20:

[0561] The server interacts with the payment system, performs billing, and, if successful, updates the database to enable the new feature.

[0562] Step 21:

[0563] The server sends a notification to the device confirming the successful completion of the billing process.

[0564] Step 22:

[0565] The device will display a notification to the user that the payment was successful and enable new filtering and social media account management features.

[0566] (Example 1)

[0567] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0568] In modern times, users often have multiple social networking service (SNS) accounts. However, there is a lack of safe and convenient ways to manage them all in one place. Furthermore, the presence of inappropriate content (defamatory, sexual, or violent material) can damage the user experience. Additionally, the limited means users have access to additional features makes flexible customization difficult. There is a need to provide an environment where users can safely and securely use multiple SNS platforms.

[0569] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0570] In this invention, the server includes means for receiving user authentication information and authenticating it by matching it with a database, means for receiving social networking service account information and coordinating it via a corresponding application programming interface, and means for filtering digital media content based on user settings. This allows users to securely centrally manage multiple SNS accounts and use them in a clean state with inappropriate content removed. Furthermore, flexible customization features are provided through internal billing options, which will improve the user experience.

[0571] "User authentication information" refers to information (primarily email address and password) that a user provides to prove their identity.

[0572] A "database" is a structured collection of data that a system uses to efficiently store, manage, and retrieve data.

[0573] An "Application Programming Interface (API)" is an interface that allows different software systems to access specific functions.

[0574] A "social networking service (SNS)" is a web-based platform designed for user interaction.

[0575] "Digital media content" refers to information that has been digitized in various forms, such as text, images, audio, and video.

[0576] "Filtering" is the process of removing unnecessary or inappropriate elements from data based on specific criteria.

[0577] A "user terminal" refers to an electronic device such as a computer, smartphone, or tablet that a user uses to access the system.

[0578] An "internal billing option" is a payment method that users use to access additional features or services provided within the software.

[0579] "Additional features" are supplementary functions provided in addition to the basic functions, and are intended to improve the user experience.

[0580] "Defamatory, sexual, and violent content" refers to digital media content that contains inappropriate language that attacks users, content that is considered sexually inappropriate, and content that promotes violence.

[0581] This invention relates to a "social networking service browsing system" that enables users to safely and comfortably use multiple social networking services (SNS). This system provides user authentication, SNS account linking, content filtering, and additional functions.

[0582] Hardware and software configuration

[0583] This system consists primarily of a server and user terminals. The server is a high-performance computer and includes a database server, application server, and content filtering engine. User terminals consist of smartphones, tablets, or personal computers.

[0584] The specific software used includes purchased commercial or open-source database management systems (DBMS), RESTful API frameworks for API calls, and natural language processing (NLP) or machine learning models as content filtering engines.

[0585] User Authentication

[0586] The user enters an email address and password to use the system. The device sends this authentication information to the server. The server compares it with the authentication information in the database, and if successful, generates an authentication token and returns it to the device. For example, if the user enters "user@example.com" and "password123", the device sends this to the server, and the server returns a token after authentication.

[0587] Linking social media accounts

[0588] The user enters their social media account information (e.g., Instagram username and password). The device sends this information to the server, which attempts to establish a connection via the corresponding social media API. For example, when a user enters their Instagram account information, the server calls the Instagram API and establishes the connection.

[0589] Content filtering

[0590] Users can set filters such as "defamation," "sexual," and "violent." The device sends this setting information to the server, which filters digital media content based on the settings. For example, if a user selects the "defamation" filter, the server analyzes the retrieved content and excludes posts containing defamation.

[0591] Internal billing option

[0592] Users can select an internal billing option to enable additional filtering features or manage new social media accounts. The device sends billing information to the server, which then processes the billing in conjunction with the payment system. For example, if a user selects an additional filtering feature and enters billing information, the server processes the billing through the payment system, and the new filtering feature is enabled.

[0593] Example of a prompt

[0594] Please describe the overview of the social networking service browsing system using the following steps:

[0595] 1. The user launches the application and enters their login information.

[0596] 2. Explain the authentication process.

[0597] 3. We will explain how to link your social media accounts.

[0598] 4. Instructions for setting up filters are shown.

[0599] 5. Explain the content retrieval and filtering process.

[0600] 6. Explain how to use the in-app purchase feature.

[0601] ---

[0602] Thus, the present invention is a system that allows users to securely manage multiple SNS accounts in a centralized manner, eliminate inappropriate content, and provide flexible customization functions.

[0603] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0604] Step 1:

[0605] User Authentication

[0606] Specific actions: The user launches the application and is redirected to the login screen. The user enters their email address and password.

[0607] Input: The email address and password entered by the user.

[0608] Data processing: The terminal sends these authentication credentials to the server. The server compares the received authentication credentials with the database.

[0609] Output: The server returns the authentication result, and if successful, generates an authentication token and returns it to the terminal.

[0610] Example: When a user enters the email address "user@example.com" and password "password123" and presses the "Login" button, the device sends this information to the server. The server verifies the information against its database and returns an authentication token upon successful authentication.

[0611] Step 2:

[0612] Linking social media accounts

[0613] Specific action: The user is redirected to the account linking screen and enters their social media account information.

[0614] Input: Username and password for the social networking service entered by the user.

[0615] Data processing: The terminal sends the entered SNS account information to the server. The server attempts to link the account via the corresponding application programming interface (API).

[0616] Output: If the connection is successful, the server saves the account information to the database and sends a connection confirmation message to the device.

[0617] Specific example: When a user enters their Instagram account username "insta_user" and password "insta_pass", the device sends this information to the server. The server attempts to connect using the Instagram API, and if successful, notifies the device of the successful connection.

[0618] Step 3:

[0619] Filter settings

[0620] Specific action: The user navigates to the filter settings screen and selects filter options such as "defamation," "sexual," or "violent."

[0621] Input: The filter options selected by the user.

[0622] Data processing: The terminal sends the selected filter settings to the server. The server records this information in its database.

[0623] Output: The server notifies the terminal that the filter settings were successful.

[0624] Specific example: When a user selects the "defamation" filter, the device sends this setting information to the server, which then stores it in a database. Upon successful saving, the server notifies the device that the filter settings have been completed.

[0625] Step 4:

[0626] Content retrieval and filtering

[0627] Specific action: The user clicks the content viewing button.

[0628] Input: User's content retrieval request.

[0629] Data processing: The device sends a content retrieval request to the server. The server uses the corresponding SNS API to retrieve the latest posts and analyzes and filters the content based on the configured filters.

[0630] Output: Returns filtered, clean content to the device.

[0631] Specific example: When a user clicks the "View" button, their device sends a request to the server. The server uses the Instagram API to retrieve the latest posts and analyzes them with a filtering engine. Defamatory, sexual, and violent content is filtered out, and safe content is returned to the device.

[0632] Step 5:

[0633] Internal billing option

[0634] Specific operation: The user selects options to enable additional filtering functions or new social media account management functions.

[0635] Input: Billing information entered by the user.

[0636] Data processing: The terminal sends billing information to the server. The server works with the payment system to process the billing.

[0637] Output: The server checks the billing process and, if successful, notifies the device that the new feature has been enabled.

[0638] Specific example: When a user selects the "additional filter function" and enters billing information, the device sends this information to the server, which then uses the payment system to process the payment. After success, the server notifies the device that the new filter function is now available.

[0639] (Application Example 1)

[0640] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0641] Many modern users utilize multiple social networking services (SNS), requiring them to manage separate authentication credentials to access each service. Furthermore, SNS platforms often contain defamatory, sexually explicit, and violent content, posing a challenge in protecting users from this inappropriate material. Moreover, providing a safe browsing environment necessitates the integration of the real and digital worlds through the use of smart devices.

[0642] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0643] In this invention, the server includes means for receiving user authentication information and authenticating it by matching it with a database, means for receiving service account information and coordinating with the corresponding service via an API, and means for filtering information based on user settings. This makes it possible to centrally manage multiple services and provide a secure browsing environment by filtering inappropriate content. Furthermore, by integrating real-world information and digital content via smart devices, the user experience can be improved.

[0644] "User authentication information" refers to the identification information necessary for a user to access a system, and generally consists of things like an email address and password.

[0645] A "database" is a collection of data that is systematically structured to allow for the efficient collection, management, and retrieval of information.

[0646] "Authentication" is the process of verifying that the information entered by the user (authentication information) is accurate and that the user has the authority to access the system.

[0647] "Service account information" refers to information about accounts for various social networking services (SNS) and other online services, and usually includes usernames and passwords.

[0648] "API" stands for Application Programming Interface, and it is an interface that allows one piece of software to communicate with other pieces of software.

[0649] "User settings" refer to various settings that users can configure to customize their own usage environment, including filtering targets and display methods.

[0650] "Filtering information" is the process of selecting and removing inappropriate or unnecessary content based on specific criteria.

[0651] A "user terminal" is a device that a user can directly operate, and includes smartphones, smart glasses, tablets, and other similar devices.

[0652] An "internal billing option" is a system where users pay an additional fee to use extra features within an application or service.

[0653] "Integrating real-world information with digital content" means providing an environment where the physical real world and digital information can be linked and used interactively through smart devices.

[0654] This invention is a system that enables users to safely and comfortably use multiple social networking services (SNS). This system includes functions for user authentication, SNS account linking, information filtering, provision of filtered information, provision of in-app purchase options, and integration of real-world information and digital content via smart devices.

[0655] First, the user enters their authentication information (email address and password) and sends it from their device to the server. The server then verifies this information against its database and performs authentication. If authentication is successful, the user enters their service account information (username and password for various social networking services) and sends it to the server. The server attempts to connect via the API of the specific service, and if successful, saves that information to its database.

[0656] Next, the user selects their desired filtering conditions (e.g., defamatory, sexual, or violent content) on the settings screen and sends the settings information to the server. This settings information is stored in a database and used for subsequent content filtering. When a user wants to view the latest posts from social media, they send a request from their device to the server. The server retrieves the content using the API of each social media platform, analyzes it with a filtering engine, and removes inappropriate content. The filtered, clean content is returned to the device and provided to the user.

[0657] When using the in-app purchase option, users select the option in the app's settings screen and proceed with the purchase. The device sends the purchase information to the server, which then authenticates the transaction in conjunction with the payment system. If successful, the new filtering feature is enabled, allowing users to enjoy enhanced security and convenience.

[0658] Furthermore, smart devices (such as smartphones and smart glasses) can be used to interactively integrate information from the real world with digital content. This can improve the user experience, for example, by overlaying digital information in front of the user's eyes.

[0659] For example, if a user has set up a defamation filter and linked their Instagram and Twitter accounts, when the user opens the app and views the latest posts, their account information will first be authenticated. Then, the latest posts will be retrieved using the APIs of each social media platform, and posts containing defamation will be filtered out. Ultimately, only clean content will be provided to the user.

[0660] Example of a prompt:

[0661] For example, a user might link their Instagram and Twitter accounts and set up a defamation filter. When the user opens the app and tries to view the latest posts, user authentication is first successful, and then the latest posts are retrieved via the APIs of each social media platform. After that, the retrieved content is filtered, and only clean content is displayed to the user.

[0662] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0663] Step 1:

[0664] The user enters their authentication information (email address and password) into the device. The device sends this authentication information to the server. The server compares it with the database and returns the result. If authentication is successful, the user is granted access to the next step; if it fails, an error message is returned.

[0665] Enter: Email address, password

[0666] Output: Authentication result (success / failure)

[0667] Step 2:

[0668] The user enters the service account information they want to link (e.g., SNS username and password) into their device. The device sends this information to the server. The server attempts to link the account via the corresponding service's API and saves the result to a database. It also notifies the user of the success or failure of the linking.

[0669] Input: Service account information

[0670] Output: Integration result (success / failure)

[0671] Step 3:

[0672] The user selects filter settings options on their device (e.g., filtering for defamatory, sexual, or violent content). The device sends this setting information to the server. The server stores this information in a database and notifies the user when the filtering settings are updated.

[0673] Input: Filter settings options

[0674] Output: Saved filter settings

[0675] Step 4:

[0676] The user clicks the "Get Content" button on their device. The device sends a request to the server. The server uses the APIs of each connected social networking service to retrieve the latest content. The retrieved content is filtered, and inappropriate content is removed. Clean content is returned to the device and displayed to the user.

[0677] Input: Content Retrieval Request

[0678] Output: Filtered content

[0679] Step 5:

[0680] If a user wants to use additional filtering features, they select a payment option within the app and initiate the payment process. The device sends the payment information to the server. The server then works with an external payment system to process the payment. If the payment is successful, the new filtering feature is enabled, and the user receives a notification.

[0681] Input: Select billing option, billing information

[0682] Output: Results of enabling the new filter function

[0683] Step 6:

[0684] When a user wants to integrate real-world information with digital content using a smart device (e.g., smart glasses), they send a request from the device to a server. The server integrates the user's current location and surrounding information with the digital content and sends that information back to the device. This allows the user to visually experience the fused content in real time.

[0685] Input: Integration request, current location information

[0686] Output: Integrated digital content

[0687] These steps enable the system of the present invention to provide users with a safe and comfortable SNS usage environment.

[0688] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0689] This invention is a "social networking service browsing system" aimed at enabling users to safely and comfortably use multiple social networking services (SNS). The system provides secure access using user authentication information, allows for centralized management of multiple SNS accounts, and includes functions to filter defamatory, sexual, and violent content. Furthermore, it offers additional filtering and SNS account management functions through internal billing options. In addition, the invention incorporates an emotion engine that recognizes user emotions, providing additional functions to improve the user experience.

[0690] Overall System Overview

[0691] User Authentication

[0692] To use the application, users must first enter their authentication information (email address and password). The device sends this information to the server, which attempts to authenticate the user by comparing it against its database. If authentication is successful, the user interface is displayed, and the user can link additional social media accounts.

[0693] Linking social media accounts

[0694] The user enters their social media account information through the application. The device sends this information to the server, which then performs account linking via the corresponding social media API. If this linking process is successful, the information is stored in the database.

[0695] Filter settings

[0696] Users can set filters for content such as "defamation," "sexual content," and "violent content." The device sends this setting information to the server, which stores it in a database.

[0697] Content retrieval and filtering

[0698] The device sends a request to the server to retrieve the latest posts from its linked social media accounts. The server uses each social media API to retrieve the content, analyzes it, and filters it. Inappropriate content is excluded, and the filtered, clean content is returned to the device.

[0699] Internal billing feature

[0700] Users can choose an in-app purchase option to enable additional filtering features and management of new social media accounts. This will allow users to access a wider range of services.

[0701] Implementation of an emotion engine

[0702] This invention incorporates an emotion engine that recognizes the user's emotions. The emotion engine determines the user's emotional state by analyzing the user's behavior and input data (e.g., text, facial expressions, voice).

[0703] Specific processing examples

[0704] Adjusting the filtering strength by the emotion engine

[0705] If a user is emotionally agitated, the sentiment engine detects this and instructs the server to strengthen the filtering. For example, posts that would normally be allowed may be filtered in this case.

[0706] Adjusting content display using an emotion engine

[0707] If the sentiment engine determines that a user is likely feeling down, the server will adjust its display to prioritize more positive content and posts that encourage the user.

[0708] Customized feedback powered by an emotion engine

[0709] If the emotion engine detects that the user is feeling stressed, the server will display advice and recommended content that can help with relaxation and stress relief.

[0710] Specific examples of authentication

[0711] The user enters their email address and password and clicks the "Login" button. The device sends the entered information to the server, which verifies the database. If authentication is successful, the user interface is displayed, and options such as "Link SNS account" are shown.

[0712] Examples of linking social media accounts

[0713] If a user wants to link their social media account (e.g., an Instagram account), they enter their account information into the app. The device sends this information to the server, which attempts to link the account using the social media API. If successful, the information is stored in the database, and the user can then view social media content within the app.

[0714] Specific examples of filter settings

[0715] When a user selects the "defamation" filter, that setting is sent to the server and stored in the database. From then on, all retrieved content is analyzed based on this filter setting, and posts containing defamation are excluded.

[0716] Examples of internal billing

[0717] To utilize additional filtering features, the user selects a billing option in the app's settings screen. The device sends this selection information to the server, which then authenticates the user in conjunction with the payment system. Upon success, the database is updated and the new feature is enabled.

[0718] This invention provides a system that allows users to safely and comfortably use multiple social networking services, and by incorporating an emotion engine, it can provide an even more personalized user experience.

[0719] The following describes the processing flow.

[0720] Step 1:

[0721] The user enters their email address and password on the application's login screen.

[0722] Step 2:

[0723] The device sends the entered authentication information (email address and password) to the server.

[0724] Step 3:

[0725] The server compares the received authentication information with the registered information in the database and attempts to authenticate the user.

[0726] Step 4:

[0727] If authentication is successful, the server sends an authentication success message back to the terminal. If authentication fails, an error message is sent back.

[0728] Step 5:

[0729] If authentication is successful, the device will display the user interface for linking the social media account.

[0730] Step 6:

[0731] The user enters their social media account information (e.g., username, password).

[0732] Step 7:

[0733] The device sends the entered SNS account information to the server.

[0734] Step 8:

[0735] The server performs the integration process via the SNS API, and if successful, saves the information to the database.

[0736] Step 9:

[0737] The server sends a success message to the device when linking the social media account.

[0738] Step 10:

[0739] On the filter settings screen, users can select filter settings for defamation, sexual content, and violent content.

[0740] Step 11:

[0741] The terminal sends the configured filter information to the server.

[0742] Step 12:

[0743] The server saves the received filter settings information to the database.

[0744] Step 13:

[0745] The user clicks the "Browse" button.

[0746] Step 14:

[0747] The device sends a request to the server to retrieve content from the linked social media account.

[0748] Step 15:

[0749] The server uses the APIs of each social networking service to send the retrieved content to a filtering engine, which then analyzes and filters it based on the user's filter settings.

[0750] Step 16:

[0751] The server generates filtered, clean content and sends it back to the terminal.

[0752] Step 17:

[0753] The device displays filtered content in the user interface.

[0754] Step 18:

[0755] The emotion engine analyzes the user's emotions.

[0756] Step 19:

[0757] If a user is emotionally agitated, the emotion engine instructs the server to increase the filtering strength.

[0758] Step 20:

[0759] If the emotion engine determines that a user is feeling down, the server will prioritize displaying positive content and posts that encourage the user.

[0760] Step 21:

[0761] Based on the analysis results of the emotion engine, the server provides customized feedback and recommended content to the user's device.

[0762] Step 22:

[0763] The device displays feedback and recommended content to the user, following instructions from the emotion engine.

[0764] Step 23:

[0765] Users can select a paid option in the app's settings screen to enable additional filtering features or new social media accounts.

[0766] Step 24:

[0767] The device sends the selected billing information to the server.

[0768] Step 25:

[0769] The server interacts with the payment system, performs billing, and, if successful, updates the database to enable the new feature.

[0770] Step 26:

[0771] The server sends a notification to the device confirming the successful completion of the billing process.

[0772] Step 27:

[0773] The device will display a notification to the user that the payment was successful and enable new filtering and social media account management features.

[0774] (Example 2)

[0775] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0776] Currently, in order to use multiple social networking services (SNS) safely and comfortably, users need to manage separate accounts for each SNS and operate multiple applications. Furthermore, filtering settings for defamatory, sexual, and violent content are inadequate, making it highly likely that users will have an unpleasant experience. In addition, current systems are not adequately able to adjust the filtering strength and content display according to the user's emotional state.

[0777] The identification processing performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for receiving user authentication information and authenticating it by comparing it with a database, means for receiving multiple SNS account information and coordinating with each SNS via its API, means for filtering content based on user settings, means for providing filtered content to the user terminal, means for providing internal billing options and enabling additional functions, and means for analyzing the user's emotional state using an emotion engine and adjusting the filtering strength and content display. As a result, users can centrally manage multiple SNS and use them safely and comfortably, and flexible filtering and content display according to the user's emotional state are possible.

[0778] "User authentication information" refers to the identification information (e.g., email address and password) that a user uses to access the system.

[0779] A "database" is a storage device used by a system to store data such as user authentication information, social media account information, and filter settings.

[0780] "SNS account information" refers to the authentication information that users use to log in to various social networking services (e.g., Facebook and Twitter).

[0781] "API" stands for Application Programming Interface, which is an interface that allows different software components to interact with each other.

[0782] "Filtering" refers to the process of excluding inappropriate content (e.g., defamatory, sexual, or violent content) based on user preferences.

[0783] An "internal billing option" refers to a billing option that users can choose to enable additional features.

[0784] An "emotion engine" is a software component that analyzes user behavior and input data (e.g., text, facial expressions, voice) to determine the user's emotional state.

[0785] A "user terminal" refers to a device used by a user, such as a computer or smartphone.

[0786] "Filtering strength" is a measure that indicates the strictness of the filtering process.

[0787] "Content display" refers to the display format used when providing filtered information or posts to users.

[0788] This invention provides a system that allows users to safely and comfortably use multiple social networking services (SNS). The system provides secure access using user authentication information and enables centralized management of multiple SNS accounts. It also includes a function to filter defamatory, sexual, and violent content, and offers additional filtering and SNS account management functions through internal billing options. Furthermore, it incorporates an emotion engine that recognizes the user's emotions and adjusts the filtering strength and content display accordingly.

[0789] The user sends authentication information from their device to the server by entering their email address and password. The server checks its database and verifies the authentication information. If authentication is successful, the user interface is displayed on the device, and the user can link additional social media accounts.

[0790] In SNS account linking, the user enters their SNS account information, and the device sends that information to the server. The server uses the API of each SNS to perform the account linking, and if successful, the information is saved in the database. For example, if a user wants to link their Instagram account, they enter their account information into the application, the device sends the information to the server, and the server attempts to link via the Instagram API. If successful, the information is saved in the database, and the user can view SNS content within the application.

[0791] In the filter settings, users select filters such as "defamation," "sexual content," and "violent content." The device sends this setting information to the server, which stores the settings information in a database. Based on this setting, the server analyzes the content retrieved from social media and filters out inappropriate content. Filtered, clean content is provided to the device, allowing users to browse social media safely.

[0792] In the internal billing option, the user selects a billing option to enable additional features. The device sends this selection information to the server, which then works with the payment system to process the billing. If the process is successful, the database is updated and the new feature is enabled. For example, if a user selects a billing option to use an additional filter feature, that information is sent to the server, the payment system authenticates it, and if successful, the new filter feature is enabled.

[0793] The emotion engine analyzes user behavior and input data (text, facial expressions, voice) to determine the user's emotional state. If the user is emotionally agitated, the emotion engine instructs the server to strengthen the filtering. If the user is depressed, the server adjusts to prioritize displaying positive content.

[0794] Examples of specific cases and prompt statements

[0795] For example, if a user logs in, enters the email address "example@example.com" and password "password123," and clicks the "Login" button, the device sends this information to the server. The server checks the information in its database, and if authentication is successful, the option to "Link SNS account" appears on the user interface.

[0796] Additionally, the user enters their Instagram account information ("username: example_user, password: 123456"), the device sends this information to the server, the server processes it via API, and if successful, the information is saved to the database. The user can then view Instagram content within the app.

[0797] Example of a prompt

[0798] "When a user is emotionally agitated, we will strengthen the filtering intensity and configure the system to prioritize displaying positive content."

[0799] This system allows users to centrally manage multiple social media platforms, enabling them to use them safely and conveniently, and also provides a more personalized experience by leveraging an emotion engine.

[0800] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0801] Step 1: User Authentication

[0802] The user enters their email address and password and clicks the "Login" button.

[0803] Input: The user enters their email address and password.

[0804] Terminal operation: The terminal sends the entered authentication information to the server.

[0805] Server operation: The server checks the database and verifies the submitted authentication information. In this process, it verifies whether the email address and password combination matches.

[0806] Output: Notification of authentication success or failure.

[0807] Device behavior: If authentication is successful, the device will display "Authentication successful" on the user interface and provide the option to "Link SNS account".

[0808] Step 2: Linking SNS accounts

[0809] The user enters their social media account information.

[0810] Input: Social media account information (e.g., username and password).

[0811] Terminal operation: The terminal sends the entered account information to the server.

[0812] Server operation: The server attempts to link accounts using the APIs of each social networking service. If the linking is successful, the information is saved to the database.

[0813] Output: Notification of successful or unsuccessful account linking.

[0814] Device operation: Display a notification to the user that the connection was successful and make the SNS content viewable.

[0815] Step 3: Filter settings

[0816] The user selects the filter settings.

[0817] Input: Filter settings selected by the user (e.g., "defamation", "sexual", "violent").

[0818] Terminal operation: The terminal sends the selected filter settings to the server.

[0819] Server operation: The server saves the filter settings to the database.

[0820] Output: Notification that filter settings are complete.

[0821] Terminal action: Notify the user that the filter settings have been completed.

[0822] Step 4: Retrieve and filter content

[0823] The device retrieves the latest posts from linked social media accounts.

[0824] Input: A request sent from the device to retrieve the latest posts.

[0825] Server operation: The server calls the APIs of each social networking service to retrieve the latest posts. The retrieved content is analyzed based on the filter settings, and inappropriate content is excluded.

[0826] Output: Filtered, clean content.

[0827] Device operation: Display clean content to the user.

[0828] Step 5: Internal billing feature

[0829] Users select a billing option to enable additional features.

[0830] Input: The billing option selected by the user.

[0831] Device operation: The device sends billing option information to the server.

[0832] Server operation: The server works in conjunction with the payment system to process payments. If the payment is successful, it updates the database and enables the new feature.

[0833] Output: Notification of successful or failed billing, information on the availability of new features.

[0834] Device operation: If the charge is successful, the user will be notified that a new feature is available.

[0835] Step 6: Implementing the Emotion Engine

[0836] The emotion engine analyzes user behavior and input data (text, facial expressions, voice).

[0837] Input: Behavioral and input data collected from users.

[0838] Server operation: The server uses an emotion engine to analyze data and determine the user's emotional state. It adjusts the filtering strength and content display according to the emotional state.

[0839] Output: Adjusted filtering strength, personalized content display.

[0840] Device operation: Displays appropriately filtered content and personalized information to the user.

[0841] Through these steps, users can manage multiple social media platforms in a centralized, safe, and convenient environment, and utilize an emotion engine for flexible filtering and content display.

[0842] (Application Example 2)

[0843] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0844] In recent years, as many users utilize multiple content distribution services, there is a risk of exposure to defamatory, sexually explicit, and violent content. Furthermore, centralized management of account information across these services is difficult, and there is a lack of methods to appropriately provide content that aligns with users' emotional states. This makes it challenging to provide a safe and comfortable viewing environment. Moreover, the inability to provide content that considers users' emotional states may lead to decreased user satisfaction.

[0845] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0846] In this invention, the server includes means for receiving user authentication information and authenticating it by matching it with a database, means for receiving SNS account information and coordinating with the corresponding SNS via its API, means for filtering content based on user settings, means for providing filtered content to the user's terminal, means for providing internal billing options and enabling additional functions, means for detecting the user's emotional state, means for adjusting the filtering strength according to the emotional state, means for providing recommended content based on the emotional state, and means for centrally managing accounts for multiple content distribution services. This enables users to use multiple content distribution services in a safe and comfortable viewing environment. Furthermore, personalized content provision according to the emotional state can improve user satisfaction.

[0847] "User authentication information" refers to individual authentication credentials used to identify a user and grant them access to the system.

[0848] A "database" is an information management system used to manage and store user authentication information, social media account information, and other similar data.

[0849] "SNS account information" refers to information about the accounts that a user uses on social networking services.

[0850] An API (Application Programming Interface) is an interface for exchanging information between different software and services.

[0851] "Filtering" refers to the operation or process of removing unnecessary information or inappropriate content based on specific conditions.

[0852] "Filtering strength" is an indicator that shows the strictness or leniency of the filtering process.

[0853] A "content distribution service" is a service that provides digital content such as videos, music, and text via the internet.

[0854] A "user terminal" refers to a device used by a user, such as a smartphone, tablet, or computer.

[0855] An "internal billing option" is an option to provide additional features or services within an application for a fee.

[0856] "Emotional state" refers to the user's current emotional or mood state.

[0857] An "emotion engine" is an algorithm or system that analyzes a user's emotional state and provides appropriate content.

[0858] "Recommended content" refers to content that is specifically recommended based on the user's preferences and emotional state.

[0859] "Centralized management" means managing multiple services or systems together in one place.

[0860] Modes for carrying out the invention

[0861] System Overview

[0862] This invention is a "content distribution management system" that allows users to safely and comfortably utilize multiple content distribution services. This system provides secure access using user authentication information, enables centralized management of accounts for multiple distribution services, and includes functions for filtering defamatory, sexual, and violent content. It also provides additional filtering and service management functions through internal billing options. Furthermore, the invention incorporates an emotion engine that recognizes user emotions, providing additional functions to enhance the user experience.

[0863] Program Overview

[0864] The server will have the following features implemented:

[0865] 1. User Authentication: The server receives the user's authentication information (email address and password), compares it with the database, and authenticates the user. Communication with the server is performed using the Python requests library.

[0866] 2. Social Media Account Integration: The server uses the APIs of various content distribution services to integrate user account information. Examples include the APIs of YouTube and Netflix.

[0867] 3. Filtering Settings: The server receives the filtering information set by the user and stores it in the database. Filtering targets defamatory, sexual, and violent content.

[0868] 4. Emotion Engine: The server detects the user's emotional state and adjusts the filtering strength accordingly. The emotion engine is implemented using Python's natural language processing library (e.g., NLTK) or machine learning library (e.g., TensorFlow).

[0869] 5. Content Acquisition and Filtering: The server retrieves the latest content from the linked distribution service and filters it based on user settings. The filtered content is then provided to the user's device.

[0870] 6. Internal billing function: The server provides an internal billing system that allows users to purchase additional features and filtering functions.

[0871] Hardware and software to use

[0872] Hardware: Servers (cloud-based servers, e.g., Amazon Web Services), user devices (smartphones, tablets, computers)

[0873] Software: Python, requests library, natural language processing library (NLTK), machine learning library (TensorFlow)

[0874] Specific example

[0875] The following is a concrete example of a system that allows users to link their Netflix and YouTube accounts and enjoy safely filtered content.

[0876] User scenario:

[0877] 1. The user launches the app and enters their email address and password to authenticate.

[0878] 2. Once authentication is successful, the user will enter their Netflix and YouTube account information to link them.

[0879] 3. The user enables the "defamation" filtering in the app's settings screen.

[0880] 4. If the emotion engine detects that the user is experiencing stress, the "defamation" filtering strength will be increased.

[0881] 5. The server retrieves the latest filtered content and provides it to the user.

[0882] Examples of prompts for a generative AI model:

[0883] Functional requirements for content delivery applications

[0884] A feature that filters out defamatory, sexual, and violent content.

[0885] A feature that adjusts the filtering strength according to the user's emotional state.

[0886] A feature that allows you to manage accounts for multiple content distribution services all in one place.

[0887] Please generate pseudocode for an application that meets these requirements.

[0888] Through the above processing, the system of the present invention enables users to safely and comfortably utilize multiple content distribution services and improves the user experience through personalized content delivery based on emotional state.

[0889] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0890] Step 1:

[0891] The user launches the application and enters their email address and password on the login screen.

[0892] Input: Email address, password

[0893] Data processing: Send the entered authentication information to the server.

[0894] Output: Authentication success or failure message

[0895] Step 2:

[0896] The server compares the received user authentication information with the database and returns the authentication result.

[0897] Input: Email address, password

[0898] Data processing: Database matching

[0899] Output: Authentication success message or error message

[0900] Step 3:

[0901] Once the user successfully authenticates, a screen for linking social media accounts will appear, where they will enter the corresponding account information.

[0902] Input: Social media account information (e.g., User ID, Token)

[0903] Data processing: Send the entered SNS account information to the server.

[0904] Output: Message indicating success or failure in linking SNS accounts.

[0905] Step 4:

[0906] The server uses the APIs of the corresponding social networking services to link the user's social networking service account with the app.

[0907] Input: SNS account information

[0908] Data processing: Communicate with SNS APIs and link accounts.

[0909] Output: Integration success message

[0910] Step 5:

[0911] Users can set filters such as "defamation," "sexual content," and "violent content" on the filtering settings screen.

[0912] Input: Filter settings information

[0913] Data processing: Send the entered filter settings to the server.

[0914] Output: Filter settings saved message

[0915] Step 6:

[0916] The server retrieves the latest content from linked social media accounts and analyzes it based on the filtering settings.

[0917] Input: SNS account information, filter settings information

[0918] Data processing: Content retrieval and filtering using SNS APIs.

[0919] Output: Filtered, clean content

[0920] Step 7:

[0921] The server detects the user's emotional state and adjusts the filtering strength accordingly.

[0922] Input: User behavior and input data (e.g., text, facial expressions, voice)

[0923] Data processing: Sentiment analysis using an emotion engine

[0924] Output: Adjusted filtering strength

[0925] Step 8:

[0926] The server generates and provides recommended content to the user's terminal based on their emotional state.

[0927] Input: User's emotional state, filtered content

[0928] Data processing: Application of sentiment-based content recommendation algorithms

[0929] Output: Recommended content

[0930] Step 9:

[0931] Users can select in-app purchase options and enable additional filters and features.

[0932] Input: Internal billing selection information

[0933] Data processing: Send billing information to the server and process payments in conjunction with the payment system.

[0934] Output: Billing success message, Additional feature activation message

[0935] Step 10:

[0936] Users can comfortably enjoy filtered content and sentiment-based recommendations.

[0937] Input: Filtered content, recommended content

[0938] Data processing: Displaying content

[0939] Output: Improved user experience, increased satisfaction

[0940] Through the processing steps described above, the system of the present invention enables users to safely and comfortably utilize multiple content distribution services and to provide personalized content based on their emotional state.

[0941] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0942] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0943] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0944] [Third Embodiment]

[0945] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0946] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0947] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0948] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0949] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0950] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0951] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0952] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0953] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0954] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0955] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0956] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0957] This invention is a "social networking service browsing system" aimed at enabling users to safely and comfortably use multiple social networking services (SNS). This system provides secure access using user authentication information, allows for centralized management of multiple SNS accounts, and includes functions to filter defamatory, sexual, and violent content. Furthermore, it offers additional filtering and SNS account management functions through internal billing options.

[0958] Overall System Overview

[0959] User Authentication

[0960] To use the application, users must first enter their authentication information (email address and password). The device sends this authentication information to the server. The server compares it with the database and authenticates the user. If authentication is successful, the user interface is displayed, and the user can link additional social media accounts.

[0961] Linking social media accounts

[0962] The user enters their social media account information through the application. The device sends this information to the server, which then performs account linking via the corresponding social media API. If successful, the information is stored in the database.

[0963] Filter settings

[0964] Users can set filters for content such as "defamation," "sexual content," and "violent content." The device sends this setting information to the server, which stores this information in a database.

[0965] Content retrieval and filtering

[0966] The device sends a request to the server to retrieve the latest posts from its linked social media accounts. The server uses each social media API to retrieve the content, analyzes it, and filters it. Inappropriate content is excluded, and the filtered, clean content is returned to the device.

[0967] Internal billing feature

[0968] Users can choose an in-app purchase option to enable additional filtering features and management of new social media accounts. This will allow users to access a wider range of services.

[0969] Specific processing examples

[0970] Specific examples of authentication

[0971] The user enters their email address and password and clicks the "Login" button. The device sends the entered information to the server, which verifies the database. If authentication is successful, the user interface is displayed, and options such as "Link SNS account" are shown.

[0972] Examples of linking social media accounts

[0973] If a user wants to link their Instagram account, they enter their Instagram username and password into the app. The device sends this information to the server, which attempts to link using the Instagram API. If successful, the information is stored in the database, and the user can then view Instagram content within the app.

[0974] Specific examples of filter settings

[0975] If a user selects the "defamation" filter, that setting is sent to the server and stored in the database. From then on, all retrieved content is analyzed based on this filter setting, and posts containing defamation are excluded.

[0976] Examples of content retrieval and filtering

[0977] When a user clicks the "View" button, their device sends a request to the server. The server uses the Instagram API to retrieve the latest posts and analyzes them with a filtering engine. As a result, defamatory, sexual, and violent content is filtered out, and clean content is returned to the device.

[0978] Examples of internal billing features

[0979] If a user wants to use additional filtering features, they select the option in the app's settings screen and proceed with the payment process. The device sends the payment information to the server, which then authenticates the transaction in conjunction with the payment system. If successful, the new filtering feature is enabled, and the user can use the added filters.

[0980] Thus, the present invention is designed to enable users to safely and comfortably use multiple social networking services (SNS), and is a system that improves the user experience through a function to filter inappropriate content and an in-app purchase option.

[0981] The following describes the processing flow.

[0982] Step 1:

[0983] The user enters their email address and password on the application's login screen.

[0984] Step 2:

[0985] The device sends the entered authentication information (email address and password) to the server.

[0986] Step 3:

[0987] The server compares the received authentication information with the registered information in the database and attempts to authenticate the user.

[0988] Step 4:

[0989] If authentication is successful, the server sends an authentication success message back to the terminal. If authentication fails, an error message is sent back.

[0990] Step 5:

[0991] If authentication is successful, the device will display the user interface for linking the social media account.

[0992] Step 6:

[0993] The user enters their social media account information (e.g., username, password).

[0994] Step 7:

[0995] The device sends the entered SNS account information to the server.

[0996] Step 8:

[0997] The server performs the integration process via the SNS API, and if successful, saves the information to the database.

[0998] Step 9:

[0999] The server sends a success message to the device when linking the social media account.

[1000] Step 10:

[1001] On the filter settings screen, users can select filter settings for defamation, sexual content, and violent content.

[1002] Step 11:

[1003] The terminal sends the configured filter information to the server.

[1004] Step 12:

[1005] The server saves the received filter settings information to the database.

[1006] Step 13:

[1007] The user clicks the "Browse" button.

[1008] Step 14:

[1009] The device sends a request to the server to retrieve content from the linked social media account.

[1010] Step 15:

[1011] The server uses the APIs of each social networking service to send the retrieved content to a filtering engine, which then analyzes and filters it based on the user's filter settings.

[1012] Step 16:

[1013] The server generates filtered, clean content and sends it back to the terminal.

[1014] Step 17:

[1015] The device displays filtered content in the user interface.

[1016] Step 18:

[1017] Users can select a paid option in the app's settings screen to enable additional filtering features or new social media accounts.

[1018] Step 19:

[1019] The device sends the selected billing information to the server.

[1020] Step 20:

[1021] The server interacts with the payment system, performs billing, and, if successful, updates the database to enable the new feature.

[1022] Step 21:

[1023] The server sends a notification to the device confirming the successful completion of the billing process.

[1024] Step 22:

[1025] The device will display a notification to the user that the payment was successful and enable new filtering and social media account management features.

[1026] (Example 1)

[1027] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1028] In modern times, users often have multiple social networking service (SNS) accounts. However, there is a lack of safe and convenient ways to manage them all in one place. Furthermore, the presence of inappropriate content (defamatory, sexual, or violent material) can damage the user experience. Additionally, the limited means users have access to additional features makes flexible customization difficult. There is a need to provide an environment where users can safely and securely use multiple SNS platforms.

[1029] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1030] In this invention, the server includes means for receiving user authentication information and authenticating it by matching it with a database, means for receiving social networking service account information and coordinating it via a corresponding application programming interface, and means for filtering digital media content based on user settings. This allows users to securely centrally manage multiple SNS accounts and use them in a clean state with inappropriate content removed. Furthermore, flexible customization features are provided through internal billing options, which will improve the user experience.

[1031] "User authentication information" refers to information (primarily email address and password) that a user provides to prove their identity.

[1032] A "database" is a structured collection of data that a system uses to efficiently store, manage, and retrieve data.

[1033] An "Application Programming Interface (API)" is an interface that allows different software systems to access specific functions.

[1034] A "social networking service (SNS)" is a web-based platform designed for user interaction.

[1035] "Digital media content" refers to information that has been digitized in various forms, such as text, images, audio, and video.

[1036] "Filtering" is the process of removing unnecessary or inappropriate elements from data based on specific criteria.

[1037] A "user terminal" refers to an electronic device such as a computer, smartphone, or tablet that a user uses to access the system.

[1038] An "internal billing option" is a payment method that users use to access additional features or services provided within the software.

[1039] "Additional features" are supplementary functions provided in addition to the basic functions, and are intended to improve the user experience.

[1040] "Defamatory, sexual, and violent content" refers to digital media content that contains inappropriate language that attacks users, content that is considered sexually inappropriate, and content that promotes violence.

[1041] This invention relates to a "social networking service browsing system" that enables users to safely and comfortably use multiple social networking services (SNS). This system provides user authentication, SNS account linking, content filtering, and additional functions.

[1042] Hardware and software configuration

[1043] This system consists primarily of a server and user terminals. The server is a high-performance computer and includes a database server, application server, and content filtering engine. User terminals consist of smartphones, tablets, or personal computers.

[1044] The specific software used includes purchased commercial or open-source database management systems (DBMS), RESTful API frameworks for API calls, and natural language processing (NLP) or machine learning models as content filtering engines.

[1045] User Authentication

[1046] The user enters an email address and password to use the system. The device sends this authentication information to the server. The server compares it with the authentication information in the database, and if successful, generates an authentication token and returns it to the device. For example, if the user enters "user@example.com" and "password123", the device sends this to the server, and the server returns a token after authentication.

[1047] Linking social media accounts

[1048] The user enters their social media account information (e.g., Instagram username and password). The device sends this information to the server, which attempts to establish a connection via the corresponding social media API. For example, when a user enters their Instagram account information, the server calls the Instagram API and establishes the connection.

[1049] Content filtering

[1050] Users can set filters such as "defamation," "sexual," and "violent." The device sends this setting information to the server, which filters digital media content based on the settings. For example, if a user selects the "defamation" filter, the server analyzes the retrieved content and excludes posts containing defamation.

[1051] Internal billing option

[1052] Users can select an internal billing option to enable additional filtering features or manage new social media accounts. The device sends billing information to the server, which then processes the billing in conjunction with the payment system. For example, if a user selects an additional filtering feature and enters billing information, the server processes the billing through the payment system, and the new filtering feature is enabled.

[1053] Example of a prompt

[1054] Please describe the overview of the social networking service browsing system using the following steps:

[1055] 1. The user launches the application and enters their login information.

[1056] 2. Explain the authentication process.

[1057] 3. We will explain how to link your social media accounts.

[1058] 4. Instructions for setting up filters are shown.

[1059] 5. Explain the content retrieval and filtering process.

[1060] 6. Explain how to use the in-app purchase feature.

[1061] ---

[1062] Thus, the present invention is a system that allows users to securely manage multiple SNS accounts in a centralized manner, eliminate inappropriate content, and provide flexible customization functions.

[1063] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1064] Step 1:

[1065] User Authentication

[1066] Specific actions: The user launches the application and is redirected to the login screen. The user enters their email address and password.

[1067] Input: The email address and password entered by the user.

[1068] Data processing: The terminal sends these authentication credentials to the server. The server compares the received authentication credentials with the database.

[1069] Output: The server returns the authentication result, and if successful, generates an authentication token and returns it to the terminal.

[1070] Example: When a user enters the email address "user@example.com" and password "password123" and presses the "Login" button, the device sends this information to the server. The server verifies the information against its database and returns an authentication token upon successful authentication.

[1071] Step 2:

[1072] Linking social media accounts

[1073] Specific action: The user is redirected to the account linking screen and enters their social media account information.

[1074] Input: Username and password for the social networking service entered by the user.

[1075] Data processing: The terminal sends the entered SNS account information to the server. The server attempts to link the account via the corresponding application programming interface (API).

[1076] Output: If the connection is successful, the server saves the account information to the database and sends a connection confirmation message to the device.

[1077] Specific example: When a user enters their Instagram account username "insta_user" and password "insta_pass", the device sends this information to the server. The server attempts to connect using the Instagram API, and if successful, notifies the device of the successful connection.

[1078] Step 3:

[1079] Filter settings

[1080] Specific action: The user navigates to the filter settings screen and selects filter options such as "defamation," "sexual," or "violent."

[1081] Input: The filter options selected by the user.

[1082] Data processing: The terminal sends the selected filter settings to the server. The server records this information in its database.

[1083] Output: The server notifies the terminal that the filter settings were successful.

[1084] Specific example: When a user selects the "defamation" filter, the device sends this setting information to the server, which then stores it in a database. Upon successful saving, the server notifies the device that the filter settings have been completed.

[1085] Step 4:

[1086] Content retrieval and filtering

[1087] Specific action: The user clicks the content viewing button.

[1088] Input: User's content retrieval request.

[1089] Data processing: The device sends a content retrieval request to the server. The server uses the corresponding SNS API to retrieve the latest posts and analyzes and filters the content based on the configured filters.

[1090] Output: Returns filtered, clean content to the device.

[1091] Specific example: When a user clicks the "View" button, their device sends a request to the server. The server uses the Instagram API to retrieve the latest posts and analyzes them with a filtering engine. Defamatory, sexual, and violent content is filtered out, and safe content is returned to the device.

[1092] Step 5:

[1093] Internal billing option

[1094] Specific operation: The user selects options to enable additional filtering functions or new social media account management functions.

[1095] Input: Billing information entered by the user.

[1096] Data processing: The terminal sends billing information to the server. The server works with the payment system to process the billing.

[1097] Output: The server checks the billing process and, if successful, notifies the device that the new feature has been enabled.

[1098] Specific example: When a user selects the "additional filter function" and enters billing information, the device sends this information to the server, which then uses the payment system to process the payment. After success, the server notifies the device that the new filter function is now available.

[1099] (Application Example 1)

[1100] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1101] Many modern users utilize multiple social networking services (SNS), requiring them to manage separate authentication credentials to access each service. Furthermore, SNS platforms often contain defamatory, sexually explicit, and violent content, posing a challenge in protecting users from this inappropriate material. Moreover, providing a safe browsing environment necessitates the integration of the real and digital worlds through the use of smart devices.

[1102] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1103] In this invention, the server includes means for receiving user authentication information and authenticating it by matching it with a database, means for receiving service account information and coordinating with the corresponding service via an API, and means for filtering information based on user settings. This makes it possible to centrally manage multiple services and provide a secure browsing environment by filtering inappropriate content. Furthermore, by integrating real-world information and digital content via smart devices, the user experience can be improved.

[1104] "User authentication information" refers to the identification information necessary for a user to access a system, and generally consists of things like an email address and password.

[1105] A "database" is a collection of data that is systematically structured to allow for the efficient collection, management, and retrieval of information.

[1106] "Authentication" is the process of verifying that the information entered by the user (authentication information) is accurate and that the user has the authority to access the system.

[1107] "Service account information" refers to information about accounts for various social networking services (SNS) and other online services, and usually includes usernames and passwords.

[1108] "API" stands for Application Programming Interface, and it is an interface that allows one piece of software to communicate with other pieces of software.

[1109] "User settings" refer to various settings that users can configure to customize their own usage environment, including filtering targets and display methods.

[1110] "Filtering information" is the process of selecting and removing inappropriate or unnecessary content based on specific criteria.

[1111] A "user terminal" is a device that a user can directly operate, and includes smartphones, smart glasses, tablets, and other similar devices.

[1112] An "internal billing option" is a system where users pay an additional fee to use extra features within an application or service.

[1113] "Integrating real-world information with digital content" means providing an environment where the physical real world and digital information can be linked and used interactively through smart devices.

[1114] This invention is a system that enables users to safely and comfortably use multiple social networking services (SNS). This system includes functions for user authentication, SNS account linking, information filtering, provision of filtered information, provision of in-app purchase options, and integration of real-world information and digital content via smart devices.

[1115] First, the user enters their authentication information (email address and password) and sends it from their device to the server. The server then verifies this information against its database and performs authentication. If authentication is successful, the user enters their service account information (username and password for various social networking services) and sends it to the server. The server attempts to connect via the API of the specific service, and if successful, saves that information to its database.

[1116] Next, the user selects their desired filtering conditions (e.g., defamatory, sexual, or violent content) on the settings screen and sends the settings information to the server. This settings information is stored in a database and used for subsequent content filtering. When a user wants to view the latest posts from social media, they send a request from their device to the server. The server retrieves the content using the API of each social media platform, analyzes it with a filtering engine, and removes inappropriate content. The filtered, clean content is returned to the device and provided to the user.

[1117] When using the in-app purchase option, users select the option in the app's settings screen and proceed with the purchase. The device sends the purchase information to the server, which then authenticates the transaction in conjunction with the payment system. If successful, the new filtering feature is enabled, allowing users to enjoy enhanced security and convenience.

[1118] Furthermore, smart devices (such as smartphones and smart glasses) can be used to interactively integrate information from the real world with digital content. This can improve the user experience, for example, by overlaying digital information in front of the user's eyes.

[1119] For example, if a user has set up a defamation filter and linked their Instagram and Twitter accounts, when the user opens the app and views the latest posts, their account information will first be authenticated. Then, the latest posts will be retrieved using the APIs of each social media platform, and posts containing defamation will be filtered out. Ultimately, only clean content will be provided to the user.

[1120] Example of a prompt:

[1121] For example, a user might link their Instagram and Twitter accounts and set up a defamation filter. When the user opens the app and tries to view the latest posts, user authentication is first successful, and then the latest posts are retrieved via the APIs of each social media platform. After that, the retrieved content is filtered, and only clean content is displayed to the user.

[1122] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1123] Step 1:

[1124] The user enters their authentication information (email address and password) into the device. The device sends this authentication information to the server. The server compares it with the database and returns the result. If authentication is successful, the user is granted access to the next step; if it fails, an error message is returned.

[1125] Enter: Email address, password

[1126] Output: Authentication result (success / failure)

[1127] Step 2:

[1128] The user enters the service account information they want to link (e.g., SNS username and password) into their device. The device sends this information to the server. The server attempts to link the account via the corresponding service's API and saves the result to a database. It also notifies the user of the success or failure of the linking.

[1129] Input: Service account information

[1130] Output: Integration result (success / failure)

[1131] Step 3:

[1132] The user selects filter settings options on their device (e.g., filtering for defamatory, sexual, or violent content). The device sends this setting information to the server. The server stores this information in a database and notifies the user when the filtering settings are updated.

[1133] Input: Filter settings options

[1134] Output: Saved filter settings

[1135] Step 4:

[1136] The user clicks the "Get Content" button on their device. The device sends a request to the server. The server uses the APIs of each connected social networking service to retrieve the latest content. The retrieved content is filtered, and inappropriate content is removed. Clean content is returned to the device and displayed to the user.

[1137] Input: Content Retrieval Request

[1138] Output: Filtered content

[1139] Step 5:

[1140] If a user wants to use additional filtering features, they select a payment option within the app and initiate the payment process. The device sends the payment information to the server. The server then works with an external payment system to process the payment. If the payment is successful, the new filtering feature is enabled, and the user receives a notification.

[1141] Input: Select billing option, billing information

[1142] Output: Results of enabling the new filter function

[1143] Step 6:

[1144] When a user wants to integrate real-world information with digital content using a smart device (e.g., smart glasses), they send a request from the device to a server. The server integrates the user's current location and surrounding information with the digital content and sends that information back to the device. This allows the user to visually experience the fused content in real time.

[1145] Input: Integration request, current location information

[1146] Output: Integrated digital content

[1147] These steps enable the system of the present invention to provide users with a safe and comfortable SNS usage environment.

[1148] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1149] This invention is a "social networking service browsing system" aimed at enabling users to safely and comfortably use multiple social networking services (SNS). The system provides secure access using user authentication information, allows for centralized management of multiple SNS accounts, and includes functions to filter defamatory, sexual, and violent content. Furthermore, it offers additional filtering and SNS account management functions through internal billing options. In addition, the invention incorporates an emotion engine that recognizes user emotions, providing additional functions to improve the user experience.

[1150] Overall System Overview

[1151] User Authentication

[1152] To use the application, users must first enter their authentication information (email address and password). The device sends this information to the server, which attempts to authenticate the user by comparing it against its database. If authentication is successful, the user interface is displayed, and the user can link additional social media accounts.

[1153] Linking social media accounts

[1154] The user enters their social media account information through the application. The device sends this information to the server, which then performs account linking via the corresponding social media API. If this linking process is successful, the information is stored in the database.

[1155] Filter settings

[1156] Users can set filters for content such as "defamation," "sexual content," and "violent content." The device sends this setting information to the server, which stores it in a database.

[1157] Content retrieval and filtering

[1158] The device sends a request to the server to retrieve the latest posts from its linked social media accounts. The server uses each social media API to retrieve the content, analyzes it, and filters it. Inappropriate content is excluded, and the filtered, clean content is returned to the device.

[1159] Internal billing feature

[1160] Users can choose an in-app purchase option to enable additional filtering features and management of new social media accounts. This will allow users to access a wider range of services.

[1161] Implementation of an emotion engine

[1162] This invention incorporates an emotion engine that recognizes the user's emotions. The emotion engine determines the user's emotional state by analyzing the user's behavior and input data (e.g., text, facial expressions, voice).

[1163] Specific processing examples

[1164] Adjusting the filtering strength by the emotion engine

[1165] If a user is emotionally agitated, the sentiment engine detects this and instructs the server to strengthen the filtering. For example, posts that would normally be allowed may be filtered in this case.

[1166] Adjusting content display using an emotion engine

[1167] If the sentiment engine determines that a user is likely feeling down, the server will adjust its display to prioritize more positive content and posts that encourage the user.

[1168] Customized feedback powered by an emotion engine

[1169] If the emotion engine detects that the user is feeling stressed, the server will display advice and recommended content that can help with relaxation and stress relief.

[1170] Specific examples of authentication

[1171] The user enters their email address and password and clicks the "Login" button. The device sends the entered information to the server, which verifies the database. If authentication is successful, the user interface is displayed, and options such as "Link SNS account" are shown.

[1172] Examples of linking social media accounts

[1173] If a user wants to link their social media account (e.g., an Instagram account), they enter their account information into the app. The device sends this information to the server, which attempts to link the account using the social media API. If successful, the information is stored in the database, and the user can then view social media content within the app.

[1174] Specific examples of filter settings

[1175] When a user selects the "defamation" filter, that setting is sent to the server and stored in the database. From then on, all retrieved content is analyzed based on this filter setting, and posts containing defamation are excluded.

[1176] Examples of internal billing

[1177] To utilize additional filtering features, the user selects a billing option in the app's settings screen. The device sends this selection information to the server, which then authenticates the user in conjunction with the payment system. Upon success, the database is updated and the new feature is enabled.

[1178] This invention provides a system that allows users to safely and comfortably use multiple social networking services, and by incorporating an emotion engine, it can provide an even more personalized user experience.

[1179] The following describes the processing flow.

[1180] Step 1:

[1181] The user enters their email address and password on the application's login screen.

[1182] Step 2:

[1183] The device sends the entered authentication information (email address and password) to the server.

[1184] Step 3:

[1185] The server compares the received authentication information with the registered information in the database and attempts to authenticate the user.

[1186] Step 4:

[1187] If authentication is successful, the server sends an authentication success message back to the terminal. If authentication fails, an error message is sent back.

[1188] Step 5:

[1189] If authentication is successful, the device will display the user interface for linking the social media account.

[1190] Step 6:

[1191] The user enters their social media account information (e.g., username, password).

[1192] Step 7:

[1193] The device sends the entered SNS account information to the server.

[1194] Step 8:

[1195] The server performs the integration process via the SNS API, and if successful, saves the information to the database.

[1196] Step 9:

[1197] The server sends a success message to the device when linking the social media account.

[1198] Step 10:

[1199] On the filter settings screen, users can select filter settings for defamation, sexual content, and violent content.

[1200] Step 11:

[1201] The terminal sends the configured filter information to the server.

[1202] Step 12:

[1203] The server saves the received filter settings information to the database.

[1204] Step 13:

[1205] The user clicks the "Browse" button.

[1206] Step 14:

[1207] The device sends a request to the server to retrieve content from the linked social media account.

[1208] Step 15:

[1209] The server uses the APIs of each social networking service to send the retrieved content to a filtering engine, which then analyzes and filters it based on the user's filter settings.

[1210] Step 16:

[1211] The server generates filtered, clean content and sends it back to the terminal.

[1212] Step 17:

[1213] The device displays filtered content in the user interface.

[1214] Step 18:

[1215] The emotion engine analyzes the user's emotions.

[1216] Step 19:

[1217] If a user is emotionally agitated, the emotion engine instructs the server to increase the filtering strength.

[1218] Step 20:

[1219] If the emotion engine determines that a user is feeling down, the server will prioritize displaying positive content and posts that encourage the user.

[1220] Step 21:

[1221] Based on the analysis results of the emotion engine, the server provides customized feedback and recommended content to the user's device.

[1222] Step 22:

[1223] The device displays feedback and recommended content to the user, following instructions from the emotion engine.

[1224] Step 23:

[1225] Users can select a paid option in the app's settings screen to enable additional filtering features or new social media accounts.

[1226] Step 24:

[1227] The device sends the selected billing information to the server.

[1228] Step 25:

[1229] The server interacts with the payment system, performs billing, and, if successful, updates the database to enable the new feature.

[1230] Step 26:

[1231] The server sends a notification to the device confirming the successful completion of the billing process.

[1232] Step 27:

[1233] The device will display a notification to the user that the payment was successful and enable new filtering and social media account management features.

[1234] (Example 2)

[1235] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1236] Currently, in order to use multiple social networking services (SNS) safely and comfortably, users need to manage separate accounts for each SNS and operate multiple applications. Furthermore, filtering settings for defamatory, sexual, and violent content are inadequate, making it highly likely that users will have an unpleasant experience. In addition, current systems are not adequately able to adjust the filtering strength and content display according to the user's emotional state.

[1237] The identification processing performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for receiving user authentication information and authenticating it by comparing it with a database, means for receiving multiple SNS account information and coordinating with each SNS via its API, means for filtering content based on user settings, means for providing filtered content to the user terminal, means for providing internal billing options and enabling additional functions, and means for analyzing the user's emotional state using an emotion engine and adjusting the filtering strength and content display. As a result, users can centrally manage multiple SNS and use them safely and comfortably, and flexible filtering and content display according to the user's emotional state are possible.

[1238] "User authentication information" refers to the identification information (e.g., email address and password) that a user uses to access the system.

[1239] A "database" is a storage device used by a system to store data such as user authentication information, social media account information, and filter settings.

[1240] "SNS account information" refers to the authentication information that users use to log in to various social networking services (e.g., Facebook and Twitter).

[1241] "API" stands for Application Programming Interface, which is an interface that allows different software components to interact with each other.

[1242] "Filtering" refers to the process of excluding inappropriate content (e.g., defamatory, sexual, or violent content) based on user preferences.

[1243] An "internal billing option" refers to a billing option that users can choose to enable additional features.

[1244] An "emotion engine" is a software component that analyzes user behavior and input data (e.g., text, facial expressions, voice) to determine the user's emotional state.

[1245] A "user terminal" refers to a device used by a user, such as a computer or smartphone.

[1246] "Filtering strength" is a measure that indicates the strictness of the filtering process.

[1247] "Content display" refers to the display format used when providing filtered information or posts to users.

[1248] This invention provides a system that allows users to safely and comfortably use multiple social networking services (SNS). The system provides secure access using user authentication information and enables centralized management of multiple SNS accounts. It also includes a function to filter defamatory, sexual, and violent content, and offers additional filtering and SNS account management functions through internal billing options. Furthermore, it incorporates an emotion engine that recognizes the user's emotions and adjusts the filtering strength and content display accordingly.

[1249] The user sends authentication information from their device to the server by entering their email address and password. The server checks its database and verifies the authentication information. If authentication is successful, the user interface is displayed on the device, and the user can link additional social media accounts.

[1250] In SNS account linking, the user enters their SNS account information, and the device sends that information to the server. The server uses the API of each SNS to perform the account linking, and if successful, the information is saved in the database. For example, if a user wants to link their Instagram account, they enter their account information into the application, the device sends the information to the server, and the server attempts to link via the Instagram API. If successful, the information is saved in the database, and the user can view SNS content within the application.

[1251] In the filter settings, users select filters such as "defamation," "sexual content," and "violent content." The device sends this setting information to the server, which stores the settings information in a database. Based on this setting, the server analyzes the content retrieved from social media and filters out inappropriate content. Filtered, clean content is provided to the device, allowing users to browse social media safely.

[1252] In the internal billing option, the user selects a billing option to enable additional features. The device sends this selection information to the server, which then works with the payment system to process the billing. If the process is successful, the database is updated and the new feature is enabled. For example, if a user selects a billing option to use an additional filter feature, that information is sent to the server, the payment system authenticates it, and if successful, the new filter feature is enabled.

[1253] The emotion engine analyzes user behavior and input data (text, facial expressions, voice) to determine the user's emotional state. If the user is emotionally agitated, the emotion engine instructs the server to strengthen the filtering. If the user is depressed, the server adjusts to prioritize displaying positive content.

[1254] Examples of specific cases and prompt statements

[1255] For example, if a user logs in, enters the email address "example@example.com" and password "password123," and clicks the "Login" button, the device sends this information to the server. The server checks the information in its database, and if authentication is successful, the option to "Link SNS account" appears on the user interface.

[1256] Additionally, the user enters their Instagram account information ("username: example_user, password: 123456"), the device sends this information to the server, the server processes it via API, and if successful, the information is saved to the database. The user can then view Instagram content within the app.

[1257] Example of a prompt

[1258] "When a user is emotionally agitated, we will strengthen the filtering intensity and configure the system to prioritize displaying positive content."

[1259] This system allows users to centrally manage multiple social media platforms, enabling them to use them safely and conveniently, and also provides a more personalized experience by leveraging an emotion engine.

[1260] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1261] Step 1: User Authentication

[1262] The user enters their email address and password and clicks the "Login" button.

[1263] Input: The user enters their email address and password.

[1264] Terminal operation: The terminal sends the entered authentication information to the server.

[1265] Server operation: The server checks the database and verifies the submitted authentication information. In this process, it verifies whether the email address and password combination matches.

[1266] Output: Notification of authentication success or failure.

[1267] Device behavior: If authentication is successful, the device will display "Authentication successful" on the user interface and provide the option to "Link SNS account".

[1268] Step 2: Linking SNS accounts

[1269] The user enters their social media account information.

[1270] Input: Social media account information (e.g., username and password).

[1271] Terminal operation: The terminal sends the entered account information to the server.

[1272] Server operation: The server attempts to link accounts using the APIs of each social networking service. If the linking is successful, the information is saved to the database.

[1273] Output: Notification of successful or unsuccessful account linking.

[1274] Device operation: Display a notification to the user that the connection was successful and make the SNS content viewable.

[1275] Step 3: Filter settings

[1276] The user selects the filter settings.

[1277] Input: Filter settings selected by the user (e.g., "defamation", "sexual", "violent").

[1278] Terminal operation: The terminal sends the selected filter settings to the server.

[1279] Server operation: The server saves the filter settings to the database.

[1280] Output: Notification that filter settings are complete.

[1281] Terminal action: Notify the user that the filter settings have been completed.

[1282] Step 4: Retrieve and filter content

[1283] The device retrieves the latest posts from linked social media accounts.

[1284] Input: A request sent from the device to retrieve the latest posts.

[1285] Server operation: The server calls the APIs of each social networking service to retrieve the latest posts. The retrieved content is analyzed based on the filter settings, and inappropriate content is excluded.

[1286] Output: Filtered, clean content.

[1287] Device operation: Display clean content to the user.

[1288] Step 5: Internal billing feature

[1289] Users select a billing option to enable additional features.

[1290] Input: The billing option selected by the user.

[1291] Device operation: The device sends billing option information to the server.

[1292] Server operation: The server works in conjunction with the payment system to process payments. If the payment is successful, it updates the database and enables the new feature.

[1293] Output: Notification of successful or failed billing, information on the availability of new features.

[1294] Device operation: If the charge is successful, the user will be notified that a new feature is available.

[1295] Step 6: Implementing the Emotion Engine

[1296] The emotion engine analyzes user behavior and input data (text, facial expressions, voice).

[1297] Input: Behavioral and input data collected from users.

[1298] Server operation: The server uses an emotion engine to analyze data and determine the user's emotional state. It adjusts the filtering strength and content display according to the emotional state.

[1299] Output: Adjusted filtering strength, personalized content display.

[1300] Device operation: Displays appropriately filtered content and personalized information to the user.

[1301] Through these steps, users can manage multiple social media platforms in a centralized, safe, and convenient environment, and utilize an emotion engine for flexible filtering and content display.

[1302] (Application Example 2)

[1303] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1304] In recent years, as many users utilize multiple content distribution services, there is a risk of exposure to defamatory, sexually explicit, and violent content. Furthermore, centralized management of account information across these services is difficult, and there is a lack of methods to appropriately provide content that aligns with users' emotional states. This makes it challenging to provide a safe and comfortable viewing environment. Moreover, the inability to provide content that considers users' emotional states may lead to decreased user satisfaction.

[1305] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[1306] In this invention, the server includes means for receiving user authentication information and authenticating it by matching it with a database, means for receiving SNS account information and coordinating with the corresponding SNS via its API, means for filtering content based on user settings, means for providing filtered content to the user's terminal, means for providing internal billing options and enabling additional functions, means for detecting the user's emotional state, means for adjusting the filtering strength according to the emotional state, means for providing recommended content based on the emotional state, and means for centrally managing accounts for multiple content distribution services. This enables users to use multiple content distribution services in a safe and comfortable viewing environment. Furthermore, personalized content provision according to the emotional state can improve user satisfaction.

[1307] "User authentication information" refers to individual authentication credentials used to identify a user and grant them access to the system.

[1308] A "database" is an information management system used to manage and store user authentication information, social media account information, and other similar data.

[1309] "SNS account information" refers to information about the accounts that a user uses on social networking services.

[1310] An API (Application Programming Interface) is an interface for exchanging information between different software and services.

[1311] "Filtering" refers to the operation or process of removing unnecessary information or inappropriate content based on specific conditions.

[1312] "Filtering strength" is an indicator that shows the strictness or leniency of the filtering process.

[1313] A "content distribution service" is a service that provides digital content such as videos, music, and text via the internet.

[1314] A "user terminal" refers to a device used by a user, such as a smartphone, tablet, or computer.

[1315] An "internal billing option" is an option to provide additional features or services within an application for a fee.

[1316] "Emotional state" refers to the user's current emotional or mood state.

[1317] An "emotion engine" is an algorithm or system that analyzes a user's emotional state and provides appropriate content.

[1318] "Recommended content" refers to content that is specifically recommended based on the user's preferences and emotional state.

[1319] "Centralized management" means managing multiple services or systems together in one place.

[1320] Modes for carrying out the invention

[1321] System Overview

[1322] This invention is a "content distribution management system" that allows users to safely and comfortably utilize multiple content distribution services. This system provides secure access using user authentication information, enables centralized management of accounts for multiple distribution services, and includes functions for filtering defamatory, sexual, and violent content. It also provides additional filtering and service management functions through internal billing options. Furthermore, the invention incorporates an emotion engine that recognizes user emotions, providing additional functions to enhance the user experience.

[1323] Program Overview

[1324] The server will have the following features implemented:

[1325] 1. User Authentication: The server receives the user's authentication information (email address and password), compares it with the database, and authenticates the user. Communication with the server is performed using the Python requests library.

[1326] 2. Social Media Account Integration: The server uses the APIs of various content distribution services to integrate user account information. Examples include the APIs of YouTube and Netflix.

[1327] 3. Filtering Settings: The server receives the filtering information set by the user and stores it in the database. Filtering targets defamatory, sexual, and violent content.

[1328] 4. Emotion Engine: The server detects the user's emotional state and adjusts the filtering strength accordingly. The emotion engine is implemented using Python's natural language processing library (e.g., NLTK) or machine learning library (e.g., TensorFlow).

[1329] 5. Content Acquisition and Filtering: The server retrieves the latest content from the linked distribution service and filters it based on user settings. The filtered content is then provided to the user's device.

[1330] 6. Internal billing function: The server provides an internal billing system that allows users to purchase additional features and filtering functions.

[1331] Hardware and software to use

[1332] Hardware: Servers (cloud-based servers, e.g., Amazon Web Services), user devices (smartphones, tablets, computers)

[1333] Software: Python, requests library, natural language processing library (NLTK), machine learning library (TensorFlow)

[1334] Specific example

[1335] The following is a concrete example of a system that allows users to link their Netflix and YouTube accounts and enjoy safely filtered content.

[1336] User scenario:

[1337] 1. The user launches the app and enters their email address and password to authenticate.

[1338] 2. Once authentication is successful, the user will enter their Netflix and YouTube account information to link them.

[1339] 3. The user enables the "defamation" filtering in the app's settings screen.

[1340] 4. If the emotion engine detects that the user is experiencing stress, the "defamation" filtering strength will be increased.

[1341] 5. The server retrieves the latest filtered content and provides it to the user.

[1342] Examples of prompts for a generative AI model:

[1343] Functional requirements for content delivery applications

[1344] A feature that filters out defamatory, sexual, and violent content.

[1345] A feature that adjusts the filtering strength according to the user's emotional state.

[1346] A feature that allows you to manage accounts for multiple content distribution services all in one place.

[1347] Please generate pseudocode for an application that meets these requirements.

[1348] Through the above processing, the system of the present invention enables users to safely and comfortably utilize multiple content distribution services and improves the user experience through personalized content delivery based on emotional state.

[1349] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1350] Step 1:

[1351] The user launches the application and enters their email address and password on the login screen.

[1352] Input: Email address, password

[1353] Data processing: Send the entered authentication information to the server.

[1354] Output: Authentication success or failure message

[1355] Step 2:

[1356] The server compares the received user authentication information with the database and returns the authentication result.

[1357] Input: Email address, password

[1358] Data processing: Database matching

[1359] Output: Authentication success message or error message

[1360] Step 3:

[1361] Once the user successfully authenticates, a screen for linking social media accounts will appear, where they will enter the corresponding account information.

[1362] Input: Social media account information (e.g., User ID, Token)

[1363] Data processing: Send the entered SNS account information to the server.

[1364] Output: Message indicating success or failure in linking SNS accounts.

[1365] Step 4:

[1366] The server uses the APIs of the corresponding social networking services to link the user's social networking service account with the app.

[1367] Input: SNS account information

[1368] Data processing: Communicate with SNS APIs and link accounts.

[1369] Output: Integration success message

[1370] Step 5:

[1371] Users can set filters such as "defamation," "sexual content," and "violent content" on the filtering settings screen.

[1372] Input: Filter settings information

[1373] Data processing: Send the entered filter settings to the server.

[1374] Output: Filter settings saved message

[1375] Step 6:

[1376] The server retrieves the latest content from linked social media accounts and analyzes it based on the filtering settings.

[1377] Input: SNS account information, filter settings information

[1378] Data processing: Content retrieval and filtering using SNS APIs.

[1379] Output: Filtered, clean content

[1380] Step 7:

[1381] The server detects the user's emotional state and adjusts the filtering strength accordingly.

[1382] Input: User behavior and input data (e.g., text, facial expressions, voice)

[1383] Data processing: Sentiment analysis using an emotion engine

[1384] Output: Adjusted filtering strength

[1385] Step 8:

[1386] The server generates and provides recommended content to the user's terminal based on their emotional state.

[1387] Input: User's emotional state, filtered content

[1388] Data processing: Application of sentiment-based content recommendation algorithms

[1389] Output: Recommended content

[1390] Step 9:

[1391] Users can select in-app purchase options and enable additional filters and features.

[1392] Input: Internal billing selection information

[1393] Data processing: Send billing information to the server and process payments in conjunction with the payment system.

[1394] Output: Billing success message, Additional feature activation message

[1395] Step 10:

[1396] Users can comfortably enjoy filtered content and sentiment-based recommendations.

[1397] Input: Filtered content, recommended content

[1398] Data processing: Displaying content

[1399] Output: Improved user experience, increased satisfaction

[1400] Through the processing steps described above, the system of the present invention enables users to safely and comfortably utilize multiple content distribution services and to provide personalized content based on their emotional state.

[1401] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1402] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1403] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[1404] [Fourth Embodiment]

[1405] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[1406] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1407] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1408] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[1409] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[1410] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[1411] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[1412] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[1413] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[1414] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1415] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1416] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[1417] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1418] This invention is a "social networking service browsing system" aimed at enabling users to safely and comfortably use multiple social networking services (SNS). This system provides secure access using user authentication information, allows for centralized management of multiple SNS accounts, and includes functions to filter defamatory, sexual, and violent content. Furthermore, it offers additional filtering and SNS account management functions through internal billing options.

[1419] Overall System Overview

[1420] User Authentication

[1421] To use the application, users must first enter their authentication information (email address and password). The device sends this authentication information to the server. The server compares it with the database and authenticates the user. If authentication is successful, the user interface is displayed, and the user can link additional social media accounts.

[1422] Linking social media accounts

[1423] The user enters their social media account information through the application. The device sends this information to the server, which then performs account linking via the corresponding social media API. If successful, the information is stored in the database.

[1424] Filter settings

[1425] Users can set filters for content such as "defamation," "sexual content," and "violent content." The device sends this setting information to the server, which stores this information in a database.

[1426] Content retrieval and filtering

[1427] The device sends a request to the server to retrieve the latest posts from its linked social media accounts. The server uses each social media API to retrieve the content, analyzes it, and filters it. Inappropriate content is excluded, and the filtered, clean content is returned to the device.

[1428] Internal billing feature

[1429] Users can choose an in-app purchase option to enable additional filtering features and management of new social media accounts. This will allow users to access a wider range of services.

[1430] Specific processing examples

[1431] Specific examples of authentication

[1432] The user enters their email address and password and clicks the "Login" button. The device sends the entered information to the server, which verifies the database. If authentication is successful, the user interface is displayed, and options such as "Link SNS account" are shown.

[1433] Examples of linking social media accounts

[1434] If a user wants to link their Instagram account, they enter their Instagram username and password into the app. The device sends this information to the server, which attempts to link using the Instagram API. If successful, the information is stored in the database, and the user can then view Instagram content within the app.

[1435] Specific examples of filter settings

[1436] If a user selects the "defamation" filter, that setting is sent to the server and stored in the database. From then on, all retrieved content is analyzed based on this filter setting, and posts containing defamation are excluded.

[1437] Examples of content retrieval and filtering

[1438] When a user clicks the "View" button, their device sends a request to the server. The server uses the Instagram API to retrieve the latest posts and analyzes them with a filtering engine. As a result, defamatory, sexual, and violent content is filtered out, and clean content is returned to the device.

[1439] Examples of internal billing features

[1440] If a user wants to use additional filtering features, they select the option in the app's settings screen and proceed with the payment process. The device sends the payment information to the server, which then authenticates the transaction in conjunction with the payment system. If successful, the new filtering feature is enabled, and the user can use the added filters.

[1441] Thus, the present invention is designed to enable users to safely and comfortably use multiple social networking services (SNS), and is a system that improves the user experience through a function to filter inappropriate content and an in-app purchase option.

[1442] The following describes the processing flow.

[1443] Step 1:

[1444] The user enters their email address and password on the application's login screen.

[1445] Step 2:

[1446] The device sends the entered authentication information (email address and password) to the server.

[1447] Step 3:

[1448] The server compares the received authentication information with the registered information in the database and attempts to authenticate the user.

[1449] Step 4:

[1450] If authentication is successful, the server sends an authentication success message back to the terminal. If authentication fails, an error message is sent back.

[1451] Step 5:

[1452] If authentication is successful, the device will display the user interface for linking the social media account.

[1453] Step 6:

[1454] The user enters their social media account information (e.g., username, password).

[1455] Step 7:

[1456] The device sends the entered SNS account information to the server.

[1457] Step 8:

[1458] The server performs the integration process via the SNS API, and if successful, saves the information to the database.

[1459] Step 9:

[1460] The server sends a success message to the device when linking the social media account.

[1461] Step 10:

[1462] On the filter settings screen, users can select filter settings for defamation, sexual content, and violent content.

[1463] Step 11:

[1464] The terminal sends the configured filter information to the server.

[1465] Step 12:

[1466] The server saves the received filter settings information to the database.

[1467] Step 13:

[1468] The user clicks the "Browse" button.

[1469] Step 14:

[1470] The device sends a request to the server to retrieve content from the linked social media account.

[1471] Step 15:

[1472] The server uses the APIs of each social networking service to send the retrieved content to a filtering engine, which then analyzes and filters it based on the user's filter settings.

[1473] Step 16:

[1474] The server generates filtered, clean content and sends it back to the terminal.

[1475] Step 17:

[1476] The device displays filtered content in the user interface.

[1477] Step 18:

[1478] Users can select a paid option in the app's settings screen to enable additional filtering features or new social media accounts.

[1479] Step 19:

[1480] The device sends the selected billing information to the server.

[1481] Step 20:

[1482] The server interacts with the payment system, performs billing, and, if successful, updates the database to enable the new feature.

[1483] Step 21:

[1484] The server sends a notification to the device confirming the successful completion of the billing process.

[1485] Step 22:

[1486] The device will display a notification to the user that the payment was successful and enable new filtering and social media account management features.

[1487] (Example 1)

[1488] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1489] In modern times, users often have multiple social networking service (SNS) accounts. However, there is a lack of safe and convenient ways to manage them all in one place. Furthermore, the presence of inappropriate content (defamatory, sexual, or violent material) can damage the user experience. Additionally, the limited means users have access to additional features makes flexible customization difficult. There is a need to provide an environment where users can safely and securely use multiple SNS platforms.

[1490] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1491] In this invention, the server includes means for receiving user authentication information and authenticating it by matching it with a database, means for receiving social networking service account information and coordinating it via a corresponding application programming interface, and means for filtering digital media content based on user settings. This allows users to securely centrally manage multiple SNS accounts and use them in a clean state with inappropriate content removed. Furthermore, flexible customization features are provided through internal billing options, which will improve the user experience.

[1492] "User authentication information" refers to information (primarily email address and password) that a user provides to prove their identity.

[1493] A "database" is a structured collection of data that a system uses to efficiently store, manage, and retrieve data.

[1494] An "Application Programming Interface (API)" is an interface that allows different software systems to access specific functions.

[1495] A "social networking service (SNS)" is a web-based platform designed for user interaction.

[1496] "Digital media content" refers to information that has been digitized in various forms, such as text, images, audio, and video.

[1497] "Filtering" is the process of removing unnecessary or inappropriate elements from data based on specific criteria.

[1498] A "user terminal" refers to an electronic device such as a computer, smartphone, or tablet that a user uses to access the system.

[1499] An "internal billing option" is a payment method that users use to access additional features or services provided within the software.

[1500] "Additional features" are supplementary functions provided in addition to the basic functions, and are intended to improve the user experience.

[1501] "Defamatory, sexual, and violent content" refers to digital media content that contains inappropriate language that attacks users, content that is considered sexually inappropriate, and content that promotes violence.

[1502] This invention relates to a "social networking service browsing system" that enables users to safely and comfortably use multiple social networking services (SNS). This system provides user authentication, SNS account linking, content filtering, and additional functions.

[1503] Hardware and software configuration

[1504] This system consists primarily of a server and user terminals. The server is a high-performance computer and includes a database server, application server, and content filtering engine. User terminals consist of smartphones, tablets, or personal computers.

[1505] The specific software used includes purchased commercial or open-source database management systems (DBMS), RESTful API frameworks for API calls, and natural language processing (NLP) or machine learning models as content filtering engines.

[1506] User Authentication

[1507] The user enters an email address and password to use the system. The device sends this authentication information to the server. The server compares it with the authentication information in the database, and if successful, generates an authentication token and returns it to the device. For example, if the user enters "user@example.com" and "password123", the device sends this to the server, and the server returns a token after authentication.

[1508] Linking social media accounts

[1509] The user enters their social media account information (e.g., Instagram username and password). The device sends this information to the server, which attempts to establish a connection via the corresponding social media API. For example, when a user enters their Instagram account information, the server calls the Instagram API and establishes the connection.

[1510] Content filtering

[1511] Users can set filters such as "defamation," "sexual," and "violent." The device sends this setting information to the server, which filters digital media content based on the settings. For example, if a user selects the "defamation" filter, the server analyzes the retrieved content and excludes posts containing defamation.

[1512] Internal billing option

[1513] Users can select an internal billing option to enable additional filtering features or manage new social media accounts. The device sends billing information to the server, which then processes the billing in conjunction with the payment system. For example, if a user selects an additional filtering feature and enters billing information, the server processes the billing through the payment system, and the new filtering feature is enabled.

[1514] Example of a prompt

[1515] Please describe the overview of the social networking service browsing system using the following steps:

[1516] 1. The user launches the application and enters their login information.

[1517] 2. Explain the authentication process.

[1518] 3. We will explain how to link your social media accounts.

[1519] 4. Instructions for setting up filters are shown.

[1520] 5. Explain the content retrieval and filtering process.

[1521] 6. Explain how to use the in-app purchase feature.

[1522] ---

[1523] Thus, the present invention is a system that allows users to securely manage multiple SNS accounts in a centralized manner, eliminate inappropriate content, and provide flexible customization functions.

[1524] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1525] Step 1:

[1526] User Authentication

[1527] Specific actions: The user launches the application and is redirected to the login screen. The user enters their email address and password.

[1528] Input: The email address and password entered by the user.

[1529] Data processing: The terminal sends these authentication credentials to the server. The server compares the received authentication credentials with the database.

[1530] Output: The server returns the authentication result, and if successful, generates an authentication token and returns it to the terminal.

[1531] Example: When a user enters the email address "user@example.com" and password "password123" and presses the "Login" button, the device sends this information to the server. The server verifies the information against its database and returns an authentication token upon successful authentication.

[1532] Step 2:

[1533] Linking social media accounts

[1534] Specific action: The user is redirected to the account linking screen and enters their social media account information.

[1535] Input: Username and password for the social networking service entered by the user.

[1536] Data processing: The terminal sends the entered SNS account information to the server. The server attempts to link the account via the corresponding application programming interface (API).

[1537] Output: If the connection is successful, the server saves the account information to the database and sends a connection confirmation message to the device.

[1538] Specific example: When a user enters their Instagram account username "insta_user" and password "insta_pass", the device sends this information to the server. The server attempts to connect using the Instagram API, and if successful, notifies the device of the successful connection.

[1539] Step 3:

[1540] Filter settings

[1541] Specific action: The user navigates to the filter settings screen and selects filter options such as "defamation," "sexual," or "violent."

[1542] Input: The filter options selected by the user.

[1543] Data processing: The terminal sends the selected filter settings to the server. The server records this information in its database.

[1544] Output: The server notifies the terminal that the filter settings were successful.

[1545] Specific example: When a user selects the "defamation" filter, the device sends this setting information to the server, which then stores it in a database. Upon successful saving, the server notifies the device that the filter settings have been completed.

[1546] Step 4:

[1547] Content retrieval and filtering

[1548] Specific action: The user clicks the content viewing button.

[1549] Input: User's content retrieval request.

[1550] Data processing: The device sends a content retrieval request to the server. The server uses the corresponding SNS API to retrieve the latest posts and analyzes and filters the content based on the configured filters.

[1551] Output: Returns filtered, clean content to the device.

[1552] Specific example: When a user clicks the "View" button, their device sends a request to the server. The server uses the Instagram API to retrieve the latest posts and analyzes them with a filtering engine. Defamatory, sexual, and violent content is filtered out, and safe content is returned to the device.

[1553] Step 5:

[1554] Internal billing option

[1555] Specific operation: The user selects options to enable additional filtering functions or new social media account management functions.

[1556] Input: Billing information entered by the user.

[1557] Data processing: The terminal sends billing information to the server. The server works with the payment system to process the billing.

[1558] Output: The server checks the billing process and, if successful, notifies the device that the new feature has been enabled.

[1559] Specific example: When a user selects the "additional filter function" and enters billing information, the device sends this information to the server, which then uses the payment system to process the payment. After success, the server notifies the device that the new filter function is now available.

[1560] (Application Example 1)

[1561] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1562] Many modern users utilize multiple social networking services (SNS), requiring them to manage separate authentication credentials to access each service. Furthermore, SNS platforms often contain defamatory, sexually explicit, and violent content, posing a challenge in protecting users from this inappropriate material. Moreover, providing a safe browsing environment necessitates the integration of the real and digital worlds through the use of smart devices.

[1563] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1564] In this invention, the server includes means for receiving user authentication information and authenticating it by matching it with a database, means for receiving service account information and coordinating with the corresponding service via an API, and means for filtering information based on user settings. This makes it possible to centrally manage multiple services and provide a secure browsing environment by filtering inappropriate content. Furthermore, by integrating real-world information and digital content via smart devices, the user experience can be improved.

[1565] "User authentication information" refers to the identification information necessary for a user to access a system, and generally consists of things like an email address and password.

[1566] A "database" is a collection of data that is systematically structured to allow for the efficient collection, management, and retrieval of information.

[1567] "Authentication" is the process of verifying that the information entered by the user (authentication information) is accurate and that the user has the authority to access the system.

[1568] "Service account information" refers to information about accounts for various social networking services (SNS) and other online services, and usually includes usernames and passwords.

[1569] "API" stands for Application Programming Interface, and it is an interface that allows one piece of software to communicate with other pieces of software.

[1570] "User settings" refer to various settings that users can configure to customize their own usage environment, including filtering targets and display methods.

[1571] "Filtering information" is the process of selecting and removing inappropriate or unnecessary content based on specific criteria.

[1572] A "user terminal" is a device that a user can directly operate, and includes smartphones, smart glasses, tablets, and other similar devices.

[1573] An "internal billing option" is a system where users pay an additional fee to use extra features within an application or service.

[1574] "Integrating real-world information with digital content" means providing an environment where the physical real world and digital information can be linked and used interactively through smart devices.

[1575] This invention is a system that enables users to safely and comfortably use multiple social networking services (SNS). This system includes functions for user authentication, SNS account linking, information filtering, provision of filtered information, provision of in-app purchase options, and integration of real-world information and digital content via smart devices.

[1576] First, the user enters their authentication information (email address and password) and sends it from their device to the server. The server then verifies this information against its database and performs authentication. If authentication is successful, the user enters their service account information (username and password for various social networking services) and sends it to the server. The server attempts to connect via the API of the specific service, and if successful, saves that information to its database.

[1577] Next, the user selects their desired filtering conditions (e.g., defamatory, sexual, or violent content) on the settings screen and sends the settings information to the server. This settings information is stored in a database and used for subsequent content filtering. When a user wants to view the latest posts from social media, they send a request from their device to the server. The server retrieves the content using the API of each social media platform, analyzes it with a filtering engine, and removes inappropriate content. The filtered, clean content is returned to the device and provided to the user.

[1578] When using the in-app purchase option, users select the option in the app's settings screen and proceed with the purchase. The device sends the purchase information to the server, which then authenticates the transaction in conjunction with the payment system. If successful, the new filtering feature is enabled, allowing users to enjoy enhanced security and convenience.

[1579] Furthermore, smart devices (such as smartphones and smart glasses) can be used to interactively integrate information from the real world with digital content. This can improve the user experience, for example, by overlaying digital information in front of the user's eyes.

[1580] For example, if a user has set up a defamation filter and linked their Instagram and Twitter accounts, when the user opens the app and views the latest posts, their account information will first be authenticated. Then, the latest posts will be retrieved using the APIs of each social media platform, and posts containing defamation will be filtered out. Ultimately, only clean content will be provided to the user.

[1581] Example of a prompt:

[1582] For example, a user might link their Instagram and Twitter accounts and set up a defamation filter. When the user opens the app and tries to view the latest posts, user authentication is first successful, and then the latest posts are retrieved via the APIs of each social media platform. After that, the retrieved content is filtered, and only clean content is displayed to the user.

[1583] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1584] Step 1:

[1585] The user enters their authentication information (email address and password) into the device. The device sends this authentication information to the server. The server compares it with the database and returns the result. If authentication is successful, the user is granted access to the next step; if it fails, an error message is returned.

[1586] Enter: Email address, password

[1587] Output: Authentication result (success / failure)

[1588] Step 2:

[1589] The user enters the service account information they want to link (e.g., SNS username and password) into their device. The device sends this information to the server. The server attempts to link the account via the corresponding service's API and saves the result to a database. It also notifies the user of the success or failure of the linking.

[1590] Input: Service account information

[1591] Output: Integration result (success / failure)

[1592] Step 3:

[1593] The user selects filter settings options on their device (e.g., filtering for defamatory, sexual, or violent content). The device sends this setting information to the server. The server stores this information in a database and notifies the user when the filtering settings are updated.

[1594] Input: Filter settings options

[1595] Output: Saved filter settings

[1596] Step 4:

[1597] The user clicks the "Get Content" button on their device. The device sends a request to the server. The server uses the APIs of each connected social networking service to retrieve the latest content. The retrieved content is filtered, and inappropriate content is removed. Clean content is returned to the device and displayed to the user.

[1598] Input: Content Retrieval Request

[1599] Output: Filtered content

[1600] Step 5:

[1601] If a user wants to use additional filtering features, they select a payment option within the app and initiate the payment process. The device sends the payment information to the server. The server then works with an external payment system to process the payment. If the payment is successful, the new filtering feature is enabled, and the user receives a notification.

[1602] Input: Select billing option, billing information

[1603] Output: Results of enabling the new filter function

[1604] Step 6:

[1605] When a user wants to integrate real-world information with digital content using a smart device (e.g., smart glasses), they send a request from the device to a server. The server integrates the user's current location and surrounding information with the digital content and sends that information back to the device. This allows the user to visually experience the fused content in real time.

[1606] Input: Integration request, current location information

[1607] Output: Integrated digital content

[1608] These steps enable the system of the present invention to provide users with a safe and comfortable SNS usage environment.

[1609] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1610] This invention is a "social networking service browsing system" aimed at enabling users to safely and comfortably use multiple social networking services (SNS). The system provides secure access using user authentication information, allows for centralized management of multiple SNS accounts, and includes functions to filter defamatory, sexual, and violent content. Furthermore, it offers additional filtering and SNS account management functions through internal billing options. In addition, the invention incorporates an emotion engine that recognizes user emotions, providing additional functions to improve the user experience.

[1611] Overall System Overview

[1612] User Authentication

[1613] To use the application, users must first enter their authentication information (email address and password). The device sends this information to the server, which attempts to authenticate the user by comparing it against its database. If authentication is successful, the user interface is displayed, and the user can link additional social media accounts.

[1614] Linking social media accounts

[1615] The user enters their social media account information through the application. The device sends this information to the server, which then performs account linking via the corresponding social media API. If this linking process is successful, the information is stored in the database.

[1616] Filter settings

[1617] Users can set filters for content such as "defamation," "sexual content," and "violent content." The device sends this setting information to the server, which stores it in a database.

[1618] Content retrieval and filtering

[1619] The device sends a request to the server to retrieve the latest posts from its linked social media accounts. The server uses each social media API to retrieve the content, analyzes it, and filters it. Inappropriate content is excluded, and the filtered, clean content is returned to the device.

[1620] Internal billing feature

[1621] Users can choose an in-app purchase option to enable additional filtering features and management of new social media accounts. This will allow users to access a wider range of services.

[1622] Implementation of an emotion engine

[1623] This invention incorporates an emotion engine that recognizes the user's emotions. The emotion engine determines the user's emotional state by analyzing the user's behavior and input data (e.g., text, facial expressions, voice).

[1624] Specific processing examples

[1625] Adjusting the filtering strength by the emotion engine

[1626] If a user is emotionally agitated, the sentiment engine detects this and instructs the server to strengthen the filtering. For example, posts that would normally be allowed may be filtered in this case.

[1627] Adjusting content display using an emotion engine

[1628] If the sentiment engine determines that a user is likely feeling down, the server will adjust its display to prioritize more positive content and posts that encourage the user.

[1629] Customized feedback powered by an emotion engine

[1630] If the emotion engine detects that the user is feeling stressed, the server will display advice and recommended content that can help with relaxation and stress relief.

[1631] Specific examples of authentication

[1632] The user enters their email address and password and clicks the "Login" button. The device sends the entered information to the server, which verifies the database. If authentication is successful, the user interface is displayed, and options such as "Link SNS account" are shown.

[1633] Examples of linking social media accounts

[1634] If a user wants to link their social media account (e.g., an Instagram account), they enter their account information into the app. The device sends this information to the server, which attempts to link the account using the social media API. If successful, the information is stored in the database, and the user can then view social media content within the app.

[1635] Specific examples of filter settings

[1636] When a user selects the "defamation" filter, that setting is sent to the server and stored in the database. From then on, all retrieved content is analyzed based on this filter setting, and posts containing defamation are excluded.

[1637] Examples of internal billing

[1638] To utilize additional filtering features, the user selects a billing option in the app's settings screen. The device sends this selection information to the server, which then authenticates the user in conjunction with the payment system. Upon success, the database is updated and the new feature is enabled.

[1639] This invention provides a system that allows users to safely and comfortably use multiple social networking services, and by incorporating an emotion engine, it can provide an even more personalized user experience.

[1640] The following describes the processing flow.

[1641] Step 1:

[1642] The user enters their email address and password on the application's login screen.

[1643] Step 2:

[1644] The device sends the entered authentication information (email address and password) to the server.

[1645] Step 3:

[1646] The server compares the received authentication information with the registered information in the database and attempts to authenticate the user.

[1647] Step 4:

[1648] If authentication is successful, the server sends an authentication success message back to the terminal. If authentication fails, an error message is sent back.

[1649] Step 5:

[1650] If authentication is successful, the device will display the user interface for linking the social media account.

[1651] Step 6:

[1652] The user enters their social media account information (e.g., username, password).

[1653] Step 7:

[1654] The device sends the entered SNS account information to the server.

[1655] Step 8:

[1656] The server performs the integration process via the SNS API, and if successful, saves the information to the database.

[1657] Step 9:

[1658] The server sends a success message to the device when linking the social media account.

[1659] Step 10:

[1660] On the filter settings screen, users can select filter settings for defamation, sexual content, and violent content.

[1661] Step 11:

[1662] The terminal sends the configured filter information to the server.

[1663] Step 12:

[1664] The server saves the received filter settings information to the database.

[1665] Step 13:

[1666] The user clicks the "Browse" button.

[1667] Step 14:

[1668] The device sends a request to the server to retrieve content from the linked social media account.

[1669] Step 15:

[1670] The server uses the APIs of each social networking service to send the retrieved content to a filtering engine, which then analyzes and filters it based on the user's filter settings.

[1671] Step 16:

[1672] The server generates filtered, clean content and sends it back to the terminal.

[1673] Step 17:

[1674] The device displays filtered content in the user interface.

[1675] Step 18:

[1676] The emotion engine analyzes the user's emotions.

[1677] Step 19:

[1678] If a user is emotionally agitated, the emotion engine instructs the server to increase the filtering strength.

[1679] Step 20:

[1680] If the emotion engine determines that a user is feeling down, the server will prioritize displaying positive content and posts that encourage the user.

[1681] Step 21:

[1682] Based on the analysis results of the emotion engine, the server provides customized feedback and recommended content to the user's device.

[1683] Step 22:

[1684] The device displays feedback and recommended content to the user, following instructions from the emotion engine.

[1685] Step 23:

[1686] Users can select a paid option in the app's settings screen to enable additional filtering features or new social media accounts.

[1687] Step 24:

[1688] The device sends the selected billing information to the server.

[1689] Step 25:

[1690] The server interacts with the payment system, performs billing, and, if successful, updates the database to enable the new feature.

[1691] Step 26:

[1692] The server sends a notification to the device confirming the successful completion of the billing process.

[1693] Step 27:

[1694] The device will display a notification to the user that the payment was successful and enable new filtering and social media account management features.

[1695] (Example 2)

[1696] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1697] Currently, in order to use multiple social networking services (SNS) safely and comfortably, users need to manage separate accounts for each SNS and operate multiple applications. Furthermore, filtering settings for defamatory, sexual, and violent content are inadequate, making it highly likely that users will have an unpleasant experience. In addition, current systems are not adequately able to adjust the filtering strength and content display according to the user's emotional state.

[1698] The identification processing performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for receiving user authentication information and authenticating it by comparing it with a database, means for receiving multiple SNS account information and coordinating with each SNS via its API, means for filtering content based on user settings, means for providing filtered content to the user terminal, means for providing internal billing options and enabling additional functions, and means for analyzing the user's emotional state using an emotion engine and adjusting the filtering strength and content display. As a result, users can centrally manage multiple SNS and use them safely and comfortably, and flexible filtering and content display according to the user's emotional state are possible.

[1699] "User authentication information" refers to the identification information (e.g., email address and password) that a user uses to access the system.

[1700] A "database" is a storage device used by a system to store data such as user authentication information, social media account information, and filter settings.

[1701] "SNS account information" refers to the authentication information that users use to log in to various social networking services (e.g., Facebook and Twitter).

[1702] "API" stands for Application Programming Interface, which is an interface that allows different software components to interact with each other.

[1703] "Filtering" refers to the process of excluding inappropriate content (e.g., defamatory, sexual, or violent content) based on user preferences.

[1704] An "internal billing option" refers to a billing option that users can choose to enable additional features.

[1705] An "emotion engine" is a software component that analyzes user behavior and input data (e.g., text, facial expressions, voice) to determine the user's emotional state.

[1706] A "user terminal" refers to a device used by a user, such as a computer or smartphone.

[1707] "Filtering strength" is a measure that indicates the strictness of the filtering process.

[1708] "Content display" refers to the display format used when providing filtered information or posts to users.

[1709] This invention provides a system that allows users to safely and comfortably use multiple social networking services (SNS). The system provides secure access using user authentication information and enables centralized management of multiple SNS accounts. It also includes a function to filter defamatory, sexual, and violent content, and offers additional filtering and SNS account management functions through internal billing options. Furthermore, it incorporates an emotion engine that recognizes the user's emotions and adjusts the filtering strength and content display accordingly.

[1710] The user sends authentication information from their device to the server by entering their email address and password. The server checks its database and verifies the authentication information. If authentication is successful, the user interface is displayed on the device, and the user can link additional social media accounts.

[1711] In SNS account linking, the user enters their SNS account information, and the device sends that information to the server. The server uses the API of each SNS to perform the account linking, and if successful, the information is saved in the database. For example, if a user wants to link their Instagram account, they enter their account information into the application, the device sends the information to the server, and the server attempts to link via the Instagram API. If successful, the information is saved in the database, and the user can view SNS content within the application.

[1712] In the filter settings, users select filters such as "defamation," "sexual content," and "violent content." The device sends this setting information to the server, which stores the settings information in a database. Based on this setting, the server analyzes the content retrieved from social media and filters out inappropriate content. Filtered, clean content is provided to the device, allowing users to browse social media safely.

[1713] In the internal billing option, the user selects a billing option to enable additional features. The device sends this selection information to the server, which then works with the payment system to process the billing. If the process is successful, the database is updated and the new feature is enabled. For example, if a user selects a billing option to use an additional filter feature, that information is sent to the server, the payment system authenticates it, and if successful, the new filter feature is enabled.

[1714] The emotion engine analyzes user behavior and input data (text, facial expressions, voice) to determine the user's emotional state. If the user is emotionally agitated, the emotion engine instructs the server to strengthen the filtering. If the user is depressed, the server adjusts to prioritize displaying positive content.

[1715] Examples of specific cases and prompt statements

[1716] For example, if a user logs in, enters the email address "example@example.com" and password "password123," and clicks the "Login" button, the device sends this information to the server. The server checks the information in its database, and if authentication is successful, the option to "Link SNS account" appears on the user interface.

[1717] Additionally, the user enters their Instagram account information ("username: example_user, password: 123456"), the device sends this information to the server, the server processes it via API, and if successful, the information is saved to the database. The user can then view Instagram content within the app.

[1718] Example of a prompt

[1719] "When a user is emotionally agitated, we will strengthen the filtering intensity and configure the system to prioritize displaying positive content."

[1720] This system allows users to centrally manage multiple social media platforms, enabling them to use them safely and conveniently, and also provides a more personalized experience by leveraging an emotion engine.

[1721] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1722] Step 1: User Authentication

[1723] The user enters their email address and password and clicks the "Login" button.

[1724] Input: The user enters their email address and password.

[1725] Terminal operation: The terminal sends the entered authentication information to the server.

[1726] Server operation: The server checks the database and verifies the submitted authentication information. In this process, it verifies whether the email address and password combination matches.

[1727] Output: Notification of authentication success or failure.

[1728] Device behavior: If authentication is successful, the device will display "Authentication successful" on the user interface and provide the option to "Link SNS account".

[1729] Step 2: Linking SNS accounts

[1730] The user enters their social media account information.

[1731] Input: Social media account information (e.g., username and password).

[1732] Terminal operation: The terminal sends the entered account information to the server.

[1733] Server operation: The server attempts to link accounts using the APIs of each social networking service. If the linking is successful, the information is saved to the database.

[1734] Output: Notification of successful or unsuccessful account linking.

[1735] Device operation: Display a notification to the user that the connection was successful and make the SNS content viewable.

[1736] Step 3: Filter settings

[1737] The user selects the filter settings.

[1738] Input: Filter settings selected by the user (e.g., "defamation", "sexual", "violent").

[1739] Terminal operation: The terminal sends the selected filter settings to the server.

[1740] Server operation: The server saves the filter settings to the database.

[1741] Output: Notification that filter settings are complete.

[1742] Terminal action: Notify the user that the filter settings have been completed.

[1743] Step 4: Retrieve and filter content

[1744] The device retrieves the latest posts from linked social media accounts.

[1745] Input: A request sent from the device to retrieve the latest posts.

[1746] Server operation: The server calls the APIs of each social networking service to retrieve the latest posts. The retrieved content is analyzed based on the filter settings, and inappropriate content is excluded.

[1747] Output: Filtered, clean content.

[1748] Device operation: Display clean content to the user.

[1749] Step 5: Internal billing feature

[1750] Users select a billing option to enable additional features.

[1751] Input: The billing option selected by the user.

[1752] Device operation: The device sends billing option information to the server.

[1753] Server operation: The server works in conjunction with the payment system to process payments. If the payment is successful, it updates the database and enables the new feature.

[1754] Output: Notification of successful or failed billing, information on the availability of new features.

[1755] Device operation: If the charge is successful, the user will be notified that a new feature is available.

[1756] Step 6: Implementing the Emotion Engine

[1757] The emotion engine analyzes user behavior and input data (text, facial expressions, voice).

[1758] Input: Behavioral and input data collected from users.

[1759] Server operation: The server uses an emotion engine to analyze data and determine the user's emotional state. It adjusts the filtering strength and content display according to the emotional state.

[1760] Output: Adjusted filtering strength, personalized content display.

[1761] Device operation: Displays appropriately filtered content and personalized information to the user.

[1762] Through these steps, users can manage multiple social media platforms in a centralized, safe, and convenient environment, and utilize an emotion engine for flexible filtering and content display.

[1763] (Application Example 2)

[1764] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1765] In recent years, as many users utilize multiple content distribution services, there is a risk of exposure to defamatory, sexually explicit, and violent content. Furthermore, centralized management of account information across these services is difficult, and there is a lack of methods to appropriately provide content that aligns with users' emotional states. This makes it challenging to provide a safe and comfortable viewing environment. Moreover, the inability to provide content that considers users' emotional states may lead to decreased user satisfaction.

[1766] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[1767] In this invention, the server includes means for receiving user authentication information and authenticating it by matching it with a database, means for receiving SNS account information and coordinating with the corresponding SNS via its API, means for filtering content based on user settings, means for providing filtered content to the user's terminal, means for providing internal billing options and enabling additional functions, means for detecting the user's emotional state, means for adjusting the filtering strength according to the emotional state, means for providing recommended content based on the emotional state, and means for centrally managing accounts for multiple content distribution services. This enables users to use multiple content distribution services in a safe and comfortable viewing environment. Furthermore, personalized content provision according to the emotional state can improve user satisfaction.

[1768] "User authentication information" refers to individual authentication credentials used to identify a user and grant them access to the system.

[1769] A "database" is an information management system used to manage and store user authentication information, social media account information, and other similar data.

[1770] "SNS account information" refers to information about the accounts that a user uses on social networking services.

[1771] An API (Application Programming Interface) is an interface for exchanging information between different software and services.

[1772] "Filtering" refers to the operation or process of removing unnecessary information or inappropriate content based on specific conditions.

[1773] "Filtering strength" is an indicator that shows the strictness or leniency of the filtering process.

[1774] A "content distribution service" is a service that provides digital content such as videos, music, and text via the internet.

[1775] A "user terminal" refers to a device used by a user, such as a smartphone, tablet, or computer.

[1776] An "internal billing option" is an option to provide additional features or services within an application for a fee.

[1777] "Emotional state" refers to the user's current emotional or mood state.

[1778] An "emotion engine" is an algorithm or system that analyzes a user's emotional state and provides appropriate content.

[1779] "Recommended content" refers to content that is specifically recommended based on the user's preferences and emotional state.

[1780] "Centralized management" means managing multiple services or systems together in one place.

[1781] Modes for carrying out the invention

[1782] System Overview

[1783] This invention is a "content distribution management system" that allows users to safely and comfortably utilize multiple content distribution services. This system provides secure access using user authentication information, enables centralized management of accounts for multiple distribution services, and includes functions for filtering defamatory, sexual, and violent content. It also provides additional filtering and service management functions through internal billing options. Furthermore, the invention incorporates an emotion engine that recognizes user emotions, providing additional functions to enhance the user experience.

[1784] Program Overview

[1785] The server will have the following features implemented:

[1786] 1. User Authentication: The server receives the user's authentication information (email address and password), compares it with the database, and authenticates the user. Communication with the server is performed using the Python requests library.

[1787] 2. Social Media Account Integration: The server uses the APIs of various content distribution services to integrate user account information. Examples include the APIs of YouTube and Netflix.

[1788] 3. Filtering Settings: The server receives the filtering information set by the user and stores it in the database. Filtering targets defamatory, sexual, and violent content.

[1789] 4. Emotion Engine: The server detects the user's emotional state and adjusts the filtering strength accordingly. The emotion engine is implemented using Python's natural language processing library (e.g., NLTK) or machine learning library (e.g., TensorFlow).

[1790] 5. Content Acquisition and Filtering: The server retrieves the latest content from the linked distribution service and filters it based on user settings. The filtered content is then provided to the user's device.

[1791] 6. Internal billing function: The server provides an internal billing system that allows users to purchase additional features and filtering functions.

[1792] Hardware and software to use

[1793] Hardware: Servers (cloud-based servers, e.g., Amazon Web Services), user devices (smartphones, tablets, computers)

[1794] Software: Python, requests library, natural language processing library (NLTK), machine learning library (TensorFlow)

[1795] Specific example

[1796] The following is a concrete example of a system that allows users to link their Netflix and YouTube accounts and enjoy safely filtered content.

[1797] User scenario:

[1798] 1. The user launches the app and enters their email address and password to authenticate.

[1799] 2. Once authentication is successful, the user will enter their Netflix and YouTube account information to link them.

[1800] 3. The user enables the "defamation" filtering in the app's settings screen.

[1801] 4. If the emotion engine detects that the user is experiencing stress, the "defamation" filtering strength will be increased.

[1802] 5. The server retrieves the latest filtered content and provides it to the user.

[1803] Examples of prompts for a generative AI model:

[1804] Functional requirements for content delivery applications

[1805] A feature that filters out defamatory, sexual, and violent content.

[1806] A feature that adjusts the filtering strength according to the user's emotional state.

[1807] A feature that allows you to manage accounts for multiple content distribution services all in one place.

[1808] Please generate pseudocode for an application that meets these requirements.

[1809] Through the above processing, the system of the present invention enables users to safely and comfortably utilize multiple content distribution services and improves the user experience through personalized content delivery based on emotional state.

[1810] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1811] Step 1:

[1812] The user launches the application and enters their email address and password on the login screen.

[1813] Input: Email address, password

[1814] Data processing: Send the entered authentication information to the server.

[1815] Output: Authentication success or failure message

[1816] Step 2:

[1817] The server compares the received user authentication information with the database and returns the authentication result.

[1818] Input: Email address, password

[1819] Data processing: Database matching

[1820] Output: Authentication success message or error message

[1821] Step 3:

[1822] Once the user successfully authenticates, a screen for linking social media accounts will appear, where they will enter the corresponding account information.

[1823] Input: Social media account information (e.g., User ID, Token)

[1824] Data processing: Send the entered SNS account information to the server.

[1825] Output: Message indicating success or failure in linking SNS accounts.

[1826] Step 4:

[1827] The server uses the APIs of the corresponding social networking services to link the user's social networking service account with the app.

[1828] Input: SNS account information

[1829] Data processing: Communicate with SNS APIs and link accounts.

[1830] Output: Integration success message

[1831] Step 5:

[1832] Users can set filters such as "defamation," "sexual content," and "violent content" on the filtering settings screen.

[1833] Input: Filter settings information

[1834] Data processing: Send the entered filter settings to the server.

[1835] Output: Filter settings saved message

[1836] Step 6:

[1837] The server retrieves the latest content from linked social media accounts and analyzes it based on the filtering settings.

[1838] Input: SNS account information, filter settings information

[1839] Data processing: Content retrieval and filtering using SNS APIs.

[1840] Output: Filtered, clean content

[1841] Step 7:

[1842] The server detects the user's emotional state and adjusts the filtering strength accordingly.

[1843] Input: User behavior and input data (e.g., text, facial expressions, voice)

[1844] Data processing: Sentiment analysis using an emotion engine

[1845] Output: Adjusted filtering strength

[1846] Step 8:

[1847] The server generates and provides recommended content to the user's terminal based on their emotional state.

[1848] Input: User's emotional state, filtered content

[1849] Data processing: Application of sentiment-based content recommendation algorithms

[1850] Output: Recommended content

[1851] Step 9:

[1852] Users can select in-app purchase options and enable additional filters and features.

[1853] Input: Internal billing selection information

[1854] Data processing: Send billing information to the server and process payments in conjunction with the payment system.

[1855] Output: Billing success message, Additional feature activation message

[1856] Step 10:

[1857] Users can comfortably enjoy filtered content and sentiment-based recommendations.

[1858] Input: Filtered content, recommended content

[1859] Data processing: Displaying content

[1860] Output: Improved user experience, increased satisfaction

[1861] Through the processing steps described above, the system of the present invention enables users to safely and comfortably utilize multiple content distribution services and to provide personalized content based on their emotional state.

[1862] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1863] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1864] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[1865] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1866] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[1867] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[1868] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[1869] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated based, for example, on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[1870] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[1871] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[1872] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[1873] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[1874] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[1875] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1876] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[1877] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[1878] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[1879] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[1880] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[1881] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[1882] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted as being incorporated by reference.

[1883] The following is further disclosed regarding the embodiments described above.

[1884] (Claim 1)

[1885] A means of receiving user authentication information, verifying it against a database, and authenticating the user.

[1886] A method for receiving SNS account information and linking via the corresponding SNS API,

[1887] A means of filtering content based on user settings,

[1888] A means of providing filtered content to the user's terminal,

[1889] We provide an internal billing option and a means to enable additional features,

[1890] A social networking service browsing system that includes [unclear text].

[1891] (Claim 2)

[1892] The system according to claim 1, further comprising means for enabling a user who has successfully authenticated to view multiple social networking services within a single application.

[1893] (Claim 3)

[1894] The system according to claim 1, further comprising means for filtering defamatory, sexual, or violent content.

[1895] "Example 1"

[1896] (Claim 1)

[1897] A means of receiving user authentication information, verifying it against a database, and authenticating the user.

[1898] A means of receiving account information from social networking services and integrating with them via a corresponding application programming interface,

[1899] A means of filtering digital media content based on user settings,

[1900] A means of providing filtered digital media content to a user's terminal,

[1901] We provide an internal billing option and a means to enable additional features,

[1902] A system that includes this.

[1903] (Claim 2)

[1904] The system according to claim 1, further comprising means for enabling a user who has successfully authenticated to view multiple social networking services within a single application.

[1905] (Claim 3)

[1906] The system according to claim 1, further comprising means for filtering defamatory, sexual, or violent digital media content.

[1907] "Application Example 1"

[1908] (Claim 1)

[1909] A means of receiving user authentication information, verifying it against a database, and authenticating the user.

[1910] A means of receiving service account information and integrating via the API of the corresponding service,

[1911] A means of filtering information based on user settings,

[1912] A means of providing filtered information to the user terminal,

[1913] We provide an internal billing option and a means to enable additional features,

[1914] A means of providing a safe browsing environment based on filtering conditions set by the user,

[1915] A means of integrating real-world information and digital content via smart devices,

[1916] A system that includes this.

[1917] (Claim 2)

[1918] The system according to claim 1, further comprising means for enabling a user who has successfully authenticated to view multiple services within a single application.

[1919] (Claim 3)

[1920] The system according to claim 1, further comprising means for filtering defamatory, sexual, and violent information.

[1921] "Example 2 of combining an emotion engine"

[1922] (Claim 1)

[1923] A means of receiving user authentication information, verifying it against a database, and authenticating the user.

[1924] A method for receiving information from multiple social media accounts and linking them via the API of each social media platform,

[1925] A means of filtering content based on user settings,

[1926] A means of providing filtered content to the user's terminal,

[1927] We provide an internal billing option and a means to enable additional features,

[1928] A means of analyzing the user's emotional state using an emotion engine and adjusting the filtering strength and content display accordingly,

[1929] A system that includes this.

[1930] (Claim 2)

[1931] The system according to claim 1, further comprising means for enabling a user who has successfully authenticated to view multiple social networking services (SNS) within a single application.

[1932] (Claim 3)

[1933] The system according to claim 1, further comprising means for filtering defamatory, sexual, or violent content.

[1934] "Application example 2 when combining with an emotional engine"

[1935] (Claim 1)

[1936] A means of receiving user authentication information, verifying it against a database, and authenticating the user.

[1937] A method for receiving SNS account information and linking via the corresponding SNS API,

[1938] A means of filtering content based on user settings,

[1939] A means of providing filtered content to the user's terminal,

[1940] We provide an internal billing option and a means to enable additional features,

[1941] A means of detecting the user's emotional state,

[1942] A means of adjusting the filtering strength according to the emotional state,

[1943] A means of providing recommended content based on emotional state,

[1944] A method for centrally managing accounts for multiple content distribution services,

[1945] A system that includes this.

[1946] (Claim 2)

[1947] The system according to claim 1, further comprising means for enabling a user who has successfully authenticated to view multiple social networking services within a single application.

[1948] (Claim 3)

[1949] The system according to claim 1, further comprising means for filtering defamatory, sexual, or violent content. [Explanation of Symbols]

[1950] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. A means of receiving user authentication information, verifying it against a database, and authenticating the user. A method for receiving SNS account information and linking via the corresponding SNS API, A means of filtering content based on user settings, A means of providing filtered content to the user's terminal, We provide an internal billing option and a means to enable additional features, A social networking service browsing system that includes [unclear text].

2. The system according to claim 1, further comprising means for enabling a user who has successfully authenticated to view multiple social networking services within a single application.

3. The system according to claim 1, further comprising means for filtering defamatory, sexual, or violent content.

Images