System

An AI-powered browser plugin addresses the challenge of children encountering inappropriate Internet content by real-time filtering and replacing inappropriate text and images with suitable alternatives, thereby enhancing their online safety.

JP2025051580AActive Publication Date: 2025-04-04SOFTBANK GROUP CORP

Patent Information

Application Number
JP2024050962
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-09-22
Filing Date
2024-03-27
Publication Date
2025-04-04
Estimated Expiration
2044-03-27

AI Technical Summary

Technical Problem

Children may encounter inappropriate information while using the Internet, particularly in the form of text and images, which is difficult to monitor and filter in real time.

Method used

Implementing an AI-based browser plugin that receives website content in real time, determines if it is inappropriate for children, and automatically replaces inappropriate phrases and images with suitable alternatives.

Benefits of technology

This solution effectively enhances online safety for children by ensuring they access appropriate content, improving their browsing experience by filtering out inappropriate material in real time.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025051580000001_ABST
    Figure 2025051580000001_ABST
Patent Text Reader

Abstract

To provide a system that receives a content on a website accessed by a child, determines whether or not the content is an inappropriate expression or image for the child, and replaces the inappropriate expression or image into an appropriate expression or image.SOLUTION: In a data processing system having a data processing device 12 and a smart device 14, specification processing by a specification processing part 290 of the data processing device 12 uses plug-in of a browser as means of receiving a content on a website accessed by a child. The plug-in receives the content on the website at a real time, transmits the content to an AI, determines whether or not the received content is an inappropriate expression or image for the child by the AI, and replaces the inappropriate expression with an appropriate expression capable of being understood by the child and replaces the inappropriate image with an image causing no problem when being viewed by the child.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] When children use the Internet, they may come into contact with inappropriate information. In particular, website content varies widely, including text and images, making it difficult to monitor this in real time and replace inappropriate language and images with appropriate ones. [Means for solving the problem]

[0005] The present invention uses AI to receive the content of websites accessed by children and determine whether the content contains inappropriate language or images for children. Inappropriate language or images are replaced with language or images that are more appropriate for children. This AI is implemented as a browser plug-in and can identify and replace inappropriate content not only in text but also in images. [Brief explanation of the drawings]

[0006] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 2 is a sequence diagram showing a flow of processing in the data processing system according to the first embodiment of the first form example. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1 of Embodiment 1. [Figure 13] FIG. 10 is a sequence diagram showing a processing flow of a data processing system in a second embodiment of the second form example. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 of Embodiment Example 2. [Figure 15] FIG. 10 is a sequence diagram showing the flow of processing in a data processing system according to a third embodiment of the third embodiment. [Figure 16] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 3 of Embodiment 3. [Figure 17] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the first embodiment of the first form example when an emotion engine is combined. [Figure 18] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1 of Form Example 1 when an emotion engine is combined. [Figure 19] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the second embodiment of the second form example when an emotion engine is combined. [Figure 20] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 of Form Example 2 when an emotion engine is combined. [Figure 21] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the third embodiment of the third form example when an emotion engine is combined. [Figure 22] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 3 of Form Example 3 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0007] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0008] First, the terms used in the following description will be explained.

[0009] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, the processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), or a TPU (Tensor Processing Unit).

[0010] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0011] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0012] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0013] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0014] [First embodiment]

[0015] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0016] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0017] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0018] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0019] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0020] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0021] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0022] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0023] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0024] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0025] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0026] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[0027] "Example 1" As one embodiment of the present invention, a browser plug-in is used as a means for receiving content from websites accessed by children. This plug-in receives website content in real time and transmits the content to AI. The AI ​​determines whether the received content contains wording or images that are inappropriate for children. Inappropriate wording or images are replaced with wording or images that can be communicated to children. Specifically, inappropriate words are replaced with appropriate words that children can understand, and inappropriate images are replaced with images that are safe for children to view.

[0028] "Example 2"

[0029] In another embodiment of the present invention, the AI ​​is implemented as a browser plug-in. This plug-in receives website content in real time and sends it to the AI. The AI ​​determines whether the received content contains language or images that are inappropriate for children and replaces the inappropriate language or images with language and images that are acceptable for children. Specifically, inappropriate language is replaced with appropriate language that children can understand, and inappropriate images are replaced with images that are acceptable for children to view.

[0030] "Example 3"

[0031] In a further embodiment of the present invention, AI can identify and replace inappropriate content not only in text but also in images. Specifically, AI uses image recognition technology to identify the content of an image and replace inappropriate images with images that are safe for children to view. For example, violent images can be replaced with landscape images.

[0032] The processing flow of each embodiment will be described below.

[0033] "Example 1"

[0034] Step 1: When your child visits a website, a browser plugin receives the website content in real time.

[0035] Step 2: The received content is sent to the AI.

[0036] Step 3: The AI ​​determines whether the submitted content contains language or images that are inappropriate for children.

[0037] Step 4: Inappropriate language and images are replaced with language and images that children can understand. Specifically, inappropriate words are replaced with appropriate language that children can understand, and inappropriate images are replaced with images that are safe for children to see.

[0038] "Example 2"

[0039] Step 1: When your child visits a website, a browser plugin receives the website content in real time.

[0040] Step 2: The received content is sent to the AI.

[0041] Step 3: The AI ​​determines whether the sent content contains inappropriate language or images for children and replaces the inappropriate language and images with language and images that are acceptable to children. Specifically, inappropriate words are replaced with appropriate language that children can understand, and inappropriate images are replaced with images that are safe for children to view.

[0042] "Example 3"

[0043] Step 1: When your child visits a website, a browser plugin receives the website content in real time.

[0044] Step 2: The received content is sent to the AI.

[0045] Step 3: The AI ​​determines whether the submitted content contains language or images that are inappropriate for children.

[0046] Step 4: Using image recognition technology, AI will determine the content of the image and replace inappropriate images with images that are safe for children to view. For example, violent images will be replaced with landscape images.

[0047] Example 1

[0048] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0049] Modern information and communication networks contain a lot of content and visual information that is inappropriate for certain user groups, especially children. This content poses a risk of causing children to feel psychological discomfort or learn inappropriate behavior. Conventional filtering technologies have difficulty completely resolving these issues, particularly in analyzing content in real time and replacing inappropriate content with appropriate content.

[0050] The specific processing by the specific processing unit 290 of the data processing device 12 is realized by the following means.

[0051] In this invention, the server includes means for receiving content on an information communication network accessed by a user in real time, means for transmitting the received content to an information processing system, an information processing system for analyzing and determining whether the transmitted content contains expressions or visual information that are inappropriate for a specific user group, and means for automatically converting expressions or visual information that are determined to be inappropriate into expressions or visual information that are appropriate for the specific user group. This makes it possible to increase safety when a specific user group uses the information communication network and to protect them from inappropriate content.

[0052] "Information and communications network" is a general term for systems that exchange information through the Internet and other digital communications means.

[0053] "Content" means information or entertainment in digital form, such as websites, videos, images, or text.

[0054] "Means of receiving in real time" refers to technologies and methods that capture and process information the moment a user accesses it.

[0055] An "information processing system" is a collection of hardware and software that analyzes, processes, and transforms received data.

[0056] A "particular user group" is a collection of users distinguished based on particular attributes, age, interests, etc.

[0057] "Inappropriate language or visual information" is information such as words or images that may cause psychological discomfort to the user group or encourage inappropriate behavior or thinking.

[0058] "Automatic conversion means" refers to techniques or methods that automate the process of replacing inappropriate content with appropriate content based on specific criteria or rules.

[0059] The embodiment of this invention mainly uses an information processing system, a user's terminal, and a browser plug-in as an extension. The information processing system is configured on a server that includes a generative AI model, and the user's terminal is equipped with a browser and plug-in for transmitting content to the information processing system in real time.

[0060] Information processing systems use specific generative AI models, such as OpenAI's GPT-4 and image processing-specific DALL·E. These models are capable of identifying inappropriate content in both text and images and converting it to appropriate content. This process is performed automatically based on the content sent from the device.

[0061] A browser used by the user to browse information and communication networks is installed on the terminal, and a plug-in based on the invention is added to the browser. The plug-in has the role of capturing content accessed by the user and transmitting it to an information processing system. The transmitted content is analyzed in real time by a generative AI model on a server.

[0062] For example, when a user accesses text or images containing inappropriate language, the plugin captures this content and sends it to the server. The generative AI model on the server analyzes the content using prompts such as: "This website contains language that is inappropriate for children. Please convert it to appropriate language." or "This image is inappropriate for children. Please replace it with an image that is safe for children and fits the theme." These prompts act as instructions for converting the text or image to an appropriate one. The converted content is then sent back to the device, updating the content the user sees.

[0063] This approach aims to enable certain user groups, especially children, to use information and communication networks safely.

[0064] The flow of the identification process will be described with reference to FIG.

[0065] Step 1: A user accesses content on an information and communications network through a browser. At this time, a browser plug-in installed on the device starts up and captures the content the user is viewing. This plug-in collects data on all content, including text, images, and other media files, in real time. The input is the content of the web page accessed by the user, and the output is the collected content data.

[0066] Step 2: The captured content data is sent to the server by the browser plug-in. The information processing system on the server uses a generative AI model to analyze the received content data. This process determines whether the content contains inappropriate language or visual information for a specific user group. The input is the content data sent from the device, and the output is the analysis result (identification of inappropriate content).

[0067] Step 3: The generative AI model on the server automatically converts inappropriate content into appropriate expressions and visual information. For example, inappropriate words are replaced with appropriate words, and inappropriate images are replaced with acceptable images. The input to this conversion process is the inappropriate content identified by the analysis results, and the output is the converted appropriate content.

[0068] Step 4: The converted content is sent back to the device. The device's browser plugin updates the original content with the converted content and displays it on the web page the user is viewing. The input in this step is the converted content sent from the server, and the output is the updated web page the user views.

[0069] These steps enable users to safely use information and communication networks without coming into contact with inappropriate content, and each step aims to increase online safety for vulnerable user groups, especially children.

[0070] (Application example 1)

[0071] Next, a description will be given of Application Example 1 of Embodiment Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0072] There is growing concern about the impact that inappropriate language and images in digital content can have on users, especially children. The Internet provides an environment where age-inappropriate content is easily accessible, and there is a problem that this content can have a psychological and emotional impact. In particular, there is a demand for technology that can instantly convert such content into appropriate content when users encounter it, providing a safe browsing experience.

[0073] The specific processing by the specific processing unit 290 of the data processing device 12 is realized by the following means.

[0074] In this invention, the server includes a means for acquiring digital content in real time, a means for transmitting the acquired content to a generative AI model to evaluate the appropriateness of the content, and a means based on the generative AI model for automatically converting inappropriate expressions into appropriate expressions that are easy for users to understand. This makes it possible to detect inappropriate content in real time and automatically convert it into appropriate expressions. As a result, a safe digital content viewing environment can be provided for users.

[0075] "Digital content" is a general term for information such as text, images, and videos distributed over the Internet.

[0076] "Means of real-time acquisition" refers to technologies and methods for acquiring and analyzing content the moment a user accesses it.

[0077] "Means of sending to the generative AI model" refers to the technology or method for sending the acquired content to the artificial intelligence model for analysis and processing.

[0078] "Automatically converting inappropriate language into user-friendly language" refers to the process by which a generative AI model identifies inappropriate language and images within content and replaces them with appropriate content based on age and level of understanding.

[0079] "User" means an individual who views or uses digital content.

[0080] "Server" refers to a computer system or software that provides data or services over the Internet.

[0081] An "application" is a software program designed for a specific purpose.

[0082] In an embodiment of the present invention, the system mainly consists of a server, a terminal (such as a smartphone, tablet, smart glasses, or head-mounted display), and a user (particularly a child). The server hosts a generative AI model, and the terminal runs a browser or dedicated application for accessing digital content on the Internet. The system has the function of acquiring digital content accessed by the terminal in real time and sending that content to the generative AI model on the server. The generative AI model evaluates the appropriateness of the sent content, and if it contains inappropriate language, automatically converts it into appropriate language that is easy for the user to understand.

[0083] This system utilizes browser plugins and applications written in programming languages ​​such as JavaScript and Python that run on the device, and generative AI models such as TensorFlow, OpenAI's GPT, and DALL-E that run on the server. This software runs on the hardware and efficiently processes the acquisition, analysis, and transformation of digital content.

[0084] For example, if a child accesses a news site containing violent images, the system captures the image in real time and sends it to the server. The generative AI model processes the image based on the prompt, "Please convert this image into one that is safe and easy for children to understand," and generates an alternative image that does not contain violent elements and displays it in place of the original content. This process allows users to enjoy a safe digital content viewing environment.

[0085] The flow of the identification process will be described with reference to FIG.

[0086] Step 1: Device accesses digital content

[0087] When a user accesses a specific website on the Internet using a device, a browser plug-in or application running on the device retrieves digital content (text, images, video, etc.) in real time. The input is the URL of the website accessed by the user and the HTML code of the page, and the output is the content data of the page.

[0088] Step 2: Send the content to the server for evaluation.

[0089] The acquired digital content is sent to a generative AI model on a server for evaluation. This process has the acquired digital content as input and the content received by the generative AI model as output.

[0090] Step 3: The generative AI model analyzes the content and identifies inappropriate content

[0091] The generative AI model on the server analyzes the submitted content and identifies inappropriate language and images. The input is the content submitted in step 2, and the output is a list of inappropriate content and identification information. This step involves data processing or data calculations that use specific keywords or image recognition techniques to detect inappropriate content.

[0092] Step 4: Convert inappropriate content to appropriate content

[0093] The identified inappropriate content is automatically transformed into appropriate wording and images that are easy for children to understand. This process uses a generative AI model, which takes the inappropriate content identified in step 3 as input and produces the appropriate content as output. The generative AI model receives the inappropriate content and performs data calculations to transform it into appropriate content based on a prompt such as, "Please transform this image into something that is safe and easy for children to understand."

[0094] Step 5: Send the converted content to your device and view it

[0095] Finally, the server sends the appropriate converted content to the device so that it can be displayed on the web page the user accessed. The input is the appropriate content generated in step 4, and the output is the display of that content on the user's device. This step involves sending data from the server to the device and processing the data display on the device.

[0096] Example 2

[0097] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0098] There is a lot of inappropriate content on the Internet that children should not access. It is not realistic for parents to constantly monitor, and existing filtering technologies may not be able to completely block it. In particular, when it comes to content that includes both text and images, there is still a lack of technology that can properly evaluate this in real time and automatically convert it into content that is safe for children.

[0099] The specific processing by the specific processing unit 290 of the data processing device 12 is realized by the following means.

[0100] In this invention, the server includes a means for capturing web content in real time and transmitting it over a secure communication channel, a means for evaluating the transmitted content using a generative AI model equipped with natural language and image analysis technology, and a means for automatically replacing inappropriate language or images with language or images that are more user-friendly and acceptable to users, thereby significantly improving safety when children use the Internet.

[0101] "User" refers to an individual or group who accesses web content through an information terminal.

[0102] "Information terminal" refers to a device (such as a personal computer, smartphone, or tablet) that can connect to the Internet and browse websites.

[0103] "Web content" refers to all information such as text, images, and videos that appear on web pages on the Internet.

[0104] "Real-time capture" refers to detecting and capturing web content instantly at the moment a user views it.

[0105] A "secure communication channel" refers to a means of communication that uses security technologies such as encryption to prevent third parties from intercepting or tampering with data when sending or receiving it.

[0106] "Analysis Server" refers to a computer system used to analyze and process transmitted web content.

[0107] A "generative AI model" refers to an artificial intelligence model that has the ability to generate new text or images based on input data.

[0108] "Natural language and image analysis technology" refers to technology for understanding and analyzing text data and technology for identifying and analyzing the content of images.

[0109] "Inappropriate language or images" refers to content that is deemed inappropriate or difficult to understand for certain groups of users (especially children) based on age or social norms.

[0110] "Safe images" refer to images whose content is deemed safe for viewing by a specific group of users (especially children).

[0111] "Plug-in format" refers to a software module that can be added to existing software (in this case, a browser) to expand its functionality.

[0112] The embodiment of this invention mainly involves an information terminal, an analysis server, and a communication protocol between them. A web browser is installed on the information terminal, and a plug-in is embedded in the browser that has the function of capturing web content in real time and transmitting it to the analysis server via a secure communication path. The plug-in is developed using JavaScript and other web technologies.

[0113] The analysis server is built on a high-performance computer system and has software installed that includes a generative AI model. This server receives web content sent from the information terminal and analyzes the content using natural language processing and image analysis techniques. If inappropriate language or images are detected, the AI ​​model automatically replaces them with appropriate content. This process uses deep learning frameworks such as TensorFlow and PyTorch. The replaced content is then sent back to the information terminal and displayed to the user via a plugin.

[0114] For example, consider a web page containing the text "This movie contains violent scenes intended for adults" along with a screenshot of that scene. The plugin captures this text and image and sends them to an analysis server. The AI ​​model on the server then replaces the text with child-friendly phrases such as "This movie contains scary scenes, so please watch with an adult," and replaces the image with a more innocuous image, such as the movie logo. These conversion processes are based on natural language processing and image recognition technology, and are intended to help children use the internet safely.

[0115] This invention enables secure communication between the information terminal and the analysis server while filtering web content in real time and converting it into a form that is safe for children, allowing parents to improve the safety of their children when using the Internet.

[0116] The flow of the identification process will be described with reference to FIG.

[0117] Step 1: Capturing web content

[0118] A browser plug-in running on an information terminal captures the content (text and images) of the web page the user is viewing in real time. The input to this step is the content of the web page the user is viewing, and the output is content data processed into a data format that can be sent to the server for analysis. The plug-in performs DOM analysis and extracts all text and image data from the page.

[0119] Step 2: Submit your content

[0120] The captured content is transmitted from the information terminal to the analysis server via a secure communication path. The input of this step is the content data processed in step 1, and the output is the content data that has reached the analysis server. The HTTPS protocol is used for transmission, ensuring the confidentiality and integrity of the data.

[0121] Step 3: Analyze and evaluate content

[0122] The generative AI model on the analysis server analyzes and evaluates the submitted content using natural language processing and image analysis technologies. The input to this step is the content data received in step 2, and the output is the content data after inappropriate expressions or images have been detected and replaced with appropriate content. The AI ​​model identifies inappropriate content and automatically replaces it with appropriate alternative text or images.

[0123] Step 4: Return the replacement content

[0124] The replaced content is sent back from the analysis server to the information terminal. The input of this step is the replaced content data generated in step 3, and the output is the content ready to be displayed to the user by the information terminal's browser plug-in. The return also uses the HTTPS protocol to maintain data security.

[0125] Step 5: Displaying Content

[0126] The device's browser plug-in displays the returned content in the user's browser. The input to this step is the content data returned in step 4, and the output is the appropriate content rendered on the web page the user views. The plug-in embeds the replaced text and images in their original locations, providing the user with a secure browsing environment.

[0127] (Application example 2)

[0128] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0129] The Internet contains a large amount of linguistic and visual content that is considered inappropriate for certain groups of users. In particular, in environments where children have free access, there is a risk that they may come into contact with harmful content. Previous technology has had the difficulty of efficiently filtering inappropriate content and automatically replacing it in a manner appropriate to the user's level of understanding. By solving this issue, it is necessary to provide an Internet environment where certain groups of users, especially children, can safely access information.

[0130] The specific processing by the specific processing unit 290 of the data processing device 12 is realized by the following means.

[0131] In this invention, the server includes a means for receiving content from an information distribution medium accessed by a user, an artificial intelligence means for determining whether the received content contains linguistic or visual expressions that are inappropriate for a specific user group, and a means for replacing the inappropriate linguistic or visual expressions with linguistic or visual expressions that are appropriate for the specific user group. This enables a specific user group, particularly children, to use the Internet in an environment where they can access information in a format that suits their level of understanding without being exposed to inappropriate content.

[0132] "Information distribution medium" refers to websites and applications that publish content on the Internet and are accessible to the general public.

[0133] "Content" refers to information or expressions such as text, images, video, and audio that are provided through an information distribution medium.

[0134] A "specific user group" refers to a group of users with specific characteristics, defined by age, gender, cultural background, etc.

[0135] "Inappropriate verbal or visual content" refers to language or images that may be offensive, sexual, violent, or otherwise disturbing to certain audiences, and that may be considered inappropriate for exposure to certain audiences.

[0136] "Artificial intelligence means" refers to systems or processes that use technologies such as machine learning, natural language processing, and image recognition to analyze content and make judgments.

[0137] "Information delivery media user interface extension" means a software component that is installed to extend the functionality of a web browser or application and provide additional features.

[0138] "Appropriate verbal or visual substitution" refers to a process or algorithm that replaces inappropriate content with verbal or visual substitution that is acceptable, educational, or neutral to a particular audience.

[0139] In an embodiment of the present invention, the server executes a program including artificial intelligence to receive and analyze content sent from information distribution media accessed by users. The program has the function of detecting linguistic and visual expressions that are deemed inappropriate for a specific user group and automatically replacing them with appropriate expressions. This process uses natural language processing and image recognition technologies. The hardware used is a high-performance server and storage system, and the software includes machine learning libraries such as TensorFlow and PyTorch.

[0140] On the terminal side, a program implemented as a user interface extension of the information delivery medium runs and displays the processed content received from the server. This extension is developed using JavaScript and other web technologies and is designed to display only content appropriate for a specific user group.

[0141] This system allows users to have a safer browsing experience. For example, when a child visits a website, inappropriate words are replaced with easier-to-understand synonyms, such as "clumsy," and inappropriate images are replaced with educational illustrations or landscape images. This process provides a safer environment for specific groups of users to use the Internet. Examples of prompts include, "Please translate this text into language that a 5-year-old can understand," or "Please replace this image with one that is safe for children to view."

[0142] The flow of the identification process will be described with reference to FIG.

[0143] Step 1: Receiving and Preprocessing Content

[0144] The server receives content sent from the information distribution medium accessed by the user. At this time, web page data composed of HTML, CSS, JavaScript, etc. is input. The server analyzes this data and separates it into text and images. Through this process, text data and image data are extracted and prepared as input for the next processing step.

[0145] Step 2: Detect inappropriate content

[0146] The extracted text data is analyzed using natural language processing techniques to detect inappropriate language. At the same time, image recognition techniques are applied to image data to detect inappropriate visual content. This process uses a generative AI model that leverages machine learning libraries to evaluate the appropriateness of both text and images. The input is the text and images extracted from the web page, and the output is a list of content deemed inappropriate.

[0147] Step 3: Replacing the content

[0148] Text and images that are deemed inappropriate are automatically replaced with language and visuals that are appropriate for a specific user group. The generative AI model operates based on prompts to convert inappropriate content into appropriate content. For example, text is replaced based on the prompt, "Please translate this text into language that a 5-year-old child can understand." Images are also replaced with appropriate images based on the prompt, "Please replace this image with an image that is safe for children to view." The input is inappropriate content, and the output is content that has been replaced with appropriate language.

[0149] Step 4: Submit your edited content

[0150] The replaced content is sent to the user's device through the information delivery medium's user interface extension. The server generates web page data including the edited text and images and sends it to the device. The device renders the received data in the browser and displays it to the user. This process allows the user to view a web page that contains only safe content, with the inappropriate content removed.

[0151] Example 3

[0152] Next, a description will be given of a third embodiment of the third embodiment. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0153] In today's society, where digital content is widespread, certain user groups, especially children, are at increased risk of being exposed to inappropriate content. Violent, sexual, and other harmful content is easily accessible on the Internet, threatening the healthy development and psychological safety of certain user groups. Therefore, it is urgent to effectively restrict the distribution of inappropriate information via digital content and ensure that certain user groups can access digital content in a safe environment.

[0154] The specific processing by the specific processing unit 290 of the data processing device 12 is realized by the following means.

[0155] In this invention, the server includes a means for uploading digital data, an AI means for determining whether the uploaded digital data contains content inappropriate for a specific user group, and a means for replacing the digital data containing inappropriate content with content appropriate for the specific user group. This enables the specific user group to obtain information in a safe and healthy digital environment without being exposed to inappropriate content on the Internet. The AI ​​running on the server automatically identifies inappropriate content in both text and images and replaces it with appropriate content, thereby ensuring the safety and appropriateness of digital content for the specific user group.

[0156] "Digital data" is a general term for information represented in digital form, such as images, text, audio, and video.

[0157] "Means of uploading" refers to the act of a user sending digital data to a server or cloud via the Internet, as well as the technology and process for doing so.

[0158] "AI means" refers to methods or systems that utilize artificial intelligence technology to automatically perform certain tasks, in this case including the ability to identify and replace inappropriate content.

[0159] "Inappropriate Content" refers to sexual, violent or other potentially offensive information or images that may be considered harmful to certain user groups, particularly children.

[0160] A "particular user group" refers to a group of users who share common characteristics such as a particular age range, interests, or sensitivities, and in the present invention, children are the main group of users.

[0161] "Web Service or Application" means a service or program delivered over the Internet that allows users to access certain functionality or information.

[0162] "Appropriate content replacement" refers to processes or techniques that analyze inappropriate digital data and replace that content with information or images that are appropriate and not harmful to a particular user group.

[0163] The embodiment of the present invention relates to the operation of a system that mainly involves uploading digital data, evaluating the appropriateness of that data, and replacing inappropriate data. This system is composed of three parties: a server, a terminal, and a user.

[0164] The server is a high-performance computer system equipped with data analysis capabilities that utilize artificial intelligence (AI). The AI ​​running on this server uses specific libraries and frameworks (e.g., TensorFlow, PyTorch) to evaluate the content of uploaded images and text. The AI's analytical capabilities include image recognition and natural language processing technologies, which identify inappropriate elements within digital data.

[0165] A terminal is a device connected to the Internet that provides an interface for users to upload digital data. Terminals include smartphones, tablets, personal computers, etc.

[0166] Users are people who use this system to upload and view digital content. Users send digital data to the server through specific websites or applications. The server automatically analyzes the data and replaces any inappropriate content with appropriate content.

[0167] For example, if an image uploaded by a user contains violent content, AI running on the server will determine that the image is inappropriate and automatically replace it with a safe alternative image (e.g., a landscape). An example of a prompt might be, "Analyze the content within the image to determine whether it contains inappropriate elements, and if so, automatically replace it with a safe image from a specified category (e.g., a natural landscape)."

[0168] This embodiment allows users to enjoy content in a safe digital environment without coming into contact with inappropriate content. The present invention is implemented through the interaction of a server, a terminal, and a user.

[0169] The flow of the identification process will be described with reference to FIG.

[0170] Step 1: The user uses the terminal to upload digital data (images or text) to the system. The input of this step is the digital data selected by the user, and the output is a data file sent to the server. The terminal collects the data selected by the user and processes it to send to the server.

[0171] Step 2: The server receives the uploaded digital data and analyzes its content using AI tools. The input at this stage is the uploaded data, and the output is the analysis result of the data content (whether it contains inappropriate content or not). The AI ​​on the server processes the received data and performs data processing and data calculations to identify inappropriate elements.

[0172] Step 3: If the AI ​​means determines the data is inappropriate, the server replaces it with appropriate content. The input to this step is the inappropriate data, and the output is the replaced data. The server processes the inappropriate data and replaces it with appropriate data (e.g., an image from a secure image library).

[0173] Step 4: The replaced data is sent from the server to the user via the terminal. The input at this stage is the replaced data, and the output is the data displayed in a format that the user can view. The server sends the converted data to the terminal, which then processes it to display it on the user's screen.

[0174] This process allows users to enjoy content in a safe digital environment without being exposed to inappropriate content. The system can effectively identify inappropriate data and automatically replace it with appropriate content.

[0175] (Application example 3)

[0176] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0177] In today's digital society, content accessed via the Internet by certain age groups, particularly children, often contains inappropriate language and images. This inappropriate content poses a risk of psychological harm to children. While conventional filtering technologies are effective in blocking inappropriate text content, they have difficulty detecting inappropriate images and are unable to replace inappropriate content with appropriate ones. This invention aims to provide a safe browsing environment by automatically detecting inappropriate language and images in digital content accessed by certain age groups and replacing them with appropriate language and images.

[0178] The specific processing by the specific processing unit 290 of the data processing device 12 is realized by the following means.

[0179] In this invention, the server includes a means for receiving digital content accessed through an information terminal, an AI means for determining whether the received digital content contains expressions or images that are inappropriate for a specific age group, and a means for replacing the inappropriate expressions or images with expressions or images that are appropriate for the specific age group. This ensures the safety of digital content and makes it possible to provide only content that is safe for viewing by a specific age group. The AI ​​means can accurately determine and replace inappropriate content not only in text but also in images, so it can also address issues with image content that were difficult to address with conventional technology.

[0180] An "information terminal" is an electronic device that connects to the Internet or other networks to receive and display digital content. Examples include smartphones, tablets, and personal computers.

[0181] "Digital content" refers to information content expressed in digital form, such as text, images, video, and audio. It is distributed via the Internet and can be accessed and viewed on an information terminal.

[0182] "Specific age group" refers to an age range that requires special protection when viewing content, particularly young people such as children and teenagers.

[0183] "Inappropriate language or images" refers to text, images, or other media content that is inappropriate for a particular age group to view or that may cause psychological harm, such as violent, sexual, or discriminatory content.

[0184] "AI means" means a system or program that uses artificial intelligence technology to analyze the content of digital content and determine whether the content is appropriate or inappropriate based on specific criteria. Such means include machine learning and image recognition technology.

[0185] In an embodiment of the present invention, a server receives digital content accessed through an information terminal, determines whether the content is inappropriate for a specific age group using AI means, and replaces inappropriate expressions or images with appropriate ones as necessary, in order to provide digital content appropriate for a specific age group. This system functions as an application installed on the information terminal, and monitors and appropriately converts the content in real time as the user of the terminal views the digital content.

[0186] The server uses artificial intelligence techniques to determine inappropriate content in the text and images within the received digital content. The AI ​​means, including image recognition and natural language processing techniques, assess the safety of the content. If inappropriate content is detected, the AI ​​means uses a generative AI model to automatically replace the content with content appropriate for a specific age group.

[0187] The hardware used is information terminals, such as smartphones, tablets, and personal computers, while the software utilizes generative AI models (e.g., OpenAI's GPT series) and image recognition technologies (e.g., Google Cloud Vision API).

[0188] As a concrete example, consider a situation where a user is using a video streaming service for children. When an inappropriate advertisement is inserted into the video, the AI ​​means instructs the generative AI model using a prompt sentence such as "Please replace the image containing violent content with a landscape image that is safe for children to view," and replaces the inappropriate advertisement with a landscape image. This process is intended to ensure that the user using the device can only view safe content.

[0189] The flow of the identification process will be described with reference to FIG.

[0190] Step 1: A user accesses digital content using an information terminal. At this time, the user's access request is input, and the target digital content is displayed on the terminal as output. Based on the user's access request, the terminal obtains the selected content and displays it on the screen.

[0191] Step 2: The AI ​​means on the server receives the digital content and performs a content analysis. The input is the digital content obtained in step 1, and the output is an analysis result regarding the content of the content. The analysis result includes the presence or absence of inappropriate content in the text and images. The AI ​​means uses image recognition and natural language processing techniques to detect inappropriate elements in the content.

[0192] Step 3: If inappropriate content is detected, the AI ​​means uses a generative AI model to replace the inappropriate content with appropriate content. The input is the inappropriate content detected in step 2, and the output is the appropriate replacement content. This process identifies inappropriate images and text and automatically converts them to appropriate content based on prompts such as "Please replace images containing violent content with landscape images that are safe for children to view."

[0193] Step 4: The converted content is sent to the user's information terminal and displayed. The input is the appropriate content generated in step 3, and the output is the updated content displayed on the user's terminal. The server provides the converted content to the user, and the terminal receives this content and displays it to the user. This ensures that the user can only view safe content.

[0194] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0195] "Example 1"

[0196] As one embodiment of the present invention, there is provided a system including: means for receiving content from websites accessed by children; AI means for determining whether the received content contains phrases or images that are inappropriate for children; means for replacing the inappropriate phrases and images with phrases and images that are conveyable to children; and an emotion engine for recognizing the emotions of a user, for example, from the user's facial expressions or tone of voice.

[0197] "Example 2"

[0198] In another embodiment of the present invention, a system is provided in which an emotion engine adjusts how inappropriate language and images are replaced based on the user's emotions. For example, if the user feels angry, the emotion engine conveys that information to an AI, which then replaces the user's anger with more gentle language and images to reduce the user's anger.

[0199] "Example 3"

[0200] In yet another embodiment of the present invention, a system is provided in which an emotion engine adjusts how content is displayed based on the user's emotions. For example, if the user feels happy, the emotion engine conveys that information to the AI, which then preferentially displays content that makes the user happy.

[0201] The processing flow of each embodiment will be described below.

[0202] "Example 1"

[0203] Step 1: Receive content from websites your child visits.

[0204] Step 2: The AI ​​determines whether the received content contains language or images that are inappropriate for children.

[0205] Step 3: Replace inappropriate language and images with language and images that are child-friendly.

[0206] Step 4: The emotion engine recognizes the user's emotion. This emotion engine recognizes the user's emotion from, for example, the user's facial expression or tone of voice.

[0207] "Example 2"

[0208] Step 1: Recognize the user's emotions with the emotion engine.

[0209] Step 2: The emotion engine adjusts how inappropriate language and images are replaced based on the user's emotions. For example, if the user feels angry, the emotion engine relays that information to the AI.

[0210] Step 3: The AI ​​defuses the user's anger by replacing the image with more gentle words or images.

[0211] "Example 3"

[0212] Step 1: Recognize the user's emotions with the emotion engine.

[0213] Step 2: The emotion engine adjusts how content is displayed based on the user's emotions. For example, if the user feels happy, the emotion engine conveys that information to the AI. Step 3: The AI ​​prioritizes displaying content that makes the user feel happy.

[0214] Example 1

[0215] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0216] The content on the Internet is diverse and may contain content that is inappropriate for certain user groups, especially children. This can have a negative impact on users' feelings or lead to misunderstandings. In addition, there is a lack of technology to dynamically adjust content based on user responses, making it difficult to provide an optimized Internet experience for each individual user.

[0217] The specific processing by the specific processing unit 290 of the data processing device 12 is realized by the following means.

[0218] In this invention, the server includes means for acquiring digital content from devices connected to the Internet in real time, artificial intelligence means for analyzing the acquired digital content and determining whether the content is inappropriate for a specific user group, means for replacing the determined inappropriate content with appropriate content for the specific user group, and emotion recognition means for capturing user reactions in real time and further optimizing the digital content based on the reactions, thereby enabling the identification and replacement of inappropriate content and the optimization of content based on user emotions.

[0219] An "Internet-connected device" is an electronic device that has the ability to access the Internet and is capable of obtaining web content and sending and receiving data.

[0220] "Digital content" is a general term for information expressed in digital form, such as text, images, audio, and video.

[0221] "Real-time" means that the processing or reaction occurs almost simultaneously with actual time, without delay.

[0222] "Artificial intelligence means" refers to systems or programs that utilize technologies such as machine learning and deep learning to learn, make judgments and make inferences like humans.

[0223] A "specific user group" is a group of users distinguished based on specific criteria such as age, gender, or interests.

[0224] "Inappropriate language or visual material" is content, such as text or images, that is deemed offensive or unsuitable for viewing by a particular user group.

[0225] "Replace" means to remove an element and substitute another element to take its place or role.

[0226] "Emotion recognition means" refers to technology or systems that identify and analyze people's emotions from facial expressions, tone of voice, etc.

[0227] "Optimization" is the process of adjusting performance or effectiveness to the best possible level based on specific criteria.

[0228] A specific embodiment of the present invention will now be described, which aims to optimize digital content on the Internet for a specific user group, particularly children, in a safe and educational manner.

[0229] First, a plug-in is installed on the device to capture digital content accessed through a web browser in real time. This plug-in has the function of capturing text and images from the web page the user is viewing and sending them to a server. This plug-in is compatible with commonly used web browsers such as Google Chrome and Mozilla Firefox.

[0230] On the server side, artificial intelligence means analyze the digital content. This analysis is performed using generative AI models to determine whether text or images contain inappropriate language or visual material for a specific user group. These artificial intelligence means use advanced models such as OpenAI's GPT and Google's BERT. If inappropriate content is detected, it is immediately replaced with appropriate content. For example, offensive language is replaced with more moderate language, and inappropriate images are replaced with educational images.

[0231] Additionally, the server is equipped with an emotion recognition system to capture users' reactions in real time. This system analyzes their facial expressions and vocal tone to identify emotional states such as joy or confusion. This analysis uses technologies such as Microsoft's Face API and Google's Cloud Speech-to-Text. Based on the emotional feedback, the digital content can be further optimized to provide a more appropriate experience for the user.

[0232] An example prompt might be, "Is this text / image appropriate for children?" The AI ​​then analyzes whether the content is safe and educational for children and adjusts it as needed.

[0233] This allows the server to analyze digital content in real time, identify inappropriate content, and replace it with appropriate content. It also recognizes user sentiment and optimizes content accordingly, providing a safer and more educational internet experience for specific user groups.

[0234] The flow of the identification process will be described with reference to FIG.

[0235] Step 1: Get content

[0236] The browser plug-in installed on the device receives the text and images of the page in real time when the user visits a website, and sends this content to a server for analysis.

[0237] Input: Web page text and images

[0238] Data processing: Collecting text and images from web pages

[0239] Output: Text and image data sent to the server

[0240] Step 2: Analyze your content

[0241] The server-based AI analyzes the received text and images to determine whether they contain content that is inappropriate for a particular user group, using a generative AI model.

[0242] Input: Text and image data

[0243] Data manipulation: AI-based identification of inappropriate content

[0244] Output: A list of content that was flagged as inappropriate

[0245] Step 3: Replacing the content

[0246] If content is found to be inappropriate, the server replaces it with content appropriate for a particular user group, using a database of appropriate text and images for this replacement process.

[0247] Input: List of content flagged as inappropriate

[0248] Data manipulation: replacing inappropriate content with appropriate content

[0249] Output: Replaced content

[0250] Step 4: Optimize your content

[0251] The server has an emotion recognition means that captures users' reactions in real time, and further optimizes the content based on this feedback. In this process, user reactions are analyzed using emotion recognition technology.

[0252] Input: User's emotional feedback (facial expressions and tone of voice)

[0253] Data Processing: Analysis of User Reactions Using Emotion Recognition Technology

[0254] Output: Content optimization information

[0255] Step 5: Displaying optimized content

[0256] Finally, the optimized content is sent back from the server and displayed to the user through their device, a process that allows users to experience safer and more educational content.

[0257] Input: Replaced content, optimization information

[0258] Data processing: Preparing content for display on the device

[0259] Output: The optimized content that is displayed to the user

[0260] (Application example 1)

[0261] Next, a description will be given of Application Example 1 of Embodiment Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0262] The Internet is home to a large amount of content that is inappropriate for children, and it is easily accessible. Furthermore, there is a lack of systems that provide appropriate content based on children's emotions and reactions. This increases the risk of children being negatively influenced. This invention aims to address the need for a system that provides an environment where children can safely enjoy digital content and can recommend appropriate content based on their emotions.

[0263] The specific processing by the specific processing unit 290 of the data processing device 12 is realized by the following means.

[0264] In this invention, the server includes means for receiving digital content accessed by children, AI means for determining whether the received content contains phrases or images that are inappropriate for children, means for replacing the inappropriate phrases and images with phrases and images that are conveyable to children, and means including an emotion engine for recognizing the emotions of the user. This allows children to safely enjoy Internet content and further makes it possible to recommend appropriate content according to their emotions and reactions.

[0265] "Digital content accessed by children" refers to information such as text, images, audio, and video provided on the Internet that is intended to be viewed or used by minors.

[0266] "Inappropriate language and images" refers to content such as sexual, violent, or discriminatory language that may have a negative impact on the healthy development of young people.

[0267] "AI tools" is a general term for algorithms and software that use artificial intelligence technology to analyze data and perform specific tasks.

[0268] "Replacement measures" are actions or processes that replace content that is deemed inappropriate with other content that is safe for minors to view.

[0269] An "emotion engine that recognizes user emotions" is a technology or system that estimates a person's emotional state from their facial expressions, tone of voice, behavioral patterns, etc.

[0270] A "browser plug-in" is a software component that is added to a web browser to extend its functionality, making certain features and services available directly within the browser.

[0271] A specific implementation method for the embodiment of the present invention will be described below. The system of the present invention aims to enable children to safely use Internet content and to recommend content according to the user's emotions.

[0272] The server will be developed using Python and libraries such as TensorFlow, OpenCV, and PyTorch. This software provides AI tools to detect inappropriate language and images in digital content and automatically replace them with ones that are appropriate for children. The server also includes an emotion engine that recognizes the user's emotions, inferring emotions from facial expressions and tone of voice collected via the device's camera and microphone.

[0273] A device is any device that can connect to the internet, such as a smartphone, tablet, smart TV, etc. The browser plug-in running on the device transmits the digital content accessed by the user to a server in real time and adjusts the display of the content based on feedback from the server.

[0274] When users use this system to browse the internet, they access safe content that has been automatically filtered, and if the user's sentiment is positive, similar content is recommended, and if the sentiment is negative, content from a different genre is recommended.

[0275] As a concrete example, there is a scenario in which a parent uses this system when showing a video to their child. Prompts include "a video filtering function that automatically converts content into one suitable for children to watch" and "a function that reads emotions from a child's facial expressions and recommends content."

[0276] This approach improves safety for children when they use the internet while providing them with a personalized, emotionally-driven content experience.

[0277] The flow of the identification process will be described with reference to FIG.

[0278] Step 1: The terminal receives the digital content that the user wants to access.

[0279] When a user accesses digital content on the Internet through a browser, the device receives information about the content (text, images, video, etc.) This information becomes input that is sent to the server for processing in the next step.

[0280] Step 2: The device sends the received content to the server.

[0281] The device then sends the received digital content to a server, which then uses it as input data for AI analysis.

[0282] Step 3: The AI ​​on the server analyzes the content.

[0283] The AI ​​means installed on the server analyzes the received content and determines whether it contains inappropriate language or images. If this analysis identifies certain elements in the content as inappropriate for children, information is generated to replace them. The output of this process is the location of the content to be replaced and information on the appropriate content to replace it.

[0284] Step 4: The server sends a content replacement instruction to the terminal.

[0285] Based on the results of the AI ​​analysis, the server sends specific replacement instructions to the device, including information on which content should be replaced and how.

[0286] Step 5: The device replaces the content.

[0287] The device then follows the replacement instructions received from the server and replaces the currently displayed content with an appropriate one. This operation allows the user to view safe content without being exposed to inappropriate content.

[0288] Step 6: The device recognizes the user's emotions.

[0289] The device uses a built-in camera and microphone to recognize the user's emotions from their facial expressions and tone of voice, and this information is sent to a server for content recommendation based on their emotions.

[0290] Step 7: The server recommends content based on the user's sentiment.

[0291] The server analyzes the user's emotion data sent from the terminal and recommends content that best suits that emotion. This recommendation information is sent to the terminal and presented to the user.

[0292] This processing flow provides an environment in which children can safely use digital content, and also enables a personalized content experience that responds to the user's emotions.

[0293] Example 2

[0294] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0295] The Internet contains a large amount of content that is considered inappropriate or harmful to certain user groups. Websites that may be accessed by children or sensitive individuals are particularly at risk of being negatively impacted by inappropriate language or images. There is also a growing need to appropriately tailor content based on the user's emotional state. To address this issue, it is necessary to analyze the content viewed by users in real time, automatically replace inappropriate content with appropriate content, and provide content that takes the user's emotional state into consideration.

[0296] The specific processing by the specific processing unit 290 of the data processing device 12 is realized by the following means.

[0297] In this invention, the server includes means for receiving content from the Internet in real time, artificial intelligence means for determining whether the received content contains expressions or visual elements that are inappropriate for a specific user group, means for replacing the inappropriate expressions or visual elements with expressions or visual elements that can be conveyed to the specific user group, and emotion engine means for evaluating the emotional state of the user and adjusting how the expressions and visual elements are replaced based on this evaluation. This makes it possible to automatically replace inappropriate content with appropriate content, and further makes it possible to provide appropriate content according to the emotional state of the user.

[0298] "Internet content" means all text, images, videos and other media information accessible via the Internet, including websites, online platforms and social media.

[0299] "Real-time capture" means a process or technology that captures the content of a web page at the moment a user views it and retrieves it for analysis.

[0300] A "specific user group" is a group of users who share specific attributes, such as age, gender, occupation, or cultural background, and to whom the system provides services taking into account their needs and constraints.

[0301] "Objectionable language or visual material" means language or images that are violent, sexual, offensive, or otherwise considered inappropriate or harmful to certain user groups, particularly children or sensitive individuals.

[0302] "Artificial intelligence means" refers to software or systems that use technologies such as machine learning, deep learning, natural language processing, and image recognition to analyze data, learn, and automatically perform specific tasks.

[0303] An "Internet browser extension" is a software component added to a web browser that extends the browser's functionality and enhances the user experience.

[0304] "Emotion engine means" refers to technologies and algorithms that estimate a user's emotional state from their behavior, text input, tone of voice, facial expressions, etc., and adjust the system's response based on that information.

[0305] An embodiment of the present invention relates to a system for converting internet content to be more suitable for users. The system is comprised of an artificial intelligence means, an emotion engine means, and a combination of supporting hardware and software, which are implemented as an extension of an internet browser.

[0306] This system operates as an extension to an internet browser installed on a device (personal computer, smartphone, tablet, etc.). This extension was developed using JavaScript and other web technologies, and has the function of receiving content such as text and images from web pages viewed by the user in real time. The received content is sent to an artificial intelligence means on a server via an HTTPS request. This artificial intelligence means analyzes the content using machine learning, natural language processing, and image recognition technologies, and determines whether the content is inappropriate for a specific user group.

[0307] If inappropriate content is detected, the AI ​​tools replace the text with more appropriate language or images with more benign ones: for example, offensive language is replaced with milder language, violent images with landscapes or animal images, etc. This replacement content is then sent back to the device, and the browser extension refreshes the web page.

[0308] Furthermore, this system incorporates an emotion engine means that infers the user's emotional state from their actions and inputs and provides that information to the artificial intelligence means. This allows the system to replace the content with a calmer one based on the user's emotional state, such as anger. The emotion engine uses a machine learning algorithm to evaluate the user's emotions and reflects the results in the processing of the artificial intelligence means.

[0309] For example, prompts such as "Please replace the inappropriate language in this text with language that children can easily understand" or "Please replace this image with content that is safe for children to see" are sent to the artificial intelligence means, which then analyzes and converts the content based on these requests.

[0310] The flow of the identification process will be described with reference to FIG.

[0311] Step 1: Receiving content

[0312] A browser extension running on the device receives content such as text and images from the web page the user is viewing. At this stage, the DOM of the web page is parsed and text and image data are extracted. The input is the HTML content of the web page, and the output is the extracted text and image data.

[0313] Step 2: Request content analysis

[0314] The extracted content is sent to the server via an HTTPS request. An artificial intelligence mechanism on the server receives this content and begins analyzing it. The input is the extracted text and image data, and the output is the analysis result (a decision on whether the content is inappropriate or not).

[0315] Step 3: Analyze your content

[0316] The artificial intelligence means analyzes the content of the text and images and evaluates their inappropriateness. In this process, the text is processed using natural language processing technology, and the images are processed using image recognition technology. The input is the text and image data, and the output is the inappropriateness evaluation result for each.

[0317] Step 4: Emotional Engine Adjustment

[0318] An emotion engine running on the device or server evaluates the user's emotional state and provides that information to an artificial intelligence means, which then uses that information to adjust how content is replaced. The input is the user's actions and input data, and the output is the evaluation of the user's emotional state.

[0319] Step 5: Generate replacement content

[0320] If inappropriate content is detected, the artificial intelligence means generates new content to replace it with appropriate words and images. In this process, inappropriate text is converted to appropriate words and inappropriate images are converted to appropriate images. The input is the inappropriateness assessment result and the user's emotional state, and the output is the new replaced text and images.

[0321] Step 6: Refreshing the Content

[0322] The server sends the replaced content to the device, and the web page display is updated through the browser extension. At this step, the user finally sees only the correct content. The input is the replaced new text and image data, and the output is the updated web page display.

[0323] (Application example 2)

[0324] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0325] There is content on the Internet that is considered inappropriate for certain groups of users. This content may cause psychological discomfort or misunderstanding, especially among younger users. Furthermore, depending on the user's current emotional state, even content that would normally be considered harmless may cause emotional damage. With conventional technologies, it has been difficult to filter such inappropriate content efficiently and while taking into account the user's emotional state.

[0326] The specific processing by the specific processing unit 290 of the data processing device 12 is realized by the following means.

[0327] In this invention, the server includes means for receiving website content, artificial intelligence means for determining whether the received content is inappropriate for a specific user group, means for replacing inappropriate phrases and images with phrases and images that are conveyed to the specific user group, and emotion recognition means for recognizing the emotional state of the user and adjusting how inappropriate content is replaced based on that emotional state. This allows the specific user group to use the Internet safely, while also making it possible to provide appropriate content according to the user's emotional state.

[0328] "User" refers to an individual or specific group of people who use the Internet.

[0329] "Website content" refers to all information, including text, images, and videos, that appears on a web page on the Internet.

[0330] "Artificial intelligence means" refers to systems and programs that use technologies such as machine learning, deep learning, and natural language processing to analyze data and make judgments.

[0331] "Language or imagery that is inappropriate for a particular group of users" refers to content that is deemed offensive, inappropriate, or harmful to that group based on factors such as age, gender, or cultural background.

[0332] "Means of replacing inappropriate language or images with language or images that communicate to a specific group of users" refers to technologies or methods that automatically change inappropriate content so that it can be safely viewed by the relevant group of users.

[0333] "Means for recognizing the user's emotional state" refers to technology or systems that detect and analyze the user's emotional state at that time from their facial expression, tone of voice, context, etc.

[0334] "Emotion-aware measures that adjust the replacement of inappropriate content based on emotional state" refers to technologies and processes that take into account a user's current emotions and optimize how content is replaced to provide a more positive user experience.

[0335] "Web browser extension" refers to software or programs installed to extend the functionality of an internet browser and provide additional features.

[0336] In one embodiment of the present invention, a system is provided that enables users to use the Internet safely. This system has the function of filtering website content and replacing it with appropriate content as needed, taking into account the user's emotional state in particular. This system mainly comprises an artificial intelligence means implemented as an extension of a web browser, an emotion recognition means for recognizing the user's emotional state, and a means for replacing inappropriate content.

[0337] The server runs an artificial intelligence model that uses deep learning, natural language processing, and image recognition techniques to analyze the content of incoming websites and determine whether it is inappropriate for a particular user group. If inappropriate content is detected, the server automatically replaces it with appropriate wording or images.

[0338] The device uses a camera and microphone to detect the user's emotional state in real time and transmits this information to the server. The server analyzes this emotional data and adjusts how the content is replaced, taking into account the user's current emotions. This process allows the content to be replaced with more gentle content that will soothe the user's emotions.

[0339] The hardware used is a camera, microphone, and an internet-connected computer or smart device, while the software is an artificial intelligence model developed using deep learning frameworks such as TensorFlow and PyTorch, and a program that functions as a web browser extension.

[0340] For example, a prompt such as "Please explain this to a 10-year-old child using language appropriate for that child" may be sent to an AI model. This prompt is used to instruct the AI ​​model to replace certain content that is inappropriate for children with content that is more easily understood by children. This type of functionality provides a safe environment for using the Internet.

[0341] The flow of the identification process will be described with reference to FIG.

[0342] Step 1: A user accesses a website through a web browser. At this time, the browser extension receives the content of the accessed website. The input is the website's URL or content, and the output is the content data received from the website. In this process, the web browser's API is used to retrieve the website content.

[0343] Step 2: The retrieved content is sent to a server, which uses artificial intelligence tools to determine whether the content is inappropriate for a specific user group. The input is the website content, and the output is the presence or absence of inappropriate content and its details (text or images). This step uses text analysis and image recognition techniques to identify inappropriate language and images within the content.

[0344] Step 3: The device detects the user's emotional state through a camera or microphone and sends this information to the server. The input is the user's facial expression and tone of voice, and the output is the user's emotional state (e.g., anger, joy). In this step, facial expression recognition and voice analysis technologies are used to determine the user's emotions.

[0345] Step 4: The server analyzes the received emotional data and adjusts how it replaces inappropriate content based on the user's emotional state. The input is the user's emotional state, and the output is the type of content to replace (softer words or images). This step selects the content that best matches the user's emotions and replaces the inappropriate content with an appropriate one.

[0346] Step 5: Finally, the server sends the replaced content to the user's device via the web browser extension. The input is the content to be replaced, and the output is the actual replaced website content. This process involves displaying the replaced content on the web page via the web browser's API.

[0347] Example 3

[0348] Next, a description will be given of a third embodiment of the third embodiment. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0349] Some digital content may contain inappropriate language or images for certain user groups, especially children and users who need protection from sensitive content. This content may have a negative impact on viewers. Furthermore, few existing systems provide content tailored to the user's emotional state, and personalization to improve the user experience is lacking. Effective solutions to address these issues are needed.

[0350] The specific processing by the specific processing unit 290 of the data processing device 12 is realized by the following means.

[0351] In this invention, the server includes means for receiving digital content, artificial intelligence means for determining whether the received content contains phrases or images that are inappropriate for a specific user group, means for automatically replacing the inappropriate phrases or images with appropriate phrases or images, means for detecting the emotional state of the user, and means for adjusting the display of the content based on the detected emotional state. This makes it possible to automatically replace inappropriate content with appropriate content and to realize personalization of content based on the emotional state of the user.

[0352] "Digital content" refers to information or media in electronic form, such as text, images, video, or audio, that can be shared, distributed, or accessed over the Internet.

[0353] A "specific user group" refers to a group of users distinguished based on specific attributes or conditions, such as age, gender, or cultural background.

[0354] "Inappropriate language or imagery" refers to language or visual content that may be considered offensive, offensive, or harmful to certain groups of users.

[0355] "Artificial intelligence means" refers to a general term for computer programs and technologies that aim to mimic human intelligence, such as learning, reasoning, recognition, and language comprehension.

[0356] "Automatic substitution" refers to the method or function by which a program or system autonomously performs an action or process without human intervention.

[0357] "User emotional state" refers to the emotion or mood an individual is experiencing at a given time, and can range from joy, sadness, anger, surprise, etc.

[0358] "Means of detection" refers to the techniques or methods used to identify and confirm the presence of specific information or conditions.

[0359] "Means for tailoring the presentation of content" means any process or feature that changes the form, sequence, or content of information or media presented to a user.

[0360] The implementation of this invention focuses on improving content safety and user experience. The main hardware used is a server, a terminal (smartphone, tablet, PC, etc.), and an emotion detection device (a camera or microphone built into the terminal). The software core is image recognition technology, natural language processing technology, emotion analysis technology, and generative AI models.

[0361] The servers are computers with high-performance processing power, located in the cloud or in physical data centers. Specific generative AI models are installed on these servers to identify and replace inappropriate content and adjust content based on user sentiment. The specific software used includes image recognition technology and GPT-based generative AI models provided by OpenAI.

[0362] The device acts as an interface where users can upload content and receive results sent from the server, and also detects the user's emotional state through the device's built-in camera and microphone and transmits the data to the server.

[0363] For example, if a user uploads a violent image, the generative AI model processes the following prompt: "Identify inappropriate elements in the image and replace them with appropriate landscape images. Also, if the user's current emotion is joy, adjust the display to prioritize positive news articles and images." Based on this prompt, the server replaces the violent image with a landscape image and, taking into account the user's emotion of joy, selects appropriate content and sends it to the device.

[0364] This allows users to enjoy a safe and personalized content experience.

[0365] The flow of the identification process will be described with reference to FIG.

[0366] Step 1:

[0367] A user uploads digital content to a server through a terminal. At this time, the input is an image or text provided by the user, and the server receives the digital content.

[0368] Step 2:

[0369] An artificial intelligence means on the server performs a content analysis on the received digital content. This process uses image recognition and natural language processing techniques to determine whether the wording or images in the content are inappropriate for a particular user group. The input is the digital content, and the output is information about the presence or absence of inappropriate content and its content.

[0370] Step 3:

[0371] If inappropriate content is detected, the server executes a process to automatically replace it with appropriate wording or images. The input to this step is the inappropriate content, and the output is safe alternative content for the user. This replacement process is either selected from a database of pre-prepared safe content or newly generated using a generative AI model.

[0372] Step 4:

[0373] The device has the ability to detect the user's emotional state and transmits that information to the server. In this step, the user's facial expressions and voice are used as input, and the output is the analysis result of the user's emotional state (happiness, sadness, etc.).

[0374] Step 5:

[0375] The server adjusts the display of content based on the received emotional state information. This adjustment is to select content that matches the user's emotions and display it preferentially. The input is the user's emotional state information, and the output is a set of adjusted content.

[0376] By implementing this program, users will receive content that is optimized to their emotions and will be protected from inappropriate content.

[0377] (Application example 3)

[0378] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0379] Conventional digital content delivery systems provide uniform content without considering the individual emotional state of the user. This makes it difficult to provide appropriate content that reflects the user's current emotions and needs. In particular, there are limitations in providing the emotional support and experiences desired by users through digital content.

[0380] The specific processing by the specific processing unit 290 of the data processing device 12 is realized by the following means.

[0381] In this invention, the server includes an image recognition means for analyzing the user's facial expressions in real time, an emotion engine means for determining the user's emotional state based on the analysis results, and an AI means for selecting and providing content appropriate to the user's emotional state, thereby enabling the provision of personalized digital content based on the user's current emotional state.

[0382] "Digital content" refers to content that exists in electronic form, such as video, music, text, and images, that is distributed over the Internet.

[0383] "AI means" refers to systems or programs that use artificial intelligence technology to analyze data and automatically perform specific tasks.

[0384] "Means for substituting content appropriate to the user's emotional state" refers to technologies or processes that take into account the user's current emotions and automatically switch to content that matches or responds to those emotions.

[0385] "Image recognition means" refers to technology or systems that identify and analyze specific patterns or objects from image data acquired through devices such as cameras.

[0386] "Emotion engine means" refers to technology or systems that infer and analyze a user's emotional state from their facial expressions, tone of voice, choice of words, etc.

[0387] "AI means for prioritizing content selection and display" refers to artificial intelligence functions and processes that select the most appropriate content for a user and automatically adjust the display order to suit the user's preferences and circumstances.

[0388] An embodiment of the present invention relates to a system that dynamically selects and provides digital content based on a user's emotional state. This system is implemented as an application installed on a device, such as a smartphone or tablet. The device's built-in camera is used to analyze the user's facial expressions in real time, and an emotion engine determines the user's emotional state based on the data obtained through image recognition. Based on this determination, an AI means selects content that best suits the user's current emotion and displays it on the screen.

[0389] The hardware uses the built-in camera and processor of a smartphone or tablet. The software uses libraries such as OpenCV for image recognition and TensorFlow for machine learning. This system can, for example, provide uplifting and cheerful videos and music if the user is sad. Conversely, if the user is relaxed, it will prioritize the display of calming music and landscape images.

[0390] Specifically, the program's operating procedure is as follows: first, the application activates the device's camera and captures the user's facial expression. Next, the image recognition means analyzes emotions from the facial expression, and the emotion engine means determines the user's emotional state. Finally, based on this emotional state, the AI ​​means selects and displays content. This process is carried out continuously while the user is using the application.

[0391] Examples of prompts include "Generate a list of happy videos to recommend when the user is sad" and "Generate a list of videos that will make the user even happier when the user is happy." The goal is to improve the user experience by providing content that corresponds to the user's emotions.

[0392] The flow of the identification process will be described with reference to FIG.

[0393] Step 1:

[0394] The device activates the built-in camera and captures the user's facial expressions. At this stage, the video data from the camera is received as input and sent to the device as raw image data.

[0395] Step 2:

[0396] The image recognition means analyzes the captured image data and infers emotions from the user's facial expressions. In this process, a facial recognition algorithm is applied to the image data received as input, and an emotion score (e.g., happy, sad, anger, etc.) based on the user's facial expressions is generated as output.

[0397] Step 3:

[0398] The emotion engine means finally determines the user's emotional state based on the emotion scores obtained in step 2. In this step, the emotion engine means analyzes the emotion scores received as input and determines the most likely emotional state as output.

[0399] Step 4:

[0400] The AI ​​means selects appropriate digital content based on the user's emotional state determined in step 3. In this process, the content information in the database and the user's emotional state are considered as inputs, and a list of content that best suits the emotional state is generated as output.

[0401] Step 5:

[0402] The selected content is displayed on the device screen. In this final step, the content list generated in step 4 is received as input, and the content is appropriately arranged on the user interface and presented to the user.

[0403] Through these processing steps, users can receive digital content that is appropriate to their emotional state in real time, enabling them to enjoy a more personalized user experience.

[0404] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0405] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0406] Another example of generative AI is Gemini (internet search engine). <url: https: gemini.google.com ?hl="ja">) are mentioned.

[0407] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0408] [Second embodiment]

[0409] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0410] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0411] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0412] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0413] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0414] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0415] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0416] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0417] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0418] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0419] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0420] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[0421] "Example 1"

[0422] In one embodiment of the present invention, a browser plug-in is used as a means for receiving content from websites accessed by children. This plug-in receives website content in real time and sends it to AI. The AI ​​determines whether the received content contains language or images that are inappropriate for children. Inappropriate language or images are replaced with language or images that can be communicated to children. Specifically, inappropriate words are replaced with appropriate language that children can understand, and inappropriate images are replaced with images that are safe for children to view.

[0423] "Example 2"

[0424] In another embodiment of the present invention, the AI ​​is implemented as a browser plug-in. This plug-in receives website content in real time and sends it to the AI. The AI ​​determines whether the received content contains language or images that are inappropriate for children and replaces the inappropriate language or images with language and images that are acceptable for children. Specifically, inappropriate language is replaced with appropriate language that children can understand, and inappropriate images are replaced with images that are acceptable for children to view.

[0425] "Example 3"

[0426] In a further embodiment of the present invention, AI can identify and replace inappropriate content not only in text but also in images. Specifically, AI uses image recognition technology to identify the content of an image and replace inappropriate images with images that are safe for children to view. For example, violent images can be replaced with landscape images.

[0427] The processing flow of each embodiment will be described below.

[0428] "Example 1"

[0429] Step 1: When your child visits a website, a browser plugin receives the website content in real time.

[0430] Step 2: The received content is sent to the AI.

[0431] Step 3: The AI ​​determines whether the submitted content contains inappropriate language or images for children.

[0432] Determine whether there is.

[0433] Step 4: Inappropriate language and images are replaced with language and images that children can understand. Specifically, inappropriate words are replaced with appropriate language that children can understand, and inappropriate images are replaced with images that are safe for children to see.

[0434] "Example 2"

[0435] Step 1: When your child visits a website, a browser plugin receives the website content in real time.

[0436] Step 2: The received content is sent to the AI.

[0437] Step 3: The AI ​​determines whether the sent content contains inappropriate language or images for children and replaces the inappropriate language and images with language and images that are acceptable to children. Specifically, inappropriate words are replaced with appropriate language that children can understand, and inappropriate images are replaced with images that are safe for children to view.

[0438] "Example 3"

[0439] Step 1: When your child visits a website, a browser plugin receives the website content in real time.

[0440] Step 2: The received content is sent to the AI.

[0441] Step 3: The AI ​​determines whether the submitted content contains language or images that are inappropriate for children.

[0442] Step 4: Using image recognition technology, AI will determine the content of the image and replace inappropriate images with images that are safe for children to view. For example, violent images will be replaced with landscape images.

[0443] Example 1

[0444] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0445] Modern information and communication networks contain a lot of content and visual information that is inappropriate for certain user groups, especially children. This content poses a risk of causing children to feel psychological discomfort or learn inappropriate behavior. Conventional filtering technologies have difficulty completely resolving these issues, particularly in analyzing content in real time and replacing inappropriate content with appropriate content.

[0446] The specific processing by the specific processing unit 290 of the data processing device 12 is realized by the following means.

[0447] In this invention, the server includes means for receiving content on an information communication network accessed by a user in real time, means for transmitting the received content to an information processing system, an information processing system for analyzing and determining whether the transmitted content contains expressions or visual information that are inappropriate for a specific user group, and means for automatically converting expressions or visual information that are determined to be inappropriate into expressions or visual information that are appropriate for the specific user group. This makes it possible to increase safety when a specific user group uses the information communication network and to protect them from inappropriate content.

[0448] "Information and communications network" is a general term for systems that exchange information through the Internet and other digital communications means.

[0449] "Content" means information or entertainment in digital form, such as websites, videos, images, or text.

[0450] "Means of receiving in real time" refers to technologies and methods that capture and process information the moment a user accesses it.

[0451] An "information processing system" is a collection of hardware and software that analyzes, processes, and transforms received data.

[0452] A "particular user group" is a collection of users distinguished based on particular attributes, age, interests, etc.

[0453] "Inappropriate language or visual information" is information such as words or images that may cause psychological discomfort to the user group or encourage inappropriate behavior or thinking.

[0454] "Automatic conversion means" refers to techniques or methods that automate the process of replacing inappropriate content with appropriate content based on specific criteria or rules.

[0455] The embodiment of this invention mainly uses an information processing system, a user's terminal, and a browser plug-in as an extension. The information processing system is configured on a server that includes a generative AI model, and the user's terminal is equipped with a browser and plug-in for transmitting content to the information processing system in real time.

[0456] Information processing systems use specific generative AI models, such as OpenAI's GPT-4 and image processing-specific DALL·E. These models are capable of identifying inappropriate content in both text and images and converting it to appropriate content. This process is performed automatically based on the content sent from the device.

[0457] A browser used by the user to browse information and communication networks is installed on the terminal, and a plug-in based on the invention is added to the browser. The plug-in has the role of capturing content accessed by the user and transmitting it to an information processing system. The transmitted content is analyzed in real time by a generative AI model on a server.

[0458] For example, when a user accesses text or images containing inappropriate language, the plugin captures this content and sends it to the server. The generative AI model on the server analyzes the content using prompts such as: "This website contains language that is inappropriate for children. Please convert it to appropriate language." or "This image is inappropriate for children. Please replace it with an image that is safe for children and fits the theme." These prompts act as instructions for converting the text or image to an appropriate one. The converted content is then sent back to the device, updating the content the user sees.

[0459] This approach aims to enable certain user groups, especially children, to use information and communication networks safely.

[0460] The flow of the identification process will be described with reference to FIG.

[0461] Step 1: A user accesses content on an information and communications network through a browser. At this time, a browser plug-in installed on the device starts up and captures the content the user is viewing. This plug-in collects data on all content, including text, images, and other media files, in real time. The input is the content of the web page accessed by the user, and the output is the collected content data.

[0462] Step 2: The captured content data is sent to the server by the browser plug-in. The information processing system on the server uses a generative AI model to analyze the received content data. This process determines whether the content contains inappropriate language or visual information for a specific user group. The input is the content data sent from the device, and the output is the analysis result (identification of inappropriate content).

[0463] Step 3: The generative AI model on the server automatically converts inappropriate content into appropriate expressions and visual information. For example, inappropriate words are replaced with appropriate words, and inappropriate images are replaced with acceptable images. The input to this conversion process is the inappropriate content identified by the analysis results, and the output is the converted appropriate content.

[0464] Step 4: The converted content is sent back to the device. The device's browser plugin updates the original content with the converted content and displays it on the web page the user is viewing. The input in this step is the converted content sent from the server, and the output is the updated web page the user views.

[0465] These steps enable users to safely use information and communication networks without coming into contact with inappropriate content, and each step aims to increase online safety for vulnerable user groups, especially children.

[0466] (Application example 1)

[0467] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0468] There is growing concern about the impact that inappropriate language and images in digital content can have on users, especially children. The Internet provides an environment where age-inappropriate content is easily accessible, and there is a problem that this content can have a psychological and emotional impact. In particular, there is a demand for technology that can instantly convert such content into appropriate content when users encounter it, providing a safe browsing experience.

[0469] The specific processing by the specific processing unit 290 of the data processing device 12 is realized by the following means.

[0470] In this invention, the server includes a means for acquiring digital content in real time, a means for transmitting the acquired content to a generative AI model to evaluate the appropriateness of the content, and a means based on the generative AI model for automatically converting inappropriate expressions into appropriate expressions that are easy for users to understand. This makes it possible to detect inappropriate content in real time and automatically convert it into appropriate expressions. As a result, a safe digital content viewing environment can be provided for users.

[0471] "Digital content" is a general term for information such as text, images, and videos distributed over the Internet.

[0472] "Means of real-time acquisition" refers to technologies and methods for acquiring and analyzing content the moment a user accesses it.

[0473] "Means of sending to the generative AI model" refers to the technology or method for sending the acquired content to the artificial intelligence model for analysis and processing.

[0474] "Automatically converting inappropriate language into user-friendly language" refers to the process by which a generative AI model identifies inappropriate language and images within content and replaces them with appropriate content based on age and level of understanding.

[0475] "User" means an individual who views or uses digital content.

[0476] "Server" refers to a computer system or software that provides data or services over the Internet.

[0477] An "application" is a software program designed for a specific purpose.

[0478] In an embodiment of the present invention, the system mainly consists of a server, a terminal (such as a smartphone, tablet, smart glasses, or head-mounted display), and a user (particularly a child). The server hosts a generative AI model, and the terminal runs a browser or dedicated application for accessing digital content on the Internet. The system has the function of acquiring digital content accessed by the terminal in real time and sending that content to the generative AI model on the server. The generative AI model evaluates the appropriateness of the sent content, and if it contains inappropriate language, automatically converts it into appropriate language that is easy for the user to understand.

[0479] This system utilizes browser plugins and applications written in programming languages ​​such as JavaScript and Python that run on the device, and generative AI models such as TensorFlow, OpenAI's GPT, and DALL-E that run on the server. This software runs on the hardware and efficiently processes the acquisition, analysis, and transformation of digital content.

[0480] For example, if a child accesses a news site containing violent images, the system captures the image in real time and sends it to the server. The generative AI model processes the image based on the prompt, "Please convert this image into one that is safe and easy for children to understand," and generates an alternative image that does not contain violent elements and displays it in place of the original content. This process allows users to enjoy a safe digital content viewing environment.

[0481] The flow of the identification process will be described with reference to FIG.

[0482] Step 1: Device accesses digital content

[0483] When a user accesses a specific website on the Internet using a device, a browser plug-in or application running on the device retrieves digital content (text, images, video, etc.) in real time. The input is the URL of the website accessed by the user and the HTML code of the page, and the output is the content data of the page.

[0484] Step 2: Send the content to the server for evaluation.

[0485] The acquired digital content is sent to a generative AI model on a server for evaluation. This process has the acquired digital content as input and the content received by the generative AI model as output.

[0486] Step 3: The generative AI model analyzes the content and identifies inappropriate content

[0487] The generative AI model on the server analyzes the submitted content and identifies inappropriate language and images. The input is the content submitted in step 2, and the output is a list of inappropriate content and identification information. This step involves data processing or data calculations that use specific keywords or image recognition techniques to detect inappropriate content.

[0488] Step 4: Convert inappropriate content to appropriate content

[0489] The identified inappropriate content is automatically transformed into appropriate wording and images that are easy for children to understand. This process uses a generative AI model, which takes the inappropriate content identified in step 3 as input and produces the appropriate content as output. The generative AI model receives the inappropriate content and performs data calculations to transform it into appropriate content based on a prompt such as, "Please transform this image into something that is safe and easy for children to understand."

[0490] Step 5: Send the converted content to your device and view it

[0491] Finally, the server sends the appropriate converted content to the device so that it can be displayed on the web page the user accessed. The input is the appropriate content generated in step 4, and the output is the display of that content on the user's device. This step involves sending data from the server to the device and processing the data display on the device.

[0492] Example 2

[0493] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0494] There is a lot of inappropriate content on the Internet that children should not access. It is not realistic for parents to constantly monitor, and existing filtering technologies may not be able to completely block it. In particular, when it comes to content that includes both text and images, there is still a lack of technology that can properly evaluate this in real time and automatically convert it into content that is safe for children.

[0495] The specific processing by the specific processing unit 290 of the data processing device 12 is realized by the following means.

[0496] In this invention, the server includes a means for capturing web content in real time and transmitting it over a secure communication channel, a means for evaluating the transmitted content using a generative AI model equipped with natural language and image analysis technology, and a means for automatically replacing inappropriate language or images with language or images that are more user-friendly and acceptable to users, thereby significantly improving safety when children use the Internet.

[0497] "User" refers to an individual or group who accesses web content through an information terminal.

[0498] "Information terminal" refers to a device (such as a personal computer, smartphone, or tablet) that can connect to the Internet and browse websites.

[0499] "Web content" refers to all information such as text, images, and videos that appear on web pages on the Internet.

[0500] "Real-time capture" refers to detecting and capturing web content instantly at the moment a user views it.

[0501] A "secure communication channel" refers to a means of communication that uses security technologies such as encryption to prevent third parties from intercepting or tampering with data when sending or receiving it.

[0502] "Analysis Server" refers to a computer system used to analyze and process transmitted web content.

[0503] A "generative AI model" refers to an artificial intelligence model that has the ability to generate new text or images based on input data.

[0504] "Natural language and image analysis technology" refers to technology for understanding and analyzing text data and technology for identifying and analyzing the content of images.

[0505] "Inappropriate language or images" refers to content that is deemed inappropriate or difficult to understand for certain groups of users (especially children) based on age or social norms.

[0506] "Safe images" refer to images whose content is deemed safe for viewing by a specific group of users (especially children).

[0507] "Plug-in format" refers to a software module that can be added to existing software (in this case, a browser) to expand its functionality.

[0508] The embodiment of this invention mainly involves an information terminal, an analysis server, and a communication protocol between them. A web browser is installed on the information terminal, and a plug-in is embedded in the browser that has the function of capturing web content in real time and transmitting it to the analysis server via a secure communication path. The plug-in is developed using JavaScript and other web technologies.

[0509] The analysis server is built on a high-performance computer system and has software installed that includes a generative AI model. This server receives web content sent from the information terminal and analyzes the content using natural language processing and image analysis techniques. If inappropriate language or images are detected, the AI ​​model automatically replaces them with appropriate content. This process uses deep learning frameworks such as TensorFlow and PyTorch. The replaced content is then sent back to the information terminal and displayed to the user via a plugin.

[0510] For example, consider a web page containing the text "This movie contains violent scenes intended for adults" along with a screenshot of that scene. The plugin captures this text and image and sends them to an analysis server. The AI ​​model on the server then replaces the text with child-friendly phrases such as "This movie contains scary scenes, so please watch with an adult," and replaces the image with a more innocuous image, such as the movie logo. These conversion processes are based on natural language processing and image recognition technology, and are intended to help children use the internet safely.

[0511] This invention enables secure communication between the information terminal and the analysis server while filtering web content in real time and converting it into a form that is safe for children, allowing parents to improve the safety of their children when using the Internet.

[0512] The flow of the identification process will be described with reference to FIG.

[0513] Step 1: Capturing web content

[0514] A browser plug-in running on an information terminal captures the content (text and images) of the web page the user is viewing in real time. The input to this step is the content of the web page the user is viewing, and the output is content data processed into a data format that can be sent to the server for analysis. The plug-in performs DOM analysis and extracts all text and image data from the page.

[0515] Step 2: Submit your content

[0516] The captured content is transmitted from the information terminal to the analysis server via a secure communication path. The input of this step is the content data processed in step 1, and the output is the content data that has reached the analysis server. The HTTPS protocol is used for transmission, ensuring the confidentiality and integrity of the data.

[0517] Step 3: Analyze and evaluate content

[0518] The generative AI model on the analysis server analyzes and evaluates the submitted content using natural language processing and image analysis technologies. The input to this step is the content data received in step 2, and the output is the content data after inappropriate expressions or images have been detected and replaced with appropriate content. The AI ​​model identifies inappropriate content and automatically replaces it with appropriate alternative text or images.

[0519] Step 4: Return the replacement content

[0520] The replaced content is sent back from the analysis server to the information terminal. The input of this step is the replaced content data generated in step 3, and the output is the content ready to be displayed to the user by the information terminal's browser plug-in. The return also uses the HTTPS protocol to maintain data security.

[0521] Step 5: Displaying Content

[0522] The device's browser plug-in displays the returned content in the user's browser. The input to this step is the content data returned in step 4, and the output is the appropriate content rendered on the web page the user views. The plug-in embeds the replaced text and images in their original locations, providing the user with a secure browsing environment.

[0523] (Application example 2)

[0524] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0525] The Internet contains a large amount of linguistic and visual content that is considered inappropriate for certain groups of users. In particular, in environments where children have free access, there is a risk that they may come into contact with harmful content. Previous technology has had the difficulty of efficiently filtering inappropriate content and automatically replacing it in a manner appropriate to the user's level of understanding. By solving this issue, it is necessary to provide an Internet environment where certain groups of users, especially children, can safely access information.

[0526] The specific processing by the specific processing unit 290 of the data processing device 12 is realized by the following means.

[0527] In this invention, the server includes a means for receiving content from an information distribution medium accessed by a user, an artificial intelligence means for determining whether the received content contains linguistic or visual expressions that are inappropriate for a specific user group, and a means for replacing the inappropriate linguistic or visual expressions with linguistic or visual expressions that are appropriate for the specific user group. This enables a specific user group, particularly children, to use the Internet in an environment where they can access information in a format that suits their level of understanding without being exposed to inappropriate content.

[0528] "Information distribution medium" refers to websites and applications that publish content on the Internet and are accessible to the general public.

[0529] "Content" refers to information or expressions such as text, images, video, and audio that are provided through an information distribution medium.

[0530] A "specific user group" refers to a group of users with specific characteristics, defined by age, gender, cultural background, etc.

[0531] "Inappropriate verbal or visual content" refers to language or images that may be offensive, sexual, violent, or otherwise disturbing to certain audiences, and that may be considered inappropriate for exposure to certain audiences.

[0532] "Artificial intelligence means" refers to systems or processes that use technologies such as machine learning, natural language processing, and image recognition to analyze content and make judgments.

[0533] "Information delivery media user interface extension" means a software component that is installed to extend the functionality of a web browser or application and provide additional features.

[0534] "Appropriate verbal or visual substitution" refers to a process or algorithm that replaces inappropriate content with verbal or visual substitution that is acceptable, educational, or neutral to a particular audience.

[0535] In an embodiment of the present invention, the server executes a program including artificial intelligence to receive and analyze content sent from information distribution media accessed by users. The program has the function of detecting linguistic and visual expressions that are deemed inappropriate for a specific user group and automatically replacing them with appropriate expressions. This process uses natural language processing and image recognition technologies. The hardware used is a high-performance server and storage system, and the software includes machine learning libraries such as TensorFlow and PyTorch.

[0536] On the terminal side, a program implemented as a user interface extension of the information delivery medium runs and displays the processed content received from the server. This extension is developed using JavaScript and other web technologies and is designed to display only content appropriate for a specific user group.

[0537] This system allows users to have a safer browsing experience. For example, when a child visits a website, inappropriate words are replaced with easier-to-understand synonyms, such as "clumsy," and inappropriate images are replaced with educational illustrations or landscape images. This process provides a safer environment for specific groups of users to use the Internet. Examples of prompts include, "Please translate this text into language that a 5-year-old can understand," or "Please replace this image with one that is safe for children to view."

[0538] The flow of the identification process will be described with reference to FIG.

[0539] Step 1: Receiving and Preprocessing Content

[0540] The server receives content sent from the information distribution medium accessed by the user. At this time, web page data composed of HTML, CSS, JavaScript, etc. is input. The server analyzes this data and separates it into text and images. Through this process, text data and image data are extracted and prepared as input for the next processing step.

[0541] Step 2: Detect inappropriate content

[0542] The extracted text data is analyzed using natural language processing techniques to detect inappropriate language. At the same time, image recognition techniques are applied to image data to detect inappropriate visual content. This process uses a generative AI model that leverages machine learning libraries to evaluate the appropriateness of both text and images. The input is the text and images extracted from the web page, and the output is a list of content deemed inappropriate.

[0543] Step 3: Replacing the content

[0544] Text and images that are deemed inappropriate are automatically replaced with language and visuals that are appropriate for a specific user group. The generative AI model operates based on prompts to convert inappropriate content into appropriate content. For example, text is replaced based on the prompt, "Please translate this text into language that a 5-year-old child can understand." Images are also replaced with appropriate images based on the prompt, "Please replace this image with an image that is safe for children to view." The input is inappropriate content, and the output is content that has been replaced with appropriate language.

[0545] Step 4: Submit your edited content

[0546] The replaced content is sent to the user's device through the information delivery medium's user interface extension. The server generates web page data including the edited text and images and sends it to the device. The device renders the received data in the browser and displays it to the user. This process allows the user to view a web page that contains only safe content, with the inappropriate content removed.

[0547] Example 3

[0548] Next, a description will be given of Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0549] In today's society, where digital content is widespread, certain user groups, especially children, are at increased risk of being exposed to inappropriate content. Violent, sexual, and other harmful content is easily accessible on the Internet, threatening the healthy development and psychological safety of certain user groups. Therefore, it is urgent to effectively restrict the distribution of inappropriate information via digital content and ensure that certain user groups can access digital content in a safe environment.

[0550] The specific processing by the specific processing unit 290 of the data processing device 12 is realized by the following means.

[0551] In this invention, the server includes a means for uploading digital data, an AI means for determining whether the uploaded digital data contains content inappropriate for a specific user group, and a means for replacing the digital data containing inappropriate content with content appropriate for the specific user group. This enables the specific user group to obtain information in a safe and healthy digital environment without being exposed to inappropriate content on the Internet. The AI ​​running on the server automatically identifies inappropriate content in both text and images and replaces it with appropriate content, thereby ensuring the safety and appropriateness of digital content for the specific user group.

[0552] "Digital data" is a general term for information represented in digital form, such as images, text, audio, and video.

[0553] "Means of uploading" refers to the act of a user sending digital data to a server or cloud via the Internet, as well as the technology and process for doing so.

[0554] "AI means" refers to methods or systems that utilize artificial intelligence technology to automatically perform certain tasks, in this case including the ability to identify and replace inappropriate content.

[0555] "Inappropriate Content" refers to sexual, violent or other potentially offensive information or images that may be considered harmful to certain user groups, particularly children.

[0556] A "particular user group" refers to a group of users who share common characteristics such as a particular age range, interests, or sensitivities, and in the present invention, children are the main group of users.

[0557] "Web Service or Application" means a service or program delivered over the Internet that allows users to access certain functionality or information.

[0558] "Appropriate content replacement" refers to processes or techniques that analyze inappropriate digital data and replace that content with information or images that are appropriate and not harmful to a particular user group.

[0559] The embodiment of the present invention relates to the operation of a system that mainly involves uploading digital data, evaluating the appropriateness of that data, and replacing inappropriate data. This system is composed of three parties: a server, a terminal, and a user.

[0560] The server is a high-performance computer system equipped with data analysis capabilities that utilize artificial intelligence (AI). The AI ​​running on this server uses specific libraries and frameworks (e.g., TensorFlow, PyTorch) to evaluate the content of uploaded images and text. The AI's analytical capabilities include image recognition and natural language processing technologies, which identify inappropriate elements within digital data.

[0561] A terminal is a device connected to the Internet that provides an interface for users to upload digital data. Terminals include smartphones, tablets, personal computers, etc.

[0562] Users are people who use this system to upload and view digital content. Users send digital data to the server through specific websites or applications. The server automatically analyzes the data and replaces any inappropriate content with appropriate content.

[0563] For example, if an image uploaded by a user contains violent content, AI running on the server will determine that the image is inappropriate and automatically replace it with a safe alternative image (e.g., a landscape). An example of a prompt might be, "Analyze the content within the image to determine whether it contains inappropriate elements, and if so, automatically replace it with a safe image from a specified category (e.g., a natural landscape)."

[0564] This embodiment allows users to enjoy content in a safe digital environment without coming into contact with inappropriate content. The present invention is implemented through the interaction of a server, a terminal, and a user.

[0565] The flow of the identification process will be described with reference to FIG.

[0566] Step 1: The user uses the terminal to upload digital data (images or text) to the system. The input of this step is the digital data selected by the user, and the output is a data file sent to the server. The terminal collects the data selected by the user and processes it to send to the server.

[0567] Step 2: The server receives the uploaded digital data and analyzes its content using AI tools. The input at this stage is the uploaded data, and the output is the analysis result of the data content (whether it contains inappropriate content or not). The AI ​​on the server processes the received data and performs data processing and data calculations to identify inappropriate elements.

[0568] Step 3: If the AI ​​means determines the data is inappropriate, the server replaces it with appropriate content. The input to this step is the inappropriate data, and the output is the replaced data. The server processes the inappropriate data and replaces it with appropriate data (e.g., an image from a secure image library).

[0569] Step 4: The replaced data is sent from the server to the user via the terminal. The input at this stage is the replaced data, and the output is the data displayed in a format that the user can view. The server sends the converted data to the terminal, which then processes it to display it on the user's screen.

[0570] This process allows users to enjoy content in a safe digital environment without being exposed to inappropriate content. The system can effectively identify inappropriate data and automatically replace it with appropriate content.

[0571] (Application example 3)

[0572] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0573] In today's digital society, content accessed via the Internet by certain age groups, particularly children, often contains inappropriate language and images. This inappropriate content poses a risk of psychological harm to children. While conventional filtering technologies are effective in blocking inappropriate text content, they have difficulty detecting inappropriate images and are unable to replace inappropriate content with appropriate ones. This invention aims to provide a safe browsing environment by automatically detecting inappropriate language and images in digital content accessed by certain age groups and replacing them with appropriate language and images.

[0574] The specific processing by the specific processing unit 290 of the data processing device 12 is realized by the following means.

[0575] In this invention, the server includes a means for receiving digital content accessed through an information terminal, an AI means for determining whether the received digital content contains expressions or images that are inappropriate for a specific age group, and a means for replacing the inappropriate expressions or images with expressions or images that are appropriate for the specific age group. This ensures the safety of digital content and makes it possible to provide only content that is safe for viewing by a specific age group. The AI ​​means can accurately determine and replace inappropriate content not only in text but also in images, so it can also address issues with image content that were difficult to address with conventional technology.

[0576] An "information terminal" is an electronic device that connects to the Internet or other networks to receive and display digital content. Examples include smartphones, tablets, and personal computers.

[0577] "Digital content" refers to information content expressed in digital form, such as text, images, video, and audio. It is distributed via the Internet and can be accessed and viewed on an information terminal.

[0578] "Specific age group" refers to an age range that requires special protection when viewing content, particularly young people such as children and teenagers.

[0579] "Inappropriate language or images" refers to text, images, or other media content that is inappropriate for a particular age group to view or that may cause psychological harm, such as violent, sexual, or discriminatory content.

[0580] "AI means" means a system or program that uses artificial intelligence technology to analyze the content of digital content and determine whether the content is appropriate or inappropriate based on specific criteria. Such means include machine learning and image recognition technology.

[0581] In an embodiment of the present invention, a server receives digital content accessed through an information terminal, determines whether the content is inappropriate for a specific age group using AI means, and replaces inappropriate expressions or images with appropriate ones as necessary, in order to provide digital content appropriate for a specific age group. This system functions as an application installed on the information terminal, and monitors and appropriately converts the content in real time as the user of the terminal views the digital content.

[0582] The server uses artificial intelligence techniques to determine inappropriate content in the text and images within the received digital content. The AI ​​means, including image recognition and natural language processing techniques, assess the safety of the content. If inappropriate content is detected, the AI ​​means uses a generative AI model to automatically replace the content with content appropriate for a specific age group.

[0583] The hardware used is information terminals, such as smartphones, tablets, and personal computers, while the software utilizes generative AI models (e.g., OpenAI's GPT series) and image recognition technologies (e.g., Google Cloud Vision API).

[0584] As a concrete example, consider a situation where a user is using a video streaming service for children. When an inappropriate advertisement is inserted into the video, the AI ​​means instructs the generative AI model using a prompt sentence such as "Please replace the image containing violent content with a landscape image that is safe for children to view," and replaces the inappropriate advertisement with a landscape image. This process is intended to ensure that the user using the device can only view safe content.

[0585] The flow of the identification process will be described with reference to FIG.

[0586] Step 1: A user accesses digital content using an information terminal. At this time, the user's access request is input, and the target digital content is displayed on the terminal as output. Based on the user's access request, the terminal obtains the selected content and displays it on the screen.

[0587] Step 2: The AI ​​means on the server receives the digital content and performs a content analysis. The input is the digital content obtained in step 1, and the output is an analysis result regarding the content of the content. The analysis result includes the presence or absence of inappropriate content in the text and images. The AI ​​means uses image recognition and natural language processing techniques to detect inappropriate elements in the content.

[0588] Step 3: If inappropriate content is detected, the AI ​​means uses a generative AI model to replace the inappropriate content with appropriate content. The input is the inappropriate content detected in step 2, and the output is the appropriate replacement content. This process identifies inappropriate images and text and automatically converts them to appropriate content based on prompts such as "Please replace images containing violent content with landscape images that are safe for children to view."

[0589] Step 4: The converted content is sent to the user's information terminal and displayed. The input is the appropriate content generated in step 3, and the output is the updated content displayed on the user's terminal. The server provides the converted content to the user, and the terminal receives this content and displays it to the user. This ensures that the user can only view safe content.

[0590] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0591] "Example 1"

[0592] As one embodiment of the present invention, there is provided a system including: means for receiving content from websites accessed by children; AI means for determining whether the received content contains phrases or images that are inappropriate for children; means for replacing the inappropriate phrases and images with phrases and images that are conveyable to children; and an emotion engine for recognizing the emotions of a user, for example, from the user's facial expressions or tone of voice.

[0593] "Example 2"

[0594] In another embodiment of the present invention, a system is provided in which an emotion engine adjusts how inappropriate language and images are replaced based on the user's emotions. For example, if the user feels angry, the emotion engine conveys that information to an AI, which then replaces the user's anger with more gentle language and images to reduce the user's anger.

[0595] "Example 3"

[0596] In yet another embodiment of the present invention, a system is provided in which an emotion engine adjusts how content is displayed based on the user's emotions. For example, if the user feels happy, the emotion engine conveys that information to the AI, which then preferentially displays content that makes the user happy.

[0597] The processing flow of each embodiment will be described below.

[0598] "Example 1"

[0599] Step 1: Receive content from websites your child visits.

[0600] Step 2: The AI ​​determines whether the received content contains language or images that are inappropriate for children.

[0601] Step 3: Replace inappropriate language and images with language and images that are child-friendly.

[0602] Step 4: The emotion engine recognizes the user's emotion. This emotion engine recognizes the user's emotion from, for example, the user's facial expression or tone of voice.

[0603] "Example 2"

[0604] Step 1: Recognize the user's emotions with the emotion engine.

[0605] Step 2: The emotion engine adjusts how inappropriate language and images are replaced based on the user's emotions. For example, if the user feels angry, the emotion engine relays that information to the AI.

[0606] Step 3: The AI ​​defuses the user's anger by replacing the image with more gentle words or images.

[0607] "Example 3"

[0608] Step 1: Recognize the user's emotions with the emotion engine.

[0609] Step 2: The emotion engine adjusts how content is displayed based on the user's emotions. For example, if the user feels happy, the emotion engine conveys that information to the AI. Step 3: The AI ​​prioritizes displaying content that makes the user feel happy.

[0610] Example 1

[0611] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0612] The content on the Internet is diverse and may contain content that is inappropriate for certain user groups, especially children. This can have a negative impact on users' feelings or lead to misunderstandings. In addition, there is a lack of technology to dynamically adjust content based on user responses, making it difficult to provide an optimized Internet experience for each individual user.

[0613] The specific processing by the specific processing unit 290 of the data processing device 12 is realized by the following means.

[0614] In this invention, the server includes means for acquiring digital content from devices connected to the Internet in real time, artificial intelligence means for analyzing the acquired digital content and determining whether the content is inappropriate for a specific user group, means for replacing the determined inappropriate content with appropriate content for the specific user group, and emotion recognition means for capturing user reactions in real time and further optimizing the digital content based on the reactions, thereby enabling the identification and replacement of inappropriate content and the optimization of content based on user emotions.

[0615] An "Internet-connected device" is an electronic device that has the ability to access the Internet and is capable of obtaining web content and sending and receiving data.

[0616] "Digital content" is a general term for information expressed in digital form, such as text, images, audio, and video.

[0617] "Real-time" means that the processing or reaction occurs almost simultaneously with actual time, without delay.

[0618] "Artificial intelligence means" refers to systems or programs that utilize technologies such as machine learning and deep learning to learn, make judgments and make inferences like humans.

[0619] A "specific user group" is a group of users distinguished based on specific criteria such as age, gender, or interests.

[0620] "Inappropriate language or visual material" is content, such as text or images, that is deemed offensive or unsuitable for viewing by a particular user group.

[0621] "Replace" means to remove an element and substitute another element to take its place or role.

[0622] "Emotion recognition means" refers to technology or systems that identify and analyze people's emotions from facial expressions, tone of voice, etc.

[0623] "Optimization" is the process of adjusting performance or effectiveness to the best possible level based on specific criteria.

[0624] A specific embodiment of the present invention will now be described, which aims to optimize digital content on the Internet for a specific user group, particularly children, in a safe and educational manner.

[0625] First, a plug-in is installed on the device to capture digital content accessed through a web browser in real time. This plug-in has the function of capturing text and images from the web page the user is viewing and sending them to a server. This plug-in is compatible with commonly used web browsers such as Google Chrome and Mozilla Firefox.

[0626] On the server side, artificial intelligence means analyze the digital content. This analysis is performed using generative AI models to determine whether text or images contain inappropriate language or visual material for a specific user group. These artificial intelligence means use advanced models such as OpenAI's GPT and Google's BERT. If inappropriate content is detected, it is immediately replaced with appropriate content. For example, offensive language is replaced with more moderate language, and inappropriate images are replaced with educational images.

[0627] Additionally, the server is equipped with an emotion recognition system to capture users' reactions in real time. This system analyzes their facial expressions and vocal tone to identify emotional states such as joy or confusion. This analysis uses technologies such as Microsoft's Face API and Google's Cloud Speech-to-Text. Based on the emotional feedback, the digital content can be further optimized to provide a more appropriate experience for the user.

[0628] An example prompt might be, "Is this text / image appropriate for children?" The AI ​​then analyzes whether the content is safe and educational for children and adjusts it as needed.

[0629] This allows the server to analyze digital content in real time, identify inappropriate content, and replace it with appropriate content. It also recognizes user sentiment and optimizes content accordingly, providing a safer and more educational internet experience for specific user groups.

[0630] The flow of the identification process will be described with reference to FIG.

[0631] Step 1: Get content

[0632] The browser plug-in installed on the device receives the text and images of the page in real time when the user visits a website, and sends this content to a server for analysis.

[0633] Input: Web page text and images

[0634] Data processing: Collecting text and images from web pages

[0635] Output: Text and image data sent to the server

[0636] Step 2: Analyze your content

[0637] The server-based AI analyzes the received text and images to determine whether they contain content that is inappropriate for a particular user group, using a generative AI model.

[0638] Input: Text and image data

[0639] Data manipulation: AI-based identification of inappropriate content

[0640] Output: A list of content that was flagged as inappropriate

[0641] Step 3: Replacing the content

[0642] If content is found to be inappropriate, the server replaces it with content appropriate for a particular user group, using a database of appropriate text and images for this replacement process.

[0643] Input: List of content flagged as inappropriate

[0644] Data manipulation: replacing inappropriate content with appropriate content

[0645] Output: Replaced content

[0646] Step 4: Optimize your content

[0647] The server has an emotion recognition means that captures users' reactions in real time, and further optimizes the content based on this feedback. In this process, user reactions are analyzed using emotion recognition technology.

[0648] Input: User's emotional feedback (facial expressions and tone of voice)

[0649] Data Processing: Analysis of User Reactions Using Emotion Recognition Technology

[0650] Output: Content optimization information

[0651] Step 5: Displaying optimized content

[0652] Finally, the optimized content is sent back from the server and displayed to the user through their device, a process that allows users to experience safer and more educational content.

[0653] Input: Replaced content, optimization information

[0654] Data processing: Preparing content for display on the device

[0655] Output: The optimized content that is displayed to the user

[0656] (Application example 1)

[0657] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0658] The Internet is home to a large amount of content that is inappropriate for children, and it is easily accessible. Furthermore, there is a lack of systems that provide appropriate content based on children's emotions and reactions. This increases the risk of children being negatively influenced. This invention aims to address the need for a system that provides an environment where children can safely enjoy digital content and can recommend appropriate content based on their emotions.

[0659] The specific processing by the specific processing unit 290 of the data processing device 12 is realized by the following means.

[0660] In this invention, the server includes means for receiving digital content accessed by children, AI means for determining whether the received content contains phrases or images that are inappropriate for children, means for replacing the inappropriate phrases and images with phrases and images that are conveyable to children, and means including an emotion engine for recognizing the emotions of the user. This allows children to safely enjoy Internet content and further makes it possible to recommend appropriate content according to their emotions and reactions.

[0661] "Digital content accessed by children" refers to information such as text, images, audio, and video provided on the Internet that is intended to be viewed or used by minors.

[0662] "Inappropriate language and images" refers to content such as sexual, violent, or discriminatory language that may have a negative impact on the healthy development of young people.

[0663] "AI tools" is a general term for algorithms and software that use artificial intelligence technology to analyze data and perform specific tasks.

[0664] "Replacement measures" are actions or processes that replace content that is deemed inappropriate with other content that is safe for minors to view.

[0665] An "emotion engine that recognizes user emotions" is a technology or system that estimates a person's emotional state from their facial expressions, tone of voice, behavioral patterns, etc.

[0666] A "browser plug-in" is a software component that is added to a web browser to extend its functionality, making certain features and services available directly within the browser.

[0667] A specific implementation method for the embodiment of the present invention will be described below. The system of the present invention aims to enable children to safely use Internet content and to recommend content according to the user's emotions.

[0668] The server will be developed using Python and libraries such as TensorFlow, OpenCV, and PyTorch. This software provides AI tools to detect inappropriate language and images in digital content and automatically replace them with ones that are appropriate for children. The server also includes an emotion engine that recognizes the user's emotions, inferring emotions from facial expressions and tone of voice collected via the device's camera and microphone.

[0669] A device is any device that can connect to the internet, such as a smartphone, tablet, smart TV, etc. The browser plug-in running on the device transmits the digital content accessed by the user to a server in real time and adjusts the display of the content based on feedback from the server.

[0670] When users use this system to browse the internet, they access safe content that has been automatically filtered, and if the user's sentiment is positive, similar content is recommended, and if the sentiment is negative, content from a different genre is recommended.

[0671] As a concrete example, there is a scenario in which a parent uses this system when showing a video to their child. Prompts include "a video filtering function that automatically converts content into one suitable for children to watch" and "a function that reads emotions from a child's facial expressions and recommends content."

[0672] This approach improves safety for children when they use the internet while providing them with a personalized, emotionally-driven content experience.

[0673] The flow of the identification process will be described with reference to FIG.

[0674] Step 1: The terminal receives the digital content that the user wants to access.

[0675] When a user accesses digital content on the Internet through a browser, the device receives information about the content (text, images, video, etc.) This information becomes input that is sent to the server for processing in the next step.

[0676] Step 2: The device sends the received content to the server.

[0677] The device then sends the received digital content to a server, which then uses it as input data for AI analysis.

[0678] Step 3: The AI ​​on the server analyzes the content.

[0679] The AI ​​means installed on the server analyzes the received content and determines whether it contains inappropriate language or images. If this analysis identifies certain elements in the content as inappropriate for children, information is generated to replace them. The output of this process is the location of the content to be replaced and information on the appropriate content to replace it.

[0680] Step 4: The server sends a content replacement instruction to the terminal.

[0681] Based on the results of the AI ​​analysis, the server sends specific replacement instructions to the device, including information on which content should be replaced and how.

[0682] Step 5: The device replaces the content.

[0683] The device then follows the replacement instructions received from the server and replaces the currently displayed content with an appropriate one. This operation allows the user to view safe content without being exposed to inappropriate content.

[0684] Step 6: The device recognizes the user's emotions.

[0685] The device uses a built-in camera and microphone to recognize the user's emotions from their facial expressions and tone of voice, and this information is sent to a server for content recommendation based on their emotions.

[0686] Step 7: The server recommends content based on the user's sentiment.

[0687] The server analyzes the user's emotion data sent from the terminal and recommends content that best suits that emotion. This recommendation information is sent to the terminal and presented to the user.

[0688] This processing flow provides an environment in which children can safely use digital content, and also enables a personalized content experience that responds to the user's emotions.

[0689] Example 2

[0690] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0691] The Internet contains a large amount of content that is considered inappropriate or harmful to certain user groups. Websites that may be accessed by children or sensitive individuals are particularly at risk of being negatively impacted by inappropriate language or images. There is also a growing need to appropriately tailor content based on the user's emotional state. To address this issue, it is necessary to analyze the content viewed by users in real time, automatically replace inappropriate content with appropriate content, and provide content that takes the user's emotional state into consideration.

[0692] The specific processing by the specific processing unit 290 of the data processing device 12 is realized by the following means.

[0693] In this invention, the server includes means for receiving content from the Internet in real time, artificial intelligence means for determining whether the received content contains expressions or visual elements that are inappropriate for a specific user group, means for replacing the inappropriate expressions or visual elements with expressions or visual elements that can be conveyed to the specific user group, and emotion engine means for evaluating the emotional state of the user and adjusting how the expressions and visual elements are replaced based on this evaluation. This makes it possible to automatically replace inappropriate content with appropriate content, and further makes it possible to provide appropriate content according to the emotional state of the user.

[0694] "Internet content" means all text, images, videos and other media information accessible via the Internet, including websites, online platforms and social media.

[0695] "Real-time capture" means a process or technology that captures the content of a web page at the moment a user views it and retrieves it for analysis.

[0696] A "specific user group" is a group of users who share specific attributes, such as age, gender, occupation, or cultural background, and to whom the system provides services taking into account their needs and constraints.

[0697] "Objectionable language or visual material" means language or images that are violent, sexual, offensive, or otherwise considered inappropriate or harmful to certain user groups, particularly children or sensitive individuals.

[0698] "Artificial intelligence means" refers to software or systems that use technologies such as machine learning, deep learning, natural language processing, and image recognition to analyze data, learn, and automatically perform specific tasks.

[0699] An "Internet browser extension" is a software component added to a web browser that extends the browser's functionality and enhances the user experience.

[0700] "Emotion engine means" refers to technologies and algorithms that estimate a user's emotional state from their behavior, text input, tone of voice, facial expressions, etc., and adjust the system's response based on that information.

[0701] An embodiment of the present invention relates to a system for converting internet content to be more suitable for users. The system is comprised of an artificial intelligence means, an emotion engine means, and a combination of supporting hardware and software, which are implemented as an extension of an internet browser.

[0702] This system operates as an extension to an internet browser installed on a device (personal computer, smartphone, tablet, etc.). This extension was developed using JavaScript and other web technologies, and has the function of receiving content such as text and images from web pages viewed by the user in real time. The received content is sent to an artificial intelligence means on a server via an HTTPS request. This artificial intelligence means analyzes the content using machine learning, natural language processing, and image recognition technologies, and determines whether the content is inappropriate for a specific user group.

[0703] If inappropriate content is detected, the AI ​​tools replace the text with more appropriate language or images with more benign ones: for example, offensive language is replaced with milder language, violent images with landscapes or animal images, etc. This replacement content is then sent back to the device, and the browser extension refreshes the web page.

[0704] Furthermore, this system incorporates an emotion engine means that infers the user's emotional state from their actions and inputs and provides that information to the artificial intelligence means. This allows the system to replace the content with a calmer one based on the user's emotional state, such as anger. The emotion engine uses a machine learning algorithm to evaluate the user's emotions and reflects the results in the processing of the artificial intelligence means.

[0705] For example, prompts such as "Please replace the inappropriate language in this text with language that children can easily understand" or "Please replace this image with content that is safe for children to see" are sent to the artificial intelligence means, which then analyzes and converts the content based on these requests.

[0706] The flow of the identification process will be described with reference to FIG.

[0707] Step 1: Receiving content

[0708] A browser extension running on the device receives content such as text and images from the web page the user is viewing. At this stage, the DOM of the web page is parsed and text and image data are extracted. The input is the HTML content of the web page, and the output is the extracted text and image data.

[0709] Step 2: Request content analysis

[0710] The extracted content is sent to the server via an HTTPS request. An artificial intelligence mechanism on the server receives this content and begins analyzing it. The input is the extracted text and image data, and the output is the analysis result (a decision on whether the content is inappropriate or not).

[0711] Step 3: Analyze your content

[0712] The artificial intelligence means analyzes the content of the text and images and evaluates their inappropriateness. In this process, the text is processed using natural language processing technology, and the images are processed using image recognition technology. The input is the text and image data, and the output is the inappropriateness evaluation result for each.

[0713] Step 4: Emotional Engine Adjustment

[0714] An emotion engine running on the device or server evaluates the user's emotional state and provides that information to an artificial intelligence means, which then uses that information to adjust how content is replaced. The input is the user's actions and input data, and the output is the evaluation of the user's emotional state.

[0715] Step 5: Generate replacement content

[0716] If inappropriate content is detected, the artificial intelligence means generates new content to replace it with appropriate words and images. In this process, inappropriate text is converted to appropriate words and inappropriate images are converted to appropriate images. The input is the inappropriateness assessment result and the user's emotional state, and the output is the new replaced text and images.

[0717] Step 6: Refreshing the Content

[0718] The server sends the replaced content to the device, and the web page display is updated through the browser extension. At this step, the user finally sees only the correct content. The input is the replaced new text and image data, and the output is the updated web page display.

[0719] (Application example 2)

[0720] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0721] There is content on the Internet that is considered inappropriate for certain groups of users. This content may cause psychological discomfort or misunderstanding, especially among younger users. Furthermore, depending on the user's current emotional state, even content that would normally be considered harmless may cause emotional damage. With conventional technologies, it has been difficult to filter such inappropriate content efficiently and while taking into account the user's emotional state.

[0722] The specific processing by the specific processing unit 290 of the data processing device 12 is realized by the following means.

[0723] In this invention, the server includes means for receiving website content, artificial intelligence means for determining whether the received content is inappropriate for a specific user group, means for replacing inappropriate phrases and images with phrases and images that are conveyed to the specific user group, and emotion recognition means for recognizing the emotional state of the user and adjusting how inappropriate content is replaced based on that emotional state. This allows the specific user group to use the Internet safely, while also making it possible to provide appropriate content according to the user's emotional state.

[0724] "User" refers to an individual or specific group of people who use the Internet.

[0725] "Website content" refers to all information, including text, images, and videos, that appears on a web page on the Internet.

[0726] "Artificial intelligence means" refers to systems and programs that use technologies such as machine learning, deep learning, and natural language processing to analyze data and make judgments.

[0727] "Language or imagery that is inappropriate for a particular group of users" refers to content that is deemed offensive, inappropriate, or harmful to that group based on factors such as age, gender, or cultural background.

[0728] "Means of replacing inappropriate language or images with language or images that communicate to a specific group of users" refers to technologies or methods that automatically change inappropriate content so that it can be safely viewed by the relevant group of users.

[0729] "Means for recognizing the user's emotional state" refers to technology or systems that detect and analyze the user's emotional state at that time from their facial expression, tone of voice, context, etc.

[0730] "Emotion-aware measures that adjust the replacement of inappropriate content based on emotional state" refers to technologies and processes that take into account a user's current emotions and optimize how content is replaced to provide a more positive user experience.

[0731] "Web browser extension" refers to software or programs installed to extend the functionality of an internet browser and provide additional features.

[0732] In one embodiment of the present invention, a system is provided that enables users to use the Internet safely. This system has the function of filtering website content and replacing it with appropriate content as needed, taking into account the user's emotional state in particular. This system mainly comprises an artificial intelligence means implemented as an extension of a web browser, an emotion recognition means for recognizing the user's emotional state, and a means for replacing inappropriate content.

[0733] The server runs an artificial intelligence model that uses deep learning, natural language processing, and image recognition techniques to analyze the content of incoming websites and determine whether it is inappropriate for a particular user group. If inappropriate content is detected, the server automatically replaces it with appropriate wording or images.

[0734] The device uses a camera and microphone to detect the user's emotional state in real time and transmits this information to the server. The server analyzes this emotional data and adjusts how the content is replaced, taking into account the user's current emotions. This process allows the content to be replaced with more gentle content that will soothe the user's emotions.

[0735] The hardware used is a camera, microphone, and an internet-connected computer or smart device, while the software is an artificial intelligence model developed using deep learning frameworks such as TensorFlow and PyTorch, and a program that functions as a web browser extension.

[0736] For example, a prompt such as "Please explain this to a 10-year-old child using language appropriate for that child" may be sent to an AI model. This prompt is used to instruct the AI ​​model to replace certain content that is inappropriate for children with content that is more easily understood by children. This type of functionality provides a safe environment for using the Internet.

[0737] The flow of the identification process will be described with reference to FIG.

[0738] Step 1: A user accesses a website through a web browser. At this time, the browser extension receives the content of the accessed website. The input is the website's URL or content, and the output is the content data received from the website. In this process, the web browser's API is used to retrieve the website content.

[0739] Step 2: The retrieved content is sent to a server, which uses artificial intelligence tools to determine whether the content is inappropriate for a specific user group. The input is the website content, and the output is the presence or absence of inappropriate content and its details (text or images). This step uses text analysis and image recognition techniques to identify inappropriate language and images within the content.

[0740] Step 3: The device detects the user's emotional state through a camera or microphone and sends this information to the server. The input is the user's facial expression and tone of voice, and the output is the user's emotional state (e.g., anger, joy). In this step, facial expression recognition and voice analysis technologies are used to determine the user's emotions.

[0741] Step 4: The server analyzes the received emotional data and adjusts how it replaces inappropriate content based on the user's emotional state. The input is the user's emotional state, and the output is the type of content to replace (softer words or images). This step selects the content that best matches the user's emotions and replaces the inappropriate content with an appropriate one.

[0742] Step 5: Finally, the server sends the replaced content to the user's device via the web browser extension. The input is the content to be replaced, and the output is the actual replaced website content. This process involves displaying the replaced content on the web page via the web browser's API.

[0743] Example 3

[0744] Next, a description will be given of Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0745] Some digital content may contain inappropriate language or images for certain user groups, especially children and users who need protection from sensitive content. This content may have a negative impact on viewers. Furthermore, few existing systems provide content tailored to the user's emotional state, and personalization to improve the user experience is lacking. Effective solutions to address these issues are needed.

[0746] The specific processing by the specific processing unit 290 of the data processing device 12 is realized by the following means.

[0747] In this invention, the server includes means for receiving digital content, artificial intelligence means for determining whether the received content contains phrases or images that are inappropriate for a specific user group, means for automatically replacing the inappropriate phrases or images with appropriate phrases or images, means for detecting the emotional state of the user, and means for adjusting the display of the content based on the detected emotional state. This makes it possible to automatically replace inappropriate content with appropriate content and to realize personalization of content based on the emotional state of the user.

[0748] "Digital content" refers to information or media in electronic form, such as text, images, video, or audio, that can be shared, distributed, or accessed over the Internet.

[0749] A "specific user group" refers to a group of users distinguished based on specific attributes or conditions, such as age, gender, or cultural background.

[0750] "Inappropriate language or imagery" refers to language or visual content that may be considered offensive, offensive, or harmful to certain groups of users.

[0751] "Artificial intelligence means" refers to a general term for computer programs and technologies that aim to mimic human intelligence, such as learning, reasoning, recognition, and language comprehension.

[0752] "Automatic substitution" refers to the method or function by which a program or system autonomously performs an action or process without human intervention.

[0753] "User emotional state" refers to the emotion or mood an individual is experiencing at a given time, and can range from joy, sadness, anger, surprise, etc.

[0754] "Means of detection" refers to the techniques or methods used to identify and confirm the presence of specific information or conditions.

[0755] "Means for tailoring the presentation of content" means any process or feature that changes the form, sequence, or content of information or media presented to a user.

[0756] The implementation of this invention focuses on improving content safety and user experience. The main hardware used is a server, a terminal (smartphone, tablet, PC, etc.), and an emotion detection device (a camera or microphone built into the terminal). The software core is image recognition technology, natural language processing technology, emotion analysis technology, and generative AI models.

[0757] The servers are computers with high-performance processing power, located in the cloud or in physical data centers. Specific generative AI models are installed on these servers to identify and replace inappropriate content and adjust content based on user sentiment. The specific software used includes image recognition technology and GPT-based generative AI models provided by OpenAI.

[0758] The device acts as an interface where users can upload content and receive results sent from the server, and also detects the user's emotional state through the device's built-in camera and microphone and transmits the data to the server.

[0759] For example, if a user uploads a violent image, the generative AI model processes the following prompt: "Identify inappropriate elements in the image and replace them with appropriate landscape images. Also, if the user's current emotion is joy, adjust the display to prioritize positive news articles and images." Based on this prompt, the server replaces the violent image with a landscape image and, taking into account the user's emotion of joy, selects appropriate content and sends it to the device.

[0760] This allows users to enjoy a safe and personalized content experience.

[0761] The flow of the identification process will be described with reference to FIG.

[0762] Step 1:

[0763] A user uploads digital content to a server through a terminal. At this time, the input is an image or text provided by the user, and the server receives the digital content.

[0764] Step 2:

[0765] An artificial intelligence means on the server performs a content analysis on the received digital content. This process uses image recognition and natural language processing techniques to determine whether the wording or images in the content are inappropriate for a particular user group. The input is the digital content, and the output is information about the presence or absence of inappropriate content and its content.

[0766] Step 3:

[0767] If inappropriate content is detected, the server executes a process to automatically replace it with appropriate wording or images. The input to this step is the inappropriate content, and the output is safe alternative content for the user. This replacement process is either selected from a database of pre-prepared safe content or newly generated using a generative AI model.

[0768] Step 4:

[0769] The device has the ability to detect the user's emotional state and transmits that information to the server. In this step, the user's facial expressions and voice are used as input, and the output is the analysis result of the user's emotional state (happiness, sadness, etc.).

[0770] Step 5:

[0771] The server adjusts the display of content based on the received emotional state information. This adjustment is to select content that matches the user's emotions and display it preferentially. The input is the user's emotional state information, and the output is a set of adjusted content.

[0772] By implementing this program, users will receive content that is optimized to their emotions and will be protected from inappropriate content.

[0773] (Application example 3)

[0774] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0775] Conventional digital content delivery systems provide uniform content without considering the individual emotional state of the user. This makes it difficult to provide appropriate content that reflects the user's current emotions and needs. In particular, there are limitations in providing the emotional support and experiences desired by users through digital content.

[0776] The specific processing by the specific processing unit 290 of the data processing device 12 is realized by the following means.

[0777] In this invention, the server includes an image recognition means for analyzing the user's facial expressions in real time, an emotion engine means for determining the user's emotional state based on the analysis results, and an AI means for selecting and providing content appropriate to the user's emotional state, thereby enabling the provision of personalized digital content based on the user's current emotional state.

[0778] "Digital content" refers to content that exists in electronic form, such as video, music, text, and images, that is distributed over the Internet.

[0779] "AI means" refers to systems or programs that use artificial intelligence technology to analyze data and automatically perform specific tasks.

[0780] "Means for substituting content appropriate to the user's emotional state" refers to technologies or processes that take into account the user's current emotions and automatically switch to content that matches or responds to those emotions.

[0781] "Image recognition means" refers to technology or systems that identify and analyze specific patterns or objects from image data acquired through devices such as cameras.

[0782] "Emotion engine means" refers to technology or systems that infer and analyze a user's emotional state from their facial expressions, tone of voice, choice of words, etc.

[0783] "AI means for prioritizing content selection and display" refers to artificial intelligence functions and processes that select the most appropriate content for a user and automatically adjust the display order to suit the user's preferences and circumstances.

[0784] An embodiment of the present invention relates to a system that dynamically selects and provides digital content based on a user's emotional state. This system is implemented as an application installed on a device, such as a smartphone or tablet. The device's built-in camera is used to analyze the user's facial expressions in real time, and an emotion engine determines the user's emotional state based on the data obtained through image recognition. Based on this determination, an AI means selects content that best suits the user's current emotion and displays it on the screen.

[0785] The hardware uses the built-in camera and processor of a smartphone or tablet. The software uses libraries such as OpenCV for image recognition and TensorFlow for machine learning. This system can, for example, provide uplifting and cheerful videos and music if the user is sad. Conversely, if the user is relaxed, it will prioritize the display of calming music and landscape images.

[0786] Specifically, the program's operating procedure is as follows: first, the application activates the device's camera and captures the user's facial expression. Next, the image recognition means analyzes emotions from the facial expression, and the emotion engine means determines the user's emotional state. Finally, based on this emotional state, the AI ​​means selects and displays content. This process is carried out continuously while the user is using the application.

[0787] Examples of prompts include "Generate a list of happy videos to recommend when the user is sad" and "Generate a list of videos that will make the user even happier when the user is happy." The goal is to improve the user experience by providing content that corresponds to the user's emotions.

[0788] The flow of the identification process will be described with reference to FIG.

[0789] Step 1:

[0790] The device activates the built-in camera and captures the user's facial expressions. At this stage, the video data from the camera is received as input and sent to the device as raw image data.

[0791] Step 2:

[0792] The image recognition means analyzes the captured image data and infers emotions from the user's facial expressions. In this process, a facial recognition algorithm is applied to the image data received as input, and an emotion score (e.g., happy, sad, anger, etc.) based on the user's facial expressions is generated as output.

[0793] Step 3:

[0794] The emotion engine means finally determines the user's emotional state based on the emotion scores obtained in step 2. In this step, the emotion engine means analyzes the emotion scores received as input and determines the most likely emotional state as output.

[0795] Step 4:

[0796] The AI ​​means selects appropriate digital content based on the user's emotional state determined in step 3. In this process, the content information in the database and the user's emotional state are considered as inputs, and a list of content that best suits the emotional state is generated as output.

[0797] Step 5:

[0798] The selected content is displayed on the device screen. In this final step, the content list generated in step 4 is received as input, and the content is appropriately arranged on the user interface and presented to the user.

[0799] Through these processing steps, users can receive digital content that is appropriate to their emotional state in real time, enabling them to enjoy a more personalized user experience.

[0800] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0801] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0802] Another example of generative AI is Gemini (internet search engine). <url: https: gemini.google.com ?hl="ja">) are mentioned.

[0803] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0804] [Third embodiment]

[0805] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0806] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0807] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0808] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0809] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0810] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0811] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0812] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0813] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0814] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0815] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0816] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[0817] "Example 1"

[0818] In one embodiment of the present invention, a browser plug-in is used as a means for receiving content from websites accessed by children. This plug-in receives website content in real time and sends it to AI. The AI ​​determines whether the received content contains language or images that are inappropriate for children. Inappropriate language or images are replaced with language or images that can be communicated to children. Specifically, inappropriate words are replaced with appropriate language that children can understand, and inappropriate images are replaced with images that are safe for children to view.

[0819] "Example 2"

[0820] In another embodiment of the present invention, the AI ​​is implemented as a browser plug-in. This plug-in receives website content in real time and sends it to the AI. The AI ​​determines whether the received content contains language or images that are inappropriate for children and replaces the inappropriate language or images with language and images that are acceptable for children. Specifically, inappropriate language is replaced with appropriate language that children can understand, and inappropriate images are replaced with images that are acceptable for children to view.

[0821] "Example 3"

[0822] In a further embodiment of the present invention, AI can identify and replace inappropriate content not only in text but also in images. Specifically, AI uses image recognition technology to identify the content of an image and replace inappropriate images with images that are safe for children to view. For example, violent images can be replaced with landscape images.

[0823] The processing flow of each embodiment will be described below.

[0824] "Example 1"

[0825] Step 1: When your child visits a website, a browser plugin receives the website content in real time.

[0826] Step 2: The received content is sent to the AI.

[0827] Step 3: The AI ​​determines whether the submitted content contains language or images that are inappropriate for children.

[0828] Step 4: Inappropriate language and images are replaced with language and images that children can understand. Specifically, inappropriate words are replaced with appropriate language that children can understand, and inappropriate images are replaced with images that are safe for children to see.

[0829] "Example 2"

[0830] Step 1: When your child visits a website, a browser plugin receives the website content in real time.

[0831] Step 2: The received content is sent to the AI.

[0832] Step 3: The AI ​​determines whether the sent content contains inappropriate language or images for children and replaces the inappropriate language and images with language and images that are acceptable to children. Specifically, inappropriate words are replaced with appropriate language that children can understand, and inappropriate images are replaced with images that are safe for children to view.

[0833] "Example 3"

[0834] Step 1: When your child visits a website, a browser plugin receives the website content in real time.

[0835] Step 2: The received content is sent to the AI.

[0836] Step 3: The AI ​​determines whether the submitted content contains language or images that are inappropriate for children.

[0837] Step 4: Using image recognition technology, AI will determine the content of the image and replace inappropriate images with images that are safe for children to view. For example, violent images will be replaced with landscape images.

[0838] Example 1

[0839] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0840] Modern information and communication networks contain a lot of content and visual information that is inappropriate for certain user groups, especially children. This content poses a risk of causing children to feel psychological discomfort or learn inappropriate behavior. Conventional filtering technologies have difficulty completely resolving these issues, particularly in analyzing content in real time and replacing inappropriate content with appropriate content.

[0841] The specific processing by the specific processing unit 290 of the data processing device 12 is realized by the following means.

[0842] In this invention, the server includes means for receiving content on an information communication network accessed by a user in real time, means for transmitting the received content to an information processing system, an information processing system for analyzing and determining whether the transmitted content contains expressions or visual information that are inappropriate for a specific user group, and means for automatically converting expressions or visual information that are determined to be inappropriate into expressions or visual information that are appropriate for the specific user group. This makes it possible to increase safety when a specific user group uses the information communication network and to protect them from inappropriate content.

[0843] "Information and communications network" is a general term for systems that exchange information through the Internet and other digital communications means.

[0844] "Content" means information or entertainment in digital form, such as websites, videos, images, or text.

[0845] "Means of receiving in real time" refers to technologies and methods that capture and process information the moment a user accesses it.

[0846] An "information processing system" is a collection of hardware and software that analyzes, processes, and transforms received data.

[0847] A "particular user group" is a collection of users distinguished based on particular attributes, age, interests, etc.

[0848] "Inappropriate language or visual information" is information such as words or images that may cause psychological discomfort to the user group or encourage inappropriate behavior or thinking.

[0849] "Automatic conversion means" refers to techniques or methods that automate the process of replacing inappropriate content with appropriate content based on specific criteria or rules.

[0850] The embodiment of this invention mainly uses an information processing system, a user's terminal, and a browser plug-in as an extension. The information processing system is configured on a server that includes a generative AI model, and the user's terminal is equipped with a browser and plug-in for transmitting content to the information processing system in real time.

[0851] Information processing systems use specific generative AI models, such as OpenAI's GPT-4 and image processing-specific DALL·E. These models are capable of identifying inappropriate content in both text and images and converting it to appropriate content. This process is performed automatically based on the content sent from the device.

[0852] A browser used by the user to browse information and communication networks is installed on the terminal, and a plug-in based on the invention is added to the browser. The plug-in has the role of capturing content accessed by the user and transmitting it to an information processing system. The transmitted content is analyzed in real time by a generative AI model on a server.

[0853] For example, when a user accesses text or images containing inappropriate language, the plugin captures this content and sends it to the server. The generative AI model on the server analyzes the content using prompts such as: "This website contains language that is inappropriate for children. Please convert it to appropriate language." or "This image is inappropriate for children. Please replace it with an image that is safe for children and fits the theme." These prompts act as instructions for converting the text or image to an appropriate one. The converted content is then sent back to the device, updating the content the user sees.

[0854] This approach aims to enable certain user groups, especially children, to use information and communication networks safely.

[0855] The flow of the identification process will be described with reference to FIG.

[0856] Step 1: A user accesses content on an information and communications network through a browser. At this time, a browser plug-in installed on the device starts up and captures the content the user is viewing. This plug-in collects data on all content, including text, images, and other media files, in real time. The input is the content of the web page accessed by the user, and the output is the collected content data.

[0857] Step 2: The captured content data is sent to the server by the browser plug-in. The information processing system on the server uses a generative AI model to analyze the received content data. This process determines whether the content contains inappropriate language or visual information for a specific user group. The input is the content data sent from the device, and the output is the analysis result (identification of inappropriate content).

[0858] Step 3: The generative AI model on the server automatically converts inappropriate content into appropriate expressions and visual information. For example, inappropriate words are replaced with appropriate words, and inappropriate images are replaced with acceptable images. The input to this conversion process is the inappropriate content identified by the analysis results, and the output is the converted appropriate content.

[0859] Step 4: The converted content is sent back to the device. The device's browser plugin updates the original content with the converted content and displays it on the web page the user is viewing. The input in this step is the converted content sent from the server, and the output is the updated web page the user views.

[0860] These steps enable users to safely use information and communication networks without coming into contact with inappropriate content, and each step aims to increase online safety for vulnerable user groups, especially children.

[0861] (Application example 1)

[0862] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0863] There is growing concern about the impact that inappropriate language and images in digital content can have on users, especially children. The Internet provides an environment where age-inappropriate content is easily accessible, and there is a problem that this content can have a psychological and emotional impact. In particular, there is a demand for technology that can instantly convert such content into appropriate content when users encounter it, providing a safe browsing experience.

[0864] The specific processing by the specific processing unit 290 of the data processing device 12 is realized by the following means.

[0865] In this invention, the server includes a means for acquiring digital content in real time, a means for transmitting the acquired content to a generative AI model to evaluate the appropriateness of the content, and a means based on the generative AI model for automatically converting inappropriate expressions into appropriate expressions that are easy for users to understand. This makes it possible to detect inappropriate content in real time and automatically convert it into appropriate expressions. As a result, a safe digital content viewing environment can be provided for users.

[0866] "Digital content" is a general term for information such as text, images, and videos distributed over the Internet.

[0867] "Means of real-time acquisition" refers to technologies and methods for acquiring and analyzing content the moment a user accesses it.

[0868] "Means of sending to the generative AI model" refers to the technology or method for sending the acquired content to the artificial intelligence model for analysis and processing.

[0869] "Automatically converting inappropriate language into user-friendly language" refers to the process by which a generative AI model identifies inappropriate language and images within content and replaces them with appropriate content based on age and level of understanding.

[0870] "User" means an individual who views or uses digital content.

[0871] "Server" refers to a computer system or software that provides data or services over the Internet.

[0872] An "application" is a software program designed for a specific purpose.

[0873] In an embodiment of the present invention, the system mainly consists of a server, a terminal (such as a smartphone, tablet, smart glasses, or head-mounted display), and a user (particularly a child). The server hosts a generative AI model, and the terminal runs a browser or dedicated application for accessing digital content on the Internet. The system has the function of acquiring digital content accessed by the terminal in real time and sending that content to the generative AI model on the server. The generative AI model evaluates the appropriateness of the sent content, and if it contains inappropriate language, automatically converts it into appropriate language that is easy for the user to understand.

[0874] This system utilizes browser plugins and applications written in programming languages ​​such as JavaScript and Python that run on the device, and generative AI models such as TensorFlow, OpenAI's GPT, and DALL-E that run on the server. This software runs on the hardware and efficiently processes the acquisition, analysis, and transformation of digital content.

[0875] For example, if a child accesses a news site containing violent images, the system captures the image in real time and sends it to the server. The generative AI model processes the image based on the prompt, "Please convert this image into one that is safe and easy for children to understand," and generates an alternative image that does not contain violent elements and displays it in place of the original content. This process allows users to enjoy a safe digital content viewing environment.

[0876] The flow of the identification process will be described with reference to FIG.

[0877] Step 1: Device accesses digital content

[0878] When a user accesses a specific website on the Internet using a device, a browser plug-in or application running on the device retrieves digital content (text, images, video, etc.) in real time. The input is the URL of the website accessed by the user and the HTML code of the page, and the output is the content data of the page.

[0879] Step 2: Send the content to the server for evaluation.

[0880] The acquired digital content is sent to a generative AI model on a server for evaluation. This process has the acquired digital content as input and the content received by the generative AI model as output.

[0881] Step 3: The generative AI model analyzes the content and identifies inappropriate content

[0882] The generative AI model on the server analyzes the submitted content and identifies inappropriate language and images. The input is the content submitted in step 2, and the output is a list of inappropriate content and identification information. This step involves data processing or data calculations that use specific keywords or image recognition techniques to detect inappropriate content.

[0883] Step 4: Convert inappropriate content to appropriate content

[0884] The identified inappropriate content is automatically transformed into appropriate wording and images that are easy for children to understand. This process uses a generative AI model, which takes the inappropriate content identified in step 3 as input and produces the appropriate content as output. The generative AI model receives the inappropriate content and performs data calculations to transform it into appropriate content based on a prompt such as, "Please transform this image into something that is safe and easy for children to understand."

[0885] Step 5: Send the converted content to your device and view it

[0886] Finally, the server sends the appropriate converted content to the device so that it can be displayed on the web page the user accessed. The input is the appropriate content generated in step 4, and the output is the display of that content on the user's device. This step involves sending data from the server to the device and processing the data display on the device.

[0887] Example 2

[0888] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0889] There is a lot of inappropriate content on the Internet that children should not access. It is not realistic for parents to constantly monitor, and existing filtering technologies may not be able to completely block it. In particular, when it comes to content that includes both text and images, there is still a lack of technology that can properly evaluate this in real time and automatically convert it into content that is safe for children.

[0890] The specific processing by the specific processing unit 290 of the data processing device 12 is realized by the following means.

[0891] In this invention, the server includes a means for capturing web content in real time and transmitting it over a secure communication channel, a means for evaluating the transmitted content using a generative AI model equipped with natural language and image analysis technology, and a means for automatically replacing inappropriate language or images with language or images that are more user-friendly and acceptable to users, thereby significantly improving safety when children use the Internet.

[0892] "User" refers to an individual or group who accesses web content through an information terminal.

[0893] "Information terminal" refers to a device (such as a personal computer, smartphone, or tablet) that can connect to the Internet and browse websites.

[0894] "Web content" refers to all information such as text, images, and videos that appear on web pages on the Internet.

[0895] "Real-time capture" refers to detecting and capturing web content instantly at the moment a user views it.

[0896] A "secure communication channel" refers to a means of communication that uses security technologies such as encryption to prevent third parties from intercepting or tampering with data when sending or receiving it.

[0897] "Analysis Server" refers to a computer system used to analyze and process transmitted web content.

[0898] A "generative AI model" refers to an artificial intelligence model that has the ability to generate new text or images based on input data.

[0899] "Natural language and image analysis technology" refers to technology for understanding and analyzing text data and technology for identifying and analyzing the content of images.

[0900] "Inappropriate language or images" refers to content that is deemed inappropriate or difficult to understand for certain groups of users (especially children) based on age or social norms.

[0901] "Safe images" refer to images whose content is deemed safe for viewing by a specific group of users (especially children).

[0902] "Plug-in format" refers to a software module that can be added to existing software (in this case, a browser) to expand its functionality.

[0903] The embodiment of this invention mainly involves an information terminal, an analysis server, and a communication protocol between them. A web browser is installed on the information terminal, and a plug-in is embedded in the browser that has the function of capturing web content in real time and transmitting it to the analysis server via a secure communication path. The plug-in is developed using JavaScript and other web technologies.

[0904] The analysis server is built on a high-performance computer system and has software installed that includes a generative AI model. This server receives web content sent from the information terminal and analyzes the content using natural language processing and image analysis techniques. If inappropriate language or images are detected, the AI ​​model automatically replaces them with appropriate content. This process uses deep learning frameworks such as TensorFlow and PyTorch. The replaced content is then sent back to the information terminal and displayed to the user via a plugin.

[0905] For example, consider a web page containing the text "This movie contains violent scenes intended for adults" along with a screenshot of that scene. The plugin captures this text and image and sends them to an analysis server. The AI ​​model on the server then replaces the text with child-friendly phrases such as "This movie contains scary scenes, so please watch with an adult," and replaces the image with a more innocuous image, such as the movie logo. These conversion processes are based on natural language processing and image recognition technology, and are intended to help children use the internet safely.

[0906] This invention enables secure communication between the information terminal and the analysis server while filtering web content in real time and converting it into a form that is safe for children, allowing parents to improve the safety of their children when using the Internet.

[0907] The flow of the identification process will be described with reference to FIG.

[0908] Step 1: Capturing web content

[0909] A browser plug-in running on an information terminal captures the content (text and images) of the web page the user is viewing in real time. The input to this step is the content of the web page the user is viewing, and the output is content data processed into a data format that can be sent to the server for analysis. The plug-in performs DOM analysis and extracts all text and image data from the page.

[0910] Step 2: Submit your content

[0911] The captured content is transmitted from the information terminal to the analysis server via a secure communication path. The input of this step is the content data processed in step 1, and the output is the content data that has reached the analysis server. The HTTPS protocol is used for transmission, ensuring the confidentiality and integrity of the data.

[0912] Step 3: Analyze and evaluate content

[0913] The generative AI model on the analysis server analyzes and evaluates the submitted content using natural language processing and image analysis technologies. The input to this step is the content data received in step 2, and the output is the content data after inappropriate expressions or images have been detected and replaced with appropriate content. The AI ​​model identifies inappropriate content and automatically replaces it with appropriate alternative text or images.

[0914] Step 4: Return the replacement content

[0915] The replaced content is sent back from the analysis server to the information terminal. The input of this step is the replaced content data generated in step 3, and the output is the content ready to be displayed to the user by the information terminal's browser plug-in. The return also uses the HTTPS protocol to maintain data security.

[0916] Step 5: Displaying Content

[0917] The device's browser plug-in displays the returned content in the user's browser. The input to this step is the content data returned in step 4, and the output is the appropriate content rendered on the web page the user views. The plug-in embeds the replaced text and images in their original locations, providing the user with a secure browsing environment.

[0918] (Application example 2)

[0919] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0920] The Internet contains a large amount of linguistic and visual content that is considered inappropriate for certain groups of users. In particular, in environments where children have free access, there is a risk that they may come into contact with harmful content. Previous technology has had the difficulty of efficiently filtering inappropriate content and automatically replacing it in a manner appropriate to the user's level of understanding. By solving this issue, it is necessary to provide an Internet environment where certain groups of users, especially children, can safely access information.

[0921] The specific processing by the specific processing unit 290 of the data processing device 12 is realized by the following means.

[0922] In this invention, the server includes a means for receiving content from an information distribution medium accessed by a user, an artificial intelligence means for determining whether the received content contains linguistic or visual expressions that are inappropriate for a specific user group, and a means for replacing the inappropriate linguistic or visual expressions with linguistic or visual expressions that are appropriate for the specific user group. This enables a specific user group, particularly children, to use the Internet in an environment where they can access information in a format that suits their level of understanding without being exposed to inappropriate content.

[0923] "Information distribution medium" refers to websites and applications that publish content on the Internet and are accessible to the general public.

[0924] "Content" refers to information or expressions such as text, images, video, and audio that are provided through an information distribution medium.

[0925] A "specific user group" refers to a group of users with specific characteristics, defined by age, gender, cultural background, etc.

[0926] "Inappropriate verbal or visual content" refers to language or images that may be offensive, sexual, violent, or otherwise disturbing to certain audiences, and that may be considered inappropriate for exposure to certain audiences.

[0927] "Artificial intelligence means" refers to systems or processes that use technologies such as machine learning, natural language processing, and image recognition to analyze content and make judgments.

[0928] "Information delivery media user interface extension" means a software component that is installed to extend the functionality of a web browser or application and provide additional features.

[0929] "Appropriate verbal or visual substitution" refers to a process or algorithm that replaces inappropriate content with verbal or visual substitution that is acceptable, educational, or neutral to a particular audience.

[0930] In an embodiment of the present invention, the server executes a program including artificial intelligence to receive and analyze content sent from information distribution media accessed by users. The program has the function of detecting linguistic and visual expressions that are deemed inappropriate for a specific user group and automatically replacing them with appropriate expressions. This process uses natural language processing and image recognition technologies. The hardware used is a high-performance server and storage system, and the software includes machine learning libraries such as TensorFlow and PyTorch.

[0931] On the terminal side, a program implemented as a user interface extension of the information delivery medium runs and displays the processed content received from the server. This extension is developed using JavaScript and other web technologies and is designed to display only content appropriate for a specific user group.

[0932] This system allows users to have a safer browsing experience. For example, when a child visits a website, inappropriate words are replaced with easier-to-understand synonyms, such as "clumsy," and inappropriate images are replaced with educational illustrations or landscape images. This process provides a safer environment for specific groups of users to use the Internet. Examples of prompts include, "Please translate this text into language that a 5-year-old can understand," or "Please replace this image with one that is safe for children to view."

[0933] The flow of the identification process will be described with reference to FIG.

[0934] Step 1: Receiving and Preprocessing Content

[0935] The server receives content sent from the information distribution medium accessed by the user. At this time, web page data composed of HTML, CSS, JavaScript, etc. is input. The server analyzes this data and separates it into text and images. Through this process, text data and image data are extracted and prepared as input for the next processing step.

[0936] Step 2: Detect inappropriate content

[0937] The extracted text data is analyzed using natural language processing techniques to detect inappropriate language. At the same time, image recognition techniques are applied to image data to detect inappropriate visual content. This process uses a generative AI model that leverages machine learning libraries to evaluate the appropriateness of both text and images. The input is the text and images extracted from the web page, and the output is a list of content deemed inappropriate.

[0938] Step 3: Replacing the content

[0939] Text and images that are deemed inappropriate are automatically replaced with language and visuals that are appropriate for a specific user group. The generative AI model operates based on prompts to convert inappropriate content into appropriate content. For example, text is replaced based on the prompt, "Please translate this text into language that a 5-year-old child can understand." Images are also replaced with appropriate images based on the prompt, "Please replace this image with an image that is safe for children to view." The input is inappropriate content, and the output is content that has been replaced with appropriate language.

[0940] Step 4: Submit your edited content

[0941] The replaced content is sent to the user's device through the information delivery medium's user interface extension. The server generates web page data including the edited text and images and sends it to the device. The device renders the received data in the browser and displays it to the user. This process allows the user to view a web page that contains only safe content, with the inappropriate content removed.

[0942] Example 3

[0943] Next, a third embodiment of the third embodiment will be described. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0944] In today's society, where digital content is widespread, certain user groups, especially children, are at increased risk of being exposed to inappropriate content. Violent, sexual, and other harmful content is easily accessible on the Internet, threatening the healthy development and psychological safety of certain user groups. Therefore, it is urgent to effectively restrict the distribution of inappropriate information via digital content and ensure that certain user groups can access digital content in a safe environment.

[0945] The specific processing by the specific processing unit 290 of the data processing device 12 is realized by the following means.

[0946] In this invention, the server includes a means for uploading digital data, an AI means for determining whether the uploaded digital data contains content inappropriate for a specific user group, and a means for replacing the digital data containing inappropriate content with content appropriate for the specific user group. This enables the specific user group to obtain information in a safe and healthy digital environment without being exposed to inappropriate content on the Internet. The AI ​​running on the server automatically identifies inappropriate content in both text and images and replaces it with appropriate content, thereby ensuring the safety and appropriateness of digital content for the specific user group.

[0947] "Digital data" is a general term for information represented in digital form, such as images, text, audio, and video.

[0948] "Means of uploading" refers to the act of a user sending digital data to a server or cloud via the Internet, as well as the technology and process for doing so.

[0949] "AI means" refers to methods or systems that utilize artificial intelligence technology to automatically perform certain tasks, in this case including the ability to identify and replace inappropriate content.

[0950] "Inappropriate Content" refers to sexual, violent or other potentially offensive information or images that may be considered harmful to certain user groups, particularly children.

[0951] A "particular user group" refers to a group of users who share common characteristics such as a particular age range, interests, or sensitivities, and in the present invention, children are the main group of users.

[0952] "Web Service or Application" means a service or program delivered over the Internet that allows users to access certain functionality or information.

[0953] "Appropriate content replacement" refers to processes or techniques that analyze inappropriate digital data and replace that content with information or images that are appropriate and not harmful to a particular user group.

[0954] The embodiment of the present invention relates to the operation of a system that mainly involves uploading digital data, evaluating the appropriateness of that data, and replacing inappropriate data. This system is composed of three parties: a server, a terminal, and a user.

[0955] The server is a high-performance computer system equipped with data analysis capabilities that utilize artificial intelligence (AI). The AI ​​running on this server uses specific libraries and frameworks (e.g., TensorFlow, PyTorch) to evaluate the content of uploaded images and text. The AI's analytical capabilities include image recognition and natural language processing technologies, which identify inappropriate elements within digital data.

[0956] A terminal is a device connected to the Internet that provides an interface for users to upload digital data. Terminals include smartphones, tablets, personal computers, etc.

[0957] Users are people who use this system to upload and view digital content. Users send digital data to the server through specific websites or applications. The server automatically analyzes the data and replaces any inappropriate content with appropriate content.

[0958] For example, if an image uploaded by a user contains violent content, AI running on the server will determine that the image is inappropriate and automatically replace it with a safe alternative image (e.g., a landscape). An example of a prompt might be, "Analyze the content within the image to determine whether it contains inappropriate elements, and if so, automatically replace it with a safe image from a specified category (e.g., a natural landscape)."

[0959] This embodiment allows users to enjoy content in a safe digital environment without coming into contact with inappropriate content. The present invention is implemented through the interaction of a server, a terminal, and a user.

[0960] The flow of the identification process will be described with reference to FIG.

[0961] Step 1: The user uses the terminal to upload digital data (images or text) to the system. The input of this step is the digital data selected by the user, and the output is a data file sent to the server. The terminal collects the data selected by the user and processes it to send to the server.

[0962] Step 2: The server receives the uploaded digital data and analyzes its content using AI tools. The input at this stage is the uploaded data, and the output is the analysis result of the data content (whether it contains inappropriate content or not). The AI ​​on the server processes the received data and performs data processing and data calculations to identify inappropriate elements.

[0963] Step 3: If the AI ​​means determines the data is inappropriate, the server replaces it with appropriate content. The input to this step is the inappropriate data, and the output is the replaced data. The server processes the inappropriate data and replaces it with appropriate data (e.g., an image from a secure image library).

[0964] Step 4: The replaced data is sent from the server to the user via the terminal. The input at this stage is the replaced data, and the output is the data displayed in a format that the user can view. The server sends the converted data to the terminal, which then processes it to display it on the user's screen.

[0965] This process allows users to enjoy content in a safe digital environment without being exposed to inappropriate content. The system can effectively identify inappropriate data and automatically replace it with appropriate content.

[0966] (Application example 3)

[0967] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0968] In today's digital society, content accessed via the Internet by certain age groups, particularly children, often contains inappropriate language and images. This inappropriate content poses a risk of psychological harm to children. While conventional filtering technologies are effective in blocking inappropriate text content, they have difficulty detecting inappropriate images and are unable to replace inappropriate content with appropriate ones. This invention aims to provide a safe browsing environment by automatically detecting inappropriate language and images in digital content accessed by certain age groups and replacing them with appropriate language and images.

[0969] The specific processing by the specific processing unit 290 of the data processing device 12 is realized by the following means.

[0970] In this invention, the server includes a means for receiving digital content accessed through an information terminal, an AI means for determining whether the received digital content contains expressions or images that are inappropriate for a specific age group, and a means for replacing the inappropriate expressions or images with expressions or images that are appropriate for the specific age group. This ensures the safety of digital content and makes it possible to provide only content that is safe for viewing by a specific age group. The AI ​​means can accurately determine and replace inappropriate content not only in text but also in images, so it can also address issues with image content that were difficult to address with conventional technology.

[0971] An "information terminal" is an electronic device that connects to the Internet or other networks to receive and display digital content. Examples include smartphones, tablets, and personal computers.

[0972] "Digital content" refers to information content expressed in digital form, such as text, images, video, and audio. It is distributed via the Internet and can be accessed and viewed on an information terminal.

[0973] "Specific age group" refers to an age range that requires special protection when viewing content, particularly young people such as children and teenagers.

[0974] "Inappropriate language or images" refers to text, images, or other media content that is inappropriate for a particular age group to view or that may cause psychological harm, such as violent, sexual, or discriminatory content.

[0975] "AI means" means a system or program that uses artificial intelligence technology to analyze the content of digital content and determine whether the content is appropriate or inappropriate based on specific criteria. Such means include machine learning and image recognition technology.

[0976] In an embodiment of the present invention, a server receives digital content accessed through an information terminal, determines whether the content is inappropriate for a specific age group using AI means, and replaces inappropriate expressions or images with appropriate ones as necessary, in order to provide digital content appropriate for a specific age group. This system functions as an application installed on the information terminal, and monitors and appropriately converts the content in real time as the user of the terminal views the digital content.

[0977] The server uses artificial intelligence techniques to determine inappropriate content in the text and images within the received digital content. The AI ​​means, including image recognition and natural language processing techniques, assess the safety of the content. If inappropriate content is detected, the AI ​​means uses a generative AI model to automatically replace the content with content appropriate for a specific age group.

[0978] The hardware used is information terminals, such as smartphones, tablets, and personal computers, while the software utilizes generative AI models (e.g., OpenAI's GPT series) and image recognition technologies (e.g., Google Cloud Vision API).

[0979] As a concrete example, consider a situation where a user is using a video streaming service for children. When an inappropriate advertisement is inserted into the video, the AI ​​means instructs the generative AI model using a prompt sentence such as "Please replace the image containing violent content with a landscape image that is safe for children to view," and replaces the inappropriate advertisement with a landscape image. This process is intended to ensure that the user using the device can only view safe content.

[0980] The flow of the identification process will be described with reference to FIG.

[0981] Step 1: A user accesses digital content using an information terminal. At this time, the user's access request is input, and the target digital content is displayed on the terminal as output. Based on the user's access request, the terminal obtains the selected content and displays it on the screen.

[0982] Step 2: The AI ​​means on the server receives the digital content and performs a content analysis. The input is the digital content obtained in step 1, and the output is an analysis result regarding the content of the content. The analysis result includes the presence or absence of inappropriate content in the text and images. The AI ​​means uses image recognition and natural language processing techniques to detect inappropriate elements in the content.

[0983] Step 3: If inappropriate content is detected, the AI ​​means uses a generative AI model to replace the inappropriate content with appropriate content. The input is the inappropriate content detected in step 2, and the output is the appropriate replacement content. This process identifies inappropriate images and text and automatically converts them to appropriate content based on prompts such as "Please replace images containing violent content with landscape images that are safe for children to view."

[0984] Step 4: The converted content is sent to the user's information terminal and displayed. The input is the appropriate content generated in step 3, and the output is the updated content displayed on the user's terminal. The server provides the converted content to the user, and the terminal receives this content and displays it to the user. This ensures that the user can only view safe content.

[0985] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0986] "Example 1"

[0987] As one embodiment of the present invention, there is provided a system including: means for receiving content from websites accessed by children; AI means for determining whether the received content contains phrases or images that are inappropriate for children; means for replacing the inappropriate phrases and images with phrases and images that are conveyable to children; and an emotion engine for recognizing the emotions of a user, for example, from the user's facial expressions or tone of voice.

[0988] "Example 2"

[0989] In another embodiment of the present invention, a system is provided in which an emotion engine adjusts how inappropriate language and images are replaced based on the user's emotions. For example, if the user feels angry, the emotion engine conveys that information to an AI, which then replaces the user's anger with more gentle language and images to reduce the user's anger.

[0990] "Example 3"

[0991] In yet another embodiment of the present invention, a system is provided in which an emotion engine adjusts how content is displayed based on the user's emotions. For example, if the user feels happy, the emotion engine conveys that information to the AI, which then preferentially displays content that makes the user happy.

[0992] The processing flow of each embodiment will be described below.

[0993] "Example 1"

[0994] Step 1: Receive content from websites your child visits.

[0995] Step 2: The AI ​​determines whether the received content contains language or images that are inappropriate for children.

[0996] Step 3: Replace inappropriate language and images with language and images that are child-friendly.

[0997] Step 4: The emotion engine recognizes the user's emotion. This emotion engine recognizes the user's emotion from, for example, the user's facial expression or tone of voice.

[0998] "Example 2"

[0999] Step 1: Recognize the user's emotions with the emotion engine.

[1000] Step 2: The emotion engine adjusts how inappropriate language and images are replaced based on the user's emotions. For example, if the user feels angry, the emotion engine relays that information to the AI.

[1001] Step 3: The AI ​​defuses the user's anger by replacing the image with more gentle words or images.

[1002] "Example 3"

[1003] Step 1: Recognize the user's emotions with the emotion engine.

[1004] Step 2: The emotion engine adjusts how content is displayed based on the user's emotions. For example, if the user feels happy, the emotion engine conveys that information to the AI. Step 3: The AI ​​prioritizes displaying content that makes the user feel happy.

[1005] Example 1

[1006] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1007] The content on the Internet is diverse and may contain content that is inappropriate for certain user groups, especially children. This can have a negative impact on users' feelings or lead to misunderstandings. In addition, there is a lack of technology to dynamically adjust content based on user responses, making it difficult to provide an optimized Internet experience for each individual user.

[1008] The specific processing by the specific processing unit 290 of the data processing device 12 is realized by the following means.

[1009] In this invention, the server includes means for acquiring digital content from devices connected to the Internet in real time, artificial intelligence means for analyzing the acquired digital content and determining whether the content is inappropriate for a specific user group, means for replacing the determined inappropriate content with appropriate content for the specific user group, and emotion recognition means for capturing user reactions in real time and further optimizing the digital content based on the reactions, thereby enabling the identification and replacement of inappropriate content and the optimization of content based on user emotions.

[1010] An "Internet-connected device" is an electronic device that has the ability to access the Internet and is capable of obtaining web content and sending and receiving data.

[1011] "Digital content" is a general term for information expressed in digital form, such as text, images, audio, and video.

[1012] "Real-time" means that the processing or reaction occurs almost simultaneously with actual time, without delay.

[1013] "Artificial intelligence means" refers to systems or programs that utilize technologies such as machine learning and deep learning to learn, make judgments and make inferences like humans.

[1014] A "specific user group" is a group of users distinguished based on specific criteria such as age, gender, or interests.

[1015] "Inappropriate language or visual material" is content, such as text or images, that is deemed offensive or unsuitable for viewing by a particular user group.

[1016] "Replace" means to remove an element and substitute another element to take its place or role.

[1017] "Emotion recognition means" refers to technology or systems that identify and analyze people's emotions from facial expressions, tone of voice, etc.

[1018] "Optimization" is the process of adjusting performance or effectiveness to the best possible level based on specific criteria.

[1019] A specific embodiment of the present invention will now be described, which aims to optimize digital content on the Internet for a specific user group, particularly children, in a safe and educational manner.

[1020] First, a plug-in is installed on the device to capture digital content accessed through a web browser in real time. This plug-in has the function of capturing text and images from the web page the user is viewing and sending them to a server. This plug-in is compatible with commonly used web browsers such as Google Chrome and Mozilla Firefox.

[1021] On the server side, artificial intelligence means analyze the digital content. This analysis is performed using generative AI models to determine whether text or images contain inappropriate language or visual material for a specific user group. These artificial intelligence means use advanced models such as OpenAI's GPT and Google's BERT. If inappropriate content is detected, it is immediately replaced with appropriate content. For example, offensive language is replaced with more moderate language, and inappropriate images are replaced with educational images.

[1022] Additionally, the server is equipped with an emotion recognition system to capture users' reactions in real time. This system analyzes their facial expressions and vocal tone to identify emotional states such as joy or confusion. This analysis uses technologies such as Microsoft's Face API and Google's Cloud Speech-to-Text. Based on the emotional feedback, the digital content can be further optimized to provide a more appropriate experience for the user.

[1023] An example prompt might be, "Is this text / image appropriate for children?" The AI ​​then analyzes whether the content is safe and educational for children and adjusts it as needed.

[1024] This allows the server to analyze digital content in real time, identify inappropriate content, and replace it with appropriate content. It also recognizes user sentiment and optimizes content accordingly, providing a safer and more educational internet experience for specific user groups.

[1025] The flow of the identification process will be described with reference to FIG.

[1026] Step 1: Get content

[1027] The browser plug-in installed on the device receives the text and images of the page in real time when the user visits a website, and sends this content to a server for analysis.

[1028] Input: Web page text and images

[1029] Data processing: Collecting text and images from web pages

[1030] Output: Text and image data sent to the server

[1031] Step 2: Analyze your content

[1032] The server-based AI analyzes the received text and images to determine whether they contain content that is inappropriate for a particular user group, using a generative AI model.

[1033] Input: Text and image data

[1034] Data manipulation: AI-based identification of inappropriate content

[1035] Output: A list of content that was flagged as inappropriate

[1036] Step 3: Replacing the content

[1037] If content is found to be inappropriate, the server replaces it with content appropriate for a particular user group, using a database of appropriate text and images for this replacement process.

[1038] Input: List of content flagged as inappropriate

[1039] Data manipulation: replacing inappropriate content with appropriate content

[1040] Output: Replaced content

[1041] Step 4: Optimize your content

[1042] The server has an emotion recognition means that captures users' reactions in real time, and further optimizes the content based on this feedback. In this process, user reactions are analyzed using emotion recognition technology.

[1043] Input: User's emotional feedback (facial expressions and tone of voice)

[1044] Data Processing: Analysis of User Reactions Using Emotion Recognition Technology

[1045] Output: Content optimization information

[1046] Step 5: Displaying optimized content

[1047] Finally, the optimized content is sent back from the server and displayed to the user through their device, a process that allows users to experience safer and more educational content.

[1048] Input: Replaced content, optimization information

[1049] Data processing: Preparing content for display on the device

[1050] Output: The optimized content that is displayed to the user

[1051] (Application example 1)

[1052] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1053] The Internet is home to a large amount of content that is inappropriate for children, and it is easily accessible. Furthermore, there is a lack of systems that provide appropriate content based on children's emotions and reactions. This increases the risk of children being negatively influenced. This invention aims to address the need for a system that provides an environment where children can safely enjoy digital content and can recommend appropriate content based on their emotions.

[1054] The specific processing by the specific processing unit 290 of the data processing device 12 is realized by the following means.

[1055] In this invention, the server includes means for receiving digital content accessed by children, AI means for determining whether the received content contains phrases or images that are inappropriate for children, means for replacing the inappropriate phrases and images with phrases and images that are conveyable to children, and means including an emotion engine for recognizing the emotions of the user. This allows children to safely enjoy Internet content and further makes it possible to recommend appropriate content according to their emotions and reactions.

[1056] "Digital content accessed by children" refers to information such as text, images, audio, and video provided on the Internet that is intended to be viewed or used by minors.

[1057] "Inappropriate language and images" refers to content such as sexual, violent, or discriminatory language that may have a negative impact on the healthy development of young people.

[1058] "AI tools" is a general term for algorithms and software that use artificial intelligence technology to analyze data and perform specific tasks.

[1059] "Replacement measures" are actions or processes that replace content that is deemed inappropriate with other content that is safe for minors to view.

[1060] An "emotion engine that recognizes user emotions" is a technology or system that estimates a person's emotional state from their facial expressions, tone of voice, behavioral patterns, etc.

[1061] A "browser plug-in" is a software component that is added to a web browser to extend its functionality, making certain features and services available directly within the browser.

[1062] A specific implementation method for the embodiment of the present invention will be described below. The system of the present invention aims to enable children to safely use Internet content and to recommend content according to the user's emotions.

[1063] The server will be developed using Python and libraries such as TensorFlow, OpenCV, and PyTorch. This software provides AI tools to detect inappropriate language and images in digital content and automatically replace them with ones that are appropriate for children. The server also includes an emotion engine that recognizes the user's emotions, inferring emotions from facial expressions and tone of voice collected via the device's camera and microphone.

[1064] A device is any device that can connect to the internet, such as a smartphone, tablet, smart TV, etc. The browser plug-in running on the device transmits the digital content accessed by the user to a server in real time and adjusts the display of the content based on feedback from the server.

[1065] When users use this system to browse the internet, they access safe content that has been automatically filtered, and if the user's sentiment is positive, similar content is recommended, and if the sentiment is negative, content from a different genre is recommended.

[1066] As a concrete example, there is a scenario in which a parent uses this system when showing a video to their child. Prompts include "a video filtering function that automatically converts content into one suitable for children to watch" and "a function that reads emotions from a child's facial expressions and recommends content."

[1067] This approach improves safety for children when they use the internet while providing them with a personalized, emotionally-driven content experience.

[1068] The flow of the identification process will be described with reference to FIG.

[1069] Step 1: The terminal receives the digital content that the user wants to access.

[1070] When a user accesses digital content on the Internet through a browser, the device receives information about the content (text, images, video, etc.) This information becomes input that is sent to the server for processing in the next step.

[1071] Step 2: The device sends the received content to the server.

[1072] The device then sends the received digital content to a server, which then uses it as input data for AI analysis.

[1073] Step 3: The AI ​​on the server analyzes the content.

[1074] The AI ​​means installed on the server analyzes the received content and determines whether it contains inappropriate language or images. If this analysis identifies certain elements in the content as inappropriate for children, information is generated to replace them. The output of this process is the location of the content to be replaced and information on the appropriate content to replace it.

[1075] Step 4: The server sends a content replacement instruction to the terminal.

[1076] Based on the results of the AI ​​analysis, the server sends specific replacement instructions to the device, including information on which content should be replaced and how.

[1077] Step 5: The device replaces the content.

[1078] The device then follows the replacement instructions received from the server and replaces the currently displayed content with an appropriate one. This operation allows the user to view safe content without being exposed to inappropriate content.

[1079] Step 6: The device recognizes the user's emotions.

[1080] The device uses a built-in camera and microphone to recognize the user's emotions from their facial expressions and tone of voice, and this information is sent to a server for content recommendation based on their emotions.

[1081] Step 7: The server recommends content based on the user's sentiment.

[1082] The server analyzes the user's emotion data sent from the terminal and recommends content that best suits that emotion. This recommendation information is sent to the terminal and presented to the user.

[1083] This processing flow provides an environment in which children can safely use digital content, and also enables a personalized content experience that responds to the user's emotions.

[1084] Example 2

[1085] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1086] The Internet contains a large amount of content that is considered inappropriate or harmful to certain user groups. Websites that may be accessed by children or sensitive individuals are particularly at risk of being negatively impacted by inappropriate language or images. There is also a growing need to appropriately tailor content based on the user's emotional state. To address this issue, it is necessary to analyze the content viewed by users in real time, automatically replace inappropriate content with appropriate content, and provide content that takes the user's emotional state into consideration.

[1087] The specific processing by the specific processing unit 290 of the data processing device 12 is realized by the following means.

[1088] In this invention, the server includes means for receiving content from the Internet in real time, artificial intelligence means for determining whether the received content contains expressions or visual elements that are inappropriate for a specific user group, means for replacing the inappropriate expressions or visual elements with expressions or visual elements that can be conveyed to the specific user group, and emotion engine means for evaluating the emotional state of the user and adjusting how the expressions and visual elements are replaced based on this evaluation. This makes it possible to automatically replace inappropriate content with appropriate content, and further makes it possible to provide appropriate content according to the emotional state of the user.

[1089] "Internet content" means all text, images, videos and other media information accessible via the Internet, including websites, online platforms and social media.

[1090] "Real-time capture" means a process or technology that captures the content of a web page at the moment a user views it and retrieves it for analysis.

[1091] A "specific user group" is a group of users who share specific attributes, such as age, gender, occupation, or cultural background, and to whom the system provides services taking into account their needs and constraints.

[1092] "Objectionable language or visual material" means language or images that are violent, sexual, offensive, or otherwise considered inappropriate or harmful to certain user groups, particularly children or sensitive individuals.

[1093] "Artificial intelligence means" refers to software or systems that use technologies such as machine learning, deep learning, natural language processing, and image recognition to analyze data, learn, and automatically perform specific tasks.

[1094] An "Internet browser extension" is a software component added to a web browser that extends the browser's functionality and enhances the user experience.

[1095] "Emotion engine means" refers to technologies and algorithms that estimate a user's emotional state from their behavior, text input, tone of voice, facial expressions, etc., and adjust the system's response based on that information.

[1096] An embodiment of the present invention relates to a system for converting internet content to be more suitable for users. The system is comprised of an artificial intelligence means, an emotion engine means, and a combination of supporting hardware and software, which are implemented as an extension of an internet browser.

[1097] This system operates as an extension to an internet browser installed on a device (personal computer, smartphone, tablet, etc.). This extension was developed using JavaScript and other web technologies, and has the function of receiving content such as text and images from web pages viewed by the user in real time. The received content is sent to an artificial intelligence means on a server via an HTTPS request. This artificial intelligence means analyzes the content using machine learning, natural language processing, and image recognition technologies, and determines whether the content is inappropriate for a specific user group.

[1098] If inappropriate content is detected, the AI ​​tools replace the text with more appropriate language or images with more benign ones: for example, offensive language is replaced with milder language, violent images with landscapes or animal images, etc. This replacement content is then sent back to the device, and the browser extension refreshes the web page.

[1099] Furthermore, this system incorporates an emotion engine means that infers the user's emotional state from their actions and inputs and provides that information to the artificial intelligence means. This allows the system to replace the content with a calmer one based on the user's emotional state, such as anger. The emotion engine uses a machine learning algorithm to evaluate the user's emotions and reflects the results in the processing of the artificial intelligence means.

[1100] For example, prompts such as "Please replace the inappropriate language in this text with language that children can easily understand" or "Please replace this image with content that is safe for children to see" are sent to the artificial intelligence means, which then analyzes and converts the content based on these requests.

[1101] The flow of the identification process will be described with reference to FIG.

[1102] Step 1: Receiving content

[1103] A browser extension running on the device receives content such as text and images from the web page the user is viewing. At this stage, the DOM of the web page is parsed and text and image data are extracted. The input is the HTML content of the web page, and the output is the extracted text and image data.

[1104] Step 2: Request content analysis

[1105] The extracted content is sent to the server via an HTTPS request. An artificial intelligence mechanism on the server receives this content and begins analyzing it. The input is the extracted text and image data, and the output is the analysis result (a decision on whether the content is inappropriate or not).

[1106] Step 3: Analyze your content

[1107] The artificial intelligence means analyzes the content of the text and images and evaluates their inappropriateness. In this process, the text is processed using natural language processing technology, and the images are processed using image recognition technology. The input is the text and image data, and the output is the inappropriateness evaluation result for each.

[1108] Step 4: Emotional Engine Adjustment

[1109] An emotion engine running on the device or server evaluates the user's emotional state and provides that information to an artificial intelligence means, which then uses that information to adjust how content is replaced. The input is the user's actions and input data, and the output is the evaluation of the user's emotional state.

[1110] Step 5: Generate replacement content

[1111] If inappropriate content is detected, the artificial intelligence means generates new content to replace it with appropriate words and images. In this process, inappropriate text is converted to appropriate words and inappropriate images are converted to appropriate images. The input is the inappropriateness assessment result and the user's emotional state, and the output is the new replaced text and images.

[1112] Step 6: Refreshing the Content

[1113] The server sends the replaced content to the device, and the web page display is updated through the browser extension. At this step, the user finally sees only the correct content. The input is the replaced new text and image data, and the output is the updated web page display.

[1114] (Application example 2)

[1115] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1116] There is content on the Internet that is considered inappropriate for certain groups of users. This content may cause psychological discomfort or misunderstanding, especially among younger users. Furthermore, depending on the user's current emotional state, even content that would normally be considered harmless may cause emotional damage. With conventional technologies, it has been difficult to filter such inappropriate content efficiently and while taking into account the user's emotional state.

[1117] The specific processing by the specific processing unit 290 of the data processing device 12 is realized by the following means.

[1118] In this invention, the server includes means for receiving website content, artificial intelligence means for determining whether the received content is inappropriate for a specific user group, means for replacing inappropriate phrases and images with phrases and images that are conveyed to the specific user group, and emotion recognition means for recognizing the emotional state of the user and adjusting how inappropriate content is replaced based on that emotional state. This allows the specific user group to use the Internet safely, while also making it possible to provide appropriate content according to the user's emotional state.

[1119] "User" refers to an individual or specific group of people who use the Internet.

[1120] "Website content" refers to all information, including text, images, and videos, that appears on a web page on the Internet.

[1121] "Artificial intelligence means" refers to systems and programs that use technologies such as machine learning, deep learning, and natural language processing to analyze data and make judgments.

[1122] "Language or imagery that is inappropriate for a particular group of users" refers to content that is deemed offensive, inappropriate, or harmful to that group based on factors such as age, gender, or cultural background.

[1123] "Means of replacing inappropriate language or images with language or images that communicate to a specific group of users" refers to technologies or methods that automatically change inappropriate content so that it can be safely viewed by the relevant group of users.

[1124] "Means for recognizing the user's emotional state" refers to technology or systems that detect and analyze the user's emotional state at that time from their facial expression, tone of voice, context, etc.

[1125] "Emotion-aware measures that adjust the replacement of inappropriate content based on emotional state" refers to technologies and processes that take into account a user's current emotions and optimize how content is replaced to provide a more positive user experience.

[1126] "Web browser extension" refers to software or programs installed to extend the functionality of an internet browser and provide additional features.

[1127] In one embodiment of the present invention, a system is provided that enables users to use the Internet safely. This system has the function of filtering website content and replacing it with appropriate content as needed, taking into account the user's emotional state in particular. This system mainly comprises an artificial intelligence means implemented as an extension of a web browser, an emotion recognition means for recognizing the user's emotional state, and a means for replacing inappropriate content.

[1128] The server runs an artificial intelligence model that uses deep learning, natural language processing, and image recognition techniques to analyze the content of incoming websites and determine whether it is inappropriate for a particular user group. If inappropriate content is detected, the server automatically replaces it with appropriate wording or images.

[1129] The device uses a camera and microphone to detect the user's emotional state in real time and transmits this information to the server. The server analyzes this emotional data and adjusts how the content is replaced, taking into account the user's current emotions. This process allows the content to be replaced with more gentle content that will soothe the user's emotions.

[1130] The hardware used is a camera, microphone, and an internet-connected computer or smart device, while the software is an artificial intelligence model developed using deep learning frameworks such as TensorFlow and PyTorch, and a program that functions as a web browser extension.

[1131] For example, a prompt such as "Please explain this to a 10-year-old child using language appropriate for that child" may be sent to an AI model. This prompt is used to instruct the AI ​​model to replace certain content that is inappropriate for children with content that is more easily understood by children. This type of functionality provides a safe environment for using the Internet.

[1132] The flow of the identification process will be described with reference to FIG.

[1133] Step 1: A user accesses a website through a web browser. At this time, the browser extension receives the content of the accessed website. The input is the website's URL or content, and the output is the content data received from the website. In this process, the web browser's API is used to retrieve the website content.

[1134] Step 2: The retrieved content is sent to a server, which uses artificial intelligence tools to determine whether the content is inappropriate for a specific user group. The input is the website content, and the output is the presence or absence of inappropriate content and its details (text or images). This step uses text analysis and image recognition techniques to identify inappropriate language and images within the content.

[1135] Step 3: The device detects the user's emotional state through a camera or microphone and sends this information to the server. The input is the user's facial expression and tone of voice, and the output is the user's emotional state (e.g., anger, joy). In this step, facial expression recognition and voice analysis technologies are used to determine the user's emotions.

[1136] Step 4: The server analyzes the received emotional data and adjusts how it replaces inappropriate content based on the user's emotional state. The input is the user's emotional state, and the output is the type of content to replace (softer words or images). This step selects the content that best matches the user's emotions and replaces the inappropriate content with an appropriate one.

[1137] Step 5: Finally, the server sends the replaced content to the user's device via the web browser extension. The input is the content to be replaced, and the output is the actual replaced website content. This process involves displaying the replaced content on the web page via the web browser's API.

[1138] Example 3

[1139] Next, a third embodiment of the third embodiment will be described. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1140] Some digital content may contain inappropriate language or images for certain user groups, especially children and users who need protection from sensitive content. This content may have a negative impact on viewers. Furthermore, few existing systems provide content tailored to the user's emotional state, and personalization to improve the user experience is lacking. Effective solutions to address these issues are needed.

[1141] The specific processing by the specific processing unit 290 of the data processing device 12 is realized by the following means.

[1142] In this invention, the server includes means for receiving digital content, artificial intelligence means for determining whether the received content contains phrases or images that are inappropriate for a specific user group, means for automatically replacing the inappropriate phrases or images with appropriate phrases or images, means for detecting the emotional state of the user, and means for adjusting the display of the content based on the detected emotional state. This makes it possible to automatically replace inappropriate content with appropriate content and to realize personalization of content based on the emotional state of the user.

[1143] "Digital content" refers to information or media in electronic form, such as text, images, video, or audio, that can be shared, distributed, or accessed over the Internet.

[1144] A "specific user group" refers to a group of users distinguished based on specific attributes or conditions, such as age, gender, or cultural background.

[1145] "Inappropriate language or imagery" refers to language or visual content that may be considered offensive, offensive, or harmful to certain groups of users.

[1146] "Artificial intelligence means" refers to a general term for computer programs and technologies that aim to mimic human intelligence, such as learning, reasoning, recognition, and language comprehension.

[1147] "Automatic substitution" refers to the method or function by which a program or system autonomously performs an action or process without human intervention.

[1148] "User emotional state" refers to the emotion or mood an individual is experiencing at a given time, and can range from joy, sadness, anger, surprise, etc.

[1149] "Means of detection" refers to the techniques or methods used to identify and confirm the presence of specific information or conditions.

[1150] "Means for tailoring the presentation of content" means any process or feature that changes the form, sequence, or content of information or media presented to a user.

[1151] The implementation of this invention focuses on improving content safety and user experience. The main hardware used is a server, a terminal (smartphone, tablet, PC, etc.), and an emotion detection device (a camera or microphone built into the terminal). The software core is image recognition technology, natural language processing technology, emotion analysis technology, and generative AI models.

[1152] The servers are computers with high-performance processing power, located in the cloud or in physical data centers. Specific generative AI models are installed on these servers to identify and replace inappropriate content and adjust content based on user sentiment. The specific software used includes image recognition technology and GPT-based generative AI models provided by OpenAI.

[1153] The device acts as an interface where users can upload content and receive results sent from the server, and also detects the user's emotional state through the device's built-in camera and microphone and transmits the data to the server.

[1154] For example, if a user uploads a violent image, the generative AI model processes the following prompt: "Identify inappropriate elements in the image and replace them with appropriate landscape images. Also, if the user's current emotion is joy, adjust the display to prioritize positive news articles and images." Based on this prompt, the server replaces the violent image with a landscape image and, taking into account the user's emotion of joy, selects appropriate content and sends it to the device.

[1155] This allows users to enjoy a safe and personalized content experience.

[1156] The flow of the identification process will be described with reference to FIG.

[1157] Step 1:

[1158] A user uploads digital content to a server through a terminal. At this time, the input is an image or text provided by the user, and the server receives the digital content.

[1159] Step 2:

[1160] An artificial intelligence means on the server performs a content analysis on the received digital content. This process uses image recognition and natural language processing techniques to determine whether the wording or images in the content are inappropriate for a particular user group. The input is the digital content, and the output is information about the presence or absence of inappropriate content and its content.

[1161] Step 3:

[1162] If inappropriate content is detected, the server executes a process to automatically replace it with appropriate wording or images. The input to this step is the inappropriate content, and the output is safe alternative content for the user. This replacement process is either selected from a database of pre-prepared safe content or newly generated using a generative AI model.

[1163] Step 4:

[1164] The device has the ability to detect the user's emotional state and transmits that information to the server. In this step, the user's facial expressions and voice are used as input, and the output is the analysis result of the user's emotional state (happiness, sadness, etc.).

[1165] Step 5:

[1166] The server adjusts the display of content based on the received emotional state information. This adjustment is to select content that matches the user's emotions and display it preferentially. The input is the user's emotional state information, and the output is a set of adjusted content.

[1167] By implementing this program, users will receive content that is optimized to their emotions and will be protected from inappropriate content.

[1168] (Application example 3)

[1169] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1170] Conventional digital content delivery systems provide uniform content without considering the individual emotional state of the user. This makes it difficult to provide appropriate content that reflects the user's current emotions and needs. In particular, there are limitations in providing the emotional support and experiences desired by users through digital content.

[1171] The specific processing by the specific processing unit 290 of the data processing device 12 is realized by the following means.

[1172] In this invention, the server includes an image recognition means for analyzing the user's facial expressions in real time, an emotion engine means for determining the user's emotional state based on the analysis results, and an AI means for selecting and providing content appropriate to the user's emotional state, thereby enabling the provision of personalized digital content based on the user's current emotional state.

[1173] "Digital content" refers to content that exists in electronic form, such as video, music, text, and images, that is distributed over the Internet.

[1174] "AI means" refers to systems or programs that use artificial intelligence technology to analyze data and automatically perform specific tasks.

[1175] "Means for substituting content appropriate to the user's emotional state" refers to technologies or processes that take into account the user's current emotions and automatically switch to content that matches or responds to those emotions.

[1176] "Image recognition means" refers to technology or systems that identify and analyze specific patterns or objects from image data acquired through devices such as cameras.

[1177] "Emotion engine means" refers to technology or systems that infer and analyze a user's emotional state from their facial expressions, tone of voice, choice of words, etc.

[1178] "AI means for prioritizing content selection and display" refers to artificial intelligence functions and processes that select the most appropriate content for a user and automatically adjust the display order to suit the user's preferences and circumstances.

[1179] An embodiment of the present invention relates to a system that dynamically selects and provides digital content based on a user's emotional state. This system is implemented as an application installed on a device, such as a smartphone or tablet. The device's built-in camera is used to analyze the user's facial expressions in real time, and an emotion engine determines the user's emotional state based on the data obtained through image recognition. Based on this determination, an AI means selects content that best suits the user's current emotion and displays it on the screen.

[1180] The hardware uses the built-in camera and processor of a smartphone or tablet. The software uses libraries such as OpenCV for image recognition and TensorFlow for machine learning. This system can, for example, provide uplifting and cheerful videos and music if the user is sad. Conversely, if the user is relaxed, it will prioritize the display of calming music and landscape images.

[1181] Specifically, the program's operating procedure is as follows: first, the application activates the device's camera and captures the user's facial expression. Next, the image recognition means analyzes emotions from the facial expression, and the emotion engine means determines the user's emotional state. Finally, based on this emotional state, the AI ​​means selects and displays content. This process is carried out continuously while the user is using the application.

[1182] Examples of prompts include "Generate a list of happy videos to recommend when the user is sad" and "Generate a list of videos that will make the user even happier when the user is happy." The goal is to improve the user experience by providing content that corresponds to the user's emotions.

[1183] The flow of the identification process will be described with reference to FIG.

[1184] Step 1:

[1185] The device activates the built-in camera and captures the user's facial expressions. At this stage, the video data from the camera is received as input and sent to the device as raw image data.

[1186] Step 2:

[1187] The image recognition means analyzes the captured image data and infers emotions from the user's facial expressions. In this process, a facial recognition algorithm is applied to the image data received as input, and an emotion score (e.g., happy, sad, anger, etc.) based on the user's facial expressions is generated as output.

[1188] Step 3:

[1189] The emotion engine means finally determines the user's emotional state based on the emotion scores obtained in step 2. In this step, the emotion engine means analyzes the emotion scores received as input and determines the most likely emotional state as output.

[1190] Step 4:

[1191] The AI ​​means selects appropriate digital content based on the user's emotional state determined in step 3. In this process, the content information in the database and the user's emotional state are considered as inputs, and a list of content that best suits the emotional state is generated as output.

[1192] Step 5:

[1193] The selected content is displayed on the device screen. In this final step, the content list generated in step 4 is received as input, and the content is appropriately arranged on the user interface and presented to the user.

[1194] Through these processing steps, users can receive digital content that is appropriate to their emotional state in real time, enabling them to enjoy a more personalized user experience.

[1195] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1196] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1197] Another example of generative AI is Gemini (internet search engine). <url: https: gemini.google.com ?hl="ja">) are mentioned.

[1198] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1199] [Fourth embodiment]

[1200] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1201] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1202] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1203] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1204] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1205] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1206] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1207] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1208] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1209] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1210] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1211] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1212] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[1213] "Example ...

Claims

1. A means for receiving content on an information and communication network accessed by a user in real time; A means for transmitting the received content to an information processing system; An information processing system that analyzes and determines whether the transmitted content contains inappropriate expressions or visual information for a specific user group; and a means for automatically converting expression or visual information determined to be inappropriate into expression or visual information appropriate for a particular user group.

2. means for outputting a web page to the user; the content being web page content; said particular user group being children; The information processing system and the converting means use a generative AI model to determine whether each of the text and images included in the content is inappropriate for the child, and convert the text and the image determined to be inappropriate into a text and an image appropriate for the child; 2. The system of claim 1, wherein said outputting means outputs a web page including the converted text and images to the user.

3. The system described in claim 2, wherein the information processing system and the conversion means convert the text and images determined to be inappropriate into text and images that are easy for children to understand based on a prompt sentence instructing the conversion to content that is easy for children to understand.

4. 3. The system according to claim 2, wherein said outputting means outputs to the user a web page in which the pre-conversion text and images have been replaced with the post-conversion text and images.

5. means for outputting a video to the user; The content is a video distributed by a video distribution service, said particular user group being children; The information processing system and the converting means use a generative AI model to determine whether each advertisement inserted into the video has content inappropriate for children, and convert the advertisement determined to have inappropriate content into a landscape image; 2. The system according to claim 1, wherein said outputting means outputs to the user a moving image in which said advertisements determined to have inappropriate contents are converted into landscape images.

6. means for inferring an emotional state of the user using an emotion engine; The system of claim 1, wherein the converting means uses a generative AI model to convert expressions or visual information that are judged to be inappropriate into expressions or visual information that are appropriate for a specific user group and that are selected according to the emotional state of the user.

7. means for outputting content to the user; and means for inferring an emotional state of the user using an emotion engine; The output means includes:

2. The system according to claim 1, wherein, from among the contents including the converted expressions and visual information, the contents selected according to the emotional state of the user are preferentially output to the user.

Citation Information

Patent Citations

  • Video reproducing device

    JP2008271175A

  • Device, method, and program for controlling browsing

    JP2011044116A

  • Content filtering in media playing devices

    JP2021175187A

  • Information processing device, information processing method, and information processing program

    JP2022049571A

  • Suggestion device and method

    JP2022189185A

Cited By

  • System and Method

    JP7874372B1