system

Abstract

We provide the system. [Solution] A means comprising a server device that receives requirements information from users and operates a generative artificial intelligence that generates multiple design proposals according to said requirements information, A means comprising a terminal device that displays design proposals received from the server device and allows users to adjust the design proposals, A means of transmitting feedback information from the user to a server device and finalizing the design proposal, A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance as a response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In conventional information terminal devices, even when a generative artificial intelligence is used, there is a lack of sufficient flexibility for users to customize the device based on intuitive and individual design requirements. Also, the technology for effectively utilizing the design elements of past information communication devices is insufficient, and only limited options are provided for users who desire a high degree of customization. Furthermore, there is a problem that the satisfaction with the final product is low because there is no mechanism to smoothly reflect the feedback provided by users in the design.

Means for Solving the Problems

[0005] This invention provides a means for users to intuitively adjust design proposals by generating multiple design proposals using artificial intelligence generated by a server device based on user requirements information, and presenting them to the user via a terminal device. Furthermore, it provides a wider variety of design options by referencing past design data of information and communication devices and generating design proposals that incorporate those elements. The final design proposal is stored by the server device, reflecting user feedback, and enables increased satisfaction through the feedback process.

[0006] A "user" is someone who operates the system and provides design requirements for smartphones.

[0007] "Requirements information" refers to information that describes the design and functional specifications desired by the user.

[0008] "Generative artificial intelligence" refers to an algorithm or program that automatically generates design proposals based on requirements information provided by the user.

[0009] A "server device" is a computer system that runs generative artificial intelligence to generate and manage design proposals.

[0010] The "design proposal" refers to a smartphone design prototype created by the server device using artificial intelligence.

[0011] A "terminal device" is a device that presents design proposals to the user and accepts user input.

[0012] "Feedback information" refers to information that shows the opinions and improvement requests that users provide regarding the design proposal.

[0013] "Design data" refers to historical design information for past information and communication devices, and serves as the basis for generating new design proposals. [Brief explanation of the drawing]

[0014] [Figure 1] It is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] It is a conceptual diagram showing an example of the main functions of a data processing device and a smart device according to the first embodiment. [Figure 3] It is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] It is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] It is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] It is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] It is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] It is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] It shows an emotion map to which a plurality of emotions are mapped. [Figure 10] It shows an emotion map to which a plurality of emotions are mapped. [Figure 11] It is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] It is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] It is a sequence diagram showing the processing flow of the data processing system in Example 2 when an emotion engine is combined. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when an emotion engine is combined.

Embodiments for Carrying Out the Invention

[0015] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0016] First, the terms used in the following description will be explained.

[0017] In the following embodiments, a tagged processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0018] In the following embodiments, a tagged RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0019] In the following embodiments, a tagged storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, etc.

[0020] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0021] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0022] [First Embodiment]

[0023] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0024] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0025] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0026] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0027] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0028] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0029] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0030] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0031] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0032] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0033] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0034] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0035] The present invention is implemented in the following form. The system is composed of three main components: a server device, a terminal device, and a user.

[0036] The server receives requirements information from users and uses artificial intelligence to generate multiple design proposals based on those requirements. The server also refers to a database of past information and communication device designs and uses that data to incorporate retro elements into design proposals that meet modern needs. Furthermore, the server quickly saves the generated design proposals to the cloud and transmits them to terminal devices.

[0037] The terminal plays the role of presenting design proposals received from the server to the user, and provides an environment where the user can adjust the design proposals through an interactive user interface. Users can modify details such as color, shape, and function through touch functions and gesture operations, and customize their own unique design.

[0038] Users can compare multiple design options presented on their device, select the one that best suits their preferences, and make further adjustments. Based on these adjustments, users send feedback to the server via their device. This feedback is used by the server to finalize the design.

[0039] For example, if a user requests a compact and stylish design, the server utilizes design information from past small feature phones to generate various design options (for instance, a modern look with rounded corners or metallic materials). The user can then review these options on their device and make necessary adjustments to ultimately create their own unique smartphone design.

[0040] Thus, the present invention provides a means for users to easily and effectively design information and communication devices that reflect their own needs, enabling the realization of more personalized devices. Furthermore, it is a system that can increase user satisfaction in the final design process, taking into account individual feedback.

[0041] The following describes the processing flow.

[0042] Step 1:

[0043] The user enters design requirements information based on their preferences into the terminal. This includes desired design style, functionality, materials, and colors.

[0044] Step 2:

[0045] The terminal sends user requirements information to the server and requests the generation of design proposals by the artificial intelligence.

[0046] Step 3:

[0047] The server activates the generating artificial intelligence based on the received requirements information. The server references past design data for information and communication devices and generates multiple design options based on that data.

[0048] Step 4:

[0049] The server stores the generated design proposals in the cloud and sends that information to the terminal. This information is organized in a format that the user can view and manipulate.

[0050] Step 5:

[0051] The terminal presents the user with design proposals received from the server. The user visually reviews and compares the provided design proposals before making a selection.

[0052] Step 6:

[0053] Users adjust the design proposal via their device. Specifically, they customize it to their liking by changing colors, shapes, and adding or removing specific functions.

[0054] Step 7:

[0055] Users send feedback on their customized design proposals from their devices to the server. This feedback information is used to refine the final design proposal.

[0056] Step 8:

[0057] The server finalizes the design based on the feedback received and saves it to the cloud. This generates the final design that reflects the user's requests.

[0058] (Example 1)

[0059] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0060] The challenge is to provide a means to quickly and effectively design unique information and communication devices that reflect the individual needs of each user. Another challenge is to build a system that utilizes user feedback to finalize a more satisfactory design.

[0061] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0062] In this invention, the server includes means for a computing device that receives requirement information from a user and operates a generation AI model to generate multiple design proposals according to the requirement information; means for a display device that displays the design proposals received from the computing device and allows the user to adjust the design proposals through interactive operation; and means for transmitting feedback information from the user to the computing device and finalizing the design proposals. This makes it possible to create and finalize original designs based on the requests of individual users.

[0063] A "user" is an individual or organization that uses the system to request, confirm, and adjust the design of information and communication devices.

[0064] A "generative AI model" is an artificial intelligence algorithm that automatically generates design proposals based on requirements information.

[0065] A "processing unit" is an information processing device that uses generative artificial intelligence to perform various processes and generate and manage design proposals.

[0066] A "display device" is a device equipped with an interface that presents design proposals received from a server to the user and allows for adjustments through interactive operation.

[0067] "Feedback information" refers to information that users use to send adjustments and opinions they have made regarding the presented design proposal to the system.

[0068] A "design proposal" is a design suggestion for an information and communication device created by an AI model based on user requirements.

[0069] This invention is implemented in an information processing system comprising users, a server device, and a terminal device. This system utilizes a generative AI model to generate design proposals for information and communication devices based on the requests of individual users, thereby supporting user customization.

[0070] The server receives requirements information from users via the internet. Based on this information, the server activates a generative artificial intelligence and generates multiple design proposals while referencing design data of past information and communication devices. Specifically, the server accesses a design database and constructs design proposals that incorporate elements that meet modern needs. In this process, the generative AI model uses prompt statements to determine the direction of the design. For example, a prompt statement such as "Design a compact and stylish smartphone. Please refer to data from past feature phones" might be used.

[0071] The generated design proposals are saved to the cloud by the server and sent to the device. The device presents the received design proposals to the user, allowing the user to adjust the design through touch and gesture operations via an interactive interface. This allows the user to freely customize the design's color, shape, and function.

[0072] Finally, the user sends feedback on the customized design proposal to the server via their device. This feedback is used by the server to finalize the design proposal. The server then saves the design proposal, incorporating this feedback, to enhance user satisfaction.

[0073] Thus, the present invention is a system that allows users to easily design original information and communication devices that reflect their own requirements, and that can meet the specific needs of users through concrete customization in the process.

[0074] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0075] Step 1:

[0076] The user enters the requirements information into the device.

[0077] The user inputs their desired design and functionality requirements for the information and communication device using the terminal's interface. For example, they might write "I want a retro design" in the form. The terminal receives this requirements information and prepares it as data for the next processing step.

[0078] Step 2:

[0079] The terminal sends the requirements information to the server.

[0080] The terminal converts the requirements information entered by the user into data packets to be sent to the server. The server then begins processing the received requirements information packets as input for database access.

[0081] Step 3:

[0082] The server generates design proposals.

[0083] The server activates the AI ​​model based on the received requirements information. The server operates the AI ​​model using the prompt "Generate a design based on past data" and generates new design proposals by referencing past design data. The generated design proposals are temporarily stored on the server and prepared for the next transmission step.

[0084] Step 4:

[0085] The server sends the design proposal to the terminal.

[0086] The server sends the generated design proposals to the terminal while saving them to the cloud. The terminal inputs the received design proposals in preparation for analysis and display, and converts them into a format for presentation to the user.

[0087] Step 5:

[0088] The device presents design options to the user.

[0089] The terminal displays the received design proposals and presents them to the user through a user interface. To support detailed customization, an interactive operating environment is provided, allowing the user to adjust the design via touch or gesture. This adjustment is prepared as design adjustment data based on user input.

[0090] Step 6:

[0091] Users customize the design proposals.

[0092] Based on the presented design proposal, the user adjusts the color, shape, and function. For example, they perform specific operations such as changing the roundness of the corners or changing the color to red. After customization, the user confirms the design and prepares it as feedback for the next process.

[0093] Step 7:

[0094] The device sends feedback information to the server.

[0095] The device sends user-defined customization information to the server as feedback data. This feedback is used as input data for reviewing and adjusting the final design proposal.

[0096] Step 8:

[0097] The server reviews and saves the final design proposal.

[0098] The server analyzes the feedback information received from the terminal and adjusts and verifies the final design proposal. By saving this verified design proposal to the database, a design based on user-satisfactory specifications is completed.

[0099] (Application Example 1)

[0100] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0101] Conventional design support systems have had the challenge of making it difficult for users to intuitively customize unique designs in real-world spaces to meet their specific needs. Furthermore, there was a lack of systems that could effectively incorporate past design elements into modern products. These challenges made it difficult to maximize user satisfaction.

[0102] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0103] In this invention, the server includes means for an information processing device that receives requirement information from a user and operates a generative artificial intelligence that generates multiple design proposals according to the requirement information; means for an input device that displays the design proposals received from the information processing device and allows the user to adjust the design proposals; means for transmitting feedback information from the user to the information processing device and finalizing the design proposals; and means for an output device that allows the user to intuitively customize products in real space using the generated design proposals. This makes it possible for users to intuitively customize products according to their needs and realize highly satisfying original designs.

[0104] "User" refers to the entity that operates the system and customizes the design proposal based on its own requirements.

[0105] "Requirements information" refers to data that users communicate to the system, expressing their design preferences and requirements.

[0106] "Design proposals" refer to multiple design options generated by artificial intelligence on the server, based on the user's requirements.

[0107] "Generative artificial intelligence" is an artificial intelligence technology that generates new design proposals by referencing past design data.

[0108] An "information processing device" refers to a server or computer system that receives requirements information from users and uses artificial intelligence to generate design proposals.

[0109] An "input device" is a device that a user operates to adjust a design proposal, and typically includes a touch panel or keyboard.

[0110] "Feedback information" refers to data that users send to an information processing device after reviewing and adjusting their design proposals.

[0111] An "output device" is a device that visually presents the generated design proposal to the user, enabling them to verify and customize it in a real-world space.

[0112] The system for carrying out this invention consists of a user, an information processing device (hereinafter referred to as "server"), and input and output devices. The server is responsible for generating design proposals based on the requirements information provided by the user, using generative artificial intelligence (AI model).

[0113] First, the server references past design information from a large database and runs a generative AI model to generate multiple design options that meet the user's needs. The generated design options are then sent to the user's device via the network.

[0114] Users can view and review these design proposals using terminal devices (including input devices), and customize the designs through various interfaces (e.g., touch panels, mice, keyboards). This allows users to make detailed adjustments to colors, shapes, materials, and other elements in real time.

[0115] The customized design proposal is resent to the server as user feedback. Based on this feedback, the server finalizes the design proposal and makes adjustments as needed. Through this process, users can obtain a more satisfying original design.

[0116] As a concrete example, consider a case where a customer customizes the design of sneakers at a physical store. The customer can use a tablet device installed in the store to view various color and pattern design options. After making adjustments to the design as needed, the final selected design is saved on a server.

[0117] Example prompt: "Please propose a design for a compact and stylish sneaker, inspired by the design of a classic feature phone. Include a modern look with rounded corners and metallic material elements."

[0118] In this way, the present invention enables users to enjoy an intuitive and interactive customization experience while meeting modern needs.

[0119] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0120] Step 1:

[0121] The server receives requirement information provided by the user via their terminal. This requirement information includes details and conditions of the desired design. Using this as input, the server references past design information in the database and generates multiple design proposals using a generation AI model. During this process, prompt statements are used to give specific output instructions to the AI ​​model. The resulting design proposals are then output.

[0122] Step 2:

[0123] The server sends the generated design proposals to the terminal via the network. The terminal displays the received design proposals to the user. This display shows the details of each design and the customizable points, and awaits user interaction.

[0124] Step 3:

[0125] The user uses the device's interface to review and adjust the design proposal. The device accepts user input (e.g., touch, click) and dynamically updates design elements such as color, shape, and material. The customized design is regenerated and output on the device.

[0126] Step 4:

[0127] The user sends feedback information about the finalized design proposal to the server via their terminal. The server receives the user's final design adjustments as input and uses this to perform a final review of the design proposal. The final approved design is then output and saved to the database.

[0128] Step 5:

[0129] The server transmits data to the in-store output device based on the final design proposal, enabling visual confirmation and further customization in the real world. Users can review the design proposal displayed in the physical space and make adjustments as needed, allowing them to intuitively visualize the final product. The outputted design is then prepared for manufacturing and delivery according to the final feedback.

[0130] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0131] This invention is a system that uses an emotion engine to recognize a user's emotions and generates and adjusts smartphone design proposals accordingly. This system is primarily implemented through the cooperation of a server, a terminal, and an emotion engine.

[0132] The server utilizes generative artificial intelligence to generate multiple design proposals based on user requirements and emotional data acquired by the emotion engine. By referencing past design data for information and communication devices and incorporating elements that align with the user's preferences estimated from the emotional data, it provides more personalized design proposals. The emotion engine also analyzes the user's emotions in real time and feeds feedback information on recommended designs to the server.

[0133] The terminal interactively presents the user with design proposals sent from the server and emotion-based recommendations from the emotion engine. The interface on the terminal is designed to allow users to easily review and customize the design proposals. The terminal also sends the user's emotional state during operation back to the emotion engine, dynamically adjusting the design proposals in real time.

[0134] Users can refer to design proposals provided via their devices and make modifications and adjustments based on emotionally-based recommendations and suggestions. For example, by adding specific features or design elements to a design proposal that a user has expressed a favorable emotion towards, they can obtain a more satisfying custom design.

[0135] For example, if the emotion engine recognizes an "excited" state while the user is operating the device, the server can generate and present a design proposal with vibrant colors and innovative features. The user then refines the design based on this proposal to finalize the smartphone design.

[0136] This invention provides a device design process that takes user emotions into account, resulting in a system that enables a more personalized user experience.

[0137] The following describes the processing flow.

[0138] Step 1:

[0139] Users input design requirements for their smartphones through their devices. This information includes design style, functionality, and desired materials and colors.

[0140] Step 2:

[0141] The terminal sends the requirements information entered by the user to the server, and simultaneously activates the emotion engine to analyze the user's current emotional state.

[0142] Step 3:

[0143] The emotion engine analyzes the user's emotional state in real time and provides emotional data to the server. This data estimates emotions based on the user's facial expressions, voice tone, and other factors.

[0144] Step 4:

[0145] The server uses generative artificial intelligence to generate multiple design proposals based on the received requirements information and sentiment data. It references a database of past designs to select design elements that are appropriate for the user's emotions.

[0146] Step 5:

[0147] The server sends the generated design proposals and sentiment-based recommendations to the device. As a result, the device displays design proposals tailored to the user's preferences and emotions.

[0148] Step 6:

[0149] The device visually presents the user with multiple design options and related recommendations. The user can compare these options and adjust individual design elements.

[0150] Step 7:

[0151] Users send feedback from their devices to the server, reflecting their emotional state regarding the presented design proposals. This feedback is used to further refine the design proposals.

[0152] Step 8:

[0153] The server incorporates user feedback and sentiment data to refine and finalize the design. The final design is then saved to the cloud and prepared for the manufacturing process if necessary.

[0154] (Example 2)

[0155] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0156] Conventional design generation systems have struggled to make real-time design adjustments based on users' subjective emotions and preferences. As a result, they have been unable to provide design proposals that address individual user emotions, leading to insufficient personalized experiences. Therefore, there is a need for a new system that can analyze user emotions in real time and immediately generate and adjust design proposals using that data.

[0157] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0158] In this invention, the server includes means for acquiring emotional data using a device that analyzes the user's emotions and transmitting said emotional data to the server device; means for operating a generative artificial intelligence that generates multiple design proposals based on the user's requirements information and emotional data; and means for a terminal device that displays the design proposals received from the server device and allows the user to adjust the design proposals. This enables dynamic design generation and adjustment in response to the user's emotions.

[0159] "Emotional data" refers to information that expresses a user's psychological state and emotions in the form of numbers, categories, etc.

[0160] "Generative artificial intelligence" refers to algorithms and programs that automatically generate new information and designs based on large amounts of data.

[0161] A "server device" is a central computing device that performs information processing and data storage via a network.

[0162] A "terminal device" is an electronic device used by users to input and output information.

[0163] A "design proposal" refers to a set of proposals or plans formulated regarding the design and functional specifications of devices such as information and communication equipment.

[0164] "Recommendation information" refers to suggestions for the next action or choice provided based on the user's emotional data and past behavioral history.

[0165] "Feedback information" refers to data compiled from user reactions and evaluations, which is used to improve and adjust the system.

[0166] This invention provides a system that generates and adjusts smartphone designs using user emotion data. The system mainly consists of a server device, terminal devices, sensors related to emotion analysis, and software.

[0167] The server generates multiple design proposals based on emotion data and requirements information obtained from the user by manipulating a generative AI model. In doing so, the server refers to a database of past information and communication device designs. The generative AI model on the server generates designs using prompt statements. For example, a prompt such as, "The user's current emotion is 'excited.' Please generate several smartphone design proposals based on this. Emphasize vibrant colors and innovative features," can be set.

[0168] The terminal functions as a device that interacts with the user. It displays design proposals sent from the server and features an interface that allows the user to provide emotion-based feedback. While the user interacts with the terminal, their emotional state is sent in real time to an emotion analysis system, and this information is returned to the server to help refine the design proposals.

[0169] Users can view design proposals presented through their devices and customize them based on their preferences and emotions. This is crucial for personalizing the user experience and achieving a more satisfying design. For example, if a user expresses excitement upon viewing a design proposal, the next design generated by the server will include more vibrant and dynamic elements.

[0170] By implementing this invention, it becomes possible to design devices that reflect the user's emotions and improve the user experience.

[0171] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0172] Step 1:

[0173] The user acquires emotional data through their device. Specifically, the device uses its built-in camera and microphone to analyze facial expressions and voice in real time. This input data is classified into emotions such as "joy," "excitement," and "calmness" by an emotion analysis algorithm. The output is emotional data that quantifies or categorizes these emotions.

[0174] Step 2:

[0175] The terminal sends the acquired emotional data to the server. At the same time, the terminal also sends user requirements information. The server receives this data and uses it as input for the next process. From the emotional data and requirements information, the server obtains the basic data for design generation.

[0176] Step 3:

[0177] The server generates multiple design proposals using a generative AI model based on the received emotion data and requirements information. Specifically, it creates prompt statements based on the emotion data and inputs them into the AI ​​model. For example, if the emotion is "excitement," it might create a prompt such as "Generate design proposals that include vibrant colors and dynamic features." The output is a collection of generated computer designs.

[0178] Step 4:

[0179] The server sends the generated design proposals to the terminal as options. The terminal receives them and presents them visually to the user. The user can choose their preferred design proposal and further customize it. The terminal provides an interface that clearly displays the received design proposals.

[0180] Step 5:

[0181] Users review the presented design proposals and make adjustments based on their preferences and needs through touch controls. Specifically, they can manipulate color sliders and toggle functions on and off. This allows users to fine-tune the design based on their own feelings and feedback. The output is the design proposal adjusted by the user's actions.

[0182] Step 6:

[0183] The device sends back feedback information and updated sentiment data obtained from user actions to the server. Based on this information, the server readjusts the design proposal as needed or performs a final check. This process finalizes the individualized design proposal. The output is the final confirmed design proposal.

[0184] (Application Example 2)

[0185] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0186] While aiming to provide personalized content based on user emotions, there is a need for a system that generates and adjusts design proposals according to user requests. Conventional technologies make it difficult to adjust content immediately in response to emotions, and a flexible approach is needed to solve this problem.

[0187] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0188] In this invention, the server includes means for operating an artificial intelligence unit that receives requirement information from a user and generates multiple design proposals according to said requirement information; means for a display device that displays the design proposals received from the information processing device and allows the user to adjust the design proposals; and means for a device that generates content according to the emotional state of the user. This makes it possible to provide personalized design proposals and content immediately based on the emotional state of the user.

[0189] A "user" is an individual or group that uses the system to receive and adjust design proposals and content suggestions.

[0190] "Requirements information" refers to data that details the wishes and requests that users present to the system.

[0191] A "design proposal" is a specific design and content plan generated based on the user's requirements information.

[0192] An "artificial intelligence unit" is a software component that generates design proposals and content according to the user's requirements.

[0193] An "information processing device" refers to a computer system used for receiving, processing, and transmitting data.

[0194] A "display device" is an output device that provides users with design proposals and content adjustment screens.

[0195] "Emotional state" refers to the state of a user's psychological or physiological response and serves as a criterion for adjusting content.

[0196] "Content" refers to information media such as videos, music, and video scenes provided to users.

[0197] The server receives requirements information from the user and uses an artificial intelligence unit to generate multiple design proposals. In this process, the server refers to design data from past information and communication systems and customizes the design proposals while also considering the user's emotional state. The server selects appropriate content that corresponds to the user's emotional state and provides it to the user.

[0198] The device (e.g., smartphone or smart glasses) displays design proposals and content sent from the server, providing an interface that allows the user to review and interact with them. This interface is designed to be intuitive, allowing users to adjust design proposals and submit feedback as needed.

[0199] Based on the information displayed on their device, users receive emotion-based recommendations and select designs and content that interest them. During the selection process, the device detects the user's emotions in real time and sends feedback to the server. Through this entire process, users can experience content optimized for their emotional state.

[0200] For example, when a user is operating a device in a relaxed state, the server may send design suggestions or video content with a calming theme that matches that emotional state. In this case, the generative AI model optimizes the suggestions based on the user's past choices and real-time emotional data.

[0201] An example of a prompt to input into a generative AI model is: "Based on the user's current emotions, suggest video clips with relaxing themes. The user's emotional state is 'fatigue'."

[0202] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0203] Step 1:

[0204] The server retrieves requirements information from the user. It receives data indicating the user's wishes and requests as input, and uses this to determine what design proposals should be generated. The server analyzes the received requirements information and forms multiple appropriate design proposals and content generation prompts.

[0205] Step 2:

[0206] The server generates design proposals using an artificial intelligence unit. It uses user requirements information and past design data of information and communication systems as input. Data processing involves extracting trends from similar past data and running a generation AI model to output customized design proposals.

[0207] Step 3:

[0208] The server sends the generated design proposal to the terminal. The output is a design proposal that reflects the user's emotional state. When sending to the terminal, the data is sent in a format that allows for content adjustments that take into account the user's current emotional state.

[0209] Step 4:

[0210] The terminal displays the received design proposals to the user. It receives design proposals sent from the server as input and visualizes them through the user interface. It provides an interactive screen to make it easy for the user to operate.

[0211] Step 5:

[0212] The user provides feedback based on the displayed design proposal. The input data includes design elements selected on the device. By specifically manipulating the parts the user wants to adjust, the feedback data output is generated.

[0213] Step 6:

[0214] The device then sends the user feedback back to the server. Using the feedback data as input, the server analyzes the user's emotional state and selection history, and generates prompts requesting revisions to the design proposal.

[0215] Step 7:

[0216] The server generates content based on emotional states and updates the final design proposal. Inputs include user feedback data and real-time emotional data. Through data processing and the operation of a generative AI model, it provides personalized content output.

[0217] Step 8:

[0218] The terminal presents the user with the updated final design proposal and customized content. It displays the latest design proposal received as input, allowing for further final confirmation and evaluation.

[0219] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0220] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0221] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0222] [Second Embodiment]

[0223] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0224] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0225] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0226] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0227] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0228] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0229] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0230] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0231] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0232] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0233] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0234] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0235] The present invention is implemented in the following form. The system is composed of three main components: a server device, a terminal device, and a user.

[0236] The server receives requirements information from users and uses artificial intelligence to generate multiple design proposals based on those requirements. The server also refers to a database of past information and communication device designs and uses that data to incorporate retro elements into design proposals that meet modern needs. Furthermore, the server quickly saves the generated design proposals to the cloud and transmits them to terminal devices.

[0237] The terminal plays the role of presenting design proposals received from the server to the user, and provides an environment where the user can adjust the design proposals through an interactive user interface. Users can modify details such as color, shape, and function through touch functions and gesture operations, and customize their own unique design.

[0238] Users can compare multiple design options presented on their device, select the one that best suits their preferences, and make further adjustments. Based on these adjustments, users send feedback to the server via their device. This feedback is used by the server to finalize the design.

[0239] For example, if a user requests a compact and stylish design, the server utilizes design information from past small feature phones to generate various design options (for instance, a modern look with rounded corners or metallic materials). The user can then review these options on their device and make necessary adjustments to ultimately create their own unique smartphone design.

[0240] Thus, the present invention provides a means for users to easily and effectively design information and communication devices that reflect their own needs, enabling the realization of more personalized devices. Furthermore, it is a system that can increase user satisfaction in the final design process, taking into account individual feedback.

[0241] The following describes the processing flow.

[0242] Step 1:

[0243] The user enters design requirements information based on their preferences into the terminal. This includes desired design style, functionality, materials, and colors.

[0244] Step 2:

[0245] The terminal sends user requirements information to the server and requests the generation of design proposals by the artificial intelligence.

[0246] Step 3:

[0247] The server activates the generating artificial intelligence based on the received requirements information. The server references past design data for information and communication devices and generates multiple design options based on that data.

[0248] Step 4:

[0249] The server stores the generated design proposals in the cloud and sends that information to the terminal. This information is organized in a format that the user can view and manipulate.

[0250] Step 5:

[0251] The terminal presents the user with design proposals received from the server. The user visually reviews and compares the provided design proposals before making a selection.

[0252] Step 6:

[0253] Users adjust the design proposal via their device. Specifically, they customize it to their liking by changing colors, shapes, and adding or removing specific functions.

[0254] Step 7:

[0255] Users send feedback on their customized design proposals from their devices to the server. This feedback information is used to refine the final design proposal.

[0256] Step 8:

[0257] The server finalizes the design based on the feedback received and saves it to the cloud. This generates the final design that reflects the user's requests.

[0258] (Example 1)

[0259] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0260] The challenge is to provide a means to quickly and effectively design unique information and communication devices that reflect the individual needs of each user. Another challenge is to build a system that utilizes user feedback to finalize a more satisfactory design.

[0261] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0262] In this invention, the server includes means for a computing device that receives requirement information from a user and operates a generation AI model to generate multiple design proposals according to the requirement information; means for a display device that displays the design proposals received from the computing device and allows the user to adjust the design proposals through interactive operation; and means for transmitting feedback information from the user to the computing device and finalizing the design proposals. This makes it possible to create and finalize original designs based on the requests of individual users.

[0263] A "user" is an individual or organization that uses the system to request, confirm, and adjust the design of information and communication devices.

[0264] A "generative AI model" is an artificial intelligence algorithm that automatically generates design proposals based on requirements information.

[0265] A "processing unit" is an information processing device that uses generative artificial intelligence to perform various processes and generate and manage design proposals.

[0266] A "display device" is a device equipped with an interface that presents design proposals received from a server to the user and allows for adjustments through interactive operation.

[0267] "Feedback information" refers to information that users use to send adjustments and opinions they have made regarding the presented design proposal to the system.

[0268] A "design proposal" is a design suggestion for an information and communication device created by an AI model based on user requirements.

[0269] This invention is implemented in an information processing system comprising users, a server device, and a terminal device. This system utilizes a generative AI model to generate design proposals for information and communication devices based on the requests of individual users, thereby supporting user customization.

[0270] The server receives requirements information from users via the internet. Based on this information, the server activates a generative artificial intelligence and generates multiple design proposals while referencing design data of past information and communication devices. Specifically, the server accesses a design database and constructs design proposals that incorporate elements that meet modern needs. In this process, the generative AI model uses prompt statements to determine the direction of the design. For example, a prompt statement such as "Design a compact and stylish smartphone. Please refer to data from past feature phones" might be used.

[0271] The generated design proposals are saved to the cloud by the server and sent to the device. The device presents the received design proposals to the user, allowing the user to adjust the design through touch and gesture operations via an interactive interface. This allows the user to freely customize the design's color, shape, and function.

[0272] Finally, the user sends feedback on the customized design proposal to the server via their device. This feedback is used by the server to finalize the design proposal. The server then saves the design proposal, incorporating this feedback, to enhance user satisfaction.

[0273] Thus, the present invention is a system that allows users to easily design original information and communication devices that reflect their own requirements, and that can meet the specific needs of users through concrete customization in the process.

[0274] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0275] Step 1:

[0276] The user enters the requirements information into the device.

[0277] The user inputs their desired design and functionality requirements for the information and communication device using the terminal's interface. For example, they might write "I want a retro design" in the form. The terminal receives this requirements information and prepares it as data for the next processing step.

[0278] Step 2:

[0279] The terminal sends the requirements information to the server.

[0280] The terminal converts the requirements information entered by the user into data packets to be sent to the server. The server then begins processing the received requirements information packets as input for database access.

[0281] Step 3:

[0282] The server generates design proposals.

[0283] The server activates the generated AI model based on the received requirement information. The server operates the AI model using the prompt sentence "Generate a design based on past data" and generates a new design proposal by referring to past design data. The generated design proposal is temporarily saved in the server and is prepared for the next transmission step.

[0284] Step 4:

[0285] The server transmits the design proposal to the terminal.

[0286] The server transmits data to the terminal while saving the generated design proposal in the cloud. The terminal inputs the received design proposal for analysis and display preparation and converts it into a format for presenting to the user.

[0287] Step 5:

[0288] The terminal presents the design proposal to the user.

[0289] The terminal displays the received design proposal and presents it to the user through the user interface. To support detailed customization, an interactive operation environment is prepared, enabling the user to adjust the design by touch or gesture. This operation is prepared as design adjustment data based on user input.

[0290] Step 6:

[0291] The user customizes the design proposal.

[0292] The user adjusts the color, shape, and function based on the presented design. For example, specific operations such as changing the roundness of corners or changing the color to red are performed. After customization, the user finalizes the design and prepares it as feedback for the next process.

[0293] Step 7:

[0294] The device sends feedback information to the server.

[0295] The device sends user-defined customization information to the server as feedback data. This feedback is used as input data for reviewing and adjusting the final design proposal.

[0296] Step 8:

[0297] The server reviews and saves the final design proposal.

[0298] The server analyzes the feedback information received from the terminal and adjusts and verifies the final design proposal. By saving this verified design proposal to the database, a design based on user-satisfactory specifications is completed.

[0299] (Application Example 1)

[0300] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0301] Conventional design support systems have had the challenge of making it difficult for users to intuitively customize unique designs in real-world spaces to meet their specific needs. Furthermore, there was a lack of systems that could effectively incorporate past design elements into modern products. These challenges made it difficult to maximize user satisfaction.

[0302] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0303] In this invention, the server includes means for receiving requirement information from a user and operating an information processing device that activates a generation artificial intelligence for generating a plurality of design proposals according to the requirement information; means for displaying the design proposals received from the information processing device and including an input device that enables the user to adjust the design proposals; means for transmitting feedback information from the user to the information processing device to finally confirm the design proposals; and means for including an output device that can intuitively customize products in the real space using the generated design proposals. Thereby, it becomes possible for the user to intuitively perform customization according to their own needs and realize a highly satisfactory original design.

[0304] The "user" refers to the entity that operates the system and customizes the design proposal based on their own requirements.

[0305] The "requirement information" refers to the data representing the wishes and requirements regarding the design transmitted by the user to the system.

[0306] The "design proposal" refers to a plurality of design options generated by the generation artificial intelligence on the server based on the requirement information of the user.

[0307] The "generation artificial intelligence" is an artificial intelligence technology that generates new design proposals by referring to past design data.

[0308] The "information processing device" refers to a server or computer system that receives requirement information from the user and activates the generation artificial intelligence to generate design proposals.

[0309] The "input device" is a device that the user operates to adjust the design proposal, usually including a touch panel and a keyboard.

[0310] The "feedback information" refers to the data for the user to review and adjust the design proposal and transmit the results to the information processing device.

[0311] An "output device" is a device that visually presents the generated design proposal to the user, enabling them to verify and customize it in a real-world space.

[0312] The system for carrying out this invention consists of a user, an information processing device (hereinafter referred to as "server"), and input and output devices. The server is responsible for generating design proposals based on the requirements information provided by the user, using generative artificial intelligence (AI model).

[0313] First, the server references past design information from a large database and runs a generative AI model to generate multiple design options that meet the user's needs. The generated design options are then sent to the user's device via the network.

[0314] Users can view and review these design proposals using terminal devices (including input devices), and customize the designs through various interfaces (e.g., touch panels, mice, keyboards). This allows users to make detailed adjustments to colors, shapes, materials, and other elements in real time.

[0315] The customized design proposal is resent to the server as user feedback. Based on this feedback, the server finalizes the design proposal and makes adjustments as needed. Through this process, users can obtain a more satisfying original design.

[0316] As a concrete example, consider a case where a customer customizes the design of sneakers at a physical store. The customer can use a tablet device installed in the store to view various color and pattern design options. After making adjustments to the design as needed, the final selected design is saved on a server.

[0317] Example prompt: "Please propose a design for a compact and stylish sneaker, inspired by the design of a classic feature phone. Include a modern look with rounded corners and metallic material elements."

[0318] In this way, the present invention enables users to enjoy an intuitive and interactive customization experience while meeting modern needs.

[0319] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0320] Step 1:

[0321] The server receives requirement information provided by the user via their terminal. This requirement information includes details and conditions of the desired design. Using this as input, the server references past design information in the database and generates multiple design proposals using a generation AI model. During this process, prompt statements are used to give specific output instructions to the AI ​​model. The resulting design proposals are then output.

[0322] Step 2:

[0323] The server sends the generated design proposals to the terminal via the network. The terminal displays the received design proposals to the user. This display shows the details of each design and the customizable points, and awaits user interaction.

[0324] Step 3:

[0325] The user uses the device's interface to review and adjust the design proposal. The device accepts user input (e.g., touch, click) and dynamically updates design elements such as color, shape, and material. The customized design is regenerated and output on the device.

[0326] Step 4:

[0327] The user sends feedback information about the finalized design proposal to the server via their terminal. The server receives the user's final design adjustments as input and uses this to perform a final review of the design proposal. The final approved design is then output and saved to the database.

[0328] Step 5:

[0329] The server transmits data to the in-store output device based on the final design proposal, enabling visual confirmation and further customization in the real world. Users can review the design proposal displayed in the physical space and make adjustments as needed, allowing them to intuitively visualize the final product. The outputted design is then prepared for manufacturing and delivery according to the final feedback.

[0330] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0331] This invention is a system that uses an emotion engine to recognize a user's emotions and generates and adjusts smartphone design proposals accordingly. This system is primarily implemented through the cooperation of a server, a terminal, and an emotion engine.

[0332] The server utilizes generative artificial intelligence to generate multiple design proposals based on user requirements and emotional data acquired by the emotion engine. By referencing past design data for information and communication devices and incorporating elements that align with the user's preferences estimated from the emotional data, it provides more personalized design proposals. The emotion engine also analyzes the user's emotions in real time and feeds feedback information on recommended designs to the server.

[0333] The terminal interactively presents the user with design proposals sent from the server and emotion-based recommendations from the emotion engine. The interface on the terminal is designed to allow users to easily review and customize the design proposals. The terminal also sends the user's emotional state during operation back to the emotion engine, dynamically adjusting the design proposals in real time.

[0334] Users can refer to design proposals provided via their devices and make modifications and adjustments based on emotionally-based recommendations and suggestions. For example, by adding specific features or design elements to a design proposal that a user has expressed a favorable emotion towards, they can obtain a more satisfying custom design.

[0335] For example, if the emotion engine recognizes an "excited" state while the user is operating the device, the server can generate and present a design proposal with vibrant colors and innovative features. The user then refines the design based on this proposal to finalize the smartphone design.

[0336] This invention provides a device design process that takes user emotions into account, resulting in a system that enables a more personalized user experience.

[0337] The following describes the processing flow.

[0338] Step 1:

[0339] Users input design requirements for their smartphones through their devices. This information includes design style, functionality, and desired materials and colors.

[0340] Step 2:

[0341] The terminal sends the requirements information entered by the user to the server, and simultaneously activates the emotion engine to analyze the user's current emotional state.

[0342] Step 3:

[0343] The emotion engine analyzes the user's emotional state in real time and provides emotional data to the server. This data estimates emotions based on the user's facial expressions, voice tone, and other factors.

[0344] Step 4:

[0345] The server uses generative artificial intelligence to generate multiple design proposals based on the received requirements information and sentiment data. It references a database of past designs to select design elements that are appropriate for the user's emotions.

[0346] Step 5:

[0347] The server sends the generated design proposals and sentiment-based recommendations to the device. As a result, the device displays design proposals tailored to the user's preferences and emotions.

[0348] Step 6:

[0349] The device visually presents the user with multiple design options and related recommendations. The user can compare these options and adjust individual design elements.

[0350] Step 7:

[0351] Users send feedback from their devices to the server, reflecting their emotional state regarding the presented design proposals. This feedback is used to further refine the design proposals.

[0352] Step 8:

[0353] The server incorporates user feedback and sentiment data to refine and finalize the design. The final design is then saved to the cloud and prepared for the manufacturing process if necessary.

[0354] (Example 2)

[0355] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0356] Conventional design generation systems have struggled to make real-time design adjustments based on users' subjective emotions and preferences. As a result, they have been unable to provide design proposals that address individual user emotions, leading to insufficient personalized experiences. Therefore, there is a need for a new system that can analyze user emotions in real time and immediately generate and adjust design proposals using that data.

[0357] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0358] In this invention, the server includes means for acquiring emotional data using a device that analyzes the user's emotions and transmitting said emotional data to the server device; means for operating a generative artificial intelligence that generates multiple design proposals based on the user's requirements information and emotional data; and means for a terminal device that displays the design proposals received from the server device and allows the user to adjust the design proposals. This enables dynamic design generation and adjustment in response to the user's emotions.

[0359] "Emotional data" refers to information that expresses a user's psychological state and emotions in the form of numbers, categories, etc.

[0360] "Generative artificial intelligence" refers to algorithms and programs that automatically generate new information and designs based on large amounts of data.

[0361] A "server device" is a central computing device that performs information processing and data storage via a network.

[0362] A "terminal device" is an electronic device used by users to input and output information.

[0363] A "design proposal" refers to a set of proposals or plans formulated regarding the design and functional specifications of devices such as information and communication equipment.

[0364] "Recommendation information" refers to suggestions for the next action or choice provided based on the user's emotional data and past behavioral history.

[0365] "Feedback information" refers to data compiled from user reactions and evaluations, which is used to improve and adjust the system.

[0366] This invention provides a system that generates and adjusts smartphone designs using user emotion data. The system mainly consists of a server device, terminal devices, sensors related to emotion analysis, and software.

[0367] The server generates multiple design proposals based on emotion data and requirements information obtained from the user by manipulating a generative AI model. In doing so, the server refers to a database of past information and communication device designs. The generative AI model on the server generates designs using prompt statements. For example, a prompt such as, "The user's current emotion is 'excited.' Please generate several smartphone design proposals based on this. Emphasize vibrant colors and innovative features," can be set.

[0368] The terminal functions as a device that interacts with the user. It displays design proposals sent from the server and features an interface that allows the user to provide emotion-based feedback. While the user interacts with the terminal, their emotional state is sent in real time to an emotion analysis system, and this information is returned to the server to help refine the design proposals.

[0369] Users can view design proposals presented through their devices and customize them based on their preferences and emotions. This is crucial for personalizing the user experience and achieving a more satisfying design. For example, if a user expresses excitement upon viewing a design proposal, the next design generated by the server will include more vibrant and dynamic elements.

[0370] By implementing this invention, it becomes possible to design devices that reflect the user's emotions and improve the user experience.

[0371] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0372] Step 1:

[0373] The user acquires emotional data through their device. Specifically, the device uses its built-in camera and microphone to analyze facial expressions and voice in real time. This input data is classified into emotions such as "joy," "excitement," and "calmness" by an emotion analysis algorithm. The output is emotional data that quantifies or categorizes these emotions.

[0374] Step 2:

[0375] The terminal sends the acquired emotional data to the server. At the same time, the terminal also sends user requirements information. The server receives this data and uses it as input for the next process. From the emotional data and requirements information, the server obtains the basic data for design generation.

[0376] Step 3:

[0377] The server generates multiple design proposals using a generative AI model based on the received emotion data and requirements information. Specifically, it creates prompt statements based on the emotion data and inputs them into the AI ​​model. For example, if the emotion is "excitement," it might create a prompt such as "Generate design proposals that include vibrant colors and dynamic features." The output is a collection of generated computer designs.

[0378] Step 4:

[0379] The server sends the generated design proposals to the terminal as options. The terminal receives them and presents them visually to the user. The user can choose their preferred design proposal and further customize it. The terminal provides an interface that clearly displays the received design proposals.

[0380] Step 5:

[0381] Users review the presented design proposals and make adjustments based on their preferences and needs through touch controls. Specifically, they can manipulate color sliders and toggle functions on and off. This allows users to fine-tune the design based on their own feelings and feedback. The output is the design proposal adjusted by the user's actions.

[0382] Step 6:

[0383] The device sends back feedback information and updated sentiment data obtained from user actions to the server. Based on this information, the server readjusts the design proposal as needed or performs a final check. This process finalizes the individualized design proposal. The output is the final confirmed design proposal.

[0384] (Application Example 2)

[0385] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0386] While aiming to provide personalized content based on user emotions, there is a need for a system that generates and adjusts design proposals according to user requests. Conventional technologies make it difficult to adjust content immediately in response to emotions, and a flexible approach is needed to solve this problem.

[0387] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0388] In this invention, the server includes means for operating an artificial intelligence unit that receives requirement information from a user and generates multiple design proposals according to said requirement information; means for a display device that displays the design proposals received from the information processing device and allows the user to adjust the design proposals; and means for a device that generates content according to the emotional state of the user. This makes it possible to provide personalized design proposals and content immediately based on the emotional state of the user.

[0389] A "user" is an individual or group that uses the system to receive and adjust design proposals and content suggestions.

[0390] "Requirements information" refers to data that details the wishes and requests that users present to the system.

[0391] A "design proposal" is a specific design and content plan generated based on the user's requirements information.

[0392] An "artificial intelligence unit" is a software component that generates design proposals and content according to the user's requirements.

[0393] An "information processing device" refers to a computer system used for receiving, processing, and transmitting data.

[0394] A "display device" is an output device that provides users with design proposals and content adjustment screens.

[0395] "Emotional state" refers to the state of a user's psychological or physiological response and serves as a criterion for adjusting content.

[0396] "Content" refers to information media such as videos, music, and video scenes provided to users.

[0397] The server receives requirements information from the user and uses an artificial intelligence unit to generate multiple design proposals. In this process, the server refers to design data from past information and communication systems and customizes the design proposals while also considering the user's emotional state. The server selects appropriate content that corresponds to the user's emotional state and provides it to the user.

[0398] The device (e.g., smartphone or smart glasses) displays design proposals and content sent from the server, providing an interface that allows the user to review and interact with them. This interface is designed to be intuitive, allowing users to adjust design proposals and submit feedback as needed.

[0399] Based on the information displayed on their device, users receive emotion-based recommendations and select designs and content that interest them. During the selection process, the device detects the user's emotions in real time and sends feedback to the server. Through this entire process, users can experience content optimized for their emotional state.

[0400] For example, when a user is operating a device in a relaxed state, the server may send design suggestions or video content with a calming theme that matches that emotional state. In this case, the generative AI model optimizes the suggestions based on the user's past choices and real-time emotional data.

[0401] An example of a prompt to input into a generative AI model is: "Based on the user's current emotions, suggest video clips with relaxing themes. The user's emotional state is 'fatigue'."

[0402] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0403] Step 1:

[0404] The server retrieves requirements information from the user. It receives data indicating the user's wishes and requests as input, and uses this to determine what design proposals should be generated. The server analyzes the received requirements information and forms multiple appropriate design proposals and content generation prompts.

[0405] Step 2:

[0406] The server generates design proposals using an artificial intelligence unit. It uses user requirements information and past design data of information and communication systems as input. Data processing involves extracting trends from similar past data and running a generation AI model to output customized design proposals.

[0407] Step 3:

[0408] The server sends the generated design proposal to the terminal. The output is a design proposal that reflects the user's emotional state. When sending to the terminal, the data is sent in a format that allows for content adjustments that take into account the user's current emotional state.

[0409] Step 4:

[0410] The terminal displays the received design proposals to the user. It receives design proposals sent from the server as input and visualizes them through the user interface. It provides an interactive screen to make it easy for the user to operate.

[0411] Step 5:

[0412] The user provides feedback based on the displayed design proposal. The input data includes design elements selected on the device. By specifically manipulating the parts the user wants to adjust, the feedback data output is generated.

[0413] Step 6:

[0414] The device then sends the user feedback back to the server. Using the feedback data as input, the server analyzes the user's emotional state and selection history, and generates prompts requesting revisions to the design proposal.

[0415] Step 7:

[0416] The server generates content based on emotional states and updates the final design proposal. Inputs include user feedback data and real-time emotional data. Through data processing and the operation of a generative AI model, it provides personalized content output.

[0417] Step 8:

[0418] The terminal presents the user with the updated final design proposal and customized content. It displays the latest design proposal received as input, allowing for further final confirmation and evaluation.

[0419] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0420] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet Search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0421] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0422] [Third Embodiment]

[0423] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0424] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0425] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0426] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0427] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0428] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0429] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0430] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0431] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0432] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0433] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0434] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0435] The present invention is implemented in the following form. The system is composed of three main components: a server device, a terminal device, and a user.

[0436] The server receives requirements information from users and uses artificial intelligence to generate multiple design proposals based on those requirements. The server also refers to a database of past information and communication device designs and uses that data to incorporate retro elements into design proposals that meet modern needs. Furthermore, the server quickly saves the generated design proposals to the cloud and transmits them to terminal devices.

[0437] The terminal plays the role of presenting design proposals received from the server to the user, and provides an environment where the user can adjust the design proposals through an interactive user interface. Users can modify details such as color, shape, and function through touch functions and gesture operations, and customize their own unique design.

[0438] Users can compare multiple design options presented on their device, select the one that best suits their preferences, and make further adjustments. Based on these adjustments, users send feedback to the server via their device. This feedback is used by the server to finalize the design.

[0439] For example, if a user requests a compact and stylish design, the server utilizes design information from past small feature phones to generate various design options (for instance, a modern look with rounded corners or metallic materials). The user can then review these options on their device and make necessary adjustments to ultimately create their own unique smartphone design.

[0440] Thus, the present invention provides a means for users to easily and effectively design information and communication devices that reflect their own needs, enabling the realization of more personalized devices. Furthermore, it is a system that can increase user satisfaction in the final design process, taking into account individual feedback.

[0441] The following describes the processing flow.

[0442] Step 1:

[0443] The user enters design requirements information based on their preferences into the terminal. This includes desired design style, functionality, materials, and colors.

[0444] Step 2:

[0445] The terminal sends user requirements information to the server and requests the generation of design proposals by the artificial intelligence.

[0446] Step 3:

[0447] The server activates the generating artificial intelligence based on the received requirements information. The server references past design data for information and communication devices and generates multiple design options based on that data.

[0448] Step 4:

[0449] The server stores the generated design proposals in the cloud and sends that information to the terminal. This information is organized in a format that the user can view and manipulate.

[0450] Step 5:

[0451] The terminal presents the user with design proposals received from the server. The user visually reviews and compares the provided design proposals before making a selection.

[0452] Step 6:

[0453] Users adjust the design proposal via their device. Specifically, they customize it to their liking by changing colors, shapes, and adding or removing specific functions.

[0454] Step 7:

[0455] Users send feedback on their customized design proposals from their devices to the server. This feedback information is used to refine the final design proposal.

[0456] Step 8:

[0457] The server finalizes the design based on the feedback received and saves it to the cloud. This generates the final design that reflects the user's requests.

[0458] (Example 1)

[0459] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0460] The challenge is to provide a means to quickly and effectively design unique information and communication devices that reflect the individual needs of each user. Another challenge is to build a system that utilizes user feedback to finalize a more satisfactory design.

[0461] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0462] In this invention, the server includes means for a computing device that receives requirement information from a user and operates a generation AI model to generate multiple design proposals according to the requirement information; means for a display device that displays the design proposals received from the computing device and allows the user to adjust the design proposals through interactive operation; and means for transmitting feedback information from the user to the computing device and finalizing the design proposals. This makes it possible to create and finalize original designs based on the requests of individual users.

[0463] A "user" is an individual or organization that uses the system to request, confirm, and adjust the design of information and communication devices.

[0464] A "generative AI model" is an artificial intelligence algorithm that automatically generates design proposals based on requirements information.

[0465] A "processing unit" is an information processing device that uses generative artificial intelligence to perform various processes and generate and manage design proposals.

[0466] A "display device" is a device equipped with an interface that presents design proposals received from a server to the user and allows for adjustments through interactive operation.

[0467] "Feedback information" refers to information that users use to send adjustments and opinions they have made regarding the presented design proposal to the system.

[0468] A "design proposal" is a design suggestion for an information and communication device created by an AI model based on user requirements.

[0469] This invention is implemented in an information processing system comprising users, a server device, and a terminal device. This system utilizes a generative AI model to generate design proposals for information and communication devices based on the requests of individual users, thereby supporting user customization.

[0470] The server receives requirements information from users via the internet. Based on this information, the server activates a generative artificial intelligence and generates multiple design proposals while referencing design data of past information and communication devices. Specifically, the server accesses a design database and constructs design proposals that incorporate elements that meet modern needs. In this process, the generative AI model uses prompt statements to determine the direction of the design. For example, a prompt statement such as "Design a compact and stylish smartphone. Please refer to data from past feature phones" might be used.

[0471] The generated design proposals are saved to the cloud by the server and sent to the device. The device presents the received design proposals to the user, allowing the user to adjust the design through touch and gesture operations via an interactive interface. This allows the user to freely customize the design's color, shape, and function.

[0472] Finally, the user sends feedback on the customized design proposal to the server via their device. This feedback is used by the server to finalize the design proposal. The server then saves the design proposal, incorporating this feedback, to enhance user satisfaction.

[0473] Thus, the present invention is a system that allows users to easily design original information and communication devices that reflect their own requirements, and that can meet the specific needs of users through concrete customization in the process.

[0474] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0475] Step 1:

[0476] The user enters the requirements information into the device.

[0477] The user inputs their desired design and functionality requirements for the information and communication device using the terminal's interface. For example, they might write "I want a retro design" in the form. The terminal receives this requirements information and prepares it as data for the next processing step.

[0478] Step 2:

[0479] The terminal sends the requirements information to the server.

[0480] The terminal converts the requirements information entered by the user into data packets to be sent to the server. The server then begins processing the received requirements information packets as input for database access.

[0481] Step 3:

[0482] The server generates design proposals.

[0483] The server activates the AI ​​model based on the received requirements information. The server operates the AI ​​model using the prompt "Generate a design based on past data" and generates new design proposals by referencing past design data. The generated design proposals are temporarily stored on the server and prepared for the next transmission step.

[0484] Step 4:

[0485] The server sends the design proposal to the terminal.

[0486] The server sends the generated design proposals to the terminal while saving them to the cloud. The terminal inputs the received design proposals in preparation for analysis and display, and converts them into a format for presentation to the user.

[0487] Step 5:

[0488] The device presents design options to the user.

[0489] The terminal displays the received design proposals and presents them to the user through a user interface. To support detailed customization, an interactive operating environment is provided, allowing the user to adjust the design via touch or gesture. This adjustment is prepared as design adjustment data based on user input.

[0490] Step 6:

[0491] Users customize the design proposals.

[0492] Based on the presented design proposal, the user adjusts the color, shape, and function. For example, they might change the roundness of the corners or change the color to red. After customization, the user confirms the design and prepares it as feedback for the next step.

[0493] Step 7:

[0494] The device sends feedback information to the server.

[0495] The device sends user-defined customization information to the server as feedback data. This feedback is used as input data for reviewing and adjusting the final design proposal.

[0496] Step 8:

[0497] The server reviews and saves the final design proposal.

[0498] The server analyzes the feedback information received from the terminal and adjusts and verifies the final design proposal. By saving this verified design proposal to the database, a design based on user-satisfactory specifications is completed.

[0499] (Application Example 1)

[0500] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0501] Conventional design support systems have had the challenge of making it difficult for users to intuitively customize unique designs in real-world spaces to meet their specific needs. Furthermore, there was a lack of systems that could effectively incorporate past design elements into modern products. These challenges made it difficult to maximize user satisfaction.

[0502] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0503] In this invention, the server includes means for an information processing device that receives requirement information from a user and operates a generative artificial intelligence that generates multiple design proposals according to the requirement information; means for an input device that displays the design proposals received from the information processing device and allows the user to adjust the design proposals; means for transmitting feedback information from the user to the information processing device and finalizing the design proposals; and means for an output device that allows the user to intuitively customize products in real space using the generated design proposals. This makes it possible for users to intuitively customize products according to their needs and realize highly satisfying original designs.

[0504] "User" refers to the entity that operates the system and customizes the design proposal based on its own requirements.

[0505] "Requirements information" refers to data that users communicate to the system, expressing their design preferences and requirements.

[0506] "Design proposals" refer to multiple design options generated by artificial intelligence on the server, based on the user's requirements.

[0507] "Generative artificial intelligence" is an artificial intelligence technology that generates new design proposals by referencing past design data.

[0508] An "information processing device" refers to a server or computer system that receives requirements information from users and uses artificial intelligence to generate design proposals.

[0509] An "input device" is a device that a user operates to adjust a design proposal, and typically includes a touch panel or keyboard.

[0510] "Feedback information" refers to data that users send to an information processing device after reviewing and adjusting their design proposals.

[0511] An "output device" is a device that visually presents the generated design proposal to the user, enabling them to verify and customize it in a real-world space.

[0512] The system for carrying out this invention consists of a user, an information processing device (hereinafter referred to as "server"), and input and output devices. The server is responsible for generating design proposals based on the requirements information provided by the user, using generative artificial intelligence (AI model).

[0513] First, the server references past design information from a large database and runs a generation AI model to generate multiple design options that meet the user's needs. The generated design options are then sent to the user's device via the network.

[0514] Users can view and review these design proposals using terminal devices (including input devices), and customize the designs through various interfaces (e.g., touch panels, mice, keyboards). This allows users to make detailed adjustments to colors, shapes, materials, and other elements in real time.

[0515] The customized design proposal is resent to the server as user feedback. Based on this feedback, the server finalizes the design proposal and makes adjustments as needed. Through this process, users can obtain a more satisfying original design.

[0516] As a concrete example, consider a case where a customer customizes the design of sneakers at a physical store. The customer can use a tablet device installed in the store to view various color and pattern design options. After making adjustments to the design as needed, the final selected design is saved on a server.

[0517] Example prompt: "Please propose a design for a compact and stylish sneaker, inspired by the design of a classic feature phone. Include a modern look with rounded corners and metallic elements."

[0518] In this way, the present invention enables users to enjoy an intuitive and interactive customization experience while meeting modern needs.

[0519] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0520] Step 1:

[0521] The server receives requirement information provided by the user via their terminal. This requirement information includes details and conditions of the desired design. Using this as input, the server references past design information in the database and generates multiple design proposals using a generation AI model. During this process, prompt statements are used to give specific output instructions to the AI ​​model. The resulting design proposals are then output.

[0522] Step 2:

[0523] The server sends the generated design proposals to the terminal via the network. The terminal displays the received design proposals to the user. This display shows the details of each design and the customizable points, and awaits user interaction.

[0524] Step 3:

[0525] The user uses the device's interface to review and adjust the design proposal. The device accepts user input (e.g., touch, click) and dynamically updates design elements such as color, shape, and material. The customized design is regenerated and output on the device.

[0526] Step 4:

[0527] The user sends feedback information about the finalized design proposal to the server via their terminal. The server receives the user's final design adjustments as input and uses this to perform a final review of the design proposal. The final approved design is then output and saved to the database.

[0528] Step 5:

[0529] The server transmits data to the in-store output device based on the final design proposal, enabling visual confirmation and further customization in the real world. Users can review the design proposal displayed in the physical space and make adjustments as needed, allowing them to intuitively visualize the final product. The outputted design is then prepared for manufacturing and delivery according to the final feedback.

[0530] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0531] This invention is a system that uses an emotion engine to recognize a user's emotions and generates and adjusts smartphone design proposals accordingly. This system is primarily implemented through the cooperation of a server, a terminal, and an emotion engine.

[0532] The server utilizes generative artificial intelligence to generate multiple design proposals based on user requirements and emotional data acquired by the emotion engine. By referencing past design data for information and communication devices and incorporating elements that align with the user's preferences estimated from the emotional data, it provides more personalized design proposals. The emotion engine also analyzes the user's emotions in real time and feeds feedback information on recommended designs to the server.

[0533] The terminal interactively presents the user with design proposals sent from the server and emotion-based recommendations from the emotion engine. The interface on the terminal is designed to allow users to easily review and customize the design proposals. The terminal also sends the user's emotional state during operation back to the emotion engine, dynamically adjusting the design proposals in real time.

[0534] Users can refer to design proposals provided via their devices and make modifications and adjustments based on emotionally-based recommendations and suggestions. For example, by adding specific features or design elements to a design proposal that a user has expressed a favorable emotion towards, they can obtain a more satisfying custom design.

[0535] For example, if the emotion engine recognizes an "excited" state while the user is operating the device, the server can generate and present a design proposal with vibrant colors and innovative features. The user then refines the design based on this proposal to finalize the smartphone design.

[0536] This invention provides a device design process that takes user emotions into account, resulting in a system that enables a more personalized user experience.

[0537] The following describes the processing flow.

[0538] Step 1:

[0539] Users input design requirements for their smartphones through their devices. This information includes design style, functionality, and desired materials and colors.

[0540] Step 2:

[0541] The terminal sends the requirements information entered by the user to the server, and simultaneously activates the emotion engine to analyze the user's current emotional state.

[0542] Step 3:

[0543] The emotion engine analyzes the user's emotional state in real time and provides emotional data to the server. This data estimates emotions based on the user's facial expressions, voice tone, and other factors.

[0544] Step 4:

[0545] The server uses generative artificial intelligence to generate multiple design proposals based on the received requirements information and sentiment data. It references a database of past designs to select design elements that are appropriate for the user's emotions.

[0546] Step 5:

[0547] The server sends the generated design proposals and sentiment-based recommendations to the device. As a result, the device displays design proposals tailored to the user's preferences and emotions.

[0548] Step 6:

[0549] The device visually presents the user with multiple design options and related recommendations. The user can compare these options and adjust individual design elements.

[0550] Step 7:

[0551] Users send feedback from their devices to the server, reflecting their emotional state regarding the presented design proposals. This feedback is used to further refine the design proposals.

[0552] Step 8:

[0553] The server incorporates user feedback and sentiment data to refine and finalize the design. The final design is then saved to the cloud and prepared for the manufacturing process if necessary.

[0554] (Example 2)

[0555] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0556] Conventional design generation systems have struggled to make real-time design adjustments based on users' subjective emotions and preferences. As a result, they have been unable to provide design proposals that address individual user emotions, leading to insufficient personalized experiences. Therefore, there is a need for a new system that can analyze user emotions in real time and immediately generate and adjust design proposals using that data.

[0557] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0558] In this invention, the server includes means for acquiring emotional data using a device that analyzes the user's emotions and transmitting said emotional data to the server device; means for operating a generative artificial intelligence that generates multiple design proposals based on the user's requirements information and emotional data; and means for a terminal device that displays the design proposals received from the server device and allows the user to adjust the design proposals. This enables dynamic design generation and adjustment in response to the user's emotions.

[0559] "Emotional data" refers to information that expresses a user's psychological state and emotions in the form of numbers, categories, etc.

[0560] "Generative artificial intelligence" refers to algorithms and programs that automatically generate new information and designs based on large amounts of data.

[0561] A "server device" is a central computing device that performs information processing and data storage via a network.

[0562] A "terminal device" is an electronic device used by users to input and output information.

[0563] A "design proposal" refers to a set of proposals or plans formulated regarding the design and functional specifications of devices such as information and communication equipment.

[0564] "Recommendation information" refers to suggestions for the next action or choice provided based on the user's emotional data and past behavioral history.

[0565] "Feedback information" refers to data compiled from user reactions and evaluations, which is used to improve and adjust the system.

[0566] This invention provides a system that generates and adjusts smartphone designs using user emotion data. The system mainly consists of a server device, terminal devices, sensors related to emotion analysis, and software.

[0567] The server generates multiple design proposals based on emotion data and requirements information obtained from the user by manipulating a generative AI model. In doing so, the server refers to a database of past information and communication device designs. The generative AI model on the server generates designs using prompt statements. For example, a prompt such as, "The user's current emotion is 'excited.' Please generate several smartphone design proposals based on this. Emphasize vibrant colors and innovative features," can be set.

[0568] The terminal functions as a device that interacts with the user. It displays design proposals sent from the server and features an interface that allows the user to provide emotion-based feedback. While the user interacts with the terminal, their emotional state is sent in real time to an emotion analysis system, and this information is returned to the server to help refine the design proposals.

[0569] Users can view design proposals presented through their devices and customize them based on their preferences and emotions. This is crucial for personalizing the user experience and achieving a more satisfying design. For example, if a user expresses excitement upon viewing a design proposal, the next design generated by the server will include more vibrant and dynamic elements.

[0570] By implementing this invention, it becomes possible to design devices that reflect the user's emotions and improve the user experience.

[0571] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0572] Step 1:

[0573] The user acquires emotional data through their device. Specifically, the device uses its built-in camera and microphone to analyze facial expressions and voice in real time. This input data is classified into emotions such as "joy," "excitement," and "calmness" by an emotion analysis algorithm. The output is emotional data that quantifies or categorizes these emotions.

[0574] Step 2:

[0575] The terminal sends the acquired emotional data to the server. At the same time, the terminal also sends user requirements information. The server receives this data and uses it as input for the next process. From the emotional data and requirements information, the server obtains the basic data for design generation.

[0576] Step 3:

[0577] The server generates multiple design proposals using a generative AI model based on the received emotion data and requirements information. Specifically, it creates prompt statements based on the emotion data and inputs them into the AI ​​model. For example, if the emotion is "excitement," it might create a prompt such as "Generate design proposals that include vibrant colors and dynamic features." The output is a collection of generated computer designs.

[0578] Step 4:

[0579] The server sends the generated design proposals to the terminal as options. The terminal receives them and presents them visually to the user. The user can choose their preferred design proposal and further customize it. The terminal provides an interface that clearly displays the received design proposals.

[0580] Step 5:

[0581] Users review the presented design proposals and make adjustments based on their preferences and needs through touch controls. Specifically, they can manipulate color sliders and toggle functions on and off. This allows users to fine-tune the design based on their own feelings and feedback. The output is the design proposal adjusted by the user's actions.

[0582] Step 6:

[0583] The device sends back feedback information and updated sentiment data obtained from user actions to the server. Based on this information, the server readjusts the design proposal as needed or performs a final check. This process finalizes the individualized design proposal. The output is the final confirmed design proposal.

[0584] (Application Example 2)

[0585] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0586] While aiming to provide personalized content based on user emotions, there is a need for a system that generates and adjusts design proposals according to user requests. Conventional technologies make it difficult to adjust content immediately in response to emotions, and a flexible approach is needed to solve this problem.

[0587] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0588] In this invention, the server includes means for operating an artificial intelligence unit that receives requirement information from a user and generates multiple design proposals according to said requirement information; means for a display device that displays the design proposals received from the information processing device and allows the user to adjust the design proposals; and means for a device that generates content according to the emotional state of the user. This makes it possible to provide personalized design proposals and content immediately based on the emotional state of the user.

[0589] A "user" is an individual or group that uses the system to receive and adjust design proposals and content suggestions.

[0590] "Requirements information" refers to data that details the wishes and requests that users present to the system.

[0591] A "design proposal" is a specific design and content plan generated based on the user's requirements information.

[0592] An "artificial intelligence unit" is a software component that generates design proposals and content according to the user's requirements.

[0593] An "information processing device" refers to a computer system used for receiving, processing, and transmitting data.

[0594] A "display device" is an output device that provides users with design proposals and content adjustment screens.

[0595] "Emotional state" refers to the state of a user's psychological or physiological response and serves as a criterion for adjusting content.

[0596] "Content" refers to information media such as videos, music, and video scenes provided to users.

[0597] The server receives requirements information from the user and uses an artificial intelligence unit to generate multiple design proposals. In this process, the server refers to design data from past information and communication systems and customizes the design proposals while also considering the user's emotional state. The server selects appropriate content that corresponds to the user's emotional state and provides it to the user.

[0598] The device (e.g., smartphone or smart glasses) displays design proposals and content sent from the server, providing an interface that allows the user to review and interact with them. This interface is designed to be intuitive, allowing users to adjust design proposals and submit feedback as needed.

[0599] Based on the information displayed on their device, users receive emotion-based recommendations and select designs and content that interest them. During the selection process, the device detects the user's emotions in real time and sends feedback to the server. Through this entire process, users can experience content optimized for their emotional state.

[0600] For example, when a user is operating a device in a relaxed state, the server may send design suggestions or video content with a calming theme that matches that emotional state. In this case, the generative AI model optimizes the suggestions based on the user's past choices and real-time emotional data.

[0601] An example of a prompt to input into a generative AI model would be: "Based on the user's current emotions, suggest video clips with relaxing themes. The user's emotional state is 'fatigue'."

[0602] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0603] Step 1:

[0604] The server retrieves requirements information from the user. It receives data indicating the user's wishes and requests as input, and uses this to determine what design proposals should be generated. The server analyzes the received requirements information and forms multiple appropriate design proposals and content generation prompts.

[0605] Step 2:

[0606] The server generates design proposals using an artificial intelligence unit. It uses user requirements information and past design data of information and communication systems as input. Data processing involves extracting trends from similar past data and running a generation AI model to output customized design proposals.

[0607] Step 3:

[0608] The server sends the generated design proposal to the terminal. The output is a design proposal that reflects the user's emotional state. When sending to the terminal, the data is sent in a format that allows for content adjustments that take into account the user's current emotional state.

[0609] Step 4:

[0610] The terminal displays the received design proposals to the user. It receives design proposals sent from the server as input and visualizes them through the user interface. It provides an interactive screen to make it easy for the user to operate.

[0611] Step 5:

[0612] The user provides feedback based on the displayed design proposal. The input data includes design elements selected on the device. By specifically manipulating the parts the user wants to adjust, the feedback data output is generated.

[0613] Step 6:

[0614] The device then sends the user feedback back to the server. Using the feedback data as input, the server analyzes the user's emotional state and selection history, and generates prompts requesting revisions to the design proposal.

[0615] Step 7:

[0616] The server generates content based on emotional states and updates the final design proposal. Inputs include user feedback data and real-time emotional data. Through data processing and the operation of a generative AI model, it provides personalized content output.

[0617] Step 8:

[0618] The terminal presents the user with the updated final design proposal and customized content. It displays the latest design proposal received as input, allowing for further final confirmation and evaluation.

[0619] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0620] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0621] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[0622] [Fourth Embodiment]

[0623] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[0624] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0625] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0626] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[0627] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0628] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0629] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0630] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[0631] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0632] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0633] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0634] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0635] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0636] The present invention is implemented in the following form. The system is composed of three main components: a server device, a terminal device, and a user.

[0637] The server receives requirements information from users and uses artificial intelligence to generate multiple design proposals based on those requirements. The server also refers to a database of past information and communication device designs and uses that data to incorporate retro elements into design proposals that meet modern needs. Furthermore, the server quickly saves the generated design proposals to the cloud and transmits them to terminal devices.

[0638] The terminal plays the role of presenting design proposals received from the server to the user, and provides an environment where the user can adjust the design proposals through an interactive user interface. Users can modify details such as color, shape, and function through touch functions and gesture operations, and customize their own unique design.

[0639] Users can compare multiple design options presented on their device, select the one that best suits their preferences, and make further adjustments. Based on these adjustments, users send feedback to the server via their device. This feedback is used by the server to finalize the design.

[0640] For example, if a user requests a compact and stylish design, the server utilizes design information from past small feature phones to generate various design options (for instance, a modern look with rounded corners or metallic materials). The user can then review these options on their device and make necessary adjustments to ultimately create their own unique smartphone design.

[0641] Thus, the present invention provides a means for users to easily and effectively design information and communication devices that reflect their own needs, enabling the realization of more personalized devices. Furthermore, it is a system that can increase user satisfaction in the final design process, taking into account individual feedback.

[0642] The following describes the processing flow.

[0643] Step 1:

[0644] The user enters design requirements information based on their preferences into the terminal. This includes desired design style, functionality, materials, and colors.

[0645] Step 2:

[0646] The terminal sends user requirements information to the server and requests the generation of design proposals by the artificial intelligence.

[0647] Step 3:

[0648] The server activates the generating artificial intelligence based on the received requirements information. The server references past design data for information and communication devices and generates multiple design options based on that data.

[0649] Step 4:

[0650] The server stores the generated design proposals in the cloud and sends that information to the terminal. This information is organized in a format that the user can view and manipulate.

[0651] Step 5:

[0652] The terminal presents the user with design proposals received from the server. The user visually reviews and compares the provided design proposals before making a selection.

[0653] Step 6:

[0654] Users adjust the design proposal via their device. Specifically, they customize it to their liking by changing colors, shapes, and adding or removing specific functions.

[0655] Step 7:

[0656] Users send feedback on their customized design proposals from their devices to the server. This feedback information is used to refine the final design proposal.

[0657] Step 8:

[0658] The server finalizes the design based on the feedback received and saves it to the cloud. This generates the final design that reflects the user's requests.

[0659] (Example 1)

[0660] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0661] The challenge is to provide a means to quickly and effectively design unique information and communication devices that reflect the individual needs of each user. Another challenge is to build a system that utilizes user feedback to finalize a more satisfactory design.

[0662] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0663] In this invention, the server includes means for a computing device that receives requirement information from a user and operates a generation AI model to generate multiple design proposals according to the requirement information; means for a display device that displays the design proposals received from the computing device and allows the user to adjust the design proposals through interactive operation; and means for transmitting feedback information from the user to the computing device and finalizing the design proposals. This makes it possible to create and finalize original designs based on the requests of individual users.

[0664] A "user" is an individual or organization that uses the system to request, confirm, and adjust the design of information and communication devices.

[0665] A "generative AI model" is an artificial intelligence algorithm that automatically generates design proposals based on requirements information.

[0666] A "processing unit" is an information processing device that uses generative artificial intelligence to perform various processes and generate and manage design proposals.

[0667] A "display device" is a device equipped with an interface that presents design proposals received from a server to the user and allows for adjustments through interactive operation.

[0668] "Feedback information" refers to information that users use to send adjustments and opinions they have made regarding the presented design proposal to the system.

[0669] A "design proposal" is a design suggestion for an information and communication device created by an AI model based on user requirements.

[0670] This invention is implemented in an information processing system comprising users, a server device, and a terminal device. This system utilizes a generative AI model to generate design proposals for information and communication devices based on the requests of individual users, thereby supporting user customization.

[0671] The server receives requirements information from users via the internet. Based on this information, the server activates a generative artificial intelligence and generates multiple design proposals while referencing design data of past information and communication devices. Specifically, the server accesses a design database and constructs design proposals that incorporate elements that meet modern needs. In this process, the generative AI model uses prompt statements to determine the direction of the design. For example, a prompt statement such as "Design a compact and stylish smartphone. Please refer to data from past feature phones" might be used.

[0672] The generated design proposals are saved to the cloud by the server and sent to the device. The device presents the received design proposals to the user, allowing the user to adjust the design through touch and gesture operations via an interactive interface. This allows the user to freely customize the design's color, shape, and function.

[0673] Finally, the user sends feedback on the customized design proposal to the server via their device. This feedback is used by the server to finalize the design proposal. The server then saves the design proposal, incorporating this feedback, to enhance user satisfaction.

[0674] Thus, the present invention is a system that allows users to easily design original information and communication devices that reflect their own requirements, and that can meet the specific needs of users through concrete customization in the process.

[0675] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0676] Step 1:

[0677] The user enters the requirements information into the device.

[0678] The user inputs their desired design and functionality requirements for the information and communication device using the terminal's interface. For example, they might write "I want a retro design" in the form. The terminal receives this requirements information and prepares it as data for the next processing step.

[0679] Step 2:

[0680] The terminal sends the requirements information to the server.

[0681] The terminal converts the requirements information entered by the user into data packets to be sent to the server. The server then begins processing the received requirements information packets as input for database access.

[0682] Step 3:

[0683] The server generates design proposals.

[0684] The server activates the AI ​​model based on the received requirements information. The server operates the AI ​​model using the prompt "Generate a design based on past data" and generates new design proposals by referencing past design data. The generated design proposals are temporarily stored on the server and prepared for the next transmission step.

[0685] Step 4:

[0686] The server sends the design proposal to the terminal.

[0687] The server sends the generated design proposals to the terminal while saving them to the cloud. The terminal inputs the received design proposals in preparation for analysis and display, and converts them into a format for presentation to the user.

[0688] Step 5:

[0689] The device presents design options to the user.

[0690] The terminal displays the received design proposals and presents them to the user through a user interface. To support detailed customization, an interactive operating environment is provided, allowing the user to adjust the design via touch or gesture. This adjustment is prepared as design adjustment data based on user input.

[0691] Step 6:

[0692] Users customize the design proposals.

[0693] Based on the presented design proposal, the user adjusts the color, shape, and function. For example, they might change the roundness of the corners or change the color to red. After customization, the user confirms the design and prepares it as feedback for the next step.

[0694] Step 7:

[0695] The device sends feedback information to the server.

[0696] The device sends user-defined customization information to the server as feedback data. This feedback is used as input data for reviewing and adjusting the final design proposal.

[0697] Step 8:

[0698] The server reviews and saves the final design proposal.

[0699] The server analyzes the feedback information received from the terminal and adjusts and verifies the final design proposal. By saving this verified design proposal to the database, a design based on user-satisfactory specifications is completed.

[0700] (Application Example 1)

[0701] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0702] Conventional design support systems have had the challenge of making it difficult for users to intuitively customize unique designs in real-world spaces to meet their specific needs. Furthermore, there was a lack of systems that could effectively incorporate past design elements into modern products. These challenges made it difficult to maximize user satisfaction.

[0703] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0704] In this invention, the server includes means for an information processing device that receives requirement information from a user and operates a generative artificial intelligence that generates multiple design proposals according to the requirement information; means for an input device that displays the design proposals received from the information processing device and allows the user to adjust the design proposals; means for transmitting feedback information from the user to the information processing device and finalizing the design proposals; and means for an output device that allows the user to intuitively customize products in real space using the generated design proposals. This makes it possible for users to intuitively customize products according to their needs and realize highly satisfying original designs.

[0705] "User" refers to the entity that operates the system and customizes the design proposal based on its own requirements.

[0706] "Requirements information" refers to data that users communicate to the system, expressing their design preferences and requirements.

[0707] "Design proposals" refer to multiple design options generated by artificial intelligence on the server, based on the user's requirements.

[0708] "Generative artificial intelligence" is an artificial intelligence technology that generates new design proposals by referencing past design data.

[0709] An "information processing device" refers to a server or computer system that receives requirements information from users and uses artificial intelligence to generate design proposals.

[0710] An "input device" is a device that a user operates to adjust a design proposal, and typically includes a touch panel or keyboard.

[0711] "Feedback information" refers to data that users send to an information processing device after reviewing and adjusting their design proposals.

[0712] An "output device" is a device that visually presents the generated design proposal to the user, enabling them to verify and customize it in a real-world space.

[0713] The system for carrying out this invention consists of a user, an information processing device (hereinafter referred to as "server"), and input and output devices. The server is responsible for generating design proposals based on the requirements information provided by the user, using generative artificial intelligence (AI model).

[0714] First, the server references past design information from a large database and runs a generation AI model to generate multiple design options that meet the user's needs. The generated design options are then sent to the user's device via the network.

[0715] Users can view and review these design proposals using terminal devices (including input devices), and customize the designs through various interfaces (e.g., touch panels, mice, keyboards). This allows users to make detailed adjustments to colors, shapes, materials, and other elements in real time.

[0716] The customized design proposal is resent to the server as user feedback. Based on this feedback, the server finalizes the design proposal and makes adjustments as needed. Through this process, users can obtain a more satisfying original design.

[0717] As a concrete example, consider a case where a customer customizes the design of sneakers at a physical store. The customer can use a tablet device installed in the store to view various color and pattern design options. After making adjustments to the design as needed, the final selected design is saved on a server.

[0718] Example prompt: "Please propose a design for a compact and stylish sneaker, inspired by the design of a classic feature phone. Include a modern look with rounded corners and metallic elements."

[0719] In this way, the present invention enables users to enjoy an intuitive and interactive customization experience while meeting modern needs.

[0720] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0721] Step 1:

[0722] The server receives requirement information provided by the user via their terminal. This requirement information includes details and conditions of the desired design. Using this as input, the server references past design information in the database and generates multiple design proposals using a generation AI model. During this process, prompt statements are used to give specific output instructions to the AI ​​model. The resulting design proposals are then output.

[0723] Step 2:

[0724] The server sends the generated design proposals to the terminal via the network. The terminal displays the received design proposals to the user. This display shows the details of each design and the customizable points, and awaits user interaction.

[0725] Step 3:

[0726] The user uses the device's interface to review and adjust the design proposal. The device accepts user input (e.g., touch, click) and dynamically updates design elements such as color, shape, and material. The customized design is regenerated and output on the device.

[0727] Step 4:

[0728] The user sends feedback information about the finalized design proposal to the server via their terminal. The server receives the user's final design adjustments as input and uses this to perform a final review of the design proposal. The final approved design is then output and saved to the database.

[0729] Step 5:

[0730] The server transmits data to the in-store output device based on the final design proposal, enabling visual confirmation and further customization in the real world. Users can review the design proposal displayed in the physical space and make adjustments as needed, allowing them to intuitively visualize the final product. The outputted design is then prepared for manufacturing and delivery according to the final feedback.

[0731] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0732] This invention is a system that uses an emotion engine to recognize a user's emotions and generates and adjusts smartphone design proposals accordingly. This system is primarily implemented through the cooperation of a server, a terminal, and an emotion engine.

[0733] The server utilizes generative artificial intelligence to generate multiple design proposals based on user requirements and emotional data acquired by the emotion engine. By referencing past design data for information and communication devices and incorporating elements that align with the user's preferences estimated from the emotional data, it provides more personalized design proposals. The emotion engine also analyzes the user's emotions in real time and feeds feedback information on recommended designs to the server.

[0734] The terminal interactively presents the user with design proposals sent from the server and emotion-based recommendations from the emotion engine. The interface on the terminal is designed to allow users to easily review and customize the design proposals. The terminal also sends the user's emotional state during operation back to the emotion engine, dynamically adjusting the design proposals in real time.

[0735] Users can refer to design proposals provided via their devices and make modifications and adjustments based on emotionally-based recommendations and suggestions. For example, by adding specific features or design elements to a design proposal that a user has expressed a favorable emotion towards, they can obtain a more satisfying custom design.

[0736] For example, if the emotion engine recognizes an "excited" state while the user is operating the device, the server can generate and present a design proposal with vibrant colors and innovative features. The user then refines the design based on this proposal to finalize the smartphone design.

[0737] This invention provides a device design process that takes user emotions into account, resulting in a system that enables a more personalized user experience.

[0738] The following describes the processing flow.

[0739] Step 1:

[0740] Users input design requirements for their smartphones through their devices. This information includes design style, functionality, and desired materials and colors.

[0741] Step 2:

[0742] The terminal sends the requirements information entered by the user to the server, and simultaneously activates the emotion engine to analyze the user's current emotional state.

[0743] Step 3:

[0744] The emotion engine analyzes the user's emotional state in real time and provides emotional data to the server. This data estimates emotions based on the user's facial expressions, voice tone, and other factors.

[0745] Step 4:

[0746] The server uses generative artificial intelligence to generate multiple design proposals based on the received requirements information and sentiment data. It references a database of past designs to select design elements that are appropriate for the user's emotions.

[0747] Step 5:

[0748] The server sends the generated design proposals and sentiment-based recommendations to the device. As a result, the device displays design proposals tailored to the user's preferences and emotions.

[0749] Step 6:

[0750] The device visually presents the user with multiple design options and related recommendations. The user can compare these options and adjust individual design elements.

[0751] Step 7:

[0752] Users send feedback from their devices to the server, reflecting their emotional state regarding the presented design proposals. This feedback is used to further refine the design proposals.

[0753] Step 8:

[0754] The server incorporates user feedback and sentiment data to refine and finalize the design. The final design is then saved to the cloud and prepared for the manufacturing process if necessary.

[0755] (Example 2)

[0756] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0757] Conventional design generation systems have struggled to make real-time design adjustments based on users' subjective emotions and preferences. As a result, they have been unable to provide design proposals that address individual user emotions, leading to insufficient personalized experiences. Therefore, there is a need for a new system that can analyze user emotions in real time and immediately generate and adjust design proposals using that data.

[0758] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0759] In this invention, the server includes means for acquiring emotional data using a device that analyzes the user's emotions and transmitting said emotional data to the server device; means for operating a generative artificial intelligence that generates multiple design proposals based on the user's requirements information and emotional data; and means for a terminal device that displays the design proposals received from the server device and allows the user to adjust the design proposals. This enables dynamic design generation and adjustment in response to the user's emotions.

[0760] "Emotional data" refers to information that expresses a user's psychological state and emotions in the form of numbers, categories, etc.

[0761] "Generative artificial intelligence" refers to algorithms and programs that automatically generate new information and designs based on large amounts of data.

[0762] A "server device" is a central computing device that performs information processing and data storage via a network.

[0763] A "terminal device" is an electronic device used by users to input and output information.

[0764] A "design proposal" refers to a set of proposals or plans formulated regarding the design and functional specifications of devices such as information and communication equipment.

[0765] "Recommendation information" refers to suggestions for the next action or choice provided based on the user's emotional data and past behavioral history.

[0766] "Feedback information" refers to data compiled from user reactions and evaluations, which is used to improve and adjust the system.

[0767] This invention provides a system that generates and adjusts smartphone designs using user emotion data. The system mainly consists of a server device, terminal devices, sensors related to emotion analysis, and software.

[0768] The server generates multiple design proposals based on emotion data and requirements information obtained from the user by manipulating a generative AI model. In doing so, the server refers to a database of past information and communication device designs. The generative AI model on the server generates designs using prompt statements. For example, a prompt such as, "The user's current emotion is 'excited.' Please generate several smartphone design proposals based on this. Emphasize vibrant colors and innovative features," can be set.

[0769] The terminal functions as a device that interacts with the user. It displays design proposals sent from the server and features an interface that allows the user to provide emotion-based feedback. While the user interacts with the terminal, their emotional state is sent in real time to an emotion analysis system, and this information is returned to the server to help refine the design proposals.

[0770] Users can view design proposals presented through their devices and customize them based on their preferences and emotions. This is crucial for personalizing the user experience and achieving a more satisfying design. For example, if a user expresses excitement upon viewing a design proposal, the next design generated by the server will include more vibrant and dynamic elements.

[0771] By implementing this invention, it becomes possible to design devices that reflect the user's emotions and improve the user experience.

[0772] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0773] Step 1:

[0774] The user acquires emotional data through their device. Specifically, the device uses its built-in camera and microphone to analyze facial expressions and voice in real time. This input data is classified into emotions such as "joy," "excitement," and "calmness" by an emotion analysis algorithm. The output is emotional data that quantifies or categorizes these emotions.

[0775] Step 2:

[0776] The terminal sends the acquired emotional data to the server. At the same time, the terminal also sends user requirements information. The server receives this data and uses it as input for the next process. From the emotional data and requirements information, the server obtains the basic data for design generation.

[0777] Step 3:

[0778] The server generates multiple design proposals using a generative AI model based on the received emotion data and requirements information. Specifically, it creates prompt statements based on the emotion data and inputs them into the AI ​​model. For example, if the emotion is "excitement," it might create a prompt such as "Generate design proposals that include vibrant colors and dynamic features." The output is a collection of generated computer designs.

[0779] Step 4:

[0780] The server sends the generated design proposals to the terminal as options. The terminal receives them and presents them visually to the user. The user can choose their preferred design proposal and further customize it. The terminal provides an interface that clearly displays the received design proposals.

[0781] Step 5:

[0782] Users review the presented design proposals and make adjustments based on their preferences and needs through touch controls. Specifically, they can manipulate color sliders and toggle functions on and off. This allows users to fine-tune the design based on their own feelings and feedback. The output is the design proposal adjusted by the user's actions.

[0783] Step 6:

[0784] The device sends back feedback information and updated sentiment data obtained from user actions to the server. Based on this information, the server readjusts the design proposal as needed or performs a final check. This process finalizes the individualized design proposal. The output is the final confirmed design proposal.

[0785] (Application Example 2)

[0786] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0787] While aiming to provide personalized content based on user emotions, there is a need for a system that generates and adjusts design proposals according to user requests. Conventional technologies make it difficult to adjust content immediately in response to emotions, and a flexible approach is needed to solve this problem.

[0788] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0789] In this invention, the server includes means for operating an artificial intelligence unit that receives requirement information from a user and generates multiple design proposals according to said requirement information; means for a display device that displays the design proposals received from the information processing device and allows the user to adjust the design proposals; and means for a device that generates content according to the emotional state of the user. This makes it possible to provide personalized design proposals and content immediately based on the emotional state of the user.

[0790] A "user" is an individual or group that uses the system to receive and adjust design proposals and content suggestions.

[0791] "Requirements information" refers to data that details the wishes and requests that users present to the system.

[0792] A "design proposal" is a specific design and content plan generated based on the user's requirements information.

[0793] An "artificial intelligence unit" is a software component that generates design proposals and content according to the user's requirements.

[0794] An "information processing device" refers to a computer system used for receiving, processing, and transmitting data.

[0795] A "display device" is an output device that provides users with design proposals and content adjustment screens.

[0796] "Emotional state" refers to the state of a user's psychological or physiological response and serves as a criterion for adjusting content.

[0797] "Content" refers to information media such as videos, music, and video scenes provided to users.

[0798] The server receives requirements information from the user and uses an artificial intelligence unit to generate multiple design proposals. In this process, the server refers to design data from past information and communication systems and customizes the design proposals while also considering the user's emotional state. The server selects appropriate content that corresponds to the user's emotional state and provides it to the user.

[0799] The device (e.g., smartphone or smart glasses) displays design proposals and content sent from the server, providing an interface that allows the user to review and interact with them. This interface is designed to be intuitive, allowing users to adjust design proposals and submit feedback as needed.

[0800] Based on the information displayed on their device, users receive emotion-based recommendations and select designs and content that interest them. During the selection process, the device detects the user's emotions in real time and sends feedback to the server. Through this entire process, users can experience content optimized for their emotional state.

[0801] For example, when a user is operating a device in a relaxed state, the server may send design suggestions or video content with a calming theme that matches that emotional state. In this case, the generative AI model optimizes the suggestions based on the user's past choices and real-time emotional data.

[0802] An example of a prompt to input into a generative AI model would be: "Based on the user's current emotions, suggest video clips with relaxing themes. The user's emotional state is 'fatigue'."

[0803] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0804] Step 1:

[0805] The server retrieves requirements information from the user. It receives data indicating the user's wishes and requests as input, and uses this to determine what design proposals should be generated. The server analyzes the received requirements information and forms multiple appropriate design proposals and content generation prompts.

[0806] Step 2:

[0807] The server generates design proposals using an artificial intelligence unit. It uses user requirements information and past design data of information and communication systems as input. Data processing involves extracting trends from similar past data and running a generation AI model to output customized design proposals.

[0808] Step 3:

[0809] The server sends the generated design proposal to the terminal. The output is a design proposal that reflects the user's emotional state. When sending to the terminal, the data is sent in a format that allows for content adjustments that take into account the user's current emotional state.

[0810] Step 4:

[0811] The terminal displays the received design proposals to the user. It receives design proposals sent from the server as input and visualizes them through the user interface. It provides an interactive screen to make it easy for the user to operate.

[0812] Step 5:

[0813] The user provides feedback based on the displayed design proposal. The input data includes design elements selected on the device. By specifically manipulating the parts the user wants to adjust, the feedback data output is generated.

[0814] Step 6:

[0815] The device then sends the user feedback back to the server. Using the feedback data as input, the server analyzes the user's emotional state and selection history, and generates prompts requesting revisions to the design proposal.

[0816] Step 7:

[0817] The server generates content based on emotional states and updates the final design proposal. Inputs include user feedback data and real-time emotional data. Through data processing and the operation of a generative AI model, it provides personalized content output.

[0818] Step 8:

[0819] The terminal presents the user with the updated final design proposal and customized content. It displays the latest design proposal received as input, allowing for further final confirmation and evaluation.

[0820] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0821] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0822] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[0823] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[0824] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[0825] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[0826] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[0827] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[0828] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[0829] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[0830] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[0831] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[0832] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0833] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0834] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0835] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0836] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0837] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0838] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0839] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0840] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted as being incorporated by reference.

[0841] The following is further disclosed regarding the embodiments described above.

[0842] (Claim 1)

[0843] A means comprising a server device that receives requirements information from users and operates a generative artificial intelligence that generates multiple design proposals according to said requirements information,

[0844] A means comprising a terminal device that displays design proposals received from the server device and allows users to adjust the design proposals,

[0845] A means of transmitting feedback information from the user to a server device and finalizing the design proposal,

[0846] A system that includes this.

[0847] (Claim 2)

[0848] The system according to claim 1, characterized in that the generating artificial intelligence refers to past design data of information and communication devices and generates multiple design proposals based on said design data.

[0849] (Claim 3)

[0850] The system according to claim 1, characterized in that the server device includes means for storing a final design proposal that reflects feedback from the user.

[0851] "Example 1"

[0852] (Claim 1)

[0853] A means comprising a computing device that receives requirements information from a user and operates a generating AI model to generate multiple design proposals according to said requirements information,

[0854] A means comprising a display device that displays the design proposal received from the computing device and allows the user to adjust the design proposal through interactive operation,

[0855] A means of transmitting feedback information from the user to a computing device and making a final confirmation of the design proposal,

[0856] A system that includes this.

[0857] (Claim 2)

[0858] The system according to claim 1, characterized in that the generating AI model refers to past design data of information and communication devices and generates multiple design proposals based on said design data.

[0859] (Claim 3)

[0860] The system according to claim 1, characterized in that the computing device includes means for storing a final design proposal that reflects feedback from the user.

[0861] "Application Example 1"

[0862] (Claim 1)

[0863] A means comprising an information processing device that receives requirements information from a user and operates a generative artificial intelligence that generates multiple design proposals according to said requirements information,

[0864] A means comprising an input device that displays a design proposal received from the information processing device and allows the user to adjust the design proposal,

[0865] A means of transmitting feedback information from the user to an information processing device and making a final confirmation of the design proposal,

[0866] A means of providing an output device that allows for the intuitive customization of products in real space using the generated design proposal,

[0867] A system that includes this.

[0868] (Claim 2)

[0869] The system according to claim 1, characterized in that the generating artificial intelligence refers to past design information, generates multiple design proposals based on said design information, and enables visual confirmation in real space.

[0870] (Claim 3)

[0871] The system according to claim 1, characterized in that the information processing device includes means for saving a final design proposal that reflects feedback from the user, and further has a function for visual confirmation and adjustment in real space.

[0872] "Example 2 of combining an emotion engine"

[0873] (Claim 1)

[0874] A means for acquiring emotional data using a device that analyzes the user's emotions and transmitting said emotional data to a server device,

[0875] A means comprising a server device that operates a generative artificial intelligence that generates multiple design proposals based on user requirements information and sentiment data,

[0876] A means comprising a terminal device that displays design proposals received from the server device and allows users to adjust the design proposals,

[0877] A means of providing users with recommendation information based on sentiment data, having the terminal device send user feedback information to the server device, and finalizing the design proposal,

[0878] A system that includes this.

[0879] (Claim 2)

[0880] The system according to claim 1, characterized in that the generating artificial intelligence dynamically customizes the design proposals based on emotional data.

[0881] (Claim 3)

[0882] The system according to claim 1, characterized in that the server device includes means for storing a final design proposal that takes into account the user's emotional data.

[0883] "Application example 2 when combining with an emotional engine"

[0884] (Claim 1)

[0885] A means comprising an information processing device that receives requirements information from a user and operates an artificial intelligence unit that generates multiple design proposals according to said requirements information,

[0886] A means comprising a display device that displays a design proposal received from the information processing device and allows the user to adjust the design proposal,

[0887] A means comprising a device that generates content corresponding to the emotional state of the user,

[0888] A means of transmitting feedback information from the user to an information processing device and making a final confirmation of the design proposal,

[0889] A system that includes this.

[0890] (Claim 2)

[0891] The system according to claim 1, characterized in that an artificial intelligence unit refers to design data of past information and communication systems, generates multiple design proposals based on said design data, and further dynamically adjusts the color tone and theme of the content while taking into account the emotional state of the user.

[0892] (Claim 3)

[0893] The system according to claim 1, characterized in that the information processing device includes means for storing a final design proposal and customized content proposals that reflect feedback from the user. [Explanation of Symbols]

[0894] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. A means comprising a server device that receives requirements information from users and operates a generative artificial intelligence that generates multiple design proposals according to said requirements information, A means comprising a terminal device that displays design proposals received from the server device and allows users to adjust the design proposals, A means of transmitting feedback information from the user to a server device and finalizing the design proposal, A system that includes this.

2. The system according to claim 1, characterized in that the generating artificial intelligence refers to design data of past information and communication devices and generates multiple design proposals based on said design data.

3. The system according to claim 1, characterized in that the server device includes means for saving a final design proposal that reflects feedback from the user.

Images