Virtual character service method for artificial intelligence assistant, electronic device supporting same, and recording medium thereof

Abstract

An electronic device according to one embodiment can be configured to: recognize a target device included in an image displayed on a display; analyze user preference according to personal characteristics on the basis of user content stored in a memory, so as to determine at least one theme related to a virtual character of the recognized target device; request, from generative artificial intelligence (AI), the virtual character related to the determined at least one theme on the basis of a first input for requesting the generation of the virtual character of the recognized target device; receive, from the generative AI, the virtual character generated according to the at least one theme and display same on the display; select, on the basis of a second input for requesting detailed editing of the virtual character displayed on the display, first user content related to the theme determined by the preference; display, on the display, a detailed-editing user interface (UI) screen that displays the selected first user content as option items enabling partial editing of the virtual character; and at least partially modify, on the basis of a third input for at least partially selecting the displayed user content, the virtual character displayed on the display.

Description

Method for providing a virtual character service for an artificial intelligence assistant, an electronic device supporting the same, and a recording medium thereof

[0001] The present disclosure relates to a virtual character service method for an artificial intelligence assistant, an electronic device supporting the same, and a recording medium thereof.

[0002] Electronic devices offer a variety of convenient features for the convenience of their users. For example, electronic devices support artificial intelligence (AI) assistant functions that enable users to interact with the device. Vehicle systems offer car assistant services, and home systems offer home assistant services, providing users with not only convenient features but also an enhanced user experience.

[0003] Recently, with the emergence of the concept of infotainment, a combination of information and entertainment, technology development is underway in various industries to provide entertainment as well as information through electronic devices.

[0004] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above-described matters constitute prior art related to the present disclosure.

[0005] In the automotive industry, the importance of media content is increasing as information technology (IT) and future mobility technologies (e.g., autonomous driving) converge, freeing users (or drivers) from the burden of driving. Through AI assistants (or in-vehicle infotainment systems), users can now enjoy a wide range of media content and services, including navigation, augmented reality (AR), and voice recognition, even within their vehicles.

[0006] However, currently commercialized AI assistants have expressive limitations, failing to vividly convey the user's state, emotions, or the occurrence of events. Consequently, the AI ​​assistant field needs to move beyond conventional information delivery methods and develop methods that deliver information based on individual preferences or provide new forms of entertainment. Furthermore, there is a growing demand for differentiated AI assistants that stand out from competitors.

[0007] Various embodiments propose a method and device, as well as a recording medium thereof, that can provide fun and new experiences in various industrial fields by identifying personal preferences of users based on user contents and incorporating virtual characters (or device characters, device avatars) reflecting personal characteristics into AI assistants.

[0008] The problem to be solved in this disclosure is not limited to the problem mentioned above, and may be expanded in various ways without departing from the spirit and scope of this disclosure.

[0009] An electronic device according to one embodiment may include a display. The electronic device according to one embodiment may include a communication module including at least one communication circuit. The electronic device according to one embodiment may include at least one processor including processing circuitry. The electronic device according to one embodiment may include a memory storing instructions executable by the at least one processor. The instructions according to one embodiment, when executed by the processor, may cause the electronic device to recognize a target device included in an image displayed on the display. The instructions according to one embodiment may cause the electronic device to analyze user preferences according to personal characteristics based on user contents stored in the memory and determine at least one theme associated with a virtual character of the recognized target device. The instructions according to one embodiment may cause the electronic device to request a generative artificial intelligence (AI) to generate a virtual character associated with the determined at least one theme based on a first input requesting generation of a virtual character of the recognized target device. The instructions according to one embodiment may cause the electronic device to receive a virtual character generated according to the at least one theme from the generative AI and display the virtual character on the display. In one embodiment, the commands may cause the electronic device to select first user contents related to a theme determined by the preference based on a second input requesting detailed editing of a virtual character displayed on the display, and to display a detailed editing user interface (UI) screen on the display that displays the selected first user contents as optional items that can partially edit a visual representation of the virtual character.Commands according to one embodiment may cause a virtual character displayed on the display to at least partially transform based on a third input that selects at least some of the displayed user content.

[0010] A virtual character service method for an artificial intelligence assistant of an electronic device according to one embodiment may include an operation of recognizing a target device included in an image displayed on a display. The method according to one embodiment may include an operation of analyzing user preferences according to personal characteristics based on user contents stored in the electronic device to determine at least one theme related to a virtual character of the recognized target device. The method according to one embodiment may include an operation of requesting, based on a first input requesting the creation of a virtual character of the recognized target device, a virtual character related to the determined at least one theme from a generative AI (artificial intelligence). The method according to one embodiment may include an operation of receiving, from the generative AI, a virtual character generated according to the at least one theme and displaying the virtual character on the display. The method according to one embodiment may include an operation of selecting, based on a second input requesting detailed editing of the virtual character displayed on the display, first user contents related to the theme determined by the preferences, and displaying, on the display, a detailed editing user interface (UI) screen that displays the selected first user contents as optional items that enable partial editing of the virtual character. A method according to one embodiment may include at least partially deforming a virtual character displayed on the display based on a third input that selects at least some of the first user content.

[0011] An electronic device according to one embodiment may include a computer-readable recording medium having recorded thereon a program for implementing a virtual character service method for an artificial intelligence assistant.

[0012] According to various embodiments, a user's personal preference according to the user's personal characteristics of an electronic device can be identified, and a basic virtual character can be generated corresponding to a target device by reflecting the user's preference.

[0013] According to various embodiments, by providing virtual characters for various themes and providing a detailed editing screen that allows partial editing of the virtual characters with user contents selected based on user preferences, an environment can be provided in which virtual characters can be customized and changed according to individual needs.

[0014] According to various embodiments, in the field of artificial intelligence assistant services of a target device connected to an electronic device, a specialized artificial intelligence assistant service can be provided by providing a virtual character that reflects not only the characteristics of the target device but also user preferences.

[0015] According to various embodiments, the electronic device can generate character contents for the target device including virtual characters by linking with the target device, and can also generate contents for the target device and apply them to an artificial intelligence assistant service, thereby providing users with not only simple information provision but also enhanced new and enjoyable sensory experiences.

[0016] The effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the art to which the present disclosure belongs from the description below.

[0017] In connection with the description of the drawings, the same or similar reference numerals may be used for the same or similar components.

[0018] FIG. 1A is a block diagram of an electronic device within a network environment according to various embodiments.

[0019] Figure 1b illustrates the configuration of a generative AI system according to one embodiment.

[0020] FIG. 2 illustrates a virtual character service method for an artificial intelligence assistant of an electronic device according to one embodiment.

[0021] FIGS. 3A to 3C are drawings for explaining a user interface screen for creating a virtual character corresponding to an electronic device external to an electronic device according to one embodiment.

[0022] FIG. 4 is a diagram illustrating a user interface screen related to a virtual character service for an artificial intelligence assistant of an electronic device according to one embodiment.

[0023] FIG. 5 illustrates a method for generating a graphic object for an artificial intelligence assistant service according to one embodiment.

[0024] FIG. 6 is a diagram illustrating a user interface screen for creating a virtual character for an artificial intelligence assistant of an electronic device according to one embodiment.

[0025] FIG. 7 illustrates a situation diagram for explaining the operational functions of a virtual character generation system according to one embodiment.

[0026] FIG. 8A is a diagram illustrating an operation supporting a virtual character service of an artificial intelligence assistant system according to one embodiment.

[0027] FIG. 8b is a flowchart illustrating a method for supporting a virtual character service in electronic autonomy according to one embodiment.

[0028] FIGS. 9A and 9B are flowcharts illustrating a method for supporting a virtual character service for an artificial intelligence assistant according to one embodiment.

[0029] Figure 10 is a drawing for explaining a method for determining a theme level of a virtual character according to one embodiment.

[0030] Fig. 11 is a drawing for explaining the screen configuration of a vehicle according to one embodiment.

[0031] FIGS. 12A and 12B are examples of automotive character interface screens displayed on an electronic device and a target device according to one embodiment.

[0032] FIG. 13 illustrates a method for supporting a virtual character service for an artificial intelligence assistant in an electronic device and a target device according to one embodiment.

[0033] FIGS. 14A to 14C are examples of virtual character service interface screens for an artificial intelligence assistant of a target device according to one embodiment.

[0034] FIG. 15 is a diagram illustrating a virtual character service situation for an artificial intelligence assistant of a target device according to one embodiment.

[0035] FIG. 16 is a drawing for explaining a virtual character content service function of an electronic device according to one embodiment.

[0036] FIG. 1A is a block diagram of an electronic device within a network environment, according to one embodiment.

[0037] Referring to FIG. 1A, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160) (or a display (160)), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0038] The processor (120) includes at least one processing circuit, and the at least one processing circuit can control at least one other component (e.g., hardware or software component) of the electronic device (101) connected to the processor (120) by executing, for example, software (e.g., program (140)), and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) can store commands or data received from other components (e.g., sensor module (176) or communication module (190)) in the volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in the non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0039] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0040] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0041] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0042] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0043] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0044] The display module (160) (or display (160)) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. In one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0045] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0046] The sensor module (176) includes at least one sensor and can detect an operating state (e.g., power or temperature) of the electronic device (101) or an external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0047] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0048] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0049] A haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. In one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0050] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0051] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least a part of a power management integrated circuit (PMIC).

[0052] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0053] The communication module (190) includes at least one communication circuit and can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., the electronic device (102), the electronic device (104), or the server (108)), and the performance of communication through the established communication channel. The communication module (190) operates independently from the processor (120) (e.g., an application processor) and can include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) can include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0054] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0055] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas by, for example, the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0056] In one embodiment, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0057] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0058] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0059] The electronic device (101) according to the embodiments disclosed in this document may take various forms. The electronic device (101) may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance. The electronic device according to the embodiments of this document is not limited to the aforementioned devices.

[0060] An electronic device (101) according to one embodiment may support a generative AI (generative artificial intelligence) function. The generative AI function may refer to a technology that generates new content based on previously learned data and can generate new forms of AI content (or generative content) by utilizing given input data or information. Here, AI content may refer to content (e.g., 3D objects, images, videos, audio, screen information, or text) that is entirely generated (or reconstructed / edited) or partially generated (or reconstructed / edited) based on generative AI.

[0061] An electronic device (101) according to one embodiment may be implemented to provide generative AI functionality using a portion of the AI ​​system of FIG. 1B.

[0062] An electronic device (101) according to one embodiment may support a generative AI function in conjunction with a server (108). At least one of the electronic device (101) or the server (108) according to one embodiment may include the configuration of the generative AI system illustrated in FIG. 1B.

[0063] Figure 1b illustrates the configuration of a generative AI system according to one embodiment.

[0064] Referring to FIG. 1b, the generative AI system may include a user interface (10100), an AI framework (10200), a generative AI model (10300), an application and service component (10400), and a database component (10500).

[0065] A user interface (e.g., a user query / response interface) (10100) according to one embodiment may receive a user query. The user query input may be in the form of natural language, images, and videos. The user interface (10100) may transmit not only data regarding the user query input but also context information to the AI ​​framework (10200). The context information may include various additional information at the time of user input. In addition, the user query input may be in a form that mixes the above-described natural language, images, sounds, and context information. In addition, the user query input may be in a non-natural language form that does not generate natural language, such as a menu selection (e.g., a creation request or a modification request). The user interface (10100) may output the results of a generative artificial intelligence system to the user. The output may be in the form of natural language or specific content, and may also be provided in the form of an action requested by the user.

[0066] An AI framework (10200) according to one embodiment can receive a user query input and coordinate and control each component necessary to perform the user's intention based on the user's query input. The AI ​​framework (10200) can include a prompt design component (10210), an application and plug-in management component (APIs / Plugins Management component) (10230), and an output modification component (10250).

[0067] A user query or action entered in a user interface (10100) according to one embodiment may be transmitted to a prompt design component (10210). The prompt design component (10210) may be used to generate prompts suitable for input into a large language model (LLM) or a large multimodal model (LMM). The prompt design component (10210) may be an AI component that uses a machine learning algorithm or a neural network to develop better prompts over time. The prompt design component (10210) may access a database component (10500) (e.g., a knowledge component) containing user preference data, a prompt library, and prompt examples to generate prompts and pass them to the large language model (LLM) or the large multimodal model (LMM).

[0068] According to one embodiment, the application and plugin management component (10230) can communicate with external information when there is a request for additional information when passing user input as input to a generative model. The application and plugin management component (10230) establishes a channel for communicating with the external application and service component (10400) (e.g., AI Interface) through an application programming interface (API), thereby enabling access to various data sources. In addition, the application and plugin management component (10230) can request an action through the API to perform a final user query rather than an intermediate result when the application or service needs to perform the action. Information obtained from an external source can be passed as input to the generative model along with the user input.

[0069] An output modification component (10250) according to one embodiment can fine-tune the output of a generative model. For example, the output modification component (10250) can verify that content generated through a language model (LLM) or a large-scale multi-modal model (LMM) is not irrelevant, does not contain biased content, or does not contain harmful content. In addition, the output modification component (10250) can determine to what extent the content matches the result desired by the user and can perform additional processing if necessary. Additionally, the output modification component (10250) can configure and provide hints to the user to avoid undesired output.

[0070] A generative AI model (10300) according to one embodiment generally refers to an artificial intelligence neural network that creates new types of data based on user input information. Models that generate images may typically include generative adversarial networks (GANs) and variational autoencoders (VAEs). For example, the generative AI model may be a diffusion-based generative model that uses VAE and a transformer structure. Furthermore, a language-generating model may refer to a model trained to statistically generate the most appropriate output based on input values. Among generative AI models (10300), language-generating models may be, for example, models such as CHAT-GPT 3 and CHAT-GPT 4. As another example, large multimodal models (LMMs) may be models that recognize various types of data input, such as text, images, and voice, and generate corresponding new data.

[0071] An electronic device (101) according to one embodiment may support a virtual character service function by linking with an artificial intelligence assistant system or smart system included in a target device (e.g., car, vehicle, automobile).

[0072] An electronic device (101) according to one embodiment may support a function of generating a virtual character (or device character, device avatar) for an artificial intelligence (AI) assistant using the generative AI system of FIG. 1b, and generating character content including a virtual character in relation to the AI ​​assistant.

[0073] An electronic device (101) according to one embodiment may include a display (e.g., a display module (160)). An electronic device (101) according to one embodiment may include a communication module including at least one communication circuit. An electronic device (101) according to one embodiment may include at least one processor including processing circuitry. An electronic device (101) according to one embodiment may include a memory (130) that stores instructions executable by the at least one processor (120).

[0074] The instructions according to one embodiment, when executed by the processor, may cause the electronic device (101) to recognize a target device included in an image displayed on the display. The instructions according to one embodiment may cause the electronic device (101) to analyze user preferences according to personal characteristics based on user contents stored in the memory and determine at least one theme related to a virtual character of the recognized target device. The instructions according to one embodiment may cause the electronic device (101) to request a generative AI (artificial intelligence) to generate a virtual character related to the determined at least one theme based on a first input requesting generation of a virtual character of the recognized target device. The instructions according to one embodiment may cause the electronic device (101) to receive a virtual character generated according to the at least one theme from the generative AI and display the virtual character on the display. In one embodiment, the commands may cause the electronic device (101) to select first user contents related to a theme determined by the preference based on a second input requesting detailed editing of a virtual character displayed on the display, and to display a detailed editing user interface (UI) screen on the display that displays the selected first user contents as optional items that enable partial editing of the virtual character. In one embodiment, the commands may cause the electronic device (101) to at least partially transform the virtual character displayed on the display based on a third input that selects at least a portion of the displayed user contents.

[0075] A target device according to one embodiment is a wireless communication device or other electronic device capable of changing or expanding the functionality within the device through a wireless communication function or an application, and may include at least one of a car, a home appliance, a wearable device, a smart robot, or a smart toy.

[0076] According to one embodiment, the detailed editing UI screen includes at least one of a virtual character object, editing elements including the option items, a regeneration menu object, a theme adjustment bar, and a history list, and the editing elements may include at least one of an appearance element, a detail part element, a color element, a situation element, a location element, an emotion element, a sound element, other elements, and a manufacturer element.

[0077] According to one embodiment, the virtual character may be implemented so that at least one of the visual expression elements, text elements, image elements, video elements, and audio elements of the virtual character is partially edited through a detailed editing UI screen.

[0078] The commands according to one embodiment may cause the electronic device (101) to receive manufacturer content related to the target device from the manufacturer server of the target device through the communication circuit and to display the manufacturer content as an option item of the manufacturer element.

[0079] According to one embodiment, the first user contents may be characterized in that they are selected or recommended based on user preferences.

[0080] The determined theme according to one embodiment may include at least one of an emotional level, a realistic level, a futuristic level, or a specific level generated in response to user preferences and personal characteristics.

[0081] In one embodiment, the commands may cause the electronic device (101) to automatically select one user content within at least one edit element based on the adjusted theme level based on the detection of a fourth input for adjusting a theme level through a theme adjustment bar via the detailed editing UI screen, and cause a virtual character object displayed on the display to be transformed based on the selected user contents.

[0082] The detailed editing UI screen according to one embodiment may further include a detail bar that expresses information on simplification and complexity of editing in response to a theme level adjusted through the theme adjustment bar.

[0083] The commands according to one embodiment may cause the electronic device to change the level of the detail bar based on the theme level adjusted by the fourth input.

[0084] In one embodiment, the commands may cause the electronic device (101) to receive first information related to a state or function of the target device from the target device based on the connection between the electronic device and the target device, generate at least one character content to be applied to the state or function of the target device based on the first information, and display the state or function information using the at least one character content on the display or transmit it to the target device.

[0085] The commands according to one embodiment may cause the electronic device (101) to receive at least one of status information, execution function information, and content information of the target device from the target device, analyze a function of the electronic device and a function of the target device to generate content for the target device to provide information through the target device, and transmit the generated content for the target device to the target device.

[0086] In the embodiments described below, the electronic device (101) may refer to a device that supports overall functions related to a virtual character / character object (e.g., device character, device avatar) using generative AI. The target device (e.g., external electronic device (102)) may refer to a device or product that is capable of wireless communication, has unrestricted functions, and can change / expand functions through an application, and is the target of the virtual character. For example, the target device may be at least one of a car (car, automobile, vehicle), home appliances (e.g., smart TV, smart washing machine, robot vacuum cleaner, etc.), wearable device, smart robot, or smart toy, but this is merely an example and is not limited thereto.

[0087] A virtual character / character object refers to a 3D / 2D graphic object displayed on a display, but can also refer to a multi-modal model object composed of various types such as text elements, image elements, video elements, and audio elements in addition to visual expression elements. A virtual character / character object may also be referred to as a device character or device avatar. For example, a virtual character / character object can be transformed into various characters such as a car character, a robot vacuum cleaner character, a clock character, or a washing machine character depending on the type of target device.

[0088] In the description of the electronic device (101) according to various embodiments disclosed below, the same reference numbers are given to components that are substantially the same as the configuration disclosed in FIG. 1 described above, and redundant descriptions of their functions may be omitted.

[0089] In the embodiments described in FIGS. 2 through 15 below, the operations may be performed sequentially, but are not necessarily performed sequentially. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0090] FIG. 2 illustrates a virtual character service method for an artificial intelligence assistant of an electronic device according to one embodiment.

[0091] Referring to FIG. 2, a processor (e.g., processor (120) of FIG. 1) of an electronic device (101) according to one embodiment may, in operation 210, obtain a target device image (e.g., a car image) and display it on a display (e.g., display module (160) of FIG. 1). For example, the target device image may be referred to as an image including a target device (e.g., a car), but may also be an image including a target device and a user (or person).

[0092] According to one embodiment, the electronic device (101) may provide a user interface (UI) that supports the creation of a virtual character of a target device through at least one of an artificial intelligence (AI) assistant function, an AI application supporting a virtual character service function, and / or a camera application. For example, the processor (120) may execute an AI application or a camera application to capture an image of the target device or call up an image of the target device stored in the memory (130) and display it on a display.

[0093] According to one embodiment, the processor (120) may display an execution item (e.g., a car icon, an icon in the shape of the target device) on the display to execute a function or application (e.g., an AI application) related to a virtual character (e.g., a car character) of the target device based on the target device (e.g., a car) or / and a user (or person) recognized from the target device image through an object recognition function.

[0094] According to one embodiment, the processor (120) may display a first user interface (UI) screen on the display based on a first input (e.g., an input for selecting an execution item) requesting execution of a function or application (e.g., an AI application) related to a virtual character of the target device. For example, the first UI screen may include, but is not limited to, at least one of a target device image, recognized target device information, and a character creation menu item.

[0095] According to one embodiment, the processor (120) may request device information about a target device recognized through a communication circuit to a manufacturer server of the target device, receive device information or / content (hereinafter, manufacturer content, manufacturer data) about the target device from the manufacturer server, and configure a first UI screen based on the received device information.

[0096] In operation 220, the processor (120) may detect a second input (e.g., an input for selecting a creation menu item) requesting creation of a virtual character (e.g., a car character) of the target device through the first UI screen.

[0097] In operation 230, the processor (120) analyzes preferences according to personal characteristics of a user using the electronic device (101) based on user contents (or user data, user context) collected / stored through the electronic device (101), and determines (selects, sorts out) at least one theme (topic) (or character theme) related to a virtual character of the target device.

[0098] According to one embodiment, the electronic device (101) may operate a big data analysis function or a big data program for user contents (e.g., images, videos, voices, texts). For example, the processor (120) may determine at least one theme (or N themes) by confirming user preferences (or user preference data) based on personal characteristics (e.g., age, gender, hobbies, tendencies) of a user using the electronic device (101) through big data analysis based on the execution of a function (or application) related to a virtual character.

[0099] According to one embodiment, a theme associated with a virtual character may be designated as at least one of an emotional level, a realistic level, or a futuristic level, but is not limited thereto, and various theme levels may be generated or determined based on preferences / personal characteristics. For example, if the user content includes many photos of people playing golf, one of the themes may be determined as "sports / golf," and if the user content includes many photos of people smiling, one of the themes may be determined as "cute / smile." Specific details related to theme generation are described in FIG. 10.

[0100] Action 220 may be performed in parallel with or independently of action 230, and action 220 may be performed after action 230.

[0101] In operation 240, the processor (120) may generate a personalized, customized virtual character (e.g., a car character) corresponding to the target device using a generative AI based on a second input requesting the generation of a virtual character, and display a second UI screen (or theme UI screen) showing at least one virtual character generated according to a theme on the display.

[0102] According to one embodiment, the processor (120) may request the generation of a virtual character to the generative AI based on character generation information (e.g., input data input to the generative AI, prompt information requesting virtual character generation) configured to generate a virtual character of the target device corresponding to the determined theme, and may receive a virtual character generated corresponding to the theme from the generative AI. The generative AI may be an AI server device, but may also mean an AI application program installed as an on-device in the electronic device (101). The generative AI may generate a virtual character suitable for each theme using an AI model or an AI engine and transmit the virtual character to the electronic device (101) or the processor (120).

[0103] The second UI screen may be divided into at least one virtual character (e.g., a car character) by theme. For example, if virtual characters are created with four themes, the processor (120) may display a second UI including a first virtual character representing the first theme, a second virtual character image representing the second theme, a third virtual character image representing the third theme, and a fourth virtual character image representing the fourth theme. The virtual characters displayed on the second UI screen may mean basic characters (e.g., basic / standard characters) representing each theme.

[0104] In operation 250, the processor (120) may, based on a third input (e.g., an input for selecting a virtual character / theme), select user contents (e.g., first user contents) that can be classified into a theme related to the selected virtual character among the user contents stored in the memory (130). For example, the selected user contents may be selected based on user preferences.

[0105] In operation 260, the processor (120) may display a third UI screen or a detailed editing UI screen showing user contents selected / recommended according to user preference as an optional item that can partially change or customize the virtual character (e.g., a car character) of the target device according to the individual's needs.

[0106] The detailed editing UI screen may include at least one of a basic virtual character representing the corresponding theme, editing elements (or details (disaggregation) / segmentation elements) that allow the virtual character to be partially edited or customized according to individual needs, a theme adjustment bar, and a regeneration item. The virtual character may be implemented so that at least one of a visual expression element, a text element, an image element, a video element, and an audio element of the virtual character can be partially edited through the detailed editing UI screen. The editing elements may refer to categories classified to partially or partially change the virtual character. For example, the editing elements may include, but are not limited to, at least one of an appearance part, a detailed configuration part, a color part, a situation part, a location part, an emotion part, a sound part, a other configuration part, or a manufacturer part. The editing elements that make up the detailed editing UI screen may be changed according to the manufacturer content, user preferences, and individual characteristics.

[0107] Each edit element includes a set of options (or selection options, a list of options) that can be selected by the user. As options, user content (e.g., primary user content) or / and manufacturer content selected based on user preferences related to the theme can be recommended and displayed. The user content displayed in the options may also be content that was involved in generating the prompt.

[0108] According to one embodiment, the processor (120) may display a detailed editing UI screen by graphically processing (e.g., displaying frames, highlighting, changing colors, etc.) the user content involved in the creation of the currently displayed virtual character so that it is visually distinguished from other user content not involved in the creation of the virtual character. For example, the processor (120) may graphically process so that a square frame is displayed only for the user content involved in the creation of the virtual character among the optional items.

[0109] In operation 270, the processor (120) may detect at least one fourth input for selecting user content and a fifth input for requesting character regeneration (e.g., an input for selecting a regeneration item). For example, the user may request regeneration of a virtual character after selecting at least one or more user content items displayed as options in an editing element through a detailed editing UI screen.

[0110] In operation 280, the processor (120) can display a regenerated virtual character on the display by transforming at least a portion of the virtual character based on at least one selected user content.

[0111] For example, the processor (120) may transmit user content selected by the user from among the user contents displayed on the detailed editing UI screen and request information (e.g., part information for which a virtual character corresponding to an editing element is to be partially changed, etc.) to the generative AI, request regeneration of the virtual character currently displayed on the display, and receive the regenerated virtual character from the generative AI.

[0112] In operation 290, the processor (120) can be set to apply a virtual character to the AI ​​assistant system of the target device according to the user's input.

[0113] According to one embodiment, the processor (120) may request the generation of a character content / image set (or package, bundle) for a target device related to a function or / and driving state of the target device (e.g., a car, a car system) based on the detection of an input for saving a virtual character or terminating an editing process, and may receive the character content / image set for the target device from the generation AI. For example, the processor (120) may communicate with the target device to request function or / and state information of the target device, and may generate a character content / image set for the target device corresponding to the function or / and state information of the target device. The processor (120) may transmit the virtual character and the character content / image set for the target device to the target device so as to be applied to the AI ​​assistant system of the target device.

[0114] In the following drawings 3a to 14c, the target device is exemplarily described as a car, and thus the virtual character of the target device may be referred to as a car character, a car character object, a car graphic object / character, or a car avatar. Furthermore, the various embodiments described below may be replaced with other target devices.

[0115] FIGS. 3A to 3C are drawings for explaining a user interface screen for creating a virtual character corresponding to an electronic device external to an electronic device according to one embodiment.

[0116] In various embodiments, functions related to a virtual character of a target device may be called or executed by at least one of an artificial intelligence (AI) assistant function, an AI application supporting a virtual character service function, and / or a camera application. Figures 3a to 3c illustrate examples of calling functions related to a virtual character through a camera application, but are not limited thereto. The display format of the user interface (UI) screen described in the embodiments described below is merely an example and may be changed depending on design or settings.

[0117] Referring to FIGS. 3A to 3C, an electronic device (101) (or processor (120)) according to one embodiment <301> As shown in , a camera application (hereinafter, app) can be executed to display a camera UI screen (310) on a display (e.g., display module (160) of FIG. 1). <301> It may be a screen by operation 210 of FIG. 2. For example, a user may take a picture of a car (313) or / and a user (314) through a shooting item (312) of a camera UI screen (310), or may call up a car image (311) stored in the memory (130) through a camera app function.

[0118] The electronic device (101) can display an execution item (315) (e.g., a car item / icon) for executing a function related to a car character object (hereinafter, a car character) based on the recognition of a car (313) through object recognition of a car image (311).

[0119] The electronic device (101) is based on an input that selects a creation menu item (315). <302> As shown in , a function (or application, application program) related to a car character can be executed to display a first UI screen (310) related to a car character on the display. <302> It may be a screen by operation 220 of Fig. 2.

[0120] The first UI screen (310) may include a car image (321), recognized car information (322), and graphic object creation items (323). For example, when a car (313) is recognized from the car image (311), the electronic device (101) may check recognition information corresponding to the recognized car. For example, when the recognized car (322) is a Porsche, the electronic device (101) may display car information, such as the Porsche model name, through the first UI screen (310).

[0121] The electronic device (101) is based on an input that selects an object creation item (323). <303> As shown in , a second UI screen (330) can be displayed on the display showing car characters (or character images / character thumbnails) generated based on the recognized car information and themes determined according to user preferences / personal characteristics for each car. <303> It may be a screen by the 230 and 240 operations of Fig. 2.

[0122] According to one embodiment, the electronic device (101) may analyze the user's preference according to personal characteristics based on user contents collected / stored through the electronic device (101) to determine at least one theme related to the recognized car character, request the generation of a car character that matches the determined theme to a generative AI, and receive a car avatar (or result data related to the car avatar) that matches the theme from the generative AI.

[0123] For example, the electronic device (101) <303> As shown in , when four theme levels (e.g., cute & neon, realistic, cute & smile, futuristic) are determined based on the user's preference / personal characteristics in relation to the recognized car, a first car character (331) representing the first theme, a second car character (332) representing the second theme, a third car character (333) representing the third theme, and a fourth car character (334) representing the fourth theme can be displayed on the display.

[0124] The electronic device (101) is based on an input (335) that selects a theme (e.g. realistic), for example, an input (335) that selects a second car character image (332). <304> As shown in , a third UI or detailed editing UI screen (340) that allows for partially editing or customizing / transforming / changing at least one of the visual representation elements (or visual elements), text elements, image elements, video elements, and audio elements of a car character based on user contents can be displayed on the display. <304> It can be a screen by the 250 and 260 operations of Fig. 2.

[0125] For example, the detailed editing UI screen (340) includes a basic car character (332) representing each theme, editing elements (or detailing elements) (341, 342, 343, 344, 345, 346, 347) that can partially edit or customize the car character (332), a theme adjustment bar (349) that can change the theme level, a history list (349), and a regeneration object (350), but this is only an example.

[0126] In the detailed editing UI screen (340), user contents selected according to the user's preference may be recommended and displayed in relation to the theme selected as option items (or option images) included in each editing element. For example, the editing elements may include, but are not limited to, an appearance part (e.g., me) (341), a detailed configuration part (e.g., car shape) (342), a color part (e.g., car color) (343), a situation part (e.g., family & friends) (344), a place part (e.g., visiting place) (345), an emotion part (e.g., expressions) (346), and a sound part (e.g., voice & dialog) (347). Here, the appearance part (341) is a category that can change the overall appearance of the car character, and images selected / recommended in relation to portraits and hobby activities among the user contents may be displayed as option items. The detailed configuration part (342) is a category that can change the shape or features of each part of the car character, and images related to cars or car parts among the user contents can be displayed as optional items. The color part (343) is a category that can change the color or texture of the car character, and images expressing colors or textures preferred by the user among the user contents can be displayed as optional items. The situation part (344) is a category that can change the surrounding situation or riding situation of the car character, and images expressing a relationship with the user among the user contents (e.g., pictures taken with friends, pictures of dogs) can be displayed as optional items. The place part (345) is a category that can change the background of the car character, and images related to regions, places, or daily life visited by the user among the user contents can be displayed as optional items.The emotion part (346) is a category that can reflect the emotional elements of the car character, and among objects or user contents expressing emotions, images expressing emotions on the face, such as a smiling expression or an angry expression, can be displayed as optional items. In the case of the emotion part, the positions of the eyes, nose, and mouth configuration applied to the car character can also be changed by the user. The sound part (347) is a category that can add sounds or voices in addition to the visual expression of the car character, and not only sounds set in the electronic device but also voice contents collected through the electronic device can be displayed as optional items.

[0127] The theme adjustment bar (348) is an automatic option category that can change the overall tone of the car character. As the theme level changes, user contents suitable for each theme are automatically selected to transform / regenerate the basic car character. The theme level displayed in the theme adjustment bar (348) is indicated by the theme and car character displayed in the second UI screen (330), and the theme level can be changed in various ways depending on the model or update of the generative AI. The history list (349) can list the created or regenerated car characters in chronological order.

[0128] The user can select at least one or multiple user contents displayed in each editing element to customize the basic car character displayed in the detailed editing UI screen (340) and select a regenerated object (350).

[0129] The electronic device (101) is based on an input for selecting at least one user content and an input for selecting a regenerated object (350). <305> As shown in , the edit element corresponding to the selected user content can be modified / changed to display the regenerated / customized car character (351) (or modified car character) on the detailed editing UI screen (340). <305> It may be a screen by the operations 270 and 280 of Fig. 2. The electronic device (101) may regenerate the virtual character by partially editing at least one of the visual expression elements, text elements, image elements, video elements, and audio elements of the virtual character.

[0130] For example, the electronic device (101) may transmit user content and editing information selected by the user to the generative AI, request regeneration of the car character (332) currently displayed on the display based on the transmitted user content, and receive the regenerated car character (351) from the generative AI. The regenerated car character (351) may be added to the history list (349).

[0131] Although not shown in the drawing, the detailed editing UI screen (340) may display a save menu item (not shown) for saving the displayed car character.

[0132] According to one embodiment, the electronic device (101) may display a detailed editing UI screen (340) by graphically processing (e.g., displaying frames, highlighting, changing colors, etc.) the user content related to the currently displayed car character creation or selected by the user to visually distinguish it from other content not related to the car character creation.

[0133] The electronic device (101) can generate a set of automotive character contents related to a function or state of a target device (e.g., a car, a car system) based on a detected input that saves a user-generated car character or terminates the editing process. For example, <306> , <307> and <308> silver <305> These may be UI screens that exemplarily show a portion of a set of car character contents generated based on a car character saved by a user through the screen (e.g., a regenerated car character (351)).

[0134] <306> In relation to the warning lights of a car, for example, it may be a UI screen (360) showing a fuel status character image (361-1) corresponding to a fuel icon (361) that notifies a fuel status, a tire status character image (362-1) corresponding to an air pressure icon (362) that notifies a tire danger status, and an engine status character image (363-1) corresponding to an engine icon (363) that notifies an engine warning. <307> The UI screen (370) may be a UI screen showing a door status character image (371-1) corresponding to a door icon (371) that notifies a door status, a coolant status character image (372-1) corresponding to a coolant icon (372) that notifies a coolant status, and a brake status character image (373-1) corresponding to a brake icon (371) that notifies a parking brake status. In addition to the illustrated warning lights, character contents / images for automobiles corresponding to automobile warning lights may be generated in bulk.

[0135] <308> The UI screen (380) depicts a character content for a car that is applicable or expressible only to a car that is the target of the car character, for example, character function content (381) related to a virtual character function, character content (382) corresponding to a drowsy driving detection function, character content (383) related to a parking location transmission function, and character content (384) related to a weather / temperature condition are depicted, but are not limited thereto. Although not depicted, at least one of a driver stress detection function, an occupant detection function, a collision detection function, a parking location transmission function, a security detection function, a mobile message transmission function, a phone call reception status, a Bluetooth connection status, or a navigation status may be added as a function or status notification of the car, and character content / images related thereto may also be created.

[0136] The electronic device (101) can transmit data related to a car character and a set of car character contents to a target device (e.g., a car or car system that is the target of the car character) connected to the electronic device (101) so that the car character can be applied to the artificial intelligence assistant service of the target device.

[0137] FIG. 4 is a diagram illustrating a user interface screen related to a virtual character service for an artificial intelligence assistant of an electronic device according to one embodiment.

[0138] Referring to FIG. 4, an electronic device (101) according to one embodiment provides a detailed editing UI screen (440) (e.g., FIG. 3b) that allows the user to partially edit or customize a currently generated car character according to an individual's needs. <304> The third UI (340) shown in Fig. 4 can support the function of saving multiple regenerated car characters or recalling previously generated car characters. The detailed editing UI screen (440) shown in Fig. 4 is the same as that of Fig. 3b. <304> Since it is the same as the detailed editing UI screen (340) shown in , a detailed description of each configuration will be omitted.

[0139] According to one embodiment, the detailed editing UI screen (440) may display a detail bar (453) that expresses the level of simplification (e.g., simple level) and complexity (e.g., complex level) of editing, but is not limited thereto. The detail bar (453), like the theme adjustment bar (448), may automatically select and change editing elements of a car character that are partially transformed according to a level change.

[0140] According to one embodiment, the detail bar (453) is linked to the theme adjustment bar (448), and when the theme level is changed in the theme adjustment bar, the level of the detail bar (453) may automatically change according to the simplification and complexity of the corresponding theme. For example, when the realistic level is selected in the theme adjustment bar (453), the detail bar (453) may approach the complex level, and when the emotional level is selected in the theme adjustment bar, the detail bar (453) may approach the simple level, but this is only an example. The user can edit the currently displayed car character (e.g., me) (441), the detailed configuration part (e.g., car shape) (442), the color part (e.g., car color) (443), the situation part (e.g., family & friends) (444), the place part (e.g., visiting place) (445), the emotion part (e.g., expressions) (446), the sound part (e.g., voice & dialog) (447)), the theme bar (349), and the regenerated object (451)) included in the detailed editing UI screen (440). <304> The car character (332) shown in can be partially transformed.

[0141] For example, if the user first selects one of the images included in the appearance part (e.g., me) (441) to transform the car composition or model, and then selects one of the images included in the color part (e.g., car color) (443) to transform the car color, the electronic device (101) <401> As shown in , the previously generated car character (332) can be replaced with the first car character (450) and displayed, and the first car character (450) can be added to the history list (449).

[0142] Secondly, if the user changes the theme bar (349) to an emotion level and then adds a smile to the car character through the emotion part (e.g., expressions) (446), the electronic device (101) <402> As shown in , the second car character (460) can be replaced and displayed, and the second car character (460) can be added to the history list (449).

[0143] Thirdly, if the user changes the composition of the car again and adds a background through the place part (e.g. visiting place) (445), the electronic device (101) <403> As shown in , the third car character (445) can be replaced and the third car character (470) can be added to the history list (449).

[0144] The user <403> When the first car character (450) displayed in the history list (449) is selected in the detailed editing UI screen (440) shown in , the electronic device (101) can display the third car character (470) by replacing it with the first car character again.

[0145] FIG. 5 illustrates a method for generating a graphic object for an artificial intelligence assistant service according to one embodiment.

[0146] Referring to FIG. 5, an electronic device (101) according to one embodiment may be configured by adding a manufacturer part to an editing element when receiving information or manufacturer content related to a target device from a manufacturer server of the target device.

[0147] In operation 510, the processor (120) of the electronic device (101) may request and receive information and manufacturer content related to the target device from the manufacturer server of the target device based on the target device (e.g., a car) being recognized in the target device image.

[0148] In operation 520, the processor (120) analyzes user content stored / collected in the electronic device (101) to determine N themes related to virtual characters of the target device using generative AI, and displays N virtual characters for each theme on the display. Operation 520 may be replaced with the description of operations 230 and 240 of FIG. 2.

[0149] For example, the processor (120) can determine the preferences according to the personal characteristics of the user using the electronic device (101) through big data analysis based on the execution of a function (or application) related to virtual character creation, and determine at least one theme that matches the preferences / personal characteristics. The processor (120) can request the creation of a virtual character (e.g., a car character) corresponding to at least one theme determined according to the user's preferences / personal characteristics from the generative AI, and receive a virtual character that matches each theme from the generative AI. The processor (120) can display a second UI that shows virtual characters that match each theme received from the generative AI on the display, by theme.

[0150] In operation 530, the processor (120) can select user content and manufacturer content to be displayed on the detailed editing UI screen based on an input for selecting a first theme among N themes.

[0151] For example, the processor (120) may select user content or / manufacturer content that can be classified / recommended based on user preferences in relation to each theme based on the detected input for selecting the first theme.

[0152] In operation 540, the processor (120) may display a detailed editing UI screen showing selected user content and manufacturer content as optional items that can partially or custom-edit a virtual character corresponding to the first theme.

[0153] For example, when the processor (120) receives manufacturer content related to a virtual character from the manufacturer server of the target device, it can additionally configure a manufacturer part in an editing element of a detailed editing UI screen and display the manufacturer content as an optional item of the manufacturer part.

[0154] In operation 550, the processor (120) may regenerate the virtual character by modifying at least a portion of the virtual character based on at least one selected user content or manufacturer content displayed on the detailed editing UI screen. A specific description of operation 550 may be replaced with the description of operations 270 and 280 of FIG. 2.

[0155] For example, the processor (120) may transmit the manufacturer content and request information to the generative AI based on the detection of an input requesting virtual character regeneration after selecting the manufacturer content on the editing UI screen, thereby receiving a virtual character modified / regenerated based on the manufacturer content from the generative AI. When the manufacturer content is used as learning data for the AI ​​model, the virtual character of the target device may be generated to have similar or specialized features to the actual shape of the target device, or a character with a unique feel.

[0156] In operation 560, the processor (120) may generate character content / images for the target device based on the virtual character. A specific description of operation 560 may be replaced with operation 290 of FIG. 2.

[0157] FIG. 6 is a diagram illustrating a user interface screen for creating a virtual character for an artificial intelligence assistant of an electronic device according to one embodiment.

[0158] Referring to FIG. 6, when an electronic device (101) (or processor (120)) according to one embodiment receives manufacturer contents from a manufacturer server, a detailed editing UI screen (610) (e.g., FIG. 3b) <304> A manufacturer part (625) can be added to the editing element of the detailed editing UI screen (340) illustrated in FIG. 4 or the detailed editing UI screen (440) illustrated in FIG. 4, and manufacturer contents transmitted from the manufacturer server can be displayed as option items (or option images) of the manufacturer part (625).

[0159] For example, the detailed editing UI screen (610) illustrated in FIG. 6 may be a UI screen that additionally includes a manufacturer part (625) in addition to the appearance part (e.g., me) (341), detailed configuration part (e.g., car shape) (342), color part (e.g., car color) (343), situation part (e.g., family & friends) (344), place part (e.g., visiting place) (345), emotion part (e.g., expressions) (346), and sound part (e.g., voice & dialog) (347) illustrated in FIG. 3b as editing elements. Other configurations identical to those in FIG. 3b will be omitted. The manufacturer part (625) may display manufacturer contents as optional items. Although not illustrated in the drawing, the detailed editing UI screen (610) may also be configured to include the detail bar (453) illustrated in FIG. 4. The level of simplification and complexity of editing can be automatically changed in the detail bar (453) based on the level of the theme control bar (448).

[0160] According to one embodiment, the electronic device (101) can graphically process (e.g., display frames, display highlights, change colors, etc.) user content collected / stored in the electronic device and manufacturer content transmitted from the manufacturer server for each part of the detailed editing UI screen (610) to be visually distinguished.

[0161] According to one embodiment, the electronic device (101) may graphically process (e.g., display frames, highlight, change colors, etc.) contents involved in the creation of a virtual character (e.g., user content / manufacturer content) and other contents not involved in the creation to visually distinguish them. For example, the electronic device (101) may display a frame of a first color for user content involved in the creation of a virtual character among option items, and display a frame of a second color for manufacturer content involved in the creation of a virtual character, but may not perform separate graphic processing for other option items / content not involved in the creation of a virtual character.

[0162] According to one embodiment, the electronic device (101) may configure a virtual character list (630) generated based on manufacturer content that matches the theme of the virtual character on the detailed editing UI screen (610). For example, <601> The virtual character shown in is a UI screen that displays a virtual character (640) created by reflecting the manufacturer's content. <602> The detailed editing UI screen (610) illustrated in may be a UI screen that displays a virtual character (650) regenerated based on the selected manufacturer's content when another manufacturer's content is selected in response to a realistic theme. The history list (655) may display previously created virtual characters (340) and regenerated virtual characters (650).

[0163] FIG. 7 illustrates a situation diagram for explaining the operational functions of a virtual character generation system according to one embodiment.

[0164] Referring to FIG. 7, an electronic device (101) according to one embodiment may collect and classify content (e.g., user content or / manufacturer content) for personalization (710). The electronic device (101) may store user information and collected content in a database (DB) (715). In some cases, the electronic device (101) may receive information and content from an automobile manufacturer (or a target device manufacturer) (717). Automobile content transmitted from an automobile manufacturer may include automobile characters for the manufacturer using a generative AI for each manufacturer.

[0165] The electronic device (101) can determine a theme related to a car character and generate a virtual character corresponding to the theme using a generative AI (720). In this case, big data analysis is performed on content collected in the electronic device (725), and user preference / user preference data based on individual characteristics can be reflected in the generation of the car character.

[0166] The detailed editing UI display function (770) of the car character can be executed by processing the execution input (720) of the detailed editing UI screen (e.g., the detailed editing UI screen (340, 440)) configured to partially edit a virtual character detected user input. The editing elements (or detailed elements) to be displayed on the detailed editing UI screen can be divided into a theme part and a detailed editing part. For example, the theme part can include a theme and an emotion / element as a generation direction determining element (731). Here, the emotion / element can mean an emotion / element expressed at a theme level (e.g., an emotional level, a realistic level, etc.). The detailed editing part includes an appearance determining element (732) of the car character, including a composition, a shape, a color, and a texture, and can include ornaments, accessories, a place / background, a hobby, a friend, a family member, a pet, a sound, and a dialogue / text as a surrounding situation and detail determining element (733). When multiple selections are made for each determining element on the detailed editing UI screen, the detailed editing part The level can be raised.

[0167] The electronic device (101) can select a target device (e.g., a car, a watch, or a robot vacuum cleaner) as the purpose and target of virtual character creation based on the target device recognized from the image (740). The electronic device (101) can request virtual character creation using the content and information collected by the generation AI (720) through the car character creation engine interface (760), and can receive information or content related to the virtual character corresponding to the generation content from the generation AI (720). The electronic device (101) can store and update the car character (780) and display the car character detailed editing UI screen (770).

[0168] FIG. 8a is a diagram illustrating an operation of supporting a virtual character service of an artificial intelligence assistant system according to one embodiment, and FIG. 8b is a flowchart illustrating a method of supporting a virtual character service in an electronic autonomous system according to one embodiment.

[0169] Referring to FIG. 8A, an electronic device (101) according to one embodiment may be connected to a target device (e.g., a car) for communication, or may set a virtual character service function in an artificial intelligence assistant system of the target device based on a user of the electronic device (101) being on board the target device.

[0170] In operation 810, the electronic device (101) may request the generative AI (815) to generate a virtual character (e.g., a car character) of the target device (104). For example, the electronic device (101) may analyze user contents collected / stored through the electronic device (101) to identify user preferences based on personal characteristics. The electronic device (101) may determine a theme related to a car recognized from a car image based on the preferences / personal characteristics. The electronic device (101) may request the generative AI (815) to generate a car character.

[0171] In operation 820, the generative AI (815) can generate a car character that fits the theme according to a virtual character generation request and transmit it to the electronic device (101).

[0172] In operation 830, the electronic device (101) can store or designate the car character transmitted from the generative AI (815) as a default character.

[0173] In operation 840, the electronic device (101) may request vehicle information to the target device (104) for generating vehicle-specific character content based on being connected to the target device (104).

[0174] In operation 850, the target device (101) can transmit vehicle information to the electronic device (101). The vehicle information includes, but is not limited to, at least one of output screen information related to the target device, for example, screen (851), sensor information related to the sensor (852), network communication information related to the connection network (853), driving / control / convenience device information (854), and risk / warning / status information.

[0175] In operation 860, the electronic device (101) may request vehicle-specific character content from the generation AI (815) based on vehicle information and receive vehicle-specific character content (or a character content set) from the generation AI (815).

[0176] For example, the car-specific character content may be, but is not limited to, content (or images / thumbnails) related to at least one of the car's warning light notification function, driver stress detection function, drowsy driving detection function, passenger detection function, parking location transmission function, collision detection function, security detection function, navigation function, mobile messaging function, weather / temperature status, phone call reception status, or Bluetooth connection status.

[0177] Referring to the operations of generating a vehicle-specific character content in an electronic device (101) in FIG. 8A, in operation 861, the electronic device (101) may request vehicle information (e.g., function and / or status information) for character generation from a target device (104) and receive vehicle information from the target device (104).

[0178] In operation 862, the electronic device (101) may extract additional generated elements related to the vehicle character. The additional generated elements may refer to generated elements that can be displayed as vehicle character content in response to vehicle functions and / or status information (e.g., fuel status warning content, hazard warning content, etc.).

[0179] In operation 863, the electronic device (101) may integrate the current vehicle avatar additional generation element with the basic vehicle character. For example, the vehicle character may be integrated with the fueling status element to generate fueling status warning content.

[0180] In operation 864, the electronic device (101) may request generation of car character content by transmitting information about the car character and additional generation elements to the generative AI.

[0181] In operation 865, the electronic device (101) can receive newly generated car character content from the generative AI and display it on the display. The car-specific character content can be displayed on the screens of the electronic device (e.g., mobile) and the target device (104).

[0182] In operation 866, the electronic device (101) can store the car-specific character content and set the car character and the car-specific character content to be applied to the artificial intelligence assistant system of the target device (104).

[0183] FIGS. 9A and 9B are flowcharts illustrating a method for supporting a virtual character service for an artificial intelligence assistant according to one embodiment.

[0184] Referring to FIGS. 9A and 9B , in operation 910, the electronic device (101) (or the processor (120)) may collect information and content for a vehicle character. The content may include, but is not limited to, at least one of user content collected / stored via the electronic device and / or manufacturer content provided by a target device manufacturer, and may further include content for the target device collected from the target device.

[0185] In a 911 operation, the electronic device (101) may request vehicle information from the target device (104). For example, the electronic device (101) may request vehicle information from the target device based on being connected to the vehicle, which is the target device (104).

[0186] In operation 912, the target device (104) can transmit vehicle information and content. The vehicle information can include vehicle function and / or status information.

[0187] In one embodiment, operations 911 and 912 may be omitted.

[0188] In operation 913, the electronic device (101) may analyze the collected information and content to configure a car theme. For example, the electronic device (101) may analyze the collected information and content to identify user preferences based on personal characteristics. The electronic device (101) may determine a car theme related to a car recognized from a car image based on the preferences / personal characteristics. For example, the car theme may be designated as at least one of an emotional level, a realistic level, or a futuristic level, but is not limited thereto, and various theme levels may be generated or determined based on preferences / personal characteristics.

[0189] In operation 914, the electronic device (101) may request the generative AI (102) to generate a car character according to a car theme. In operation 915, the generative AI (102) may generate a car character according to the car theme. In operation 916, the generative AI (102) may transmit the generated car character to the electronic device (101).

[0190] In operation 917, the electronic device (101) may display a theme corresponding to the car character on the display. For example, the electronic device (101) may display a theme UI screen that distinguishes virtual characters (e.g., car characters) by theme on the display.

[0191] In operation 918, the electronic device (101) may display a detailed editing UI for a vehicle character to optimize the configuration of the vehicle character. For example, the electronic device (101) may configure a detailed editing UI screen to display at least one of user content and manufacturer content as an optional item of the vehicle character editing element. The user content or / manufacturer content displayed as an optional item of the editing element may be selected or recommended based on user preferences.

[0192] The detailed editing UI screen may include at least one of a basic virtual character representing the corresponding theme, editing elements (or details (disaggregation) / segmentation elements) that allow for partial editing or customizing the virtual character according to individual needs, a theme adjustment bar, and a regeneration item. The editing elements may refer to categories classified to partially or partially change the virtual character. For example, the editing elements may include, but are not limited to, at least one of an appearance part, a detailed configuration part, a color part, a situation part, a location part, an emotion part, a sound part, another configuration part, or a manufacturer part. The editing elements that make up the detailed editing UI screen may be changed according to manufacturer content, user preferences, and individual characteristics.

[0193] In operation 919, the electronic device (101) may determine whether the vehicle character generation is updated. The electronic device (101) may monitor whether the vehicle character is updated (no in operation 919) and, if updated (e.g., yes in operation 919), may proceed to operation 920.

[0194] For example, if an input requesting character regeneration is detected after selecting user content included in an editing element of a detailed editing UI screen, the electronic device (101) may determine that the car character generation is updated. The user may select at least one user content displayed as an option item for each editing element on the detailed editing UI screen to partially transform at least a portion of the currently generated car character, or adjust the theme level to transform the car character into a car character suitable for a different theme.

[0195] In operation 920, if there is a request for updating a car character, the electronic device (101) configures character creation information (e.g., prompt information) suitable for the purpose and target of creating the car character, and in operation 921, requests the creation of a modified car character using a generative AI. For example, the electronic device (101) may request the modification or regeneration of the car character based on user content selected in the color part and user content selected in the location part.

[0196] In operation 922, the generative AI (102) generates a transformed car character (or a regenerated car character) upon request, and in operation 23, the generative AI (102) can transmit the transformed car character to the electronic device (101).

[0197] In operation 924, the electronic device (101) can store and update the car character transmitted from the generative AI (102) and display the regenerated / modified car character on the display.

[0198] In operation 925, the electronic device (101) may determine whether the boarding / driving status has been updated with respect to the target device (104). Based on the driving status information transmitted from the target device (104), the electronic device (101) may determine whether the boarding / driving status with respect to the target device (104) is the same as before or has been updated. The electronic device (101) may monitor whether the boarding / driving status has been updated (no in operation 925), and if updated (e.g., yes in operation 925), proceed to operation 928.

[0199] In operation 925, the electronic device (101) may determine whether the boarding / driving status has been updated with respect to the target device (104). The electronic device (101) may determine whether the boarding / driving status with respect to the target device (104) is the same as before or has been updated based on the boarding / driving status information transmitted from the target device (104). The electronic device (101) may monitor whether the boarding / driving status has been updated (no in operation 925), and if updated (e.g., yes in operation 925), proceed to operation 928. The boarding / driving status information does not only mean the boarding / driving status (e.g., before boarding, boarding completed, during driving), but may also include detailed situational information related to the boarding / driving (e.g., speed, temperature, user status (e.g., stress, emotional state, drowsiness state), congestion level, location, etc.), and is not limited thereto, and various information related to the boarding / driving status may be applicable.

[0200] In operation 927, the target device (101) may transmit to the electronic device (101) the boarding / driving status information to be updated in relation to the vehicle character. For example, the target device (104) may transmit detailed driving-related situation information, such as speed, temperature, user status information, congestion level, etc., in a driving situation, but this is only an example and is not limited thereto.

[0201] In operation 928, the electronic device (101) may configure car character content that matches the current user / car status, and may proceed to operation 937 to transmit generated content (e.g., car-only character content) including car character content that matches the screen of the target device (104) to the target device.

[0202] In operation 929, the electronic device (101) can analyze the main schedule of the target device (104), the surrounding main interest events, and analyze the main status changes of the driver and passengers.

[0203] In operation 930, the electronic device (101) may determine whether the target device's AI assistant system has been updated with a car character. The electronic device (101) may monitor whether the AI ​​assistant system has been updated with a car character (e.g., "no" in operation 930), and if so (e.g., "yes" in operation 930), proceed to operation 931.

[0204] In operation 931, the electronic device (101) determines whether there is pre-generated character content, and if there is pre-generated content (e.g., yes in operation 931), the electronic device may proceed to operation 936.

[0205] In operation 932, if there is no pre-generated character content related to the current vehicle (e.g., no in operation 931), the electronic device (101) can transmit vehicle character creation information suitable for the character creation purpose and target to the generation AI.

[0206] In operation 933, the electronic device (101) may request the generation of a car character using a generative AI. In operation 934, the generative AI may generate a car character based on the generation request, and in operation 935, the generated car character may be transmitted to the electronic device (101).

[0207] In operation 936, the electronic device (101) can reconstruct the vehicle character content and information and store and update the vehicle character. In operation 937, the electronic device (101) can transmit generated content including a vehicle character suitable for the target screen to the target device (104).

[0208] In operation 938, the target device (104) can display a screen for an artificial intelligence assistant service based on information and content including a car character in the car.

[0209] Figure 10 is a drawing for explaining a method for determining a theme level of a virtual character according to one embodiment.

[0210] Referring to FIG. 10, an electronic device (101) according to one embodiment may support themes, theme levels, and generation, learning, and optimization functions related to virtual characters of a target device based on a generative AI engine. The generative AI engine may establish criteria appropriate for theme levels and generate virtual characters based on prompt information appropriate for each theme based on the established criteria.

[0211] For example, let's explain the generative AI by generating a car character according to the theme level of the car character. <1001> As shown in the figure, each car character suitable for the purpose can be generated for each of the four theme levels according to the order of each level. The emotional level generates the car character as an animated character, and it can be understood that as the level goes up to realistic level, the car character is more likely to be generated as a realistic car character. For example, if the generative AI includes “cute”, “smile”, “animation”, and “comic” as prompt information, the possibility of generating a corresponding car character may increase.

[0212] In one embodiment, the generative AI engine <1002> By performing an optimization process as shown in , virtual characters and themes can be converted into a database.

[0213] In operation 1010, the generative AI (or AI system) may be designed by a designer or user to have a basic theme generation engine interface for each target vehicle related to the generation of vehicle characters for each theme. In operation 1020, the generative AI may use the generative AI engine based on information / content related to the generation of vehicle characters. <1001> According to the criteria described in, a car character for each theme can be generated. In operation 1030, the generative AI can receive evaluation and classification information input by a designer or a user regarding the result of the car character generation. For example, the designer or the user can evaluate the car character for each theme generated through the AI ​​engine by giving a score and classifying the character into a good character and a bad character. In operation 1040, the generative AI can modify the character or reflect the modification back to the basic theme generation engine interface according to the evaluation and classification information. In operation 1050, the generative AI can continuously perform the above-described process to create a database of basic theme-specific car characters for each target car. The database-created themes and theme-specific car characters can be provided to the user through an application that supports virtual character generation.

[0214] FIG. 11 is a drawing for explaining a screen configuration of a vehicle according to one embodiment, and FIGS. 12a and 12b are examples of vehicle character interface screens displayed on an electronic device and a target device according to one embodiment.

[0215] Referring to FIGS. 11, 12A, and 12B, for example, the screen of a target device (e.g., a car) (104) may refer to a screen (e.g., a touch screen, a display) that supports an artificial intelligence assistant service. The car may include a main screen area (1120) and a center screen area (e.g., a CID, center information screen) (1130) at the bottom of the front window (1110), but this is merely an example. The car may provide a car character for an artificial intelligence assistant, a car-specific character content, and service content related to the car character through the main screen area (1120) and the center screen area (1130). For example, the main screen area (1120) may output basic information about the car and car content, and may also output modified or expanded information about the car content. The center screen area (1130) may display the connection status when an electronic device (e.g., a mobile device) is connected to a vehicle, or may display a basic vehicle character and functions or content related to the vehicle character.

[0216] According to one embodiment, the electronic device (101) and the target device (104) (hereinafter, a vehicle) can display an interface screen related to vehicle content on their respective displays based on their connection to each other. For example, when the electronic device (101) is connected to the vehicle of FIG. 11, <1201> As illustrated, a character interface screen (1210) related to a connected vehicle can be displayed on the display. For example, the character interface screen (1210) of the electronic device (101) can include a vehicle character (1220) and an image / thumbnail (1225) of a vehicle connected to the electronic device (101) and targeted by the vehicle character, and basic information (e.g., model name) of the vehicle can be displayed.

[0217] A car corresponding to the target device (104) can guide the connection of the electronic device (101) through the central screen area (1130) based on being connected to the electronic device (101), and can display an image (1230) of the electronic device (101) and a car character (1235) generated in relation to the car.

[0218] The electronic device (1010) receives the current status / function information of the connected vehicle, and generates character content exclusive to the connected vehicle based on the current status / function information of the vehicle. <1202> As illustrated, an interface screen (1240) including vehicle-specific character contents (1241) can be displayed on the display. The electronic device (101) can transmit data on the vehicle-specific character contents to the vehicle.

[0219] The vehicle can display a list of vehicle-specific character contents (1250) transmitted from an electronic device (101) on the main screen area (1130) and display vehicle characters (1260) on the center screen area (1130) to guide the user.

[0220] FIG. 13 illustrates a method for supporting a virtual character service for an artificial intelligence assistant in an electronic device and a target device according to one embodiment, and FIGS. 14a to 14c are exemplary diagrams of a virtual character service interface screen for an artificial intelligence assistant in a target device according to one embodiment.

[0221] Referring to FIG. 13, according to one embodiment, in operation 1310, the electronic device (101) may communicate with the target device (e.g., a car) (104) based on detecting that the user is in the vehicle, and transmit car character content appropriate for the current user status. For example, operation 1310 may be preceded by the operations described in the embodiments of FIGS. 2 to 10.

[0222] In operation 1311, the target device (104) can display information and content including a car character on a display (e.g., a center screen area (1130)) based on the car character content transmitted from the electronic device (101) before the car is released.

[0223] In operation 1312, the target device (104) can check the status of the car and display a corresponding car character on the artificial intelligence assistant.

[0224] For example, in Fig. 14a <1401> As illustrated, the target device (101) can display driving information related to the driving situation before the vehicle starts as vehicle character content (1420) on the main display area (1130) and display weather / temperature information (1430) on the center screen area (1130). Here, the front window (1110) refers to the front window area inside the vehicle and may refer to an area where an external real space is displayed.

[0225] For another example, if a situation occurs where the target device (104) should notify the basic status check fuel status warning light, <1402> As shown in , the fuel status character content (1425) can be displayed in the main display area (1120).

[0226] In operation 1313, the target device (104) can transmit driving / status information to an electronic device while the vehicle is driving.

[0227] In operation 1314, the electronic device (101) can analyze the user's main schedule, surrounding main interest events, and changes in the driver's and passenger's main status based on data collected through the electronic device (101).

[0228] In operation 1315, the electronic device (101) can determine whether there is content to be transmitted to the target device (104) as a car character based on the analysis result. If there is content to be transmitted to the target device (e.g., yes in operation 1315), the electronic device (101) can proceed to operation 1316, and if there is no content to be transmitted (e.g., no in operation 1315), the electronic device (101) can proceed to operation 1321.

[0229] In operation 1316, the electronic device (101) can determine whether there is a pre-generated character content related to the content to be transmitted from the target device (104). If there is a pre-generated character (e.g., yes in operation 1316), the electronic device (101) can proceed to operation 1319, and if there is no pre-generated character (e.g., yes in operation 1316), the electronic device (101) can request the creation of a car character by the generative AI by proceeding to operation 1317.

[0230] In operation 1318, the generative AI can create a car character and transmit it to the electronic device (101).

[0231] In operation 1319, the electronic device (101) can reconfigure the vehicle character content and information to suit the current vehicle and purpose, and transmit the reconfigured content and information to the target device (104).

[0232] In operation 1320, the target device (104) can display information and content including a car character based on the content and information transmitted from the electronic device (101).

[0233] For example, the target device (104) may be configured to detect the presence of a major event of the electronic device and a peripheral event of user interest in relation to the driving route, as shown in FIG. 14b. <1403> As illustrated, a character content list (e.g., card type) (1430) for a major event or major schedule can be displayed in the center screen area (1130). When a user selects one of the character content lists (1430) displayed in the center screen area (1130), the target device (104) can display additional information and detailed information (1435) about the selected character content in the main screen area (1120) in the main display area.

[0234] For another example, if the electronic device (101) detects the user's level of stress while driving, it can update the emotional elements of the car character and provide a stress-relieving function or change the driving route as car character content. The target device (101) <1404> As shown in , the user's stress level and emotional information can be identified, and a car character (1445) including an emotional element can be displayed in the main screen area (1120), and not only character content that guides the stress detection status can be displayed in the center screen area (1130), but also recommended contents (1440) related to stress / emotion can be displayed.

[0235] In operation 1321, the electronic device (101) may determine whether there is a key message related to a message or call function based on the driving status of the user.

[0236] In operation 1322, if the electronic device (101) determines that there is a primary message (e.g., "yes" in operation 1321), the electronic device (101) may generate content summarizing the message to fit the vehicle screen in order to deliver the message to the vehicle screen. If the electronic device (101) determines that there is no primary message (e.g., "no" in operation 1321), the electronic device (101) may continuously monitor whether there is primary content or content to be delivered to the vehicle based on the vehicle character, as well as the call function / messenger function.

[0237] For example, the target device (104) can display car-specific content summarizing a call or received message connected through an electronic device, including a car character, in the center screen area. For another example, if a change in driving route is required, the target device (104) can display the following information in the center screen area: <1405> As shown in , character content (1450) reflecting driving route options and contents can be displayed in the center screen area (1130), and when the user selects a changed driving route, a navigation route (1455) can be displayed in the main screen area (1120).

[0238] In operation 1323, the electronic device (101) determines that there is content to be transmitted to the car character based on the generation of the main message, and in operation 1324, the electronic device (101) can generate car character content for a path or reply to the main message and transmit it to the target device (104).

[0239] In operation 1325, the target device (104) can display information and content including a car character based on information transmitted from the electronic device (101).

[0240] For example, if the target device (104) receives a message through the electronic device (101) while driving through the navigation route (1465) displayed in the main screen area (1120), and there is content that can reply in response to the message along with the driving situation, <1406> As shown in , a response message / image (1460) generated by reflecting the user's surrounding situation and emotional state to the car character as a response candidate list can be displayed in the center screen area (1130). The user can select the response message / image (1460) displayed in the center screen area to transmit a response message for receiving a message.

[0241] FIGS. 15A and 15B are drawings illustrating a virtual character service situation for an artificial intelligence assistant of a target device according to one embodiment.

[0242] Referring to FIGS. 15A and 15B , a target device (101) according to one embodiment is capable of wireless communication, has no limited functions, and can change / expand functions through an application program, and may include a device or product that is the target of a virtual character. For example, FIGS. 15A and 15B illustrate UI screens related to a virtual character of a generated robot cleaner when the target device (104) is a robot cleaner, which is a home appliance. The electronic device may generate a cleaner character corresponding to the robot cleaner and character contents including the cleaner character by performing the operations illustrated in FIG. 2 or FIG. 5 . For example, the electronic device (101) may generate a basic cleaner character (1520) according to a preference that matches the user's individual characteristics in relation to the robot cleaner recognized from an image of the robot cleaner.

[0243] Electronic device (101) <1501> As illustrated, a detailed editing UI screen (1510) that can partially edit / deform the generated vacuum cleaner character can be displayed. The detailed editing UI screen (1510) can display user contents selected according to the user's preference and recommended in relation to the selected theme with option items (or option images) included in each editing element. The detailed editing UI (1510) includes, but is not limited to, editing elements (appearance part (e.g., me) (1511), detailed configuration part (e.g., car shape) (1512), color part (e.g., car color) (1513), situation part (e.g., family & friends) (1514), place part (e.g., visiting place) (1515), emotion part (e.g., expressions) (1516), and sound part (e.g., voice & dialog) (1517)), a theme adjustment bar (1518), and a detail bar (1519). The description of the detailed editing UI screen (1510) is the same as in Fig. 3b and Fig. 4, so a detailed description will be omitted.

[0244] Electronic device (101) <1502> As illustrated, a character content list (1535) that detects the external environment / status and conveys information related to the function / cleaning status of the robot cleaner by using the robot cleaner character can be displayed on the display. For example, when the pet care function is enabled, a pet image and a robot cleaner character can be provided together to inform the user that the pet function is available, or when a cable is detected, a robot cleaner character can be provided together with a cable image to intuitively inform the user that a cable has been detected.

[0245] According to one embodiment, the electronic device (101) <1503> As illustrated, a smart application controlling the function of the robot cleaner may provide a cleaning report UI screen (1540) from the robot cleaner. The cleaning report UI screen (1540) may include, for example, an outline and space information for a cleaning space (1541), robot cleaner character content (1542) indicating information collected about a cleaning status or a problem that occurs during the cleaning process, and / or a detailed display item (1543) of an event that occurs during cleaning. For example, when the robot cleaner cleans a child's room, the electronic device (101) may provide character content including a robot cleaner character along with a picture of a child to inform the user that the robot cleaner is cleaning the child's room.

[0246] The electronic device (101) can provide guidance content to the user using a robot character regarding problems or conditions that occur during the cleaning process of the robot vacuum cleaner.

[0247] FIG. 16 is a drawing for explaining a virtual character content service function of an electronic device according to one embodiment.

[0248] Referring to FIG. 16, the virtual character of the target device according to various embodiments may be utilized for functions of the electronic device or functions of linking with external electronic devices. For example, <1601> As illustrated, the wearable electronic device receives a virtual character (1610) representing the status of the target device from the electronic device, and can utilize the function to remotely adjust the temperature setting inside the target device from the wearable electronic device and to detect temperature changes through changes in the virtual character. For another example, <1602> As illustrated, the electronic device (101) can change the virtual character or / and character content (1620) of the target device generated and stored into a message emoji or emoticon and utilize it. Alternatively, the virtual character of the target device <1603> As shown in , the status of the target device or the content (1630) received from the electronic device (101) is displayed on another electronic device (101) linked to the home IoT (Internet of Things). <1604> As illustrated, the virtual character of the target device can also be utilized in contents (1640) posted on a shared screen service within the network.

[0249] A virtual character service method for an artificial intelligence assistant of an electronic device according to one embodiment may include an operation of recognizing a target device included in an image displayed on a display.

[0250] A virtual character service method for an artificial intelligence assistant of an electronic device according to one embodiment may include an operation of analyzing user preferences according to personal characteristics based on user contents stored in the electronic device and determining at least one theme related to a virtual character of the recognized target device.

[0251] A virtual character service method for an artificial intelligence assistant of an electronic device according to one embodiment may include an operation of requesting a generation type AI (artificial intelligence) to generate a virtual character related to at least one determined theme based on a first input requesting generation of a virtual character of the recognized target device.

[0252] A virtual character service method for an artificial intelligence assistant of an electronic device according to one embodiment may include an operation of receiving a virtual character generated according to at least one theme from the generative AI and displaying the virtual character on the display.

[0253] A virtual character service method for an artificial intelligence assistant of an electronic device according to one embodiment may include an operation of selecting first user contents related to a theme determined by the preference based on a second input requesting detailed editing of a virtual character displayed on the display, and displaying a detailed editing UI (user interface) screen on the display that displays the selected first user contents as an optional item that can partially edit the virtual character.

[0254] A virtual character service method for an artificial intelligence assistant of an electronic device according to one embodiment may include an operation of at least partially transforming a virtual character displayed on the display based on a third input that selects at least a portion of the first user content.

[0255] According to one embodiment, the operation of at least partially transforming the virtual character may further include transmitting the first user content and regeneration request information selected based on the third input to the generative AI, and receiving the transformed virtual character from the generative AI.

[0256] The operation of displaying the detailed editing UI screen displaying the selected first user contents according to one embodiment on the display may further include an operation of receiving manufacturer contents related to the target device from the manufacturer server of the target device through a communication circuit, and may be characterized by displaying the manufacturer contents as an option item of the manufacturer element.

[0257] An operation of at least partially transforming the virtual character according to one embodiment may be characterized in that, based on a fourth input for adjusting a theme level through the theme adjustment bar being detected, at least one user content within at least one editing element is automatically selected and selected according to the adjusted theme level, and a virtual character object displayed on the display is transformed based on the selected user contents.

[0258] According to one embodiment, the detailed editing UI screen further displays a detail bar that expresses information on simplification and complexity of editing in response to a theme level adjusted through the theme adjustment bar, and the operation of at least partially transforming the virtual character may further include an operation of changing the level of the detail bar based on the theme level adjusted by the fourth input.

[0259] A virtual character service method for an artificial intelligence assistant of an electronic device according to one embodiment may further include an operation of receiving first information related to a state or function of the target device from the target device based on the connection between the electronic device and the target device, an operation of generating at least one character content to be applied to the state or function of the target device based on the first information, including the virtual character, and an operation of displaying the state or function information using the at least one character content on the display or transmitting the state or function information to the target device.

[0260] A virtual character service method for an artificial intelligence assistant of an electronic device according to one embodiment may further include an operation of receiving at least one of status information, execution function information, and content information of the target device from the target device, an operation of analyzing a function of the electronic device and a function of the target device to generate content for the target device to provide information through the target device, and an operation of transmitting the generated content for the target device to the target device.

[0261] A non-transitory computer-readable recording medium storing a computer program for executing a virtual character service method for an artificial intelligence assistant of an electronic device according to one embodiment may store instructions for performing an operation of recognizing a target device included in an image displayed on a display. The recording medium according to one embodiment may store instructions for performing an operation of analyzing user preferences according to personal characteristics based on user contents stored in the electronic device and determining at least one theme related to a virtual character of the recognized target device. The recording medium according to one embodiment may store instructions for performing an operation of requesting a generative AI (artificial intelligence) to generate a virtual character related to the determined at least one theme based on a first input requesting generation of a virtual character of the recognized target device. The recording medium according to one embodiment may store instructions for performing an operation of receiving a virtual character generated according to the at least one theme from the generative AI and displaying the virtual character on the display. According to one embodiment, a recording medium may store a command that causes an operation to select first user contents related to a theme determined by the preference based on a second input requesting detailed editing of a virtual character displayed on the display, and display a detailed editing UI (user interface) screen on the display that displays the selected first user contents as optional items that can partially edit the virtual character. According to one embodiment, a recording medium may store a command that causes an operation to include an operation to at least partially transform a virtual character displayed on the display based on a third input that selects at least a portion of the first user contents.

[0262] The embodiments of this document and the terminology used herein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0263] The term "module" used in the embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0264] One embodiment of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0265] According to one embodiment, the method according to one embodiment disclosed in this document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or may be provided through an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smart phones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0266] According to one embodiment, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and arranged in other components. According to one embodiment, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to one embodiment, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In electronic devices, display; A communication module comprising at least one communication circuit; At least one processor comprising processing circuitry; and A memory that stores instructions executable by at least one processor, The above instructions, when executed by the processor, are caused by the electronic device. Recognize the target device included in the image displayed on the above display, Based on the user contents stored in the above memory, the user preference according to personal characteristics is analyzed to determine at least one theme related to the virtual character of the recognized target device, Based on a first input requesting the creation of a virtual character of the recognized target device, requesting a generative AI (artificial intelligence) to create a virtual character related to at least one of the determined themes, Receive a virtual character generated according to at least one theme from the generative AI and display it on the display, Based on a second input requesting detailed editing of a virtual character displayed on the above display, first user contents related to the theme determined by the above preference are selected, Displaying a detailed editing UI (user interface) screen on the display that displays the selected first user contents as an optional item that can partially edit the virtual character, An electronic device that at least partially transforms a virtual character displayed on the display based on a third input that selects at least some of the displayed user content.

2. In paragraph 1, The target device is an electronic device including at least one of a car, a home appliance, a wearable device, a smart robot, or a smart toy, which is a wireless communication device or other electronic device capable of changing or expanding the function within the device through a wireless communication function or an application.

3. In paragraph 1, The above detailed editing UI screen includes at least one of a virtual character object, editing elements including the above option items, a regeneration menu object, a theme adjustment bar, and a history list, and the editing elements include at least one of an appearance element, a detail part element, a color element, a situation element, a location element, an emotion element, a sound element, other elements, and a manufacturer element. An electronic device implemented so that at least one of the visual expression elements, text elements, image elements, video elements, and audio elements of the virtual character is partially edited through a detailed editing UI screen.

4. In paragraph 3, The above commands are, by the electronic device, An electronic device that receives manufacturer content related to the target device from the manufacturer server of the target device through the communication circuit and displays the manufacturer content as an optional item of the manufacturer element.

5. In paragraph 1, An electronic device characterized in that the first user contents are selected or recommended based on user preferences.

6. In paragraph 3, An electronic device wherein the above-determined theme comprises at least one of an emotional level, a realistic level, a futuristic level, or a specific level generated in response to user preferences and personal characteristics.

7. In paragraph 1, The above commands are executed by the electronic device, An electronic device in which at least one user content within at least one editing element is automatically selected based on the adjusted theme level based on the detection of a fourth input for adjusting a theme level through a theme adjustment bar through the above detailed editing UI screen, and a virtual character object displayed on the display is transformed based on the selected user content.

8. In paragraph 7, The above detailed editing UI screen further includes a detail bar that expresses information on the simplification and complexity of editing in response to the theme level adjusted through the theme adjustment bar. The above commands are executed by the electronic device, An electronic device that changes the level of the detail bar based on the theme level adjusted by the fourth input.

9. In paragraph 1, The above commands are, by the electronic device, Receiving first information related to the status or function of the target device from the target device based on the connection between the electronic device and the target device, Generate at least one character content to be applied to the status or function of the target device based on the first information, An electronic device that displays status or function information using at least one character content on the display or transmits the status or function information to the target device.

10. In paragraph 8, The above commands are, by the electronic device, Receive at least one of status information, execution function information, and content information of the target device from the target device, Generate content for the target device to provide information through the target device by analyzing the function of the electronic device and the function of the target device, An electronic device that transmits the content generated for the target device to the target device.

11. A method for providing a virtual character service for an artificial intelligence assistant of an electronic device, An action to recognize a target device included in an image displayed on a display; An operation of analyzing user preferences according to personal characteristics based on user contents stored in an electronic device and determining at least one theme related to a virtual character of the recognized target device; An action of requesting a generative AI (artificial intelligence) to generate a virtual character related to at least one determined theme based on a first input requesting generation of a virtual character of the recognized target device; An action of receiving a virtual character generated according to at least one theme from the generative AI and displaying it on the display; An operation of selecting first user contents related to a theme determined by the preference based on a second input requesting detailed editing of a virtual character displayed on the display, and displaying a detailed editing UI (user interface) screen on the display that displays the selected first user contents as an optional item that can partially edit the virtual character; and A method comprising an action of at least partially transforming a virtual character displayed on the display based on a third input selecting at least some of the first user content.

12. In paragraph 11, The above virtual character is implemented so that at least one of the visual expression elements, text elements, image elements, video elements, and audio elements of the virtual character can be partially edited through the detailed editing UI screen. An action that at least partially transforms the above virtual character, A method further comprising the action of transmitting the first user content and regeneration request information selected based on the third input to the generative AI and receiving the modified virtual character from the generative AI.

13. In paragraph 11, The target device is a wireless communication device or other electronic device capable of changing or expanding the function within the device through a wireless communication function or an application, and includes at least one of a car, a home appliance, a wearable device, a smart robot, or a smart toy.

14. In paragraph 12, The above detailed editing UI screen includes a virtual character object, editing elements including the above option items, a regeneration menu object, a theme adjustment bar, and a history list, and the editing elements include at least one of an appearance element, a detail part element, a color element, a situation element, a location element, an emotion element, a sound element, other elements, and a manufacturer element.

15. In paragraph 14, The action of displaying a detailed editing UI (user interface) screen displaying the selected first user contents on the display is as follows: Further comprising an action of receiving manufacturer content related to the target device from the manufacturer server of the target device through a communication circuit, A method characterized in that the manufacturer content is displayed as an optional item of the manufacturer element.

Images