Electronic device for sharing file, operating method thereof, and storage medium
By using multiple cameras and AI models to verify user identities and intentions, wearable electronic devices can securely and intuitively share files with external devices, addressing the challenge of complex user interactions.
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- SAMSUNG ELECTRONICS CO LTD
- Filing Date
- 2025-09-03
- Publication Date
- 2026-05-28
AI Technical Summary
Existing wearable electronic devices lack efficient methods for establishing secure and user-intention-based communication connections for file sharing with external devices, particularly in complex environments where multiple users are involved.
Incorporating multiple cameras and AI models to identify user intentions and verify user information, enabling secure file sharing by confirming user identities and intentions through image analysis, and establishing communication connections based on AI-verified user information.
Facilitates secure and intuitive file sharing between wearable electronic devices by accurately identifying users and their intentions, enhancing usability and security in complex environments.
Smart Images

Figure KR2025013574_28052026_PF_FP_ABST
Abstract
Description
Electronic device for sharing files, method of operation thereof, and storage medium
[0001] The present disclosure relates to an electronic device for sharing files, a method of operating the same, and a storage medium.
[0002] Various services and additional functions provided through wearable electronic devices, such as AR glasses (augmented reality glasses), VST (video see-through) devices, and HMD (head-mount display) devices, are gradually increasing. To enhance the utility value of these electronic devices and satisfy the needs of diverse users, telecommunications service providers or electronic device manufacturers are competitively developing devices to offer various functions and differentiate themselves from competitors. Accordingly, the various functions provided through wearable electronic devices are also becoming increasingly sophisticated.
[0003] Wearable electronic devices can provide users with a realistic experience by displaying virtual images while worn on the user's body. Wearable electronic devices can replace the usability of smartphones in various fields such as game entertainment, education, or social networking services (SNS). Users can receive content similar to reality through wearable electronic devices and feel as if they are staying in a virtual world through interaction.
[0004] A wearable electronic device can control external electronic devices by connecting to them via short-range communication with external electronic devices in the vicinity (e.g., TV (television), PC (personal computer), and / or laptop).
[0005] A wearable electronic device can share files by establishing communication with an external wearable electronic device or an external electronic device.
[0006] The information described above may be provided as related art for the purpose of aiding understanding of this document. None of the foregoing is to be claimed as prior art related to this document, nor is it to be used to determine prior art.
[0007] According to one embodiment, effective usability can be provided to establish a communication connection with an external electronic device desired by the user by identifying the intention of a user wearing a wearable electronic device or possessing an electronic device.
[0008] A wearable electronic device according to one embodiment may include a housing, a communication circuit, a display, at least one camera including a first camera positioned at a first position on the front of the housing and a second camera positioned at a second position above the first position on the front of the housing, at least one processor, and a memory for storing instructions. According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the wearable electronic device may be able to confirm a first instruction from a first user wearing the wearable electronic device. According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the wearable electronic device may be able to confirm a first instruction pointing to a second user wearing an external wearable electronic device for file sharing using an artificial intelligence (AI) model while the wearable electronic device is worn by the first user. When the instructions according to one embodiment are executed individually or collectively by the at least one processor, the wearable electronic device can verify first information about the first user based on an image of the first user obtained through the at least one camera using the AI model. When the instructions according to one embodiment are executed individually or collectively by the at least one processor, the wearable electronic device can verify second information about the second user based on an image of the second user obtained through the at least one camera using the AI model.When the instructions according to one embodiment are executed individually or collectively by the at least one processor, the wearable electronic device transmits a first message requesting a communication connection for file sharing through the communication circuit, the first message includes first information representing sender information and second information representing receiver information, and when the wearable electronic device receives a second message for accepting the communication connection for file sharing from the external wearable electronic device through the communication circuit, a communication connection with the external wearable electronic device can be established. When the instructions according to one embodiment are executed individually or collectively by the at least one processor, the wearable electronic device transmits a file to the external wearable electronic device through the communication circuit based on the second message.
[0009] A wearable electronic device according to one embodiment may include a housing, a communication circuit, a display, at least one camera including a first camera positioned at a first position on the front of the housing and a second camera positioned at a second position above the first position on the front of the housing, at least one processor, and a memory for storing instructions. When the instructions according to one embodiment are executed individually or collectively by the at least one processor, the wearable electronic device may acquire an image of the first user through the at least one camera when, while the wearable electronic device is worn by a first user, it receives a first message requesting a communication connection for file sharing through the communication circuit, which includes first information representing sender information and second information representing receiver information from an external wearable electronic device. When the instructions according to one embodiment are executed individually or collectively by the at least one processor, the wearable electronic device may identify third information about the first user based on the image of the first user using an AI model. When the commands according to one embodiment are executed individually or collectively by the at least one processor, the wearable electronic device can identify the wearable electronic device as a file sharing target for the external wearable electronic device if the similarity between the third information regarding the first user and the second information representing the recipient information is included within a threshold value range. When the commands according to one embodiment are executed individually or collectively by the at least one processor, the wearable electronic device can identify the information of the second user wearing the external wearable electronic device that transmitted the first message, based on the first information representing the sender information included in the first message using the AI model.When the commands according to one embodiment are executed individually or collectively by the at least one processor, the wearable electronic device may display a user interface including information related to the second user and a message inquiring whether to accept file sharing. When the commands according to one embodiment are executed individually or collectively by the at least one processor, the wearable electronic device may transmit a second message for accepting a communication connection for file sharing to the external wearable electronic device through the communication circuit if it confirms acceptance of file sharing through the user interface.
[0010] An electronic device according to one embodiment may include a display, a communication circuit, at least one camera, at least one processor, and a memory for storing instructions. When the instructions according to one embodiment are executed individually or collectively by the at least one processor, the electronic device may acquire first image data by capturing the appearance of a first user wearing or possessing the electronic device with the at least one camera. When the instructions according to one embodiment are executed individually or collectively by the at least one processor, the electronic device may extract at least one first feature information regarding the appearance of the first user from the first image data using an AI model. When the instructions according to one embodiment are executed individually or collectively by the at least one processor, the electronic device may generate a data transmission / reception request message based on at least a portion of at least one of the first image data and the first feature information. According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may transmit the data transmission / reception request message to an external electronic device through the communication circuit. According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may receive a data transmission / reception acceptance message from the external electronic device. According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may transmit data contained in the electronic device to the external electronic device or receive data from the external electronic device based on the data transmission / reception acceptance message.
[0011] An electronic device according to one embodiment may include a display, a communication circuit, at least one camera, at least one processor, and a memory for storing instructions. The electronic device according to one embodiment receives a data transmission and reception request message from an external electronic device through the communication circuit, wherein the data transmission and reception request message may be generated based at least partially on first image data obtained by photographing a first user with the external electronic device, and at least one first feature information extracted from the first image data. When the instructions according to one embodiment are executed individually or collectively by the at least one processor, the electronic device may display on the display, along with a message for confirming whether to accept the data transmission and reception request, at least one of the object, the first image data, a virtual image corresponding to the at least one first feature information, and text describing the at least one first feature information, when it is determined that an object corresponding to the first feature information is included in an image being photographed or already photographed through the at least one camera. When the instructions according to one embodiment are executed individually or collectively by the at least one processor, the electronic device may receive input regarding the acceptance status of the second user. When the instructions according to one embodiment are executed individually or collectively by the at least one processor, the electronic device may transmit a data transmission / reception acceptance message containing information regarding the acceptance status to the external electronic device.
[0012] A method for sharing a file in a wearable electronic device according to one embodiment may include an operation of confirming a first command from a first user wearing the wearable electronic device. The method according to one embodiment may include an operation of confirming the first command pointing to a second user wearing an external wearable electronic device for file sharing using an AI model while the wearable electronic device is worn by the first user. The method according to one embodiment may include an operation of confirming first information about the first user based on an image of the first user obtained through at least one camera of the wearable electronic device using the AI model. The method according to one embodiment may include an operation of confirming second information based on an image of the second user obtained through at least one camera using the second AI model. The method according to one embodiment may include an operation of transmitting a first message requesting a communication connection for file sharing through a communication circuit of the wearable electronic device, wherein the first message includes first information representing sender information and second information representing receiver information. The method according to one embodiment may establish a communication connection with the external wearable electronic device when receiving a second message for accepting the communication connection for file sharing from the external wearable electronic device through the communication circuit. The method according to one embodiment may include an operation of transmitting a file to the external wearable electronic device based on the second message.
[0013] A method for sharing a file in a wearable electronic device according to one embodiment may include, when the wearable electronic device is worn by a first user, receiving a first message requesting a communication connection for file sharing from an external wearable electronic device through a communication circuit of the electronic device, the first message including first information representing sender information and second information representing receiver information, and acquiring an image of the first user through at least one camera of the wearable electronic device. The method according to one embodiment may include an operation of verifying third information about the first user based on the image of the first user using an AI model. The method according to one embodiment may include an operation of identifying the wearable electronic device as a file sharing target of the external wearable electronic device if the similarity between the third information about the first user and the second information representing receiver information is included within a threshold value range. The method according to one embodiment may include an operation of verifying information of a second user wearing the external wearable electronic device that transmitted the first message, based on the first information representing sender information included in the first message using the AI model. The method according to one embodiment may include an operation of displaying a user interface including information related to the second user and a message inquiring whether to accept file sharing. The method according to one embodiment may include an operation of transmitting a second message for accepting a communication connection for file sharing to an external wearable electronic device through a communication circuit of the wearable electronic device when acceptance of file sharing is confirmed through the user interface.
[0014] In a non-volatile storage medium storing commands according to one embodiment, the commands are configured to cause the wearable electronic device to perform at least one operation when executed by the wearable electronic device, wherein the at least one operation may include an operation of confirming a first command from a first user wearing the wearable electronic device. According to one embodiment, the at least one operation may include an operation of confirming the first command pointing to a second user wearing an external wearable electronic device for file sharing using an AI model while the wearable electronic device is worn by the first user. According to one embodiment, the at least one operation may include an operation of confirming first information about the first user based on an image of the first user obtained through at least one camera of the wearable electronic device using the AI model. According to one embodiment, the at least one operation may include an operation of confirming second information based on an image of the second user obtained through at least one camera using the second AI model. According to one embodiment, the at least one operation may include transmitting a first message requesting a communication connection for file sharing through a communication circuit of the wearable electronic device, wherein the first message includes first information representing sender information and second information representing receiver information. According to one embodiment, the at least one operation may establish a communication connection with the external wearable electronic device upon receiving a second message for accepting the communication connection for file sharing from the external wearable electronic device through the communication circuit. According to one embodiment, the at least one operation may include transmitting a file to the external wearable electronic device based on the second message.
[0015] In a non-volatile storage medium storing instructions according to one embodiment, the instructions are configured to cause the wearable electronic device to perform at least one operation when executed by the wearable electronic device, wherein the at least one operation may include, when the wearable electronic device is worn by a first user, receiving a first message requesting a communication connection for file sharing from an external wearable electronic device through a communication circuit of the electronic device, the first message including first information representing sender information and second information representing receiver information, and the first information representing receiver information, thereby acquiring an image of the first user through at least one camera of the housing of the wearable electronic device. The at least one operation according to one embodiment may include an operation of verifying third information about the first user based on the image of the first user using an AI model. The at least one operation according to one embodiment may include an operation of identifying the wearable electronic device as a file sharing target of the external wearable electronic device when the similarity between the third information about the first user and the second information representing receiver information is included within a threshold value range. According to one embodiment, the at least one operation may include an operation of verifying information of a second user wearing the external wearable electronic device that transmitted the first message, based on first information representing sender information included in the first message using the AI model. According to one embodiment, the at least one operation may include an operation of displaying a user interface including information related to the second user and a message inquiring whether to accept file sharing.According to one embodiment, the at least one operation may include, when the acceptance of file sharing is confirmed through the user interface, the operation of transmitting a second message for accepting a communication connection for file sharing to an external wearable electronic device through the communication circuit of the wearable electronic device.
[0016] In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components.
[0017] FIG. 1 is a block diagram of an electronic device in a network environment according to various embodiments.
[0018] FIGS. 2a and 2b are drawings showing the front and rear of a wearable electronic device according to one embodiment.
[0019] FIG. 3a is a block diagram of a wearable electronic device according to one embodiment.
[0020] FIG. 3b is a block diagram illustrating the configuration of a processor and an artificial intelligence model according to one embodiment.
[0021] FIG. 4 is a diagram illustrating the operation of transferring a file from a wearable electronic device to an external wearable electronic device according to one embodiment.
[0022] FIG. 5 is a diagram illustrating the generation of first information representing transmitter information in a wearable electronic device according to one embodiment.
[0023] FIG. 6 is a diagram illustrating the generation of second information representing recipient information in a wearable electronic device according to one embodiment.
[0024] FIG. 7a is a diagram illustrating first information representing sender information included in a first message and second information representing receiver information in a wearable electronic device according to one embodiment.
[0025] FIG. 7b is a drawing illustrating the format of a first message in a wearable electronic device according to one embodiment.
[0026] FIG. 8 is a diagram illustrating the operation of identifying a wearable electronic device as a file sharing target when receiving a first message in a wearable electronic device according to one embodiment.
[0027] FIGS. 9A, 9B, and 9C are drawings for explaining a user interface provided for confirming acceptance of file sharing in a wearable electronic device according to one embodiment, FIGS. 9D and 9E are drawings for explaining a user interface provided for confirming acceptance of file sharing in an electronic device according to one embodiment, FIG. 9F is a drawing for explaining an operation of selecting a file sharing target in an electronic device according to one embodiment, and FIG. 9G is a drawing for explaining a file sharing operation based on conversation content in a wearable electronic device according to one embodiment.
[0028] FIGS. 10a, FIGS. 10b, and FIGS. 10c are drawings for illustrating an AI model in an electronic device according to one embodiment.
[0029] FIG. 11 is a flowchart illustrating the operation of transferring a file in a wearable electronic device according to one embodiment.
[0030] FIG. 12 is a flowchart illustrating the operation of receiving a file in a wearable electronic device according to one embodiment.
[0031] FIG. 13 is a flowchart illustrating the operation of sharing files between a wearable electronic device and external wearable electronic devices according to one embodiment.
[0032] FIG. 14 is a flowchart illustrating the operation of sharing files between a wearable electronic device and external wearable electronic devices according to one embodiment.
[0033] Hereinafter, embodiments of the present disclosure are described in detail with reference to the drawings so that those skilled in the art can easily practice them. However, the present disclosure may be embodied in various different forms and is not limited to the embodiments described herein. In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Furthermore, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and brevity.
[0034] FIG. 1 is a block diagram of an electronic device (101) in a network environment (100) according to various embodiments. Referring to FIG. 1, in the network environment (100), the electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or may communicate with at least one of an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) through a server (108). According to one embodiment, the electronic device (101) may include a processor (120), memory (130), input module (150), sound output module (155), display module (160), audio module (170), sensor module (176), interface (177), connection terminal (178), haptic module (179), camera module (180), power management module (188), battery (189), communication module (190), subscriber identification module (196), or antenna module (197). In some embodiments, at least one of these components (e.g., connection terminal (178)) may be omitted from the electronic device (101), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (176), camera module (180), or antenna module (197)) may be integrated into a single component (e.g., display module (160)).
[0035] The processor (120) can control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) by executing software (e.g., a program (140)), and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (120) can store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in volatile memory (132), process the commands or data stored in volatile memory (132), and store the resulting data in non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) that can operate independently or together with it (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device (101) includes a main processor (121) and an auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a designated function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as part thereof.
[0036] The auxiliary processor (123) may control at least some of the functions or states associated with at least one component of the electronic device (101) (e.g., display module (160), sensor module (176), or communication module (190)) on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (123) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (180) or communication module (190)). According to one embodiment, the auxiliary processor (123) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (108)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.
[0037] The memory (130) can store various data used by at least one component of the electronic device (101) (e.g., processor (120) or sensor module (176)). The data may include, for example, input data or output data for software (e.g., program (140)) and related commands. The memory (130) may include volatile memory (132) or non-volatile memory (134).
[0038] The program (140) may be stored as software in memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).
[0039] The input module (150) can receive commands or data to be used for a component of the electronic device (101) (e.g., processor (120)) from outside the electronic device (101) (e.g., user). The input module (150) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
[0040] The sound output module (155) can output a sound signal to the outside of the electronic device (101). The sound output module (155) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.
[0041] The display module (160) can visually provide information to an external (e.g., user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.
[0042] The audio module (170) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150) or output sound through the sound output module (155) or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (101).
[0043] The sensor module (176) can detect the operating state of the electronic device (101) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
[0044] The interface (177) may support one or more specified protocols that can be used for the electronic device (101) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (102)). According to one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
[0045] The connection terminal (178) may include a connector through which the electronic device (101) can be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0046] The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module (179) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.
[0047] The camera module (180) can capture still images and video. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.
[0048] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).
[0049] The battery (189) can supply power to at least one component of the electronic device (101). According to one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0050] The communication module (190) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may include one or more communication processors that operate independently of the processor (120) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (194) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (104) through a first network (198) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can identify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (196).
[0051] The wireless communication module (192) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (192) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (192) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), external electronic device (e.g., electronic device (104)), or network system (e.g., second network (199)). According to one embodiment, the wireless communication module (192) can support a Peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 164 dB or less) for realizing mMTC, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for realizing URLLC.
[0052] An antenna module (197) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (198) or a second network (199), may be selected from the plurality of antennas, for example, by a communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (197).
[0053] According to one embodiment, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.
[0054] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.
[0055] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) through a server (108) connected to a second network (199). Each of the external electronic devices (102, or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations performed on the electronic device (101) may be performed on one or more of the external electronic devices (102, 104, or 108). For example, if the electronic device (101) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (101) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (101) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or neural networks. According to one embodiment, the external electronic device (104) or the server (108) may be included within a second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.
[0056] FIGS. 2a and 2b are drawings showing the front and rear of a wearable electronic device according to one embodiment.
[0057] Referring to FIG. 2a and FIG. 2b, in one embodiment, camera modules (211, 212, 213, 214, 215, 216) and / or a depth sensor (217) for acquiring information related to the surrounding environment of the wearable electronic device (200) may be disposed on a first surface (210) of the housing (e.g., the front of the wearable electronic device (200).
[0058] In one embodiment, camera modules (211, 212) can acquire images related to the surrounding environment of the wearable electronic device (200).
[0059] In one embodiment, camera modules (213, 214, 215, 216) can acquire images while the wearable electronic device (200) is worn by a user. The camera modules (213, 214, 215, 216) can be used for hand detection, tracking, and user gesture (e.g., hand movements) recognition. The camera modules (213, 214, 215, 216) can be used for 3DoF (degrees of freedom), 6DoF head tracking, location (space, environment) recognition, and / or movement recognition. In one embodiment, camera modules (211, 212) may be used for hand detection and tracking and user gestures.
[0060] FIGS. 2a and 2b illustrate an embodiment in which camera modules (211, 212, 213, 214, 215, 216) and / or a depth sensor (217) are placed on the front of a wearable electronic device (200), but at least some of these components may be placed on the bottom or side of the wearable electronic device (200).
[0061] In one embodiment, the depth sensor (217) may be configured to transmit a signal and receive a signal reflected from a subject, and may be used for determining the distance to an object, such as time of flight (TOF). Instead of or additionally to the depth sensor (217), camera modules (213, 214, 215, 216) may determine the distance to an object.
[0062] According to one embodiment, a face recognition camera module (225, 226) and / or a display (221) (and / or a lens) may be disposed on a second surface (220) of the housing (e.g., the rear of the wearable electronic device (200)).
[0063] In one embodiment, a face recognition camera module (225, 226) adjacent to the display is used for recognizing the user's face or can recognize and / or track both of the user's eyes.
[0064] In one embodiment, the display (221) (and / or lens) may be disposed on a second surface (220) of the wearable electronic device (200). In one embodiment, the wearable electronic device (200) may not include camera modules (215, 216) among a plurality of camera modules (213, 214, 215, 216).
[0065] As described above, according to one embodiment, the wearable electronic device (200) may have a form factor for being worn on a user's head. The wearable electronic device (200) may further include a strap and / or a wearing member for being secured on a part of the user's body. The wearable electronic device (200) may provide a user experience based on augmented reality, virtual reality, and / or mixed reality while being worn on the user's head.
[0066] FIG. 3a is a block diagram of a wearable electronic device according to one embodiment, and FIG. 3b is a block diagram for explaining the configuration of a processor and an artificial intelligence model according to one embodiment.
[0067] Referring to FIGS. 3a and 3b, according to one embodiment, the wearable electronic device (301) may be implemented as a wearable electronic device that can be worn on a user's body (e.g., head). For example, the wearable electronic device (301) may be implemented as augmented reality glasses, a video see-through (VST) device, or a head-mount display (HMD) device. However, this is just one example, and the wearable electronic device (301) may be implemented as various devices.
[0068] Referring to FIGS. 3a and 3b, the wearable electronic device (301) may include a processor (320), memory (330), display (360), camera (380), and communication circuit (390).
[0069] According to one embodiment, the processor (320) can perform overall control operations of the wearable electronic device (301). According to one embodiment, the processor (320) can execute software (e.g., the program (140) of FIG. 1) to control at least one other component (e.g., a hardware or software component) of the electronic device (301) connected to the processor (320), and can perform data processing or operations based on instructions. According to one embodiment, the instructions may include instructions composed of machine language that can be processed by the electronic device (301) or the processor (320). For example, the instructions may include instructions corresponding to operation instructions used in the program.
[0070] According to one embodiment, the number of processors (320) may be one or more. For example, the processor (320) may have the structure of a multi-core processor such as a dual core, a quad core, or a hexa core. The processor (320) can control the operations of the wearable electronic device (301) by executing instructions stored in memory (330). For example, the processor (320) may correspond to a plurality of processors that collectively perform a plurality of operations by dividing them among the processors.
[0071] (1). An embodiment of transmitting a file to an external wearable electronic device representing a receiving electronic device when the wearable electronic device (301) is a transmitting electronic device for transmitting a file.
[0072] According to one embodiment, when the processor (320) confirms that the wearable electronic device (301) is performing an operation to transmit a file to an external wearable electronic device, it can identify a first user wearing the wearable electronic device (301) as the sender and identify a second user wearing the external wearable electronic device as the receiver.
[0073] According to one embodiment, the processor (320) may generate a first message including first information representing sender information (e.g., an image of a first user wearing the wearable electronic device taken from the wearable electronic device) and second information representing receiver information (e.g., an image of a second user wearing the external wearable electronic device taken from the wearable electronic device) while the wearable electronic device (301) performs an operation to transmit a file to an external wearable electronic device, and transmit the first message to the external wearable electronic device.
[0074] According to one embodiment, when an external wearable electronic device receives a first message, it may generate third information (e.g., an image of a second user wearing an external wearable electronic device taken by the external wearable electronic device) for comparison with second information included in the first message (e.g., an image of a second user wearing an external wearable electronic device taken by the wearable electronic device).
[0075] According to one embodiment, the processor (320) can identify a first command pointing to an external wearable electronic device (or a second user (receiver) wearing the external wearable electronic device, or a second user (receiver) who is not wearing or possessing the external wearable electronic device at the moment indicated by the user's gesture command) using an AI model (331) while the wearable electronic device is worn by a first user (sender).
[0076] According to one embodiment, the processor (320) can use an AI model (331) (e.g., a second AI model (331b)) to identify a gesture command identified through a first direction of at least one second camera (383) (e.g., the first camera (213) and the second camera (214) of FIG. 2a) positioned at a second position (upper side) above a first position (lower side) on the front of the housing of the wearable electronic device (e.g., the first side (210) of FIG. 2a) among the cameras (380) as a first command pointing to an external wearable electronic device for file sharing (or a second user wearing the external wearable electronic device, or a second user who is not wearing or possessing the external wearable electronic device at the moment the user's gesture command points). According to one embodiment, the processor (320) can identify a gesture command that can be obtained based on a part of the body (e.g., hand) of a user wearing the wearable electronic device (301) through at least one first camera (381) positioned on the lower side of the front of the housing of the wearable electronic device (301).
[0077] For example, the processor (320) can use an AI model (331) to identify a gesture command corresponding to a finger as a first command for a user pointing to an external wearable electronic device (or a second user wearing an external wearable electronic device, or a second user who is not wearing or possessing an external wearable electronic device at the moment the user’s gesture command is pointed) through at least one first camera (381) (e.g., the third camera (215) and the fourth camera (216) of FIG. 2a).
[0078] According to one embodiment, the processor (320) can use an AI model (331) (e.g., a third AI model (331c)) to identify a user’s gaze command, confirmed through an eye-tracking camera (385) among cameras (380), as a first command pointing to an external wearable electronic device for file sharing (or a second user wearing an external wearable electronic device, or a second user who is not wearing or possessing an external wearable electronic device at the moment the user’s gaze command points).
[0079] For example, the processor (320) can determine the direction of the user’s gaze through the eye-tracking camera (385) and, using the AI model (331), determine as a first command the gaze command in which the user’s gaze is directed at an external wearable electronic device (or a second user wearing an external wearable electronic device, or a second user who is not wearing or possessing an external wearable electronic device at the moment the user’s gaze command is directed).
[0080] According to one embodiment, the processor (320) can use an AI model (331) (e.g., a first AI model (331a)) to identify a user's voice command received through a microphone (not shown) as a first command pointing to an external wearable electronic device for file sharing (or a second user wearing an external wearable electronic device, or a second user who is not wearing or possessing an external wearable electronic device at the moment the user's voice command is spoken).
[0081] According to one embodiment, the processor (320) can use an AI model (331) (e.g., a first AI model (331a)) to analyze text received from a first user wearing a wearable electronic device through a user interface (e.g., a microphone, a keyboard, and / or a camera) and verify it as a first command.
[0082] For example, the processor (320) can determine the first command by using an AI model (331) (e.g., a first AI model (331a)) to analyze text received through a microphone, text received based on user input through a keyboard, and / or text corresponding to the result of analyzing an image.
[0083] For example, the processor (320) can identify the voice command as the first command by using an AI model (331) to identify the voice command received by a user through a microphone (not shown) (e.g., "Send the file to the person wearing the blue jacket next to the gray car") as a voice command representing an external wearable electronic device (or a second user wearing the external wearable electronic device, or a second user who is not wearing or possessing the external wearable electronic device at the moment the user's voice command is spoken).
[0084] According to one embodiment, the processor (320) can use an AI model (331) (e.g., a third AI model (331c)) to determine the rotation direction of the wearable electronic device worn by the first user as a first command pointing to an external wearable electronic device for file sharing (or a second user wearing the external wearable electronic device, or a second user who is not wearing or possessing the external wearable electronic device at the moment the wearable electronic device is rotating).
[0085] For example, the processor (320) can use an AI model (331) to determine the rotation direction of a wearable electronic device worn by a first user, and if it determines an external wearable electronic device (or a second user wearing the external wearable electronic device, or a second user who is not wearing or possessing the external wearable electronic device at the moment the wearable electronic device rotates) in the determined rotation direction, it can determine the determined rotation direction as a first command.
[0086] According to one embodiment, the first AI model (331a) is an AI model capable of analyzing text and may include a Large Language Model (LM).
[0087] According to one embodiment, the first AI model (331a) can analyze text received through a microphone, text received based on user input through a keyboard, and / or text corresponding to the result of analyzing an image.
[0088] According to one embodiment, the second AI model (331b) is an AI model capable of generating text by analyzing (interpreting) an image (still image and / or video) received through a camera (380), and may include a vision language model (VLM).
[0089] According to one embodiment, the third AI model (331c) is an AI model capable of analyzing images, audio, and / or text, and may include a large multimodal model (LMM).
[0090] According to one embodiment, when the processor (320) identifies an external wearable electronic device for file sharing, it can use an AI model (331) to generate (identify) first information (first feature information) about the first user representing sender information based on an image (first image data) of the first user wearing the wearable electronic device.
[0091] According to one embodiment, the processor (320) can detect at least one first information (first feature information) about the appearance of the first user from an image (first image data) of the first user using an AI model (331).
[0092] According to one embodiment, when the processor (320) identifies an external wearable electronic device for file sharing based on a first instruction, it can receive an image of a first user (first image data) corresponding to the appearance of a first user wearing the wearable electronic device through at least one first camera (381) (e.g., the third camera (215) and the fourth camera (216) of FIG. 2A) positioned at a first position (lower side) on the front of the housing of the wearable electronic device (e.g., the first side (210) of FIG. 2A) among the cameras (380).
[0093] According to one embodiment, the processor (320) receives an image of the first user (first image data) through a camera (e.g., eye-tracking camera (385)) positioned on the rear side of the housing of the wearable electronic device (e.g., the second side (220) of FIG. 2A) of the camera (380) while the wearable electronic device is being worn by the first user, stores the image of the first user stored in memory (330), and when checking an external wearable electronic device for file sharing, the image of the first user stored in memory (330) can be checked.
[0094] According to one embodiment, when the processor (320) checks an external wearable electronic device for file sharing, it receives an image (first image data) of a first user wearing the wearable electronic device through at least one first camera (381), and can update an image of the first user stored in memory (330) based on the image of the first user received through at least one first camera (381).
[0095] According to one embodiment, the processor (320) can periodically receive an image of a first user wearing a wearable electronic device through at least one first camera (381) and update an image of the first user stored in memory (330) based on the image of the first user (first image data) received through at least one first camera (381).
[0096] According to one embodiment, the processor (320) can update the image of the first user stored in the memory (330) based on the image of the first user (first image data) received through at least one first camera (381) when the first user wearing the wearable electronic device (301) detects the action of removing the clothes being worn or removing the accessories being worn (e.g., bag, watch and / or ring) through at least one first camera (381).
[0097] According to one embodiment, when the processor (320) identifies an external wearable electronic device for file sharing, it can receive an image (first image data) of a first user wearing the wearable electronic device shown on a reflective object (e.g., a mirror) through a second direction different from the first direction of at least one second camera (383) (e.g., the first camera (211) and the second camera (212) of FIG. 2a) positioned at a second position that is higher than (or different from) the first position on the front of the housing of the wearable electronic device (e.g., the first surface (210) of FIG. 2a) among the cameras (380).
[0098] According to one embodiment, when the processor (320) receives an image (first image data) of a first user wearing a wearable electronic device that is seen on a reflective object (e.g., a mirror) through at least one second camera (383), it can update an image of the first user stored in memory (330) based on the image of the first user received through at least one second camera (383).
[0099] According to one embodiment, the processor (320) can transmit a prompt to the AI model (331) to generate an image (first image data) and first information (first feature information) of a first user wearing a wearable electronic device (301).
[0100] According to one embodiment, the second AI model (331b) generates text that interprets the image of the first user based on a prompt, and the first AI model (331a) generates a final text that transforms the text that interprets the image of the first user into natural text and transmits it to the processor (320). Then, the processor (320) can identify the final text (first text) received from the first AI model (331a) as first information about the first user representing sender information.
[0101] According to one embodiment, in an AI model (e.g., a third AI model (331c)) capable of performing the functions of the first AI model (331a) and the second AI model (331b), text is generated by interpreting the image of the first user based on a prompt, and a final text is generated by transforming the text interpreting the image of the first user into natural text and transmitted to a processor (320). Then, the processor (320) can identify the final text received from the first AI model (331a) as first information about the first user representing sender information.
[0102] According to one embodiment, the processor (320) can generate text that interprets the image of the first user by using an AI model (331) to classify the features of the first user into items based on the image of the first user.
[0103] For example, the processor (320) can use an AI model (331) to generate text interpreting the image of the first user by classifying the type and color of the clothing worn by the first user as a first item based on the image of the first user, classifying the type and color of the bag worn by the first user and accessories such as a watch and / or ring as a second item, and classifying the shape and color of the buttons included in the clothing and / or the brand name of the accessories as a third item.
[0104] According to one embodiment, the processor (320) can generate text that interprets the item with the highest priority (e.g., the first item) among the items representing the characteristics of the first user based on the image of the first user using an AI model (331).
[0105] According to one embodiment, the processor (320) can generate text that interprets the image of the first user by using an AI model (331) and additional information representing the characteristics of the first user, such as the first user's body information (e.g., the user's skeletal structure and / or the user's skin color) stored in memory (330) together with the image of the first user.
[0106] According to one embodiment, the processor (320) can use an AI model (331) to add various items that are distinguished using the characteristics of the first user. According to one embodiment, if the processor (320) uses an AI model (331) to determine that the text interpreting the image of the first user is not clear enough to be generated as the first information, it can use the image of the first user stored in memory (330) as additional information to generate the text interpreting the image of the first user.
[0107] For example, the processor (320) can generate text interpreting the image of the first user by using an AI model (331) to identify only the buckle and strap shape in the image of the first user received through at least one first camera (381), and then identifying a bag image containing the same buckle and strap shape in the image of the first user stored in memory (330), using the image of the first user stored in memory (330) containing the bag image containing the buckle and strap shape as additional information.
[0108] According to one embodiment, the processor (320) can generate text that interprets the image of the first user (first image data) by using an AI model (331) and referring to the posture of the first user along with the image of the first user, using additional information about the action currently being performed by the first user (e.g., while running and / or stretching).
[0109] According to one embodiment, when the processor (320) confirms the existence of a first user avatar created to resemble the face of the first user, it can use an AI model (331) to identify the first user avatar, which has been modified to correspond to the image of the first user, as first information representing sender information.
[0110] According to one embodiment, when the processor (320) confirms the existence of a first user avatar created to resemble the face of the first user, it can use an AI model (331) to apply at least one item (e.g., clothing) identified in the image of the first user to the first user's avatar, and confirm the applied first user's avatar as first information representing sender information.
[0111] According to one embodiment, the processor (320) can use an AI model (331) to generate a QR (quick response) code or a specified machine language based on an image of a first user, and can identify the QR code or the specified machine language as first information representing sender information.
[0112] According to one embodiment, when the processor (320) identifies an external wearable electronic device for file sharing based on a first instruction, it can use an AI model (331) to generate (identify) second information (second feature information) about a second user representing recipient information based on an image of a second user wearing an external wearable electronic device.
[0113] According to one embodiment, the processor (320) can detect at least one second piece of information (second feature information) about the appearance of the second user from an image (second image data) of the second user using an AI model (331).
[0114] According to one embodiment, when the processor (320) identifies an external wearable electronic device for file sharing, it may receive an image of a second user wearing the external wearable electronic device through a second direction of at least one second camera (383) (e.g., the first camera (211) and the second camera (212) of FIG. 2a) positioned at a second position (upper side) above the first position on the front of the housing of the wearable electronic device (e.g., the first side (210) of FIG. 2a) among the cameras (380). According to one embodiment, the processor (320) may transmit the image of the second user wearing the external wearable electronic device and the prompt to an AI model (331).
[0115] According to one embodiment, the second AI model (331b) generates text that interprets the image of the second user based on a prompt, and the first AI model (331a) generates a final text that transforms the text that interprets the image of the second user into natural text and transmits it to the processor (320). The processor (320) can then identify the final text (second text) received from the first AI model (331a) as second information (second feature information) representing recipient information.
[0116] According to one embodiment, in an AI model (e.g., a third AI model (331c)) capable of performing the functions of the first AI model (331a) and the second AI model (331b), text is generated by interpreting the image of the second user based on a prompt, and a final text is generated by transforming the text interpreting the image of the second user into natural text and transmitted to a processor (320). Then, the processor (320) can identify the final text received from the first AI model (331a) as second information (second feature information) representing recipient information.
[0117] According to one embodiment, the processor (320) can use an AI model (331) to classify the features of the second user based on the image of the second user by item and generate text that interprets the image of the second user (second image data) by item.
[0118] For example, the processor (320) can use an AI model (331) to generate text interpreting the image of the second user by classifying the type and color of the clothing worn by the second user as a first item based on the image of the second user, classifying the type and color of the bag worn by the second user and accessories such as a watch and / or ring as a second item, and classifying the shape and color of the buttons included in the clothing and / or the brand name of the accessories as a third item.
[0119] According to one embodiment, the processor (320) can add various numbers of items distinguished by using the characteristics of the second user by using an AI model (331).
[0120] According to one embodiment, the processor (320) can generate text that interprets the item with the highest priority (e.g., the first item) among the items representing the characteristics of the second user based on the image of the second user using an AI model (331).
[0121] According to one embodiment, the processor (320) can generate text that interprets the image of the second user (second image data) based on additional information about the second user that can be distinguished from other people in the surrounding area, along with the image of the second user, using an AI model (331).
[0122] According to one embodiment, the processor (320) can generate text that interprets the image of the second user (second image data) using an AI model (331) and additional information including the second user's body information (e.g., estimated height (175 cm) and / or arm ratio) along with the image of the second user.
[0123] According to one embodiment, the processor (320) can generate text that interprets the image of the second user (second image data) by using an AI model (331) and additional information regarding the posture of the second user, along with the image of the second user, and the action currently being performed by the second user (e.g., while running and / or stretching).
[0124] According to one embodiment, the processor (320) can obtain shooting information indicating which part of the body of the second user is centered on and which image (second image data) of the second user is captured through at least one second camera (383) based on posture information or situation information (e.g., a situation where the second user is partially obscured by other people) of the second user wearing an external wearable electronic device, using an AI model (331).
[0125] According to one embodiment, the processor (320) can use an AI model (331) to identify model information of an external wearable electronic device worn by a second user, identify a part of the second user's body that is easy to photograph through a camera of the external wearable electronic device based on the model information of the external wearable electronic device, and take an image of the second user through at least one second camera (383) centered on the identified part of the second user's body.
[0126] According to one embodiment, the processor (320) can acquire an image (third image data) including the second user and the third user, in which the appearance of the second user wearing an external wearable electronic device and the appearance of the third user carrying an electronic device are captured through at least one second camera (383).
[0127] According to one embodiment, while the processor (320) displays an image (third image data) including a second user and a third user through a display (360), if it confirms a selection command (e.g., touch or voice command) for selecting at least one of the appearance of the second user and the appearance of the third user in the image (third image data) including the second user and the third user based on the input of the first user, it can generate (detect) second information (second feature information) about the selected appearance based on the selection command using an AI model (331).
[0128] According to one embodiment, the processor (320) can transmit (broadcast) a first message (data transmission / reception request message) requesting a communication connection for file sharing, which includes at least one of first information (first feature information) for a first user representing sender information and second information (second feature information) for a second user representing receiver information, through a communication circuit (390).
[0129] According to one embodiment, the processor (320) can generate a first message (data transmission / reception request message) based on at least a portion of at least one of the first information (first feature information) generated (detected) based on the first user's image (first image data) and the first user's image.
[0130] According to one embodiment, the processor (320) can generate a first message (data transmission / reception request message) based on at least a portion of at least one of a first user image (first image data), at least one first information (first feature information) generated (detected) based on the first user image, a second user image (second image data), and at least one second information (second feature information) generated (detected) based on the second user image.
[0131] According to one embodiment, the processor (320) can generate a first message (data transmission / reception request message) based on at least a portion of at least one of a first user image (first image data), first information (first feature information), an image including a second user and a third user (third image data), and at least one second information (second feature information) generated (detected) based on the image including a second user and a third user (third image data).
[0132] According to one embodiment, the processor (320) may include at least one of the following in the first information representing sender information included in the first message: text interpreting the image of the first user, an avatar image of the first user modified to correspond to the image of the first user, text briefly summarizing the text interpreting the image of the first user, a plurality of keywords detected in the text interpreting the image of the first user, or an image generated based on the text interpreting the image of the first user.
[0133] According to one embodiment, the processor (320) may include at least one of text interpreting the image of the second user, text briefly summarizing the text interpreting the image of the second user, a plurality of keywords detected in the text interpreting the image of the second user, or an image generated based on the text interpreting the image of the second user.
[0134] According to one embodiment, the processor (320) may include information for a communication connection and / or information for capturing a recipient in the first message.
[0135] According to one embodiment, when the processor (320) receives a plurality of second messages accepting a communication connection from each of a plurality of wearable electronic devices after transmitting a first message, it can change second information (second feature information) about a second user representing recipient information included in the first message using an AI model (331).
[0136] According to one embodiment, the processor (320) transmits a first message including text interpreting a first item among a plurality of items included in the second user's image (second image data) as second information representing recipient information, and then receives a plurality of second messages accepting a communication connection from each of a plurality of wearable electronic devices, and then uses an AI model (331) to generate a first message including text interpreting a second item and / or a third item among a plurality of items included in the second user's image as second information representing recipient information, and transmits the generated first message to a plurality of wearable electronic devices through a communication circuit (390).
[0137] For example, the processor (320) can generate a first message including text interpreting a clothing item (e.g., first item) among multiple items included in an image of a second user at a military academy where multiple people are wearing the same uniform, and then receiving multiple second messages accepting communication connections from each of multiple wearable electronic devices, using an AI model (331), remove the clothing item (first item) among the multiple items and include text interpreting an accessory item (second item), such as a watch, glasses, or a ring, as second information indicating recipient information.
[0138] According to one embodiment, the processor (320) can transmit a first message generated through a communication circuit (390) to a plurality of wearable electronic devices based on communication connection information included in a second message.
[0139] According to one embodiment, the processor (320) can use an AI model (331) to change second information representing recipient information included in the first message until it receives a second message accepting a communication connection from an external wearable electronic device after transmitting a first message, and can transmit a first message including second information representing changed recipient information to a plurality of wearable electronic devices.
[0140] According to one embodiment, when the processor (320) receives a second message (data transmission acceptance message) accepting a communication connection from an external wearable electronic device after transmitting a first message, it can establish communication with the external wearable electronic device based on the connection information included in the second message and transmit data (e.g., a file) included in the electronic device to the external wearable electronic device.
[0141] (2). An embodiment in which a file is received from an external wearable electronic device representing a transmitting electronic device when the wearable electronic device (301) is a receiving electronic device for receiving a file.
[0142] According to one embodiment, when the processor (320) confirms that the wearable electronic device (301) is performing an operation to receive a file from an external wearable electronic device, it can identify a first user wearing the wearable electronic device (301) as the recipient and identify a second user wearing the external wearable electronic device as the sender.
[0143] According to one embodiment, when the processor (320) receives a first message from the external wearable electronic device that includes first information representing sender information (e.g., an image of a second user wearing the external wearable electronic device taken by the external wearable electronic device) and second information representing receiver information (e.g., an image of a first user wearing the wearable electronic device taken by the external wearable electronic device) while the wearable electronic device (301) performs an operation to receive a file from the external wearable electronic device, the processor (320) may generate third information (e.g., an image of a first user wearing the wearable electronic device taken by the wearable electronic device) for comparison with the second information (e.g., an image of a first user wearing the wearable electronic device taken by the external wearable electronic device) included in the first message.
[0144] According to one embodiment, when the processor (320) receives a first message (data transmission / reception request message) requesting a communication connection for file sharing from an external wearable electronic device, which includes first information indicating sender information and second information indicating receiver information, while the wearable electronic device is worn by a first user, the processor can determine whether the wearable electronic device is a target for file sharing.
[0145] According to one embodiment, when the processor (320) confirms the reception of a first message (a message requesting the transmission and reception of data), it can receive an image of a first user (first image data) through at least one first camera (381) (e.g., the third camera (215) and the fourth camera (216) of FIG. 2a) and check third information (third feature information) that interprets the image of the first user (second image data) using an AI model.
[0146] According to one embodiment, when the processor (320) confirms the reception of the first message (data transmission / reception request message), it can receive an image (first image data) of a first user wearing a wearable electronic device through at least one first camera (381) of the cameras (380).
[0147] According to one embodiment, when the processor (320) confirms the reception of the first message, it may receive an image (first image data) of a first user wearing a wearable electronic device that is seen on a reflective object (e.g., a mirror) through at least one second camera (383) (e.g., the first camera (211) and the second camera (212) of FIG. 2a) of the cameras (380).
[0148] According to one embodiment, when the processor (320) confirms the reception of the first message, it can check the image of the first user stored in the memory (330).
[0149] According to one embodiment, the processor (320) can transmit an image (first image data) of a first user wearing a wearable electronic device (301) and a prompt to an AI model (331).
[0150] According to one embodiment, the second AI model (331b) generates text that interprets the image of the first user based on a prompt, and the first AI model (331a) generates a final text that transforms the text that interprets the image of the first user into natural text and transmits it to the processor (320). The processor (320) can then verify the final text received from the first AI model (331a) as third information (third feature information) about the first user to verify recipient information.
[0151] According to one embodiment, in an AI model (e.g., a third AI model (331c)) capable of performing the functions of a first AI model (331a) and a second AI model (331b), text is generated by interpreting an image of a first user based on a prompt, and a final text is generated by transforming the text interpreting the image of a first user into natural text and transmitted to a processor (320). Then, the processor (320) can identify the final text received from the first AI model (331a) as third information (third feature information) about the first user for verifying recipient information.
[0152] According to one embodiment, the processor (320) can use an AI model (331) to determine that the second information has captured the front view of the recipient based on text or an image included in the second information representing the shooting information (e.g., angle information) or recipient information included in the first message, and can determine the text interpreting the image of the first user wearing a wearable electronic device received through at least one first camera (381) as third information (third feature information) for the first user to determine the recipient information.
[0153] According to one embodiment, the processor (320) can use an AI model (331) to determine that the second information is a picture of the front of the recipient based on text or an image included in the second information representing the shooting information (e.g., angle information) or recipient information included in the first message, and additionally, the text interpreting the image of the first user wearing a wearable electronic device that is seen on a reflective object (e.g., a mirror) through at least one second camera (383) can be used as third information (third feature information) for the recipient to determine the recipient information.
[0154] According to one embodiment, the processor (320) can use an AI model (331) to identify, based on the shooting information (e.g., angle information) included in the first message or the text or image included in the second information representing recipient information, that the second information has captured a part of the recipient's appearance (e.g., back view and / or side view) where the recipient cannot be identified, and can identify the first user's body information stored in memory (330) or the first user's image among the first user's images stored in memory (330) that is related to the text included in the second information, and can identify the text interpreted based on the first user's image received through at least one first camera (381), the first user's body information, and the first user's image identified in memory (330) as third information (third feature information) for identifying recipient information.
[0155] According to one embodiment, the processor (320) can identify the wearable electronic device (301) as a file sharing target by using an AI model (331) if the similarity between the second information representing recipient information included in the first message and the third information (third feature information) for verifying recipient information is included within a threshold range.
[0156] According to one embodiment, the processor (320) can use an AI model (331) to determine that the similarity between the second information and the third information (third feature information) is within a threshold range if, among multiple items according to priority in the second information and the third information (third feature information), the item with the highest priority is identical by more than a specified number.
[0157] For example, the processor (320) can use an AI model (331) to determine that the similarity between the second information and the third information (third feature information) is within a threshold range if the clothing items with the highest priority (e.g., type and color of clothing) in the second information and the third information (third feature information) are identical by a specified number or more, and accessory items such as bags or watches with lower priority than the clothing items are not identical.
[0158] According to one embodiment, the processor (320) can use an AI model (331) to determine that the similarity between the second information and the third information (third feature information) is within a threshold range if more than a specified number of items among a plurality of items in the second information and the third information (third feature information) match.
[0159] According to one embodiment, when the processor (320) identifies a wearable electronic device as a file sharing target, it uses an AI model to identify information of a second user wearing an external wearable electronic device that sent the first message based on first information representing sender information of the first message, displays a user interface including information related to the second user's information and a message inquiring whether to accept file sharing, and when acceptance of file sharing is confirmed through the user interface, it can send a second message accepting a communication connection for file sharing to the external wearable electronic device.
[0160] According to one embodiment, the processor (320), based on first information indicating sender information included in the first message, can identify a second user wearing an external wearable electronic device through at least one second camera (383) and display a user interface including information related to the second user, such as a message asking whether to accept file sharing through the display (360) and an indication that the second user wearing the external wearable electronic device who sent the first message is located in front of the wearable electronic device (301).
[0161] For example, the processor (320), based on second information representing sender information included in the first message, identifies a second user wearing the wearable electronic device that sent the first message in the field of view (FOV) of at least one second camera (383) of the wearable electronic device, and can provide information related to the second user that indicates that the second user wearing the external wearable electronic device is located in front of the wearable electronic device through a user interface, distinguishing it from other users located in front of the wearable electronic device.
[0162] According to one embodiment, the processor (320) may display a user interface including information related to the second user, such as a message asking whether to accept file sharing through the display (360), an image of the second user wearing the external wearable electronic device generated based on the first information representing sender information included in the first message, and a predicted direction of movement to find the second user based on the previously captured image data, when the first user confirms the second user wearing the external wearable electronic device based on image data previously captured while wearing the wearable electronic device (301), based on the first information representing sender information.
[0163] According to one embodiment, if the processor (320) fails to identify a second user wearing an external wearable electronic device through at least one second camera (383) based on first information representing sender information included in a first message, and fails to identify a second user wearing an external wearable electronic device based on image data previously captured by the first user while wearing the wearable electronic device (301), the processor (320) may generate an avatar image that can predict the second user based on first information (e.g., text) representing sender information included in a first message, and display a user interface including information related to the second user, such as a message asking whether to accept file sharing through a display (360), characteristic information of the second user identified based on the first information representing sender information, and an avatar image that can predict the second user.
[0164] According to one embodiment, when the processor (320) confirms that the avatar image is included in the first information representing sender information included in the first message, it may display a user interface including a message inquiring whether to accept file sharing and the avatar image included in the first information through the display (360).
[0165] According to one embodiment, when the processor (320) receives a first message (data transmission / reception request message) generated based on at least a part of at least one of at least one first information (first feature information) generated (detected) based on the first user’s image (first image data) taken from an external wearable electronic device and at least one of the first information (first feature information) generated (detected) based on the first user’s image (first image data), the processor (320) may display a user interface through a display (360) including an object representing the first user, a virtual image corresponding to at least one of the first information (first feature information) (e.g., an avatar image representing the first user), at least one of the first text describing at least one of the first information (first feature information), and a message for confirming whether to accept the request for data transmission / reception.
[0166] According to one embodiment, when the processor (320) receives a first message (data transmission / reception request message) generated based on at least a part of at least one of an image of a first user wearing a wearable electronic device (first image data) taken from an external wearable electronic device, at least one first information (first feature information) generated (detected) based on the image of the first user (first image data), an image of a second user wearing an external wearable electronic device (second image data), and second information (second feature information) generated (detected) based on the image of the second user (second image data), the processor (320) may display a user interface through a display (360) that includes at least one of a second text describing at least one second information (second feature information) and a message for confirming whether to accept the request for data transmission / reception.
[0167] According to one embodiment, the processor (320) may additionally include and display a text summarizing the conversation content (e.g., voice information) between the first user and the second user in addition to the first message (data transmission / reception request message), or a third text (e.g., conversation summary text) including at least a portion of the conversation content in the user interface, or output it through a speaker (e.g., the sound output module (155) of FIG. 1).
[0168] According to one embodiment, when the processor (320) confirms the acceptance of file sharing through a user interface, it may transmit a second message (data transmission acceptance message) accepting a communication connection for file sharing, which includes information for a communication connection (e.g., a MAC (media access control) address, an IP (internet protocol) address, or encryption key information), to an external wearable electronic device through a communication circuit (390).
[0169] (3). An embodiment in which, when the wearable electronic device (301) is a transmitting electronic device for file transmission, a third message indicating acceptance of file sharing is received from an external wearable electronic device in advance before transmitting a first message for file transmission to an external wearable electronic device indicating a receiving electronic device.
[0170] According to one embodiment, the processor (320) can identify a first user wearing the wearable electronic device (301) as the sender and a second user wearing an external wearable electronic device as the receiver when the wearable electronic device (301) is a transmitting electronic device for file transmission.
[0171] According to one embodiment, when the processor (320) receives a third message indicating acceptance of file sharing from an external wearable electronic device, it can identify the fourth information included in the third message (e.g., an image of a second user wearing an external wearable electronic device taken from the external wearable electronic device) as recipient information.
[0172] According to one embodiment, the processor (320) may confirm the reception of a third message including, prior to file sharing or prior to the transmission of a first message (data transmission / reception request message), information indicating acceptance of sharing for a file transmitted by the wearable electronic device (e.g., a flag or a designated signal) based on an image (second image data) of a second user wearing the external wearable electronic device obtained through a first camera of the external wearable electronic device, prior to file sharing or transmission of a first message (e.g., an ID (identification) and / or a MAC address).
[0173] According to one embodiment, the processor (320) may store in memory (330) in relation to each other the fourth information (fourth feature information) generated based on an image (second image data) of a second user wearing an external wearable electronic device acquired through a first camera of an external wearable electronic device included in a third message, information indicating acceptance of file sharing from the external wearable electronic device (e.g., a flag or a designated signal), and first device information (e.g., an ID and / or MAC address) for a communication connection with the external wearable electronic device.
[0174] According to one embodiment, when the processor (320) confirms the switching of a file sharing mode for transmitting a file to an external wearable electronic device, it compares the second information (second feature information) generated based on an image (second image data) of a second user of the external wearable electronic device obtained through a second camera of the wearable electronic device with the fourth information stored in the memory (330), and if the comparison result is substantially identical, it can transmit a fourth message to the external wearable electronic device including device information for a communication connection of the wearable electronic device, first information generated based on an image of a first user wearing the wearable electronic device, fourth information generated based on an image (second image data) of a second user wearing the external wearable electronic device stored in the memory (330), and device information for a communication connection of the external wearable electronic device (e.g., ID and / or MAC address).
[0175] (4). An embodiment in which, when the wearable electronic device (301) is a receiving electronic device for receiving files, a third message indicating acceptance of file sharing is generated and transmitted to the external wearable electronic device in advance before receiving a first message for receiving files from an external wearable electronic device indicating a transmitting electronic device.
[0176] According to one embodiment, the processor (320) can identify a first user wearing the wearable electronic device (301) as the recipient and a second user wearing an external wearable electronic device as the sender when the wearable electronic device (301) is a receiving electronic device for receiving files.
[0177] According to one embodiment, the processor (320) may generate fourth information representing recipient information (e.g., an image of a first user wearing a wearable electronic device taken from a wearable electronic device) and transmit a third message containing the fourth information (e.g., an image of a first user wearing a wearable electronic device taken from a wearable electronic device) to an external wearable electronic device.
[0178] According to one embodiment, the processor (320) may transmit (broadcast) a third message including, prior to receiving a first message (data transmission / reception request message), information indicating acceptance of sharing for a file transmitted from an external wearable electronic device (e.g., a flag or a specified signal) generated based on an image (first image data) of a first user wearing a wearable electronic device obtained through a first camera of the wearable electronic device, information for a communication connection with an external wearable electronic device (e.g., an ID and / or a MAC address).
[0179] According to one embodiment, when the processor (320) receives a fourth message from an external wearable electronic device after transmitting a third message, it compares the first information generated based on an image (second image data) of a second user wearing the external wearable electronic device included in the fourth message and / or device information for a communication connection with the external wearable electronic device (e.g., ID and / or MAC address) with the third information generated based on an image of a first user wearing the wearable electronic device obtained through a first camera of the wearable electronic device and / or device information of the wearable electronic device, and if the comparison result is substantially identical, it can receive a file from the external wearable electronic device connected to the communication based on the fourth message.
[0180] According to one embodiment, the processor (320) displays a user interface (popup window) to confirm the first user's acceptance of file reception if the comparison result is substantially identical, and if the acceptance is confirmed based on the user's input, the file can be received from an external wearable electronic device connected to the communication based on the fourth message.
[0181] (5). An embodiment in which, when the wearable electronic device (301) is a transmitting electronic device for file transmission, after receiving a third message indicating acceptance of file sharing in advance from an external wearable electronic device representing a receiving external electronic device, the external wearable electronic device that transmitted the third message is identified in the operation to transmit the file.
[0182] According to one embodiment, the processor (320) can identify a first user wearing the wearable electronic device (301) as the sender and a second user wearing an external wearable electronic device as the receiver when the wearable electronic device (301) is a transmitting electronic device for file transmission.
[0183] According to one embodiment, the processor (320) can identify the fourth information (e.g., an image of a second user wearing an external wearable electronic device taken from an external wearable electronic device) included in a third message indicating prior acceptance of file sharing from an external wearable electronic device as recipient information.
[0184] According to one embodiment, the processor (320) stores in memory (330) in relation to each other the fourth information (fourth feature information) generated based on the image (second image data) of a second user wearing an external wearable electronic device included in the third message received from the external wearable electronic device prior to file sharing or prior to the transmission of the first message (data transmission / reception request message), information indicating acceptance of file sharing from the external wearable electronic device (e.g., a flag or a designated signal), and device information for a communication connection with the external wearable electronic device (e.g., ID and / or MAC address). After the wearable electronic device recognizes a user's voice command (e.g., "Do you want to receive the file?" or "Person who wants to receive the file") to identify the person who wants to share the file, and then confirms the reception of a gesture indicating acceptance of file sharing through the second camera of the wearable electronic device from outside the wearable electronic device, the processor generates based on the image (second image data) of the second user of the external wearable electronic device that confirmed the gesture captured through the second camera of the wearable electronic device. The second information (second feature information) and the fourth information (fourth feature information) stored in the memory (330) are compared, and if the comparison result matches, a file can be transmitted from an external wearable electronic device connected to the communication based on the third message.
[0185] (6). An embodiment in which, when the wearable electronic device (301) is a receiving electronic device for receiving files, it receives a first message from an external wearable electronic device representing a transmitting external electronic device, and if there is no third information (e.g., an image of a first user wearing the wearable electronic device taken from the wearable electronic device) to compare with second information (e.g., an image of a first user wearing the wearable electronic device taken from the external wearable electronic device) representing recipient information included in the first message, it confirms that the wearable electronic device is a file sharing target based on the second information.
[0186] According to one embodiment, the processor (320) can identify a first user wearing the wearable electronic device (301) as the recipient and a second user wearing an external wearable electronic device as the sender when the wearable electronic device (301) is a receiving electronic device for receiving files.
[0187] According to one embodiment, the processor (320) receives a first message (data transmission / reception request message) requesting a communication connection for file sharing, and if there is no image of a first user wearing a wearable electronic device (e.g., third information) to compare with second information representing recipient information included in the first message, the processor displays second information (second feature information) representing recipient information included in the first message as a pop-up window through the display (360), and if it is confirmed that the wearable electronic device is a file sharing target based on user input, the processor can transmit a second message accepting a communication connection for file sharing to an external wearable electronic device or automatically establish communication with the external wearable electronic device.
[0188] (7). An embodiment in which, when the wearable electronic device (301) is a transmitting electronic device for file transmission, a first message is generated and transmitted to an external wearable electronic device representing a receiving electronic device, which includes conversation summary information summarized in text based on conversation content (e.g., voice information) or at least a portion of said conversation content.
[0189] According to one embodiment, the processor (320) can identify a first user wearing the wearable electronic device (301) as the sender and a second user wearing an external wearable electronic device as the receiver when the wearable electronic device (301) is a transmitting electronic device for file transmission.
[0190] According to one embodiment, when a first user of a wearable electronic device has a conversation, the processor (320) can generate a conversation content (e.g., voice information) as a first conversation file, generate a conversation summary information that summarizes the conversation content (e.g., voice information) as text based on the first conversation file using an AI model (331), and store the first conversation file and the conversation summary information in relation to each other in memory (330).
[0191] According to one embodiment, the processor (320) identifies a user's voice command received through a microphone (e.g., input module (150) of FIG. 1) as a first command pointing to an external wearable electronic device for file sharing (or a second user wearing the external wearable electronic device, or a second user who is not wearing or possessing the external wearable electronic device at the moment the user's voice command is spoken), and when it identifies a user's speech related to a conversation in the voice command, it may generate a first message requesting a communication connection for file sharing, comprising at least one of an image of the first user (first image data), first information indicating sender information, and conversation summary information stored in relation to a first conversation file stored in memory.
[0192] For example, when the processor (320) confirms a voice command indicating a first command, "Send this file to the person who was talking about the computer earlier," it can use an AI model (331) to detect a first conversation file in which a conversation related to the computer is summarized among the conversation files stored in memory (330), and generate a first message requesting a communication connection for file sharing that includes at least one of the first user's image (first image data), first information indicating sender information (first feature information), and conversation summary information summarized in text based on the conversation content (e.g., voice information) included in the first conversation file.
[0193] (8). An embodiment in which, when the wearable electronic device (301) is a receiving electronic device for receiving files, it receives a conversation summary information summarized in text based on conversation content (e.g., voice information) or a first message containing at least a portion of said conversation content from an external wearable electronic device representing a transmitting electronic device.
[0194] According to one embodiment, the processor (320) can identify a first user wearing the wearable electronic device (301) as the recipient and a second user wearing an external wearable electronic device as the sender when the wearable electronic device (301) is a receiving electronic device for receiving files.
[0195] According to one embodiment, the processor (320) may receive a first message requesting a communication connection for file sharing, comprising at least one of an image of a second user wearing an external wearable electronic device (second image data), first information indicating sender information, and conversation summary information. According to one embodiment, the processor (320) may display a user interface including a message inquiring whether to accept file sharing from a person with whom you previously conversed based on the first message (e.g., "The person who spoke with you about a computer upgrade wants to send a file; would you accept it?"), and if acceptance of file sharing is confirmed through the user interface, the processor may send a second message accepting a communication connection for file sharing to the external wearable electronic device.
[0196] A memory (330) according to one embodiment may be implemented substantially identically or similarly to the memory (130) of FIG. 1.
[0197] According to one embodiment, an on-device AI model (331) may be stored in the memory (330), and the on-device AI model (331) may be configured in various ways, such as including a first AI model (331a), a second AI model (331b), and a third AI model (331c), or including at least one AI model among the first AI model (331a), the second AI model (331b), and the third AI model (331c), or including at least one of the first AI model (331a), the second AI model (331b), and the third AI model (331c) as one identical AI model, or including the first AI model (331a), the second AI model (331b), and the third AI model (331c) as one identical AI model.
[0198] At least some of the on-device AI models (331) according to one embodiment may be operated as external AI models (351).
[0199] According to one embodiment, the on-device AI model (331) performs processing of sensitive information such as personal information, and the external AI model (351) can perform processing of information excluding sensitive information such as personal information.
[0200] The on-device AI model (331) according to one embodiment is an artificial intelligence model implemented in an electronic device (301) and can provide various functions without a network.
[0201] According to one embodiment, a plurality of artificial intelligence models can be stored in the memory (330).
[0202] According to one embodiment, each of the plurality of AI models may be a model trained based on a specified type of learning algorithm, and may be an AI model implemented to receive various types of data (or content) as input, perform calculations, and output (or obtain) result data.
[0203] According to one embodiment, a plurality of AI models may include generative AI models.
[0204] According to one embodiment, a plurality of AI models may include a vision language model (VLM) capable of generating text by analyzing (interpreting) an image, a language vision model (LVM) capable of generating an image by analyzing text, a large language model (LLM) capable of analyzing text, and a large multimodal model (LMM) capable of analyzing video, audio, and / or text.
[0205] A generative AI model according to one embodiment can generate and output new content (e.g., text, images, and / or computer code) based on learned content in response to an input prompt. For example, learning is performed in an electronic device (601) using data of specified types as input data based on a machine learning algorithm or a deep learning algorithm to output specific types of result data as output data, thereby generating multiple AI models (e.g., machine learning models and deep learning models) which are stored in the electronic device (301), or AI models learned from an external electronic device (e.g., the server (108) of FIG. 1) may be transmitted to and stored in the electronic device (201). For example, the electronic device (301) can output input data (input data) as output data of a model learned through artificial intelligence of specified types based on a machine learning algorithm or a deep learning algorithm. Machine learning algorithms include supervised learning algorithms such as linear regression and logistic regression, unsupervised learning algorithms such as clustering, visualization and dimensionality reduction, and association rule learning, and reinforcement learning algorithms, and deep learning algorithms may include artificial neural networks (ANN), deep neural networks (DNN), and convolutional neural networks (CNN), and may further include various learning algorithms without being limited to those described.The trained AI model includes at least one operation (e.g., a convolution layer or a pooling layer) for processing input data, and can be implemented to output result data by performing operations on the input data based on at least one operation.
[0206] According to one embodiment, an application that can be connected to an external AI model (351) may be stored in the memory (330).
[0207] According to one embodiment, the external AI model (351) may each include a first AI model (331a), a second AI model (331b), and a third AI model (331c), or include at least one AI model among the first AI model (331a), the second AI model (331b), and the third AI model (331c), or include the first AI model (331a), the second AI model (331b), and the third AI model (331c) as one identical AI model.
[0208] According to one embodiment, based on a server that trains a common AI model, words included in each of the text included as first information representing sender information and the text included as second information representing receiver information can be identified as having substantially the same meaning in the AI model included in the sender's wearable electronic device and the AI model included in the receiver's wearable electronic device.
[0209] According to one embodiment, an external server trains a common AI model and collects a large amount of data, and the collected data contains descriptions such as "some person has a bag," "some person's shirt is red," or "some person has white hair."
[0210] According to one embodiment, an external server can provide an AI model that serves as the basis for an electronic device or a wearable electronic device, learn features from collected data, and continuously update the AI model through numerous rounds of supervised learning and unsupervised learning based on data from the Internet, thereby strengthening reliability.
[0211] According to one embodiment, the AI model of the wearable electronic device can become more accurate as the external server performs continuous update patches on the wearable electronic device based on accumulated data.
[0212] According to one embodiment, as the external server transmits standard big data that has been sufficiently trained on the AI model of the wearable electronic device or trained on a large amount of data, the AI model of the wearable electronic device is sufficiently trained on common knowledge such as common sense or norms based on human expression and is trained to be highly consistent with human intuition, so that the "word" identified by the AI model of the wearable electronic device of the sender, which commonly uses the AI model trained on the large external server, and the "word" identified by the AI model of the wearable electronic device of the receiver can be recognized as having substantially the same meaning.
[0213] According to one embodiment, the display (360) may be implemented substantially identically or similarly to the display module (160) of FIG. 1.
[0214] According to one embodiment, a microphone (not shown) can be implemented substantially the same or similar to the input module (150) of FIG. 1.
[0215] According to one embodiment, the microphone (350) can receive ambient audio data including voice commands while capturing video data.
[0216] According to one embodiment, a speaker (not shown) can be implemented substantially identically or similarly to the acoustic output module (155) of FIG. 1.
[0217] According to one embodiment, the camera (380) may be implemented substantially identically or similarly to the camera module (180) of FIG. 1.
[0218] According to one embodiment, the camera (380) may include at least one first camera (381), at least one second camera (383), and an eye-tracking camera (385).
[0219] According to one embodiment, at least one first camera (381) (e.g., the third camera (215) in FIG. 2a) and a fourth camera (216)) are positioned at a first position (lower side) on the front of the housing of the wearable electronic device (e.g., the first surface (210) in FIG. 2a) and can receive a gesture command or an image of the first user that can be obtained based on a part of the body (e.g., hand) of the first user wearing the wearable electronic device (301).
[0220] According to one embodiment, at least one second camera (381) (e.g., the first camera (211) of FIG. 2a) and the second camera (212)) are positioned at a second position (upper side) which is higher than the first position on the front of the housing of the wearable electronic device (e.g., the first surface (210) of FIG. 2a), and can acquire an image related to the surrounding environment of the wearable electronic device (301) or an image of an external wearable electronic device or a second user of the external wearable electronic device located around the wearable electronic device.
[0221] According to one embodiment, at least one camera among the first camera (381) (e.g., the first camera (211) of FIG. 2A) or the second camera (383) (e.g., the second camera (212) of FIG. 2A) can receive a gesture command included in the image while performing the capture of the image.
[0222] According to one embodiment, the eye-tracking camera (385) may represent an eye-tracking camera that tracks the user's gaze. The eye-tracking camera (385) may include an infrared (IR) camera.
[0223] According to one embodiment, the eye-tracking camera (385) may be placed on a second surface of the housing (e.g., the second surface (220) of FIG. 2b).
[0224] According to one embodiment, the eye-tracking camera (385) may be implemented in the same or similar manner as the camera modules (225, 226) of FIG. 2b. However, the number and arrangement structure of the eye-tracking cameras (385) included in the wearable electronic device (301) may be the same or similar as the camera modules (225, 226) of FIG. 2b or different from each other.
[0225] According to one embodiment, the eye-tracking camera (385) can acquire iris information of a user wearing a wearable electronic device (301).
[0226] According to one embodiment, the communication circuit (390) can form a communication connection with an external electronic device (e.g., another electronic device, or a server) using various types of communication methods and transmit and / or receive data. As described above, the communication methods may include communication methods that establish a direct communication connection, such as Bluetooth and WiFi Direct, communication methods that use an access point (AP) (e.g., WiFi communication), or communication methods that use cellular communication using a base station (e.g., 3G, 4G / LTE, 5G). Since the communication circuit (390) can be implemented as described above in the communication module (190) in FIG. 1, a redundant description is omitted.
[0227] In one embodiment, a communication connection operation for file sharing between wearable electronic devices is described, but a communication connection operation for file sharing can be performed in the same way between electronic devices (e.g., mobile devices) and electronic devices (e.g., mobile devices).
[0228] According to one embodiment, an electronic device including a front camera and a rear camera can receive an image of a first user of the electronic device through the front camera and receive an image of a second user of an external electronic device through the rear camera.
[0229] According to one embodiment, an electronic device including a front camera and a rear camera can specify an external electronic device for file sharing based on user input on a preview screen displaying an image received through the rear camera of the electronic device, or specify an external electronic device (or a second user of the external electronic device) through a voice command, and confirm this as a first command pointing to an external electronic device for file sharing (or a second user of the external electronic device).
[0230] FIG. 4 is a diagram illustrating the operation of transferring a file from a wearable electronic device to an external wearable electronic device according to one embodiment.
[0231] Referring to FIG. 4, according to one embodiment, a wearable electronic device (301) (e.g., electronic device (101) of FIG. 1, wearable electronic device (200) of FIG. 2a to 2b and / or wearable electronic device (301) of FIG. 3a to 3b) is, when the wearable electronic device (301) is worn by a first user (311), externally through at least one second camera (e.g., first camera (213) and second camera (214) of FIG. 2a and / or second camera (383) of FIG. 3a) positioned at a second position (upper side) above a first position (lower side) on the front of the housing of the wearable electronic device (301) (e.g., first surface (210) of FIG. 2a)) of the wearable electronic device (301) (e.g., camera (380) of FIG. 3a) among the cameras of the wearable electronic device (301) (e.g., camera (380) of FIG. 3a) When a gesture command (431) pointing to a second user (411) wearing a wearable electronic device (401) or an external wearable electronic device (401) is confirmed, the confirmed gesture command can be confirmed as a first command pointing to a file sharing target.
[0232] According to one embodiment, the wearable electronic device (301) may transmit a first message requesting a communication connection for file sharing, which includes, as sender information and receiver information, first information generated based on an image of a first user (311) received through at least one first camera of the wearable electronic device (301) (e.g., the first camera (381) of FIG. 3a) and second information verified based on an image of a second user (411) received through at least one second camera of the wearable electronic device (301) (e.g., the second camera (383) of FIG. 3a).
[0233] According to one embodiment, an external wearable electronic device (401) can transmit a second message accepting a communication connection for file sharing to a wearable electronic device (301) when it confirms that the similarity between second information representing recipient information included in a first message and fourth information (fourth feature information) generated based on an image of a second user received through at least one first camera of the external wearable electronic device (401) is included within a threshold range.
[0234] According to one embodiment, when a wearable electronic device (301) receives a second message from an external wearable electronic device (401), it can transmit a file (433) to an external wearable electronic device (401) connected to communication based on the second message.
[0235] FIG. 5 is a diagram illustrating the generation of first information representing transmitter information in a wearable electronic device according to one embodiment.
[0236] Referring to FIG. 5, according to one embodiment, a wearable electronic device (e.g., the electronic device (101) of FIG. 1, the wearable electronic device (200) of FIG. 2a to 2b and / or the wearable electronic device (301) of FIG. 3a to 3b) can receive an image (511) of the first user wearing the wearable electronic device through at least one first camera of the wearable electronic device (e.g., the first camera (381) of FIG. 3a)) when confirming a first command pointing to an external wearable electronic device for file sharing (or a second user wearing the external wearable electronic device or a second user who is not wearing or possessing the external wearable electronic device at the moment indicated by the user's gesture command) while the wearable electronic device is worn by a first user.
[0237] According to one embodiment, the wearable electronic device can transmit a prompt (515) to an AI model (331) in which the image (511) of the first user is added to a prompt template (513).
[0238] According to one embodiment, the second AI model (331b) generates text that interprets the first user's image (511) based on a prompt, and the first AI model (331a) can generate first information (517) corresponding to the final text that transforms the text that interprets the first user's image into natural text and output it as an output value.
[0239] FIG. 6 is a diagram illustrating the generation of second information representing recipient information in a wearable electronic device according to one embodiment.
[0240] Referring to FIG. 6, according to one embodiment, a wearable electronic device (e.g., the electronic device (101) of FIG. 1, the wearable electronic device (200) of FIG. 2a to 2b and / or the wearable electronic device (301) of FIG. 3a to 3b) can receive an image (611) of a second user wearing an external wearable electronic device through at least one second camera of the wearable electronic device (e.g., the second camera (383) of FIG. 3a)) when confirming a first command pointing to an external wearable electronic device for file sharing (or a second user wearing an external wearable electronic device, or a second user who is not wearing or possessing an external wearable electronic device at the moment the wearable electronic device is rotated) while the wearable electronic device is worn by a first user.
[0241] According to one embodiment, the wearable electronic device can transmit a prompt (615) to an AI model (331) in which an image (611) of a second user is added to a prompt template (613).
[0242] According to one embodiment, the second AI model (331b) generates text that interprets the image (611) of the second user based on a prompt, and the first AI model (331a) can generate second information corresponding to the final text (617) that transforms the text that interprets the image of the second user into natural text and output it as an output value.
[0243] FIG. 7a is a diagram illustrating first information representing sender information included in a first message and second information representing receiver information in a wearable electronic device according to one embodiment.
[0244] Referring to FIG. 7a, according to one embodiment, a wearable electronic device (e.g., the electronic device (101) of FIG. 1, the wearable electronic device (200) of FIG. 2a to 2b and / or the wearable electronic device (301) of FIG. 3a to 3b) may include text (711) interpreted based on an image of a first user wearing the wearable electronic device using an AI model (e.g., the AI model (331) of FIG. 3b) as first information representing sender information in a first message.
[0245] According to one embodiment, the wearable electronic device may include text (713) interpreted based on an image of a second user wearing an external wearable electronic device (e.g., external wearable electronic device (401) of FIG. 4) that has identified a file sharing target using an AI model (e.g., AI model (331) of FIG. 3b) in the first message as second information representing recipient information.
[0246] According to one embodiment, the same first message as in FIG. 7a can be generated not only in a wearable electronic device but also in an electronic device (e.g., a mobile device).
[0247] FIG. 7b is a drawing illustrating the format of a first message in a wearable electronic device according to one embodiment.
[0248] Referring to Fig. 7b, <730> As such, according to one embodiment, the first message may use a BLE (Bluetooth Low Energy) advertisement packet (700), and in the case of a broadcast that transmits information, the BLE advertisement packet (700) may include data in an advertising channel PDU (731) and transmit.
[0249] <750> According to one embodiment, the configuration of the advertising channel PDU (731) is shown, and the advertising packet payload (751) of the advertising channel PDU (731) may include Bluetooth address information of the transmitting side, and may broadcast the necessary information to AD 0 to AD N (753) of the advertising channel PDU (731).
[0250] According to one embodiment, the electronic device may include address information (MAC address) (771) for transmitting an advertising packet to AD 0 to AD N (753) of an advertising channel PDU (731), a service ID (773) for distinguishing an application or service for sharing, sender information (775) for the sender, and receiver information (777) for the receiver.
[0251] FIG. 8 is a diagram illustrating the operation of identifying a wearable electronic device as a file sharing target when receiving a first message in a wearable electronic device according to one embodiment.
[0252] Referring to FIG. 8, according to one embodiment, a wearable electronic device (e.g., electronic device (101) of FIG. 1, wearable electronic device (200) of FIG. 2a to 2b and / or wearable electronic device (301) of FIG. 3a to 3b) can determine whether the similarity between the second information representing recipient information included in the first message and the third information (third feature information) for verifying recipient information is included within a threshold range by using an AI model (e.g., AI model (331) of FIG. 3b) to verify the text interpreted based on the image of the first user of the wearable electronic device received through at least one first camera of the wearable electronic device (e.g., first camera (381) of FIG. 3a) as the fourth information (fourth feature information) when receiving the first message.
[0253] According to one embodiment, the wearable electronic device can use an AI model (e.g., the AI model (331) of FIG. 3b) to determine, based on second information and third information (fourth feature information), that the bag (811), watch (815), and suit (819) match, and the shirt (813), jacket (817), and hair color (821) do not match.
[0254] According to one embodiment, the wearable electronic device can identify the wearable electronic device as a file sharing target by confirming that the similarity between the second information and the fourth information (fourth feature information) is included within a threshold range, even if not all items match, when the number of clothing items, such as a jacket (817) and a suit (819), corresponding to the item with the highest priority according to a specified condition, is greater than or equal to a specified number based on the second information and the third information (fourth feature information).
[0255] FIGS. 9A, 9B, and 9C are drawings for explaining a user interface provided for confirming acceptance of file sharing in a wearable electronic device according to one embodiment, FIGS. 9D and 9E are drawings for explaining a user interface provided for confirming acceptance of file sharing in an electronic device according to one embodiment, FIG. 9F is a drawing for explaining an operation of selecting a file sharing target in an electronic device according to one embodiment, and FIG. 9G is a drawing for explaining a file sharing operation based on conversation content in a wearable electronic device according to one embodiment.
[0256] Referring to FIG. 9a, according to one embodiment, a wearable electronic device (e.g., the electronic device (101) of FIG. 1, the wearable electronic device (200) of FIG. 2a to 2b and / or the wearable electronic device (301) of FIG. 3a to 3b) can determine whether a second user (913) wearing an external wearable electronic device exists in the field of view (FOV) of at least one second camera (e.g., at least one second camera (383) of FIG. 3a) of the wearable electronic device when it receives a first message and identifies the wearable electronic device as a file sharing target, based on first information indicating sender information included in the first message.
[0257] According to one embodiment, when a wearable electronic device determines whether a second user (913) wearing an external wearable electronic device is present in the field of view (FOV) of at least one second camera of the wearable electronic device, it may display a user interface including a message (911) asking whether to accept file sharing through the display (360) of the wearable electronic device (e.g., the display (360) of FIG. 3a) and information (913a) related to the second user indicating that the second user (913) wearing the external wearable electronic device who sent the first message is located in front of the wearable electronic device.
[0258] Referring to FIG. 9b, according to one embodiment, a wearable electronic device (e.g., the electronic device (101) of FIG. 1, the wearable electronic device (200) of FIG. 2a to 2b and / or the wearable electronic device (301) of FIG. 3a to 3b) can determine whether a second user wearing an external wearable electronic device exists in the field of view (FOV) of at least one second camera of the wearable electronic device (e.g., at least one second camera (383) of FIG. 3a) based on first information indicating sender information included in the first message when the wearable electronic device is identified as a file sharing target upon receiving a first message.
[0259] According to one embodiment, if the wearable electronic device fails to determine whether a second user wearing an external wearable electronic device exists in the field of view (FOV) of at least one second camera of the wearable electronic device, the first user can determine whether a second user wearing an external wearable electronic device exists in the previously captured image data while wearing the wearable electronic device (301).
[0260] According to one embodiment, when the wearable electronic device confirms the presence of a second user wearing an external wearable electronic device in previously captured image data, it may display a user interface including information related to the second user, such as a message (931) asking whether to accept file sharing through the display (360) of the wearable electronic device (e.g., the display (360) of FIG. 3a), an image (933) of the second user wearing an external wearable electronic device generated based on first information indicating sender information, and a predicted direction of movement (935) to find the second user based on previously captured image data.
[0261] Referring to FIG. 9c, according to one embodiment, a wearable electronic device (e.g., electronic device (101) of FIG. 1, wearable electronic device (200) of FIG. 2a to 2b and / or wearable electronic device (301) of FIG. 3a to 3b) can determine whether a second user wearing an external wearable electronic device exists in the field of view (FOV) of at least one second camera of the wearable electronic device (e.g., at least one second camera (383) of FIG. 3a) based on first information indicating sender information included in the first message when the wearable electronic device is identified as a file sharing target upon receiving a first message.
[0262] According to one embodiment, if the wearable electronic device fails to determine whether a second user wearing an external wearable electronic device exists in the field of view (FOV) of at least one second camera of the wearable electronic device, the first user can determine whether a second user wearing an external wearable electronic device exists in the previously captured image data while wearing the wearable electronic device (301).
[0263] According to one embodiment, if the wearable electronic device fails to confirm the presence of a second user wearing an external wearable electronic device in previously captured image data, it may generate characteristic information of the second user and an avatar image capable of predicting the second user based on first information (e.g., text) representing sender information included in a first message, and display a user interface containing information related to the second user, including a message (951) asking whether to accept file sharing, characteristic information of the second user (953), and an avatar image (955) capable of predicting the second user, through a display (360) (e.g., the display (360) of FIG. 3a).
[0264] Referring to Fig. 9d, <991> As such, according to one embodiment, an electronic device (501) (e.g., the electronic device (101) of FIG. 1) receives a first message and, upon identifying the electronic device (501) as a file sharing target, can see a first avatar image included in first information representing first sender information included in the first message. According to one embodiment, the electronic device (501) can display a user interface (971) through the display (560) of the electronic device, which includes a message (971a) inquiring whether to accept file sharing, a first avatar image (971b) representing the first sender, and buttons (971c) for selecting to reject or accept file sharing, along with text describing the attire of the user (recipient) of the electronic device based on second information (second feature information) included in the first message.
[0265] <993> As such, according to one embodiment, an electronic device (501) (e.g., the electronic device (101) of FIG. 1) receives a first message and, upon identifying the electronic device (501) as a file sharing target, can see a second avatar image included in the first information representing the second sender information included in the first message. According to one embodiment, the electronic device (501) can display a user interface (973) through the display (560) of the electronic device, which includes a message (973a) inquiring whether to accept file sharing, a second avatar image (973b) representing the second sender, and buttons (973c) for selecting to reject or accept file sharing, along with text describing the attire of the user (recipient) of the electronic device based on the second information (second feature information) included in the first message.
[0266] Referring to Fig. 9e, <995> As such, according to one embodiment, an electronic device (501) (e.g., the electronic device (101) of FIG. 1) receives a first message and, when the electronic device (501) is identified as a file sharing target, can identify first information representing first sender information and second information (second feature information) representing receiver information included in the first message.
[0267] According to one embodiment, the electronic device (501) may display, through the display (560) of the electronic device, a user interface (975) comprising text (975a) describing the attire of a first sender based on first information, text (975b) asking whether to accept file sharing along with text describing the attire of a user (receiver) of the electronic device based on second information (second feature information), and buttons (975c) for selecting to reject or accept file sharing.
[0268] <997> As such, according to one embodiment, an electronic device (501) (e.g., the electronic device (101) of FIG. 1) receives a first message and, when the electronic device (501) is identified as a file sharing target, can identify first information representing second sender information included in the first message and second information (second feature information) representing receiver information.
[0269] According to one embodiment, the electronic device (501) may display, through the display (560) of the electronic device, a user interface (977) comprising text (977a) describing the clothing of a second sender based on first information, text describing the clothing of a user (receiver) of the electronic device based on second information (second feature information), a message (977b) inquiring whether to accept file sharing, and buttons (977c) for selecting to reject or accept file sharing.
[0270] Referring to FIG. 9f, according to one embodiment, an electronic device (501) (e.g., the electronic device (101) of FIG. 1) includes a front camera having a first direction and a rear camera having a second direction, and the electronic device (501) can acquire an image of a first user of the electronic device with the front camera and receive an image of a second user of an external electronic device with the rear camera and display it as a preview screen through the display (560) of the electronic device.
[0271] Referring to FIG. 9f, as in <998a>, according to one embodiment, an electronic device (501) (e.g., the electronic device (101) of FIG. 1) can identify the external electronic device (or the second user of the external electronic device) through a voice command (981) while displaying an image of the second user of the external electronic device received through the rear camera of the electronic device as a preview screen, as a first command pointing to the external electronic device (or the second user of the external electronic device) for file sharing.
[0272] According to one embodiment, when an electronic device (501) (e.g., the electronic device (101) of FIG. 1) identifies an external electronic device for file sharing via a voice command (981), it can transmit a first message (data transmission / reception request message) to the external electronic device specified by the voice command (981).
[0273] Referring to FIG. 9f, as in <998b>, according to one embodiment, an electronic device (501) (e.g., the electronic device (101) of FIG. 1) can identify the external electronic device (or the second user of the external electronic device) for file sharing based on user input (983) while displaying an image of the second user of the external electronic device received through the rear camera of the electronic device as a preview screen, as a first command pointing to the external electronic device (or the second user of the external electronic device) for file sharing.
[0274] According to one embodiment, when an electronic device (501) (e.g., the electronic device (101) of FIG. 1) identifies an external electronic device for file sharing through user input (983), it can display the external electronic device selected by user input (983) through a display (560) so as to be distinguished from other objects.
[0275] According to one embodiment, an electronic device (501) (e.g., the electronic device (101) of FIG. 1) can transmit a first message (data transmission / reception request message) to an external electronic device selected based on user input (983).
[0276] Referring to FIG. 9g, as in <999a>, according to one embodiment, a wearable electronic device (301) (e.g., electronic device (101) of FIG. 1, wearable electronic device (200) of FIG. 2a to 2b and / or wearable electronic device (301) of FIG. 3a to 3b) can generate a first conversation file containing the content of the conversation (e.g., computer-related content) between the first user (311) and the second user (411) when the first user (311) wearing the wearable electronic device (301) has a conversation (985a, 985b) with the second user (411).
[0277] A wearable electronic device (301) according to one embodiment can generate conversation summary information by summarizing the conversation content included in a first conversation file into text using an AI model (e.g., AI model (331) of FIG. 3b), and can generate second information (second feature information) based on an image of a second user of an external wearable electronic device that has a conversation with a first user obtained through a second camera of the wearable electronic device (301) (e.g., at least one second camera (383) of FIG. 3a).
[0278] A wearable electronic device (301) according to one embodiment may store conversation summary information and second information (second feature information) in relation to a first conversation file in the memory of the wearable electronic device (e.g., memory (330) of FIG. 3a).
[0279] According to one embodiment as in <999b>, the wearable electronic device (301) can identify a user's voice command (987a) received through the microphone (not shown) of the wearable electronic device as a first command pointing to an external wearable electronic device for file sharing (or a second user wearing the external wearable electronic device, or a second user who is not wearing or possessing the external wearable electronic device at the moment the user's voice command is spoken).
[0280] According to one embodiment, when a wearable electronic device (301) confirms a user’s utterance to transmit specific conversation content (e.g., computer-related content) in a voice command to an external wearable electronic device pointed to by a first command, it can confirm a first conversation file (988a) corresponding to specific conversation content (e.g., computer-related content) stored in the memory of the wearable electronic device.
[0281] According to one embodiment, the wearable electronic device (301) can check conversation summary information and second information (second feature information) (988b) stored in association with the first conversation file (988a) in the memory of the wearable electronic device.
[0282] According to one embodiment, a wearable electronic device (e.g., the electronic device (101) of FIG. 1, the wearable electronic device (200) of FIG. 2a to FIG. 2b and / or the wearable electronic device (301) of FIG. 3a to FIG. 3b) may generate and transmit a first message requesting a communication connection for file sharing, comprising at least one of an image of a first user (first image data), first information indicating sender information, second information indicating receiver information, and conversation summary information.
[0283] As in <999c>, according to one embodiment, when an external wearable electronic device (401) receives a first message requesting a communication connection for file sharing, which includes at least one of an image (first image data) of a first user wearing the wearable electronic device, first information indicating sender information, second information indicating receiver information, and conversation summary information, the wearable electronic device (301) can be identified as a file sharing target by using an AI model, such that the similarity between the second information indicating receiver information included in the first message and the third information (third feature information) for verifying receiver information is included within a threshold range.
[0284] According to one embodiment, an external wearable electronic device (401) displays a user interface (989) including a message inquiring whether to accept file sharing from a person with whom a previous conversation took place, based on information related to the first user and conversation summary information, and if acceptance of file sharing is confirmed through the user interface, a second message accepting a communication connection for file sharing can be transmitted to the wearable electronic device (301).
[0285] FIGS. 10a, FIGS. 10b, and FIGS. 10c are drawings for illustrating an AI model in an electronic device according to one embodiment.
[0286] Referring to FIG. 10a, according to one embodiment, an electronic device (301) (e.g., electronic device (101) of FIG. 1, electronic device (200) of FIG. 2a to 2b and / or electronic device (301) of FIG. 3a to 3b) can convert audio received from an input device (1011) of the electronic device (301) (e.g., microphone (350) of FIG. 3a) into text by performing automatic speech recognition (ASR) (1013) (1013), and transmit the converted text to a first AI model (1001a) included in an external server (1001).
[0287] According to one embodiment, a first AI model (1001a) (e.g., a large language model (LLM)) included in an external server (1001) can identify the intent and content of a user's utterance based on text received from an electronic device (301) (1015), generate an answer (1017) that matches the intent, and transmit it to the electronic device (301) in the form of text.
[0288] According to one embodiment, a first AI model (1001a) (e.g., a large language model (LLM)) can analyze audio received through a microphone of an electronic device.
[0289] According to one embodiment, the electronic device (301) converts text received from an external server (1001) into audio using a text-to-speech (TTS) (1019), outputs the converted audio through an output device (1021) (e.g., a speaker of the electronic device), and while outputting the converted audio through the output device (1021) (e.g., a speaker of the electronic device), the text can be displayed through the display of the electronic device (301).
[0290] According to one embodiment, the operation of the first AI model (1001a) (e.g., large language model (LLM)) included in the external server (1001) can be performed substantially the same way in the first AI model (e.g., the first AI model (331a) of FIG. 3b) included as an on-device model in the electronic device (301).
[0291] Referring to FIG. 10b, according to one embodiment, an electronic device (301) (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2a to 2b and / or the electronic device (301) of FIG. 3a to 3b) can transmit image data received through an input device (1031) (e.g., a camera of the electronic device) to an external server (1001).
[0292] According to one embodiment, a second AI model (1001b) (e.g., Vision model) included in an external server (1001) can determine the type of image received from an electronic device (301) as a label, or, if there are multiple objects in one image, determine a label for each object (1033), and then transmit the result of the label (1035) to the electronic device (301).
[0293] According to one embodiment, a second AI model (1001b) (e.g., Vision model) can analyze image data (still image data and / or video data) captured through a camera of an electronic device (301).
[0294] According to one embodiment, when the electronic device (301) receives a result (1035) of a label from an external server (1001), it can process and use it according to an application or service (1037).
[0295] According to one embodiment, the operation of the second AI model (1001b) (e.g., Vision model) included in the external server (1001) can be performed substantially the same way in the second AI model (e.g., the second AI model (331b) of FIG. 3b) included as an on-device model in the electronic device (301).
[0296] According to one embodiment, by using a second AI model (1001b) included in an external server (1001) or an on-device second AI model of an electronic device, when a first gesture (e.g., a hand gesture with the palm spread wide) included in the captured video data is identified while capturing video data and audio data, the first gesture (e.g., a hand gesture with the palm spread wide) is identified as a gesture command for ending the capture, and the capture of video data and audio data can be ended.
[0297] Referring to FIG. 10c, according to one embodiment, a structure for a method of processing multiple input data in a third AI model (e.g., a large multimodal model (LMM)) capable of analyzing image data, audio data, and / or text data can be described.
[0298] According to one embodiment, a third AI model (e.g., a large multimodal model (LMM)) can extract all features (1051b, 1053b, and 1055b) for audio (1051a), visual data (1053a), and text data (1055a) from data collected according to each sensor of the electronic device.
[0299] According to one embodiment, a third AI model (e.g., LMM (large multimodal model)) can fuse features extracted from an Encoder (1057) and a Dense layer (1059) into one to generate a final output (label) (1061).
[0300] A wearable electronic device according to one embodiment (101 of FIG. 1; 200 of FIG. 2a to 2b; 301 of FIG. 3a to 3b) may include a housing, a communication circuit (190 of FIG. 1; 390 of FIG. 3a), a display (160 of FIG. 1; 360 of FIG. 3a), at least one camera (380 of FIG. 3a) including a first camera (381 of FIG. 3a) positioned at a first position on the front of the housing and a second camera (383 of FIG. 3a) positioned at a second position above the first position on the front of the housing, at least one processor (120 of FIG. 1, 320 of FIG. 3a to 3b), and a memory (130 of FIG. 1; 330 of FIG. 3a) for storing instructions. According to one embodiment, when the commands are executed individually or collectively by the at least one processor, the wearable electronic device can confirm a first command from a first user wearing the wearable electronic device. According to one embodiment, when the commands are executed individually or collectively by the at least one processor, the wearable electronic device can confirm a first command pointing to a second user wearing an external wearable electronic device for file sharing using an AI model while the wearable electronic device is worn by the first user. According to one embodiment, when the commands are executed individually or collectively by the at least one processor, the wearable electronic device can confirm first information about the first user based on an image of the first user acquired through the at least one camera using the AI model.When the commands according to one embodiment are executed individually or collectively by the at least one processor, the wearable electronic device can verify second information about the second user based on an image of the second user obtained through the at least one camera using the AI model. When the commands according to one embodiment are executed individually or collectively by the at least one processor, the wearable electronic device can transmit a first message requesting a communication connection for file sharing through the communication circuit, the first message includes first information representing sender information and second information representing receiver information, and when the wearable electronic device receives a second message for accepting the communication connection for file sharing from the external wearable electronic device through the communication circuit, a communication connection can be established with the external wearable electronic device. When the instructions according to one embodiment are executed individually or collectively by the at least one processor, the wearable electronic device can transmit a file to the external wearable electronic device through the communication circuit based on the second message.
[0301] When the commands according to one embodiment are executed individually or collectively by the at least one processor, the wearable electronic device may, by using the AI model, receive a plurality of second messages for accepting a communication connection from a plurality of external wearable electronic devices through the communication circuit, change second information representing recipient information based on the image of the second user. When the commands according to one embodiment are executed individually or collectively by the at least one processor, the wearable electronic device may, through the communication circuit, transmit a first message requesting a communication connection for file sharing to the plurality of wearable electronic devices, the first information representing sender information and second information representing changed recipient information.
[0302] The wearable electronic device according to one embodiment further includes a microphone, and when the commands according to one embodiment are executed individually or collectively by the at least one processor, the wearable electronic device can identify at least one of the first user's gesture command, the first user's gaze command, or the first user's voice command as the first command using the AI model.
[0303] When the instructions according to one embodiment are executed individually or collectively by the at least one processor, the wearable electronic device may identify at least one of the first text interpreting the image of the first user, or the avatar image of the first user modified to correspond to the image of the first user, as the first information. When the instructions according to one embodiment are executed individually or collectively by the at least one processor, the wearable electronic device may identify the second text interpreting the image of the second user as the second information.
[0304] A wearable electronic device according to one embodiment (101 of FIG. 1; 200 of FIG. 2a to 2b; 301 of FIG. 3a to 3b) may include a housing, a communication circuit (190 of FIG. 1; 390 of FIG. 3a), a display (160 of FIG. 1; 360 of FIG. 3a), at least one camera (380 of FIG. 3a) including a first camera (381 of FIG. 3a) positioned at a first position on the front of the housing and a second camera (383 of FIG. 3a) positioned at a second position above the first position on the front of the housing, at least one processor (120 of FIG. 1, 320 of FIG. 3a to 3b), and a memory (130 of FIG. 1; 330 of FIG. 3a) for storing instructions. When the commands according to one embodiment are executed individually or collectively by the at least one processor, the wearable electronic device can acquire an image of the first user through the at least one camera when it receives a first message requesting a communication connection for file sharing, including first information representing sender information and second information representing receiver information, from an external wearable electronic device through the communication circuit while the wearable electronic device is worn by a first user. When the commands according to one embodiment are executed individually or collectively by the at least one processor, the wearable electronic device can verify third information about the first user based on the image of the first user using an AI model. When the instructions according to one embodiment are executed individually or collectively by the at least one processor, the wearable electronic device can identify the wearable electronic device as a file sharing target for the external wearable electronic device if the similarity between the third information regarding the first user and the second information representing the recipient information is included within a threshold value range.When the commands according to one embodiment are executed individually or collectively by the at least one processor, the wearable electronic device can verify information of a second user wearing the external wearable electronic device that transmitted the first message, based on first information representing sender information included in the first message using the AI model. When the commands according to one embodiment are executed individually or collectively by the at least one processor, the wearable electronic device can display a user interface including information related to the second user and a message inquiring whether to accept file sharing. When the commands according to one embodiment are executed individually or collectively by the at least one processor, if the wearable electronic device confirms acceptance of file sharing through the user interface, it can transmit a second message to the external wearable electronic device via the communication circuit for acceptance of a communication connection for file sharing.
[0305] When the instructions according to one embodiment are executed individually or collectively by the at least one processor, the wearable electronic device may display a user interface including a message inquiring about acceptance of file sharing and information related to the second user indicating that the second user is located in front of the wearable electronic device, based on first information indicating the sender information, when the wearable electronic device identifies the second user wearing the external wearable electronic device in an image received through the at least one camera.
[0306] An electronic device according to one embodiment may include a display (160 in FIG. 1; 360 in FIG. 3a), a communication circuit (190 in FIG. 1; 390 in FIG. 3a), at least one camera (380 in FIG. 3a), at least one processor (120 in FIG. 1; 320 in FIG. 3a to 3b), and a memory for storing instructions (130 in FIG. 1; 330 in FIG. 3a). When the instructions according to one embodiment are executed individually or collectively by the at least one processor, the electronic device may acquire first image data by photographing the appearance of a first user wearing or possessing the electronic device with the at least one camera. When the instructions according to one embodiment are executed individually or collectively by the at least one processor, the electronic device may extract at least one first feature information regarding the appearance of the first user from the first image data using an AI model. When the instructions according to one embodiment are executed individually or collectively by the at least one processor, the electronic device may generate a data transmission / reception request message based on at least a portion of at least one of the first image data and the first feature information. When the instructions according to one embodiment are executed individually or collectively by the at least one processor, the electronic device may transmit the data transmission / reception request message to an external electronic device through the communication circuit. When the instructions according to one embodiment are executed individually or collectively by the at least one processor, the electronic device may receive a data transmission / reception acceptance message from the external electronic device.When the instructions according to one embodiment are executed individually or collectively by the at least one processor, the electronic device may transmit data contained in the electronic device to the external electronic device or receive data from the external electronic device based on the data transmission and reception acceptance message.
[0307] When the instructions according to one embodiment are executed individually or collectively by the at least one processor, the electronic device may acquire the first image data including the appearance of at least the first user through a first camera that captures an image in a first direction among the at least one cameras. When the instructions according to one embodiment are executed individually or collectively by the at least one processor, the electronic device may acquire the second image data including the appearance of at least the second user who is not wearing or possessing the electronic device through the first camera or a second camera that captures an image in a second direction different from the first direction.
[0308] When the instructions according to one embodiment are executed individually or collectively by the at least one processor, the electronic device can extract at least one second feature information regarding the appearance of the second user from the second image data using an AI model. When the instructions according to one embodiment are executed individually or collectively by the at least one processor, the electronic device can generate the transmission / reception request message based on at least a portion of at least one of the first image data, the first feature information, the second image data, and the second feature information.
[0309] When the commands according to one embodiment are executed individually or collectively by the at least one processor, the electronic device may acquire the second image data, wherein the second camera further includes the appearance of a third user who is not wearing or possessing the electronic device, in addition to the appearance of the second user. When the commands according to one embodiment are executed individually or collectively by the at least one processor, the electronic device may receive a selection command from the user to select at least one of the appearance of the second user and the appearance of the third user. When the commands according to one embodiment are executed individually or collectively by the at least one processor, the electronic device may extract at least one second feature information for the at least one appearance selected by the selection command using an AI model. When the instructions according to one embodiment are executed individually or collectively by the at least one processor, the electronic device may generate the data transmission / reception request message based on at least a portion of at least one of the first image data, the first feature information, the second image data, and the second feature information.
[0310] According to one embodiment, the electronic device further includes a microphone, and according to one embodiment, when the commands are executed individually or collectively by the at least one processor, the electronic device can acquire voice information including the content of a conversation between the first user and the second user through the microphone. According to one embodiment, when the commands are executed individually or collectively by the at least one processor, the electronic device can extract conversation summary information summarizing the content of the conversation from the voice information using an AI model. According to one embodiment, when the commands are executed individually or collectively by the at least one processor, the electronic device can generate the data transmission / reception request message based at least partially on the first image data, the at least one first feature information, and the conversation summary information.
[0311] An electronic device according to one embodiment may include a display (160 in FIG. 1; 360 in FIG. 3a), a communication circuit (190 in FIG. 1; 390 in FIG. 2a), at least one camera (380 in FIG. 3a), at least one processor (120 in FIG. 1, 320 in FIG. 3a to 3b), and a memory for storing instructions (130 in FIG. 1; 330 in FIG. 3a). The electronic device according to one embodiment receives a data transmission / reception request message from an external electronic device through the communication circuit, wherein the data transmission / reception request message may be generated based at least partially on first image data obtained by photographing a first user with the external electronic device, and at least one first feature information extracted from the first image data. When the commands according to one embodiment are executed individually or collectively by the at least one processor, the electronic device may display on the display, together with a message for confirming acceptance of a data transmission and reception request, at least one of the object, the first image data, a virtual image corresponding to the at least one first feature information, and text describing the at least one first feature information, when it is determined that an object corresponding to the first feature information is included in an image being captured or already captured through the at least one camera. When the commands according to one embodiment are executed individually or collectively by the at least one processor, the electronic device may receive input regarding acceptance from a second user. When the commands according to one embodiment are executed individually or collectively by the at least one processor, the electronic device may transmit a data transmission and reception acceptance message containing information regarding acceptance to the external electronic device.
[0312] When the instructions according to one embodiment are executed individually or collectively by the at least one processor, the electronic device may further display on the display at least one of the second image data, a virtual image corresponding to the second feature information, and text describing the second feature information, in the case where the data transmission / reception request message is generated based at least partially on at least one of the second image data including the appearance of the second user and at least one second feature information regarding the appearance of the second user, in addition to the first image data and the first feature information.
[0313] When the commands according to one embodiment are executed individually or collectively by the at least one processor, the electronic device may summarize the voice information into text and further display the text on the display or output it through a speaker included in the electronic device, in the case where the data transmission / reception request message is generated based at least partially on voice information including the content of a conversation between the first user and the second user in addition to the first image data and the first feature information.
[0314] FIG. 11 is a flowchart illustrating the operation of transmitting a file in a wearable electronic device according to one embodiment. The operations of transmitting a file may include operations 1101 through 1117. In the following embodiments, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, at least two operations may be performed in parallel, or other operations may be added.
[0315] According to one embodiment, operations 1101 to 1117 may be understood to be performed in a processor (e.g., processor (120) of FIG. 1, processor (320) of FIG. 3a to 3b) of a wearable electronic device (e.g., electronic device (101) of FIG. 1, electronic device (200) of FIG. 2a to 2b, and / or wearable electronic device (301) of FIG. 3a to 3b).
[0316] In operation 1101, a wearable electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2a to 2b, and / or the wearable electronic device (301) of FIG. 3a to 3b) can verify a first command pointing to an external wearable electronic device for file sharing.
[0317] According to one embodiment, the wearable electronic device can use an AI model (e.g., the AI model (331) of FIG. 3b) to identify a gesture command identified through a first direction of at least one second camera (e.g., the first camera (213) and the second camera (214) of FIG. 2a and at least one second camera (383) of FIG. 3a) positioned above a first position (lower side) on the front of the housing of the wearable electronic device (e.g., the first side (210) of FIG. 2a) among the cameras (e.g., the camera (380) of FIG. 3a) of the wearable electronic device) as a first command pointing to an external wearable electronic device for file sharing (or a second user wearing the external wearable electronic device or a second user who is not wearing or possessing the external wearable electronic device at the moment the user's gesture command points).
[0318] According to one embodiment, the wearable electronic device can identify a gesture command that can be obtained based on a part of the body (e.g., hand) of a user wearing the wearable electronic device through a first direction of at least one first camera positioned at a first position (lower side) on the front of the housing of the wearable electronic device.
[0319] According to one embodiment, the wearable electronic device can use an AI model (e.g., the AI model (331) of FIG. 3b) to identify a user's gaze command, which is confirmed through an eye-tracking camera (e.g., the eye-tracking camera (385) of FIG. 3a) among the cameras of the wearable electronic device, as a first command pointing to an external wearable electronic device for file sharing (or a second user wearing the external wearable electronic device, or a second user who is not wearing or possessing the external wearable electronic device at the moment the user's gaze command points).
[0320] According to one embodiment, the wearable electronic device can use an AI model (e.g., the AI model (331) of FIG. 3b) to identify a user's voice command received through a microphone (not shown) as a first command pointing to an external wearable electronic device for file sharing (or a second user wearing the external wearable electronic device, or a second user who is not wearing or possessing the external wearable electronic device at the moment the user's voice command is spoken).
[0321] According to one embodiment, the wearable electronic device can use an AI model (e.g., the AI model (331) of FIG. 3b) to determine the rotation direction of the wearable electronic device worn by a first user as a first command pointing to an external wearable electronic device for file sharing (or a second user wearing the external wearable electronic device, or a second user who is not wearing or possessing the external wearable electronic device at the moment the wearable electronic device is rotating).
[0322] In operation 1103, a wearable electronic device (e.g., electronic device (101) of FIG. 1, electronic device (200) of FIG. 2a to 2b, and / or wearable electronic device (301) of FIG. 3a to 3b) can identify first information (first feature information) indicating sender information.
[0323] According to one embodiment, the wearable electronic device can receive an image of a first user wearing the wearable electronic device through a first direction of at least one first camera (e.g., the third camera (215) and the fourth camera (216) of FIG. 2a and at least one first camera (381) of FIG. 3a) positioned at a first position (lower side) on the front of the housing of the wearable electronic device (e.g., the camera (380) of FIG. 3a) among the cameras of the wearable electronic device (e.g., the camera (380) of FIG. 3a).
[0324] According to one embodiment, while the wearable electronic device is worn by a first user, the wearable electronic device receives an image of the first user through a camera (e.g., eye-tracking camera (385)) placed on the rear of the housing of the wearable electronic device (e.g., the second side (220) of FIG. 2a) and stores it in memory (e.g., memory (330) of FIG. 3a), and when checking an external wearable electronic device for file sharing, the image of the first user stored in memory can be checked.
[0325] According to one embodiment, the wearable electronic device can receive an image of a first user wearing the wearable electronic device through a second direction of at least one second camera (e.g., the first camera (211) and the second camera (212) of FIG. 2a and the second camera (383) of FIG. 3a) positioned above a first position on the front of the housing of the wearable electronic device (e.g., the first surface (210) of FIG. 2a) and the second camera (383) of FIG. 3a).
[0326] According to one embodiment, a wearable electronic device can use an AI model to generate first information representing sender information, which is text interpreting an image of a user.
[0327] According to one embodiment, a wearable electronic device can generate text that interprets the image of the first user by using an AI model to classify the features of the first user into items based on the image of the first user.
[0328] According to one embodiment, a wearable electronic device can generate text by using an AI model to interpret the item with the highest priority (e.g., the first item) among items representing the characteristics of the first user based on the image of the first user.
[0329] According to one embodiment, a wearable electronic device can generate text that interprets the image of the first user by using an AI model and additional information representing the characteristics of the first user, such as body information of the first user stored in memory (e.g., memory (330) of FIG. 3) together with the image of the first user.
[0330] According to one embodiment, if a wearable electronic device determines that text interpreting an image of a first user is not clear enough to be generated as first information by using an AI model, it can generate text interpreting an image of a first user by using an image of a first user stored in memory (e.g., memory (330) of FIG. 3) as additional information.
[0331] According to one embodiment, when a wearable electronic device confirms the existence of a first user avatar generated to resemble the face of a first user, it can use an AI model to identify the first user avatar, which has been modified to correspond to the image of the first user, as first information representing sender information.
[0332] According to one embodiment, when a wearable electronic device confirms the existence of a first user avatar generated to resemble the face of a first user, it can use an AI model to apply at least one item (e.g., clothing) identified in the image of the first user to the first user's avatar, and identify the applied first user's avatar as first information representing sender information.
[0333] According to one embodiment, the wearable electronic device can use an AI model (331) to generate a QR code or a specified machine language based on an image of a first user, and then identify the QR code or the specified machine language based on that as first information representing sender information.
[0334] In operation 1105, a wearable electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2a to FIG. 2b, and / or the wearable electronic device (301) of FIG. 3a to FIG. 3b) can identify second information (second feature information) indicating recipient information.
[0335] According to one embodiment, the wearable electronic device can generate (confirm) second information representing recipient information based on an image of a second user wearing an external wearable electronic device by using an AI model (e.g., the AI model (331) of FIG. 3b).
[0336] According to one embodiment, the wearable electronic device can receive an image of a second user wearing an external wearable electronic device through a second direction of at least one second camera (e.g., the first camera (211) and the second camera (212) of FIG. 2a, and at least one second camera (383) of FIG. 3a) positioned above a first position on the front of the housing of the wearable electronic device (e.g., the camera (380) of FIG. 3a) of the wearable electronic device (e.g., the camera (380) of FIG. 3a).
[0337] According to one embodiment, a wearable electronic device can generate (confirm) text that interprets an image of a second user as second information using an AI model.
[0338] According to one embodiment, the wearable electronic device can generate text that interprets the image of the second user by using an AI model (331) to classify the features of the second user into items based on the image of the second user.
[0339] According to one embodiment, a wearable electronic device can generate text by using an AI model to interpret the item with the highest priority (e.g., the first item) among the items representing the characteristics of the second user based on the image of the second user.
[0340] According to one embodiment, a wearable electronic device can generate text that interprets an image of a second user (second image data) based on additional information about the second user that can be distinguished from other people in the surroundings, along with an image of the second user, using an AI model.
[0341] According to one embodiment, a wearable electronic device can use an AI model to generate text that interprets the image of the second user by using the second user's body information as additional information along with the image of the second user.
[0342] According to one embodiment, the wearable electronic device can generate text that interprets the image of the second user (second image data) by using an AI model (331) and additional information regarding the posture of the second user, along with the image of the second user, and the action currently being performed by the second user (e.g., while running and / or stretching).
[0343] In operation 1107, a wearable electronic device (e.g., electronic device (101) of FIG. 1, electronic device (200) of FIG. 2a to 2b, and / or wearable electronic device (301) of FIG. 3a to 3b) may transmit a first message (data transmission / reception request message) requesting a communication connection for file sharing, which includes first information representing sender information and second information representing receiver information.
[0344] According to one embodiment, a wearable electronic device may transmit (broadcast) a first message requesting a communication connection for file sharing, including first information representing sender information and second information representing receiver information, through a communication circuit (e.g., communication circuit (390) of FIG. 3a).
[0345] According to one embodiment, the wearable electronic device may include at least one of the following in the first information representing sender information included in the first message: text interpreting the image of the first user, an avatar image of the first user modified to correspond to the image of the first user, a brief text briefly summarizing the text interpreting the image of the first user, a plurality of keywords detected in the text interpreting the image of the first user, or a brief image generated based on the text interpreting the image of the first user.
[0346] According to one embodiment, the wearable electronic device may include at least one of text interpreting an image of a second user, text briefly summarizing the text interpreting an image of a second user, a plurality of keywords detected in the text interpreting an image of a second user, or an image generated based on the text interpreting an image of a second user.
[0347] According to one embodiment, the wearable electronic device may include information for a communication connection and / or information for capturing a recipient in the first message.
[0348] In operation 1109, a wearable electronic device (e.g., electronic device (101) of FIG. 1, electronic device (200) of FIG. 2a to 2b, and / or wearable electronic device (301) of FIG. 3a to 3b) can check whether a second message (data transmission acceptance message) accepting a communication connection has been received.
[0349] In operation 1109, the wearable electronic device checks for the reception of a second message accepting a communication connection, and in operation 1111, checks for the reception of a single second message.
[0350] In operation 1111, the wearable electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2a to FIG. 2b, and / or the wearable electronic device (301) of FIG. 3a to FIG. 3b) can change the second information (second feature information) representing recipient information in operation 1113 when it confirms the reception of a plurality of second messages.
[0351] According to one embodiment, when a wearable electronic device receives a plurality of second messages accepting a communication connection from each of a plurality of wearable electronic devices after transmitting a first message, it may change second information representing recipient information included in the first message using an AI model (e.g., AI model (331) of FIG. 3b).
[0352] According to one embodiment, after transmitting a first message containing text interpreting a first item among a plurality of items included in an image of a second user as second information representing recipient information, if a plurality of second messages accepting a communication connection from each of a plurality of wearable electronic devices are received, the wearable electronic device may use an AI model to change the text interpreting a second item and / or a third item among a plurality of items included in an image of a second user into second information representing recipient information.
[0353] In operation 1115, a wearable electronic device (e.g., electronic device (101) of FIG. 1, electronic device (200) of FIG. 2a to 2b, and / or wearable electronic device (301) of FIG. 3a to 3b) may transmit a first message (data transmission / reception request message) requesting a communication connection for file sharing, which includes first information representing sender information and second information representing receiver information.
[0354] According to one embodiment, a wearable electronic device may transmit a first message requesting a communication connection for file sharing to a plurality of wearable electronic devices, including first information representing sender information and modified second information representing receiver information, through a communication circuit (e.g., communication circuit (390) of FIG. 3a), based on communication connection information included in a second message.
[0355] In operation 1111, the wearable electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2a to FIG. 2b, and / or the wearable electronic device (301) of FIG. 3a to FIG. 3b) can, upon confirming the reception of a single second message (a message accepting data transmission and reception), establish communication with an external wearable electronic device and transmit a file in operation 1117.
[0356] FIG. 12 is a flowchart illustrating the operation of receiving a file in a wearable electronic device according to one embodiment. The operations of receiving a file may include operations 1201 to 1211. In the following embodiments, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, at least two operations may be performed in parallel, or other operations may be added.
[0357] According to one embodiment, the operation of 1201 to 1211 may be understood to be performed in a processor (e.g., processor (120) of FIG. 1, processor (320) of FIG. 3a to 3b) of a wearable electronic device (e.g., electronic device (101) of FIG. 1, electronic device (200) of FIG. 2a to 2b, and / or wearable electronic device (301) of FIG. 3a to 3b).
[0358] In operation 1201, a wearable electronic device (e.g., electronic device (101) of FIG. 1, electronic device (200) of FIG. 2a to 2b, and / or wearable electronic device (301) of FIG. 3a to 3b) may receive a first message (data transmission / reception request message) requesting a communication connection for file sharing, which includes first information representing sender information and second information representing receiver information.
[0359] In operation 1203, a wearable electronic device (e.g., electronic device (101) of FIG. 1, electronic device (200) of FIG. 2a to 2b, and / or wearable electronic device (301) of FIG. 3a to 3b) can verify third information (third feature information) obtained based on an image of a first user wearing the wearable electronic device.
[0360] According to one embodiment, the wearable electronic device can receive an image of a first user wearing the wearable electronic device through at least one first camera of the wearable electronic device (e.g., the third camera (215) and the fourth camera (216) of FIG. 2a, and at least one first camera (381)).
[0361] According to one embodiment, when the wearable electronic device confirms the reception of the first message, it may receive an image of a first user wearing the wearable electronic device that is seen on a reflective object (e.g., a mirror) through at least one second camera of the wearable electronic device (e.g., the first camera (211) and the second camera (212) of FIG. 2a and the second camera (383) of FIG. 3a).
[0362] According to one embodiment, when the wearable electronic device confirms the reception of the first message, it can check the image of the first user stored in memory (e.g., memory (330) of FIG. 3a).
[0363] According to one embodiment, a wearable electronic device can use an AI model to identify text that interprets an image of a first user as third information (third feature information).
[0364] According to one embodiment, if the wearable electronic device uses an AI model to determine that the second information has captured the front view of the recipient based on the shooting information (e.g., angle information) included in the first message or the text or image included in the second information representing recipient information, the text interpreting the image of the first user wearing the wearable electronic device received through at least one first camera (381) can be identified as third information (third feature information) for confirming recipient information.
[0365] According to one embodiment, if a wearable electronic device uses an AI model to determine that the second information captures the front view of a recipient based on the shooting information (e.g., angle information) included in the first message or text or image included in the second information representing recipient information, the device may additionally determine the text interpreting the image of a first user wearing the wearable electronic device, which is seen on a reflective object (e.g., a mirror) through at least one second camera, as third information (third feature information) for confirming recipient information.
[0366] According to one embodiment, a wearable electronic device can use an AI model to identify, if it is determined that the second information captures a partial view (e.g., back view or side view) in which the recipient cannot be identified, based on the shooting information (e.g., angle information) included in the first message or the text or image included in the second information representing recipient information, identify the first user's body information stored in memory (e.g., memory (330) of FIG. 3a) or the first user's image among the images stored in memory (e.g., memory (330) of FIG. 3a) that is related to the text included in the second information, and identify the first user's image received through at least one first camera, the first user's body information, and the text interpreting the first user's image identified in memory as third information (third feature information) for identifying recipient information.
[0367] In operation 1205, a wearable electronic device (e.g., electronic device (101) of FIG. 1, electronic device (200) of FIG. 2a to 2b, and / or wearable electronic device (301) of FIG. 3a to 3b) can check whether the similarity between second information representing recipient information included in the first message and third information (third feature information) for verifying recipient information is included within a threshold range.
[0368] According to one embodiment, a wearable electronic device can use an AI model to confirm that the similarity between the second information and the third information (third feature information) is included within a threshold range if, among multiple items according to priority in the second information and the third information (third feature information), the item with the highest priority is identical to a specified number of items.
[0369] According to one embodiment, a wearable electronic device can use an AI model to determine that if a specified number or more of items among a plurality of items in the second information and the third information (third feature information) match, the similarity between the second information and the third information (third feature information) is included within a threshold range.
[0370] In operation 1205, the wearable electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2a to FIG. 2b, and / or the wearable electronic device (301) of FIG. 3a to FIG. 3b) may display a user interface including a message inquiring whether to accept file sharing and information related to the information of a second user wearing an external wearable electronic device, when it is confirmed that the similarity between the second information representing recipient information included in the first message and the third information (third feature information) for verifying the recipient information is included within a threshold range, in operation 1207.
[0371] According to one embodiment, the wearable electronic device may omit the operation 1205 of checking whether the similarity between the second information representing recipient information included in the first message and the third information (third feature information) for verifying the recipient information is included within a threshold range, and display a user interface in the operation 1207.
[0372] According to one embodiment, when a wearable electronic device identifies the wearable electronic device as a file sharing target, it may use an AI model to identify information of a second user wearing an external wearable electronic device that transmitted the first message based on first information representing sender information of the first message, and display a user interface including information related to the second user's information and a message inquiring whether to accept file sharing.
[0373] According to one embodiment, when a wearable electronic device identifies a second user wearing an external wearable electronic device through at least one second camera (e.g., at least one second camera (383) in FIG. 3a) based on first information indicating sender information included in a first message, it may display a user interface including information related to the second user, such as a message asking whether to accept file sharing through a display (e.g., display (360) in FIG. 3a) and an indication that the second user wearing the external wearable electronic device who sent the first message is located in front of the wearable electronic device.
[0374] According to one embodiment, the wearable electronic device may display a user interface including information related to a second user, such as a message asking whether to accept file sharing through a display, an image of the second user wearing the external wearable electronic device generated based on the first information representing sender information included in a first message, and a predicted direction of movement to find the second user based on previously captured image data, when the first user identifies the second user wearing the external wearable electronic device through at least one second camera based on first information representing sender information included in a first message, and when the first user identifies the second user wearing the external wearable electronic device based on previously captured image data.
[0375] According to one embodiment, if a wearable electronic device fails to identify a second user wearing an external wearable electronic device through at least one second camera based on first information representing sender information included in a first message, and fails to identify the second user wearing the external wearable electronic device based on image data previously captured by the first user while wearing the wearable electronic device, it may generate an avatar image capable of predicting the second user based on first information (e.g., text) representing sender information included in a first message, and display a user interface including information related to the second user, such as a message inquiring whether to accept file sharing through a display, characteristic information of the second user identified based on the first information representing sender information, and an avatar image capable of predicting the second user.
[0376] According to one embodiment, when a wearable electronic device confirms that an avatar image is included in first information representing sender information included in a first message, it can display a user interface including an inquiry message asking whether to accept file sharing and an avatar image included in second information through a display.
[0377] In operation 1209, when the wearable electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2a to 2b, and / or the wearable electronic device (301) of FIG. 3a to 3b) confirms the acceptance of file sharing, in operation 1211, the wearable electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2a to 2b, and / or the wearable electronic device (301) of FIG. 3a to 3b) may transmit a second message (data transmission acceptance message) accepting a communication connection for file sharing.
[0378] According to one embodiment, when a wearable electronic device confirms acceptance of file sharing through a user interface based on user input, it may transmit a second message accepting a communication connection for file sharing, including information for a communication connection (e.g., MAC address, IP address, or encryption key information), to an external wearable electronic device through a communication circuit (e.g., communication circuit (390) of FIG. 3a).
[0379] FIG. 13 is a flowchart illustrating an operation for sharing files between a wearable electronic device and external wearable electronic devices according to one embodiment. The file sharing operations may include operations 1301 through 1325. In the following embodiments, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, at least two operations may be performed in parallel, or other operations may be added.
[0380] According to one embodiment, operations 1301 to 1309 and 1323, 1325 may be understood to be performed in a processor (e.g., processor (120) of FIG. 1, processor (320) of FIG. 3a to 3b) of a wearable electronic device (e.g., electronic device (101) of FIG. 1, electronic device (200) of FIG. 2a to 2b, and / or wearable electronic device (301) of FIG. 3a to 3b). Operations 1311 to 1321 may be understood to be performed in a processor (not shown) of an external wearable electronic device (401) (e.g., external wearable electronic device (401) of FIG. 4).
[0381] In operation 1301, the wearable electronic device (301) (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2a to 2b, and / or the wearable electronic device (301) of FIG. 3a to 3b) can confirm a first command pointing to an external wearable electronic device for file sharing.
[0382] According to one embodiment, a wearable electronic device (301) uses an AI model (e.g., the AI model (331) of FIG. 3b) to receive at least one of the following: a gesture command identified through a first direction of at least one first camera (e.g., the third camera (215) and the fourth camera (216) of FIG. 2a and at least one first camera (381) of FIG. 3a) positioned at a second position (lower side) on the front of the housing of the wearable electronic device (e.g., the first surface (210) of FIG. 2a) among the cameras of the wearable electronic device (e.g., the camera (380) of FIG. 3a), a user's gaze command identified through an eye-tracking camera (e.g., the eye-tracking camera (385) of FIG. 3a) among the cameras of the wearable electronic device, or a user's voice command received through a microphone (not shown), for file sharing with an external wearable electronic device (or a second user wearing the external wearable electronic device, or at the moment the user's gaze command points externally It can be identified by a first command pointing to a second user who is not wearing or possessing a wearable electronic device, or a second user who is not wearing or possessing an external wearable electronic device at the moment the user's voice command is spoken.
[0383] In operation 1303, a wearable electronic device (301) (e.g., electronic device (101) of FIG. 1, electronic device (200) of FIG. 2a to 2b, and / or wearable electronic device (301) of FIG. 3a to 3b) can identify first information (first feature information) indicating sender information.
[0384] According to one embodiment, the wearable electronic device can receive an image of a first user wearing the wearable electronic device through a first direction of at least one first camera (e.g., the third camera (215) and the fourth camera (216) of FIG. 2a and at least one first camera (381) of FIG. 3a) positioned at a first position (lower side) on the front of the housing of the wearable electronic device (e.g., the camera (380) of FIG. 3a) among the cameras of the wearable electronic device (e.g., the camera (380) of FIG. 3a).
[0385] According to one embodiment, the wearable electronic device (301) can verify first information representing sender information, which is text that interprets the user's image using an AI model.
[0386] According to one embodiment, when the wearable electronic device (301) confirms the existence of a first user avatar created to resemble the face of the first user, it can use an AI model to apply at least one item (e.g., clothing) identified in the image of the first user to the first user's avatar, and confirm the applied first user's avatar as first information representing sender information.
[0387] In operation 1305, the wearable electronic device (301) (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2a to FIG. 2b, and / or the wearable electronic device (301) of FIG. 3a to FIG. 3b) can identify second information (second feature information) indicating recipient information.
[0388] According to one embodiment, the wearable electronic device (301) can receive an image of a second user wearing an external wearable electronic device through a second direction of at least one second camera (e.g., the first camera (211) and the second camera (212) of FIG. 2a, and at least one second camera (383) of FIG. 3a) positioned above a first position on the front of the housing of the wearable electronic device (e.g., the camera (380) of FIG. 3a) of the wearable electronic device (e.g., the camera (380) of FIG. 3a).
[0389] According to one embodiment, the wearable electronic device (301) can generate (confirm) text that interprets an image of a second user as second information using an AI model.
[0390] In operation 1307, a wearable electronic device (301) (e.g., electronic device (101) of FIG. 1, electronic device (200) of FIG. 2a to 2b, and / or wearable electronic device (301) of FIG. 3a to 3b) may generate a first message (data transmission / reception request message) requesting a communication connection for file sharing, which includes first information representing sender information and second information representing receiver information.
[0391] In operation 1309, a wearable electronic device (301) (e.g., electronic device (101) of FIG. 1, electronic device (200) of FIG. 2a to 2b, and / or wearable electronic device (301) of FIG. 3a to 3b) can transmit a first message (data transmission / reception request message).
[0392] According to one embodiment, a wearable electronic device (301) can transmit (broadcast) a first message requesting a communication connection for file sharing, including first information representing sender information and second information representing receiver information, through a communication circuit (e.g., communication circuit (390) of FIG. 3a).
[0393] In operation 1311, an external wearable electronic device (401) (e.g., the external wearable electronic device (401) of FIG. 4) may receive a first message (data transmission / reception request message) requesting a communication connection for file sharing, which includes first information representing sender information and second information representing receiver information.
[0394] In operation 1313, the external wearable electronic device (401) (e.g., the external wearable electronic device (401) of FIG. 4) can verify third information (third feature information) obtained based on an image of a second user wearing the external wearable electronic device (401).
[0395] According to one embodiment, the external wearable electronic device (401) can receive an image of a second user wearing the external wearable electronic device through at least one first camera positioned on the rear of the housing of the external wearable electronic device.
[0396] According to one embodiment, when the external wearable electronic device (401) confirms the reception of the first message, it can check the image of the first user stored in the memory of the external wearable electronic device.
[0397] According to one embodiment, an external wearable electronic device (401) can use an AI model to interpret text of an image of a second user and verify it as third information (third feature information).
[0398] In operation 1315, an external wearable electronic device (401) (e.g., the external wearable electronic device (401) of FIG. 4) can check whether the similarity between the second information representing recipient information included in the first message and the third information (third feature information) for verifying recipient information is included within a threshold range.
[0399] According to one embodiment, an external wearable electronic device (401) can use an AI model to determine that the similarity between the second information and the third information (third feature information) is included within a threshold range if, among multiple items according to priority in the second information and the third information (third feature information), the item with the highest priority is identical to a specified number of items.
[0400] According to one embodiment, an external wearable electronic device (401) can use an AI model to determine that if more than a specified number of items match among a plurality of items in the second information and the third information (third feature information), the similarity between the second information and the third information (third feature information) is included within a threshold range.
[0401] In operation 1315, the external wearable electronic device (401) (e.g., the external wearable electronic device (401) of FIG. 4) can display a user interface that includes information related to the first user wearing the wearable electronic device (301) that transmitted the first message and a message asking whether to accept file sharing, when it is confirmed that the similarity between the second information representing the recipient information included in the first message and the third information (third feature information) for verifying the recipient information is included within a threshold range.
[0402] According to one embodiment, the wearable electronic device may omit the operation 1315 of checking whether the similarity between the second information representing recipient information included in the first message and the third information (third feature information) for verifying the recipient information is included within a threshold range, and display a user interface in the operation 1317.
[0403] According to one embodiment, when an external wearable electronic device (401) identifies the external wearable electronic device as a file sharing target, it may use an AI model to identify the information of a first user wearing the wearable electronic device (301) that transmitted the first message based on first information representing the sender information of the first message, and display a user interface including a message inquiring about the information related to the first user's information and whether to accept file sharing.
[0404] In operation 1319, an external wearable electronic device (401) (e.g., the external wearable electronic device (401) of FIG. 4) can generate a second message (data transmission acceptance message) that accepts a communication connection for file sharing.
[0405] According to one embodiment, an external wearable electronic device (401) may, upon confirming acceptance of file sharing through a user interface, generate a second message that accepts a communication connection for file sharing, which includes information for a communication connection (e.g., MAC address, IP address, or encryption key information).
[0406] In operation 1321, the external wearable electronic device (401) (e.g., the external wearable electronic device (401) of FIG. 4) can transmit a second message (a message accepting data transmission and reception).
[0407] According to one embodiment, the external wearable electronic device (401) can transmit a second message to the wearable electronic device (301) through the communication circuit of the external wearable electronic device.
[0408] In operation 1323, the wearable electronic device (301) (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2a to FIG. 2b, and / or the wearable electronic device (301) of FIG. 3a to FIG. 3b) can confirm the reception of a second message (data transmission acceptance message) accepting a communication connection for file sharing.
[0409] In operation 1325, the wearable electronic device (301) (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2a to FIG. 2b, and / or the wearable electronic device (301) of FIG. 3a to FIG. 3b) can transmit a file to an external wearable electronic device (401).
[0410] According to one embodiment, the wearable electronic device (301) can transmit a file to the external wearable electronic device (401) after establishing communication with the external wearable electronic device (401) based on the second message.
[0411] FIG. 14 is a flowchart illustrating an operation for sharing files between a wearable electronic device and external wearable electronic devices according to one embodiment. The file sharing operations may include operations 1401 through 1419. In the following embodiments, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, at least two operations may be performed in parallel, or other operations may be added.
[0412] According to one embodiment, operations 1405 through 1413 and operations 1419 may be understood to be performed in a processor (e.g., processor (120) of FIG. 1, processor (320) of FIG. 3a through 3b) of a wearable electronic device (e.g., electronic device (101) of FIG. 1, electronic device (200) of FIG. 2a through 2b, and / or wearable electronic device (301) of FIG. 3a through 3b). Operations 1401, 1403, 1415, and 1417 may be understood to be performed in a processor (not shown) of an external wearable electronic device (401) (e.g., external wearable electronic device (401) of FIG. 4).
[0413] In operation 1401, an external wearable electronic device (401) (e.g., the external wearable electronic device (401) of FIG. 4) can generate a third message.
[0414] According to one embodiment, an external wearable electronic device (401) may generate a third message including a fourth information (fourth feature information) generated based on an image (second image data) of a second user wearing the external wearable electronic device acquired through a first camera of the external wearable electronic device, information indicating acceptance of sharing for a file transmitted by the wearable electronic device (e.g., a flag or a specified signal), and device information for a communication connection with the wearable electronic device (e.g., an ID and / or a MAC address).
[0415] In operation 1403, the external wearable electronic device (401) (e.g., the external wearable electronic device (401) of FIG. 4) can transmit (broadcast) a third message for accepting file sharing.
[0416] According to one embodiment, an external wearable electronic device (401) can transmit (broadcast) a third message that accepts file sharing in advance.
[0417] In operation 1405, the wearable electronic device (301) (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2a to 2b, and / or the wearable electronic device (301) of FIG. 3a to 3b) may receive a third message for accepting file sharing.
[0418] In operation 1407, the wearable electronic device (301) (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2a to 2b, and / or the wearable electronic device (301) of FIG. 3a to 3b) may store a third message.
[0419] According to one embodiment, the wearable electronic device (301) may store in a memory (e.g., memory (330) of FIG. 3a) in relation to each other the fourth information (fourth feature information) generated based on an image (second image data) of a second user wearing the external wearable electronic device acquired through a first camera of the external wearable electronic device included in the third message, information indicating acceptance of file sharing from the external wearable electronic device (e.g., a flag or a designated signal), and first device information (e.g., an ID and / or MAC address) for a communication connection with the external wearable electronic device.
[0420] In operation 1409, the wearable electronic device (301) (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2a to 2b, and / or the wearable electronic device (301) of FIG. 3a to 3b) can check the file sharing mode.
[0421] According to one embodiment, the wearable electronic device (301) can check the switching of a file sharing mode for transferring a file to an external wearable electronic device.
[0422] In operation 1411, the wearable electronic device (301) (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2a to 2b, and / or the wearable electronic device (301) of FIG. 3a to 3b) can generate a fourth message for file sharing.
[0423] According to one embodiment, the wearable electronic device (301) compares the second information (second feature information) generated based on an image (second image data) of a second user of an external wearable electronic device obtained through a second camera of the wearable electronic device (e.g., the second camera (383) of FIG. 2a) with the fourth information stored in memory, and if the comparison result is substantially identical, it may generate a fourth message including device information for a communication connection of the wearable electronic device, first information generated based on an image of a first user wearing the wearable electronic device, fourth information generated based on an image (second image data) of a second user wearing the external wearable electronic device stored in the memory of the wearable electronic device, and device information for a communication connection of the external wearable electronic device (e.g., ID and / or MAC address).
[0424] In operation 1413, the wearable electronic device (301) (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2a to 2b, and / or the wearable electronic device (301) of FIG. 3a to 3b) can transmit a fourth message.
[0425] In operation 1415, an external wearable electronic device (401) (e.g., the external wearable electronic device (401) of FIG. 4) can receive a fourth message for file sharing.
[0426] In operation 1417, an external wearable electronic device (401) (e.g., the external wearable electronic device (401) of FIG. 4) can be identified as a file sharing target based on the fourth message.
[0427] According to one embodiment, an external wearable electronic device (401) compares the fourth information generated based on an image (second image data) of a second user wearing the external wearable electronic device included in the fourth message and / or device information for a communication connection with the external wearable electronic device (e.g., ID and / or MAC address) with the third information generated based on an image of a first user wearing the wearable electronic device obtained through the first camera of the wearable electronic device and / or device information of the wearable electronic device, and if the comparison result substantially matches, it can confirm that it is a file sharing target.
[0428] In operation 1419, an external wearable electronic device (401) (e.g., the external wearable electronic device (401) of FIG. 4) can receive a file,
[0429] According to one embodiment, an external wearable electronic device (401) can receive a file from a wearable electronic device (301) connected to communication based on a fourth message.
[0430] According to one embodiment, an external wearable electronic device (401) displays a user interface (popup window) to confirm acceptance of file reception by a second user when the comparison result matches, and when acceptance is confirmed based on the user's input, it can receive a file from a wearable electronic device (301) connected to the communication based on a fourth message.
[0431] According to one embodiment, an external wearable electronic device (401) can automatically establish communication with the wearable electronic device based on the device information of the wearable electronic device included in the fourth message.
[0432] A method for sharing a file in a wearable electronic device (101 in FIG. 1; 200 in FIG. 2a to 2b; 301 in FIG. 3a to 3b) according to one embodiment may include an operation of confirming a first command from a first user wearing the wearable electronic device. According to one embodiment, the method may include an operation of confirming the first command pointing to a second user wearing an external wearable electronic device for file sharing using an AI model while the wearable electronic device is worn by the first user. According to one embodiment, the method may include an operation of confirming first information about the first user based on an image of the first user obtained through at least one camera of the wearable electronic device using the AI model. According to one embodiment, the method may include an operation of confirming second information based on an image of the second user obtained through at least one camera using the second AI model. The method according to one embodiment may include an operation of transmitting a first message requesting a communication connection for file sharing through a communication circuit of the wearable electronic device, wherein the first message includes first information representing sender information and second information representing receiver information. The method according to one embodiment may establish a communication connection with the external wearable electronic device when receiving a second message for accepting the communication connection for file sharing from the external wearable electronic device through the communication circuit. The method according to one embodiment may include an operation of transmitting a file to the external wearable electronic device based on the second message.
[0433] The method according to one embodiment may include an operation of changing second information representing recipient information based on an image of the second user when receiving a plurality of second messages for accepting a communication connection from a plurality of external wearable electronic devices through the communication circuit. The method according to one embodiment may include an operation of transmitting a first message requesting a communication connection for file sharing, comprising first information representing sender information and second information representing changed recipient information, to the plurality of wearable electronic devices through the communication circuit.
[0434] The method according to one embodiment can identify at least one of the gesture command of the first user, the gaze command of the first user, or the voice command of the first user as the first command.
[0435] The method according to one embodiment may identify at least one of a first text interpreting the image of the first user, or an avatar image of the first user modified to correspond to the image of the first user, as the first information. The method according to one embodiment may identify a second text interpreting the image of the second user as the second information.
[0436] A method for sharing a file in a wearable electronic device (101 in FIG. 1; 200 in FIG. 2a to 2b; 301 in FIG. 3a to 3b) according to one embodiment may include, when the wearable electronic device is worn by a first user, receiving a first message requesting a communication connection for file sharing from an external wearable electronic device through a communication circuit of the electronic device, the message includes first information representing sender information and second information representing receiver information, and acquiring an image of the first user through at least one camera of the wearable electronic device. The method according to one embodiment may include an operation of verifying third information about the first user based on the image of the first user using an AI model. The method according to one embodiment may include an operation of identifying the wearable electronic device as a file sharing target of the external wearable electronic device when the similarity between the third information about the first user and the second information representing receiver information falls within a threshold value range. The method according to one embodiment may include an operation of verifying information of a second user wearing the external wearable electronic device that transmitted the first message, based on first information representing sender information included in the first message using the AI model. The method according to one embodiment may include an operation of displaying a user interface including information related to the second user and a message inquiring whether to accept file sharing. The method according to one embodiment may include an operation of transmitting a second message for accepting a communication connection for file sharing to the external wearable electronic device through the communication circuit of the wearable electronic device when acceptance of file sharing is confirmed through the user interface.
[0437] The method according to one embodiment may include an operation of displaying a user interface that includes a message inquiring about acceptance of file sharing through the display of the wearable electronic device and information related to the second user indicating that the second user is located in front of the wearable electronic device.
[0438] The electronic device according to one embodiment disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance. The electronic device according to the embodiment of this document is not limited to the aforementioned devices.
[0439] One embodiment of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, each of phrases such as "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C", and "at least one of A, B, or C" may include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as “first,” “second,” or “first” or “second” may be used simply to distinguish a component from another component and do not limit the components in any other aspect (e.g., importance or order). Where any (e.g., first) component is referred to as “coupled” or “connected” to another (e.g., second) component, with or without the terms “functionally” or “communicationally,” it means that said component may be connected to said other component directly (e.g., wired), wirelessly, or through a third component.
[0440] The term "module" as used in an embodiment of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to an embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).
[0441] One embodiment of the present document may be implemented as software (e.g., program (140)) comprising one or more instructions stored in a storage medium (e.g., internal memory (136) or external memory (138)) readable by a machine (e.g., electronic device (101) or electronic device (301)). For example, a processor (e.g., processor (520)) of the machine (e.g., electronic device (301)) may call at least one of the one or more instructions stored in the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.
[0442] According to one embodiment, the method according to one embodiment disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or an application store (e.g., Play Store). TM It can be distributed online (e.g., downloaded or uploaded) through ) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.
[0443] According to one embodiment, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to one embodiment, one or more of the components or operations among the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to one embodiment, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.
Claims
1. In a wearable electronic device (101 of FIG. 1; 200 of FIG. 2a to 2b; 301 of FIG. 3a to 3b), Housing; Communication circuit (190 in FIG. 1; 390 in FIG. 4a); Display (160 in FIG. 1; 360 in FIG. 3a); At least one camera (380 in FIG. 3a) comprising a first camera (381 in FIG. 3a) positioned at a first position on the front of the housing and a second camera (383 in FIG. 3a) positioned at a second position above the first position on the front of the housing; At least one processor (120 in FIG. 1, 320 in FIG. 3a to 3b); and It includes memory for storing instructions (130 in FIG. 1: 320 in FIG. 3a), and When the above instructions are executed individually or collectively by the at least one processor, the wearable electronic device, Confirm a first command from a first user wearing the above-mentioned wearable electronic device, and With the above-mentioned wearable electronic device being worn by the first user, the AI model verifies the first command pointing to a second user wearing an external wearable electronic device for file sharing, and Using the above AI model, first information about the first user is verified based on an image of the first user obtained through at least one camera, and Using the above AI model, confirm second information about the second user based on an image of the second user obtained through at least one camera, and Through the communication circuit above, a first message requesting a communication connection for file sharing is transmitted, and the first message includes the first information representing sender information and the second information representing receiver information. When a second message for accepting the communication connection for file sharing is received from the external wearable electronic device through the communication circuit, a communication connection is established with the external wearable electronic device, and A wearable electronic device that transmits a file to an external wearable electronic device through the communication circuit based on the second message.
2. In Paragraph 1, When the above instructions are executed individually or collectively by the at least one processor, the wearable electronic device uses the AI model, When a plurality of second messages for accepting a communication connection are received from a plurality of external wearable electronic devices through the above communication circuit, second information representing recipient information is changed based on the image of the second user, and A wearable electronic device that transmits a first message requesting a communication connection for file sharing, comprising first information representing sender information and second information representing changed receiver information, to a plurality of wearable electronic devices through the communication circuit.
3. In any one of paragraphs 1 to 2, The above electronic device further includes a microphone, When the above instructions are executed individually or collectively by the at least one processor, the wearable electronic device uses the AI model, An electronic device that identifies at least one of the gesture command of the first user, the gaze command of the first user, or the voice command of the first user as the first command.
4. In any one of paragraphs 1 to 3, When the above instructions are executed individually or collectively by the at least one processor, the wearable electronic device uses the AI model, Identifying at least one of the first text interpreting the image of the first user, or the avatar image of the first user modified to correspond to the image of the first user, as the first information, and An electronic device that identifies a second text interpreted from an image of the second user as the second information.
5. In a wearable electronic device, Housing; Communication circuit; display; At least one camera comprising a first camera positioned at a first position on the front of the housing and a second camera positioned at a second position above the first position on the front of the housing: At least one processor; and It includes memory for storing instructions, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, When the above-mentioned wearable electronic device is worn by a first user, and receives a first message requesting a communication connection for file sharing from an external wearable electronic device through the communication circuit, the message includes first information representing sender information and second information representing receiver information, an image of the first user is acquired through the at least one camera, and Using an AI model, verify third information about the first user based on the image of the first user, and If the similarity between the third information regarding the first user and the second information representing the recipient information is included within a threshold range, the wearable electronic device is identified as a file sharing target for the external wearable electronic device, and Using the above AI model, based on first information representing sender information included in the first message, the information of a second user wearing the external wearable electronic device that transmitted the first message is verified, and Displays a user interface including information related to the second user and a message inquiring whether to accept file sharing, and An electronic device that, upon confirming acceptance of file sharing through the user interface, transmits a second message for acceptance of a communication connection for file sharing to the external wearable electronic device through the communication circuit.
6. In Paragraph 5, When the above instructions are executed individually or collectively by the at least one processor, the wearable electronic device uses the AI model, A wearable electronic device that, based on first information representing the sender information, identifies the second user wearing the external wearable electronic device in an image received through at least one camera, and displays a user interface including a message inquiring about acceptance of file sharing through the display and information related to the second user indicating that the second user is located in front of the wearable electronic device.
7. In electronic devices, display; Communication circuit; At least one camera; At least one processor; and Includes memory for storing instructions; and When the above instructions are executed individually or collectively by the at least one processor, the electronic device, The appearance of a first user wearing or possessing the electronic device is captured by the at least one camera to obtain first image data, and Using an AI model, at least one first feature information regarding the appearance of the first user is extracted from the first image data, and A data transmission and reception request message is generated based on at least a portion of at least one of the first image data and the first feature information, and The above data transmission and reception request message is transmitted to an external electronic device through the communication circuit, and Receive a data transmission and reception acceptance message from the above external electronic device, and An electronic device that transmits data included in the electronic device to the external electronic device or receives data from the external electronic device based on the above data transmission and reception acceptance message.
8. In Paragraph 7, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, Acquiring the first image data including at least the appearance of the first user through the first camera that captures an image in a first direction among the at least one camera, and Acquiring the second image data including the appearance of a second user who is not wearing or possessing at least the electronic device through the first camera or a second camera that captures an image in a second direction different from the first direction, and Using an AI model, at least one second feature information regarding the appearance of the second user is extracted from the second image data, and An electronic device that generates the transmission and reception request message based on at least a portion of at least one of the first image data, the first feature information, the second image data, and the second feature information.
9. In any one of paragraphs 7 to 8, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, Acquiring the second image data through the second camera, which further includes the appearance of a third user who does not wear or possess the electronic device in addition to the appearance of the second user, and A selection command is received from the above user to select at least one of the appearance of the second user and the appearance of the third user, and Using an AI model, at least one second feature information is extracted for at least one appearance selected by the above selection command, and An electronic device that generates a data transmission and reception request message based on at least a portion of at least one of the first image data, the first feature information, the second image data, and the second feature information.
10. In any one of paragraphs 7 through 9, The above electronic device further includes a microphone, and When the above instructions are executed individually or collectively by the at least one processor, the electronic device, Voice information including the content of a conversation between the first user and the second user is obtained through the microphone above, and Using an AI model, conversation information including at least a portion of the conversation content is extracted from the voice information, and An electronic device that generates a data transmission and reception request message based on at least a portion of the first image data, at least one first feature information, and the conversation information.
11. In an electronic device, display; Communication circuit; At least one camera; At least one processor; and Includes memory for storing instructions; and The above electronic device receives a data transmission and reception request message from an external electronic device through the communication circuit, wherein the data transmission and reception request message is, A first image data obtained by photographing a first user with the above external electronic device, and at least one first feature information extracted from the first image data is generated based on at least a portion thereof, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, When it is determined that an object corresponding to the first feature information is included in an image being captured or already captured through at least one of the above cameras, the object, The above first image data, A virtual image corresponding to at least one first feature information, and At least one of the texts describing at least one first feature information is displayed on the display along with a message for confirming whether to accept a data transmission / reception request, and Receive input from the second user regarding the above acceptance status, An electronic device that transmits a data transmission and reception acceptance message containing information regarding the acceptance status to the external electronic device.
12. In Paragraph 11, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, In the case where the above data transmission / reception request message is generated based on at least a portion of at least one of the second image data including the appearance of the second user and at least one second feature information regarding the appearance of the second user, in addition to the first image data and the first feature information, The above second image data, A virtual image corresponding to the above second feature information, and An electronic device that further displays at least one of the text describing the above second feature information on the display.
13. In any one of paragraphs 11 to 12, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, If the above data transmission and reception request message is generated based at least partially on voice information including the content of the conversation between the first user and the second user, in addition to the first image data and the first feature information, An electronic device that further displays text containing at least a portion of the above voice information on the display, or outputs at least a portion of the above voice information through a speaker included in the electronic device.
14. In a non-volatile storage medium storing instructions, the instructions are configured to cause the wearable electronic device to perform at least one operation when executed by the wearable electronic device, wherein the at least one operation is, An operation to confirm a first command from a first user wearing the above-mentioned wearable electronic device; An operation of confirming the first command pointing to a second user wearing an external wearable electronic device for file sharing using an AI model while the wearable electronic device is worn by the first user; An operation of verifying first information about the first user based on an image of the first user obtained through at least one camera of the wearable electronic device using the above AI model; An operation to verify second information based on an image of the second user obtained through at least one camera using the second AI model; An operation of transmitting a first message requesting a communication connection for file sharing through a communication circuit of the wearable electronic device, wherein the first message includes first information representing sender information and second information representing receiver information; and When a second message for accepting the communication connection for file sharing is received from the external wearable electronic device through the communication circuit, a communication connection is established with the external wearable electronic device, and A storage medium comprising the operation of transmitting a file to the external wearable electronic device based on the second message.
15. In a non-volatile storage medium storing instructions, the instructions are configured to cause the wearable electronic device to perform at least one operation when executed by the wearable electronic device, wherein the at least one operation is, When the wearable electronic device is worn by a first user, and a first message requesting a communication connection for file sharing is received through the communication circuit of the electronic device from an external wearable electronic device, the first message including first information representing sender information and second information representing receiver information, the operation of acquiring an image of the first user through at least one camera of the wearable electronic device; An operation to verify third information about the first user based on the image of the first user using an AI model; If the similarity between the third information regarding the first user and the second information representing the recipient information is included within a threshold range, the operation of identifying the wearable electronic device as a file sharing target for the external wearable electronic device; An operation to verify information of a second user wearing the external wearable electronic device that transmitted the first message, based on first information representing sender information included in the first message using the AI model; An operation to display a user interface including information related to the second user and a message inquiring whether to accept file sharing; and A storage medium comprising the operation of transmitting a second message for accepting a communication connection for file sharing to an external wearable electronic device through a communication circuit of the wearable electronic device, when acceptance of file sharing is confirmed through the user interface.
Citation Information
Patent Citations
Communication system including head wearable device
JP2018504688A
Boring Tool for Machining Soft Jaws
KR1020250138300A
Method of manufacturing CuO upon Cu deposition substrate
KR102230401B1
Detecting The Same Type of Objects in Images Using Machine Learning Models
US20220171980A1
Shared data and collaboration for head-mounted devices
US20240289085A1