Electronic device and virtual content sharing method using same

Abstract

According to various embodiments, a first electronic device (e.g.: a portable terminal) may comprise: a display; a communication module including a communication circuit; a processor including processing circuitry; and a memory storing instructions. The instructions, when individually or collectively executed by the processor, may cause the first electronic device to: detect a second electronic device (e.g.: a wearable electronic device or an HMD device) that outputs virtual content; in response to a situation in which the second electronic device is detected, acquire the virtual content, first coordinate information corresponding to the virtual content, and a sharing right corresponding to the virtual content from the second electronic device through the communication module; calculate second coordinate information corresponding to the virtual content to be displayed through the display, on the basis of the acquired first coordinate information; and display information related to the virtual content through the display, on the basis of the second coordinate information and the sharing right. Various other embodiments may be possible.

Description

Electronic device and method of sharing virtual content using the same

[0001] An embodiment of the present disclosure relates to an electronic device and a method for sharing virtual content using the same.

[0002] With the recent development of digital technology, various types of electronic devices (user devices) capable of communication and personal information processing (e.g., mobile communication terminals, PDAs (Personal Digital Assistants), electronic notebooks, smartphones, tablets, wearable electronic devices, and / or PCs (Personal Computers)) are being released. For example, electronic devices are gradually evolving into wearable electronic devices that can be worn on parts of the body to improve portability or user accessibility.

[0003] Wearable electronic devices may include head-mounted display (HMD) devices, such as glasses, that can be worn on the head. For example, wearable electronic devices may include glasses-shaped augmented reality (AR) glasses and / or smart glasses that display various content on transparent glass (e.g., lenses). As another example, wearable electronic devices may include a video see-through (VST) device that is an HMD device, captures the real environment using a camera, and displays the captured video by overlaying it onto a virtual image. Wearable electronic devices, HMD devices, and / or VST devices may use a camera to provide virtual reality services and / or augmented reality services (e.g., augmented reality worlds, augmented reality functions) to the user. For example, while the HMD device is worn on the user's head, the HMD device may implement virtual reality and / or augmented reality in response to the execution of an augmented reality-related application on a communication-connected electronic device, and may provide virtual reality services and / or augmented reality services to the user.

[0004] The information described above may be provided as related art for the purpose of aiding understanding of the present disclosure. No claim or determination is made as to whether any of the foregoing may be applied as prior art related to the present disclosure.

[0005] A wearable electronic device (e.g., a head-mounted display (HMD) device) can provide an augmented reality service (e.g., a virtual reality service) based on augmented reality technology (e.g., VR (virtual reality), AR (augmented reality), MR (mixed reality), XR (extended reality)) to a user. The wearable electronic device can implement a virtual environment interface within an augmented reality domain and can display said virtual environment interface through a display. The wearable electronic device can provide a virtual environment interface implemented as a visual image to a user wearing said wearable electronic device. The virtual environment interface may be implemented by mixing real objects in a real environment and virtual objects in a virtual environment.

[0006] A user wearing a wearable electronic device may lose focus on the virtual reality service due to access by an external user while receiving the virtual reality service. The wearable electronic device can share the state of content based on the virtual reality service with electronic devices that enter within a set threshold distance, and can notify the user using the electronic device that the virtual reality service is being performed.

[0007] According to one embodiment, an electronic device (e.g., a portable terminal, a first electronic device) can obtain content information related to a virtual reality service from an external electronic device (e.g., a wearable electronic device, an HMD device, a second electronic device) that is providing a virtual reality service, and can display the content information at least partially through a display. The electronic device can display the content information being output from the external electronic device through the display of the electronic device. The electronic device can request the external electronic device to share the content information and can obtain the right to share the content information. The electronic device can adjust the output location or perform modification operations on the content to which the sharing right has been granted.

[0008] The technical tasks intended to be accomplished in this document are not limited to those mentioned above, and other technical tasks not mentioned will be clearly understood by those skilled in the art to which this document belongs from the description below.

[0009] According to one embodiment, a first electronic device (e.g., a portable terminal) may include a display, a communication module including a communication circuit, a processor including a processing circuit, and a memory for storing instructions. When the instructions are executed individually or collectively by the processor, the first electronic device detects a second electronic device (e.g., a wearable electronic device, an HMD device) that outputs virtual content, and in response to the situation in which the second electronic device is detected, obtains the virtual content, first coordinate information corresponding to the virtual content, and a sharing right corresponding to the virtual content from the second electronic device through the communication module, calculates second coordinate information corresponding to the virtual content to be displayed through the display based on the obtained first coordinate information, and can display information related to the virtual content through the display based on the second coordinate information and the sharing right.

[0010] According to one embodiment, a second electronic device (e.g., HMD device) that can be worn on the head by a user may include a housing, a display supported on the housing and outputting visual information, a communication module including a communication circuit, a processor including a processing circuit, and a memory for storing instructions. When the instructions are executed individually or collectively by the processor, the second electronic device may detect a first electronic device approaching within a set threshold distance, and in response to the situation in which the first electronic device is detected, confirm first coordinate information corresponding to virtual content being output through the display and a sharing right corresponding to the virtual content, transmit the confirmed first coordinate information, the virtual content, and the sharing right corresponding to the virtual content to the first electronic device through the communication module, and display information related to the sharing status of the virtual content through the display.

[0011] According to one embodiment, a method for displaying virtual content on a first electronic device may include: detecting a second electronic device that outputs the virtual content; in response to a situation in which the second electronic device is detected, acquiring the virtual content, first coordinate information corresponding to the virtual content, and a sharing right corresponding to the virtual content from the second electronic device; calculating second coordinate information corresponding to the virtual content to be displayed through a display of the first electronic device based on the acquired first coordinate information; and displaying information related to the virtual content through the display based on the second coordinate information and the sharing right.

[0012] According to one embodiment, a non-transient computer-readable storage medium (or computer program product) storing one or more programs for performing a method of displaying virtual content in a first electronic device (101) may be described. According to one embodiment, the one or more programs may include instructions for performing, when executed by a processor of the electronic device, an operation of detecting a second electronic device that outputs the virtual content; an operation of obtaining the virtual content, a first coordinate information corresponding to the virtual content, and a sharing right corresponding to the virtual content from the second electronic device in response to the situation in which the second electronic device is detected; an operation of calculating a second coordinate information corresponding to the virtual content to be displayed through a display of the first electronic device based on the obtained first coordinate information; and an operation of displaying information related to the virtual content through the display based on the second coordinate information and the sharing right.

[0013] According to one embodiment, when a first user of an electronic device (e.g., a portable terminal, a first electronic device) looks at a second user (e.g., a user wearing a wearable electronic device (e.g., a second electronic device)) who is using a virtual reality service, the first user may find it difficult to see the virtual content that the second user is viewing. The first electronic device may obtain virtual content currently being output from the second electronic device, location information corresponding to said virtual content, and information regarding sharing rights for said virtual content, and may display information related to said virtual content through a display. According to one embodiment, since the first user of the first electronic device can directly see information related to said virtual content, accessibility to said virtual content may be improved.

[0014] According to one embodiment, a first user of a first electronic device may move considering the display location of virtual content so as not to interfere with the operation of a second electronic device (e.g., content-related operation). If the first electronic device requires a sharing right for virtual content, it may request said sharing right from the second electronic device.

[0015] According to one embodiment, a second user of a second electronic device shares information related to virtual content (e.g., location information, display information) with a first electronic device, thereby inducing the first user of the first electronic device to move away from the virtual content, and the level of immersion in the virtual content can be improved.

[0016] According to one embodiment, a first electronic device and a second electronic device can share virtual content with each other and perform integrated operations on said virtual content. Sharing of virtual content is easy, and functions related to virtual content can be utilized efficiently. The first electronic device can provide an efficient user experience to a first user, and the second electronic device can provide an efficient user experience to a second user.

[0017] The effects obtainable from the present disclosure are not limited to those mentioned above, and other unmentioned effects will be clearly understood by those skilled in the art to which the present disclosure belongs from the description below.

[0018] In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components. The aforementioned features and advantages will be clearly understood based on the attached drawings and the description thereof.

[0019] FIG. 1 is a block diagram of an electronic device in a network environment according to one embodiment of the present disclosure.

[0020] FIG. 2a is an example illustration of a user (e.g., a second user) wearing an XR device (e.g., a second electronic device) according to one embodiment of the present disclosure performing an XR (extended reality) program.

[0021] FIG. 2b is an example illustration of a first electronic device according to one embodiment of the present disclosure using a camera to photograph a second user wearing an XR device.

[0022] FIG. 2c is an example diagram showing that when virtual content is shared by an XR device according to one embodiment of the present disclosure, the shared virtual content is displayed through the display of the first electronic device.

[0023] FIG. 3 is a block diagram of a first electronic device according to one embodiment of the present disclosure.

[0024] FIG. 4 is a flowchart illustrating a method for displaying virtual content according to one embodiment of the present disclosure.

[0025] FIG. 5a is an example illustration showing virtual content to which sharing rights have been granted through a display of a first electronic device according to one embodiment of the present disclosure.

[0026] FIG. 5b is an example diagram showing an image output through the second electronic device on the first electronic device based on a mirroring function when the camera of the first electronic device according to one embodiment of the present disclosure does not photograph a second user wearing the second electronic device.

[0027] FIG. 6a is an example diagram showing whether it is possible to converse with a second user of a second electronic device based on audio information obtained from a second electronic device according to one embodiment of the present disclosure.

[0028] FIG. 6b is an example diagram of requesting a sharing right for virtual content based on virtual content being output from a second electronic device according to one embodiment of the present disclosure.

[0029] FIG. 6c is an example diagram for determining a display mode when displaying virtual content according to one embodiment of the present disclosure.

[0030] FIG. 6d is an example diagram illustrating a collaborative operation on virtual content based on virtual content being output from a second electronic device according to one embodiment of the present disclosure.

[0031] FIG. 7 is an example diagram of outputting an audio signal through an audio output device connected to a first electronic device based on audio information obtained from a second electronic device according to one embodiment of the present disclosure.

[0032] FIG. 8a is an example diagram illustrating a sharing restriction for virtual content being output from a second electronic device according to one embodiment of the present disclosure.

[0033] FIG. 8b is an example illustration of a first electronic device displaying a warning message in response to a situation in which the first electronic device approaches the second electronic device within a set threshold distance according to one embodiment of the present disclosure.

[0034] FIG. 8c is an exemplary diagram illustrating a situation in which a first user of a first electronic device is seen from the perspective of a second user wearing a second electronic device according to one embodiment of the present disclosure.

[0035] FIG. 8d is a first exemplary illustration illustrating a situation in which a first user of a first electronic device approaches within a set threshold distance from the perspective of a second user wearing a second electronic device according to one embodiment of the present disclosure.

[0036] FIG. 8e is a second exemplary illustration illustrating a situation in which a first user of a first electronic device approaches within a set threshold distance from the perspective of a second user wearing a second electronic device according to one embodiment of the present disclosure.

[0037] FIG. 8f is a first example diagram illustrating a situation in which, when a second electronic device is detected within a threshold distance set in a first electronic device according to one embodiment of the present disclosure, a request is made to share virtual content being output by the second electronic device.

[0038] FIG. 8g is a second example diagram illustrating a situation in which, when a second electronic device is detected within a threshold distance set in a first electronic device according to one embodiment of the present disclosure, a request is made to share virtual content being output by the second electronic device.

[0039] FIG. 8h is a third exemplary diagram illustrating a situation in which, when a second electronic device is detected within a threshold distance set in a first electronic device according to one embodiment of the present disclosure, a request is made to share virtual content being output by the second electronic device.

[0040] FIG. 9a is an example illustration of moving virtual content to a third electronic device under the control of the second user from the perspective of the second user wearing the second electronic device according to one embodiment of the present disclosure.

[0041] FIG. 9b is an example illustration showing virtual content being output through a third electronic device from the perspective of a second user wearing a second electronic device according to one embodiment of the present disclosure.

[0042] FIG. 9c is an example illustration of moving virtual content to a third electronic device under the control of a first user in a preview image based on a first electronic device according to one embodiment of the present disclosure.

[0043] FIG. 9d is an example illustration in which virtual content is output through a third electronic device in a preview image based on a first electronic device according to one embodiment of the present disclosure.

[0044] FIG. 10a is an example illustration showing 3D-based virtual content being output through a second electronic device in a preview image based on a first electronic device according to one embodiment of the present disclosure.

[0045] FIG. 10b is an example diagram illustrating the adjustment of the orientation of 3D-based virtual content based on first coordinate information at the center of the first electronic device and second coordinate information at the center of the second electronic device in a preview image based on a first electronic device according to one embodiment of the present disclosure.

[0046] FIG. 11a is an example diagram of individually setting sharing rights for each user according to one embodiment of the present disclosure.

[0047] FIG. 11b is an example diagram illustrating the individual setting of sharing rights for each group according to one embodiment of the present disclosure.

[0048] FIG. 11c is an example diagram illustrating the individual setting of sharing rights for a program corresponding to content according to one embodiment of the present disclosure.

[0049] Hereinafter, embodiments of the present disclosure are described in detail with reference to the drawings so that those skilled in the art can easily practice them. However, the present disclosure may be embodied in various different forms and is not limited to the embodiments described herein. In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Furthermore, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and brevity.

[0050] FIG. 1 is a block diagram of an electronic device (101) in a network environment (100) according to various embodiments. Referring to FIG. 1, in the network environment (100), the electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or may communicate with at least one of an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) through a server (108). According to one embodiment, the electronic device (101) may include a processor (120), memory (130), input module (150), sound output module (155), display module (160), audio module (170), sensor module (176), interface (177), connection terminal (178), haptic module (179), camera module (180), power management module (188), battery (189), communication module (190), subscriber identification module (196), or antenna module (197). In some embodiments, at least one of these components (e.g., connection terminal (178)) may be omitted from the electronic device (101), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (176), camera module (180), or antenna module (197)) may be integrated into a single component (e.g., display module (160)).

[0051] The processor (120) can control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) by executing software (e.g., a program (140)), and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (120) can store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in volatile memory (132), process the commands or data stored in volatile memory (132), and store the resulting data in non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) that can operate independently or together with it (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device (101) includes a main processor (121) and an auxiliary processor (123), the auxiliary processor (123) may be configured to use lower power than the main processor (121) or to be specialized for a designated function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as part thereof.

[0052] The auxiliary processor (123) may control at least some of the functions or states associated with at least one component of the electronic device (101) (e.g., display module (160), sensor module (176), or communication module (190)) on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (123) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (180) or communication module (190)). According to one embodiment, the auxiliary processor (123) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (101) itself where the artificial intelligence is performed, or through a separate server (e.g., server (108)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.

[0053] The memory (130) can store various data used by at least one component of the electronic device (101) (e.g., processor (120) or sensor module (176)). The data may include, for example, input data or output data for software (e.g., program (140)) and related commands. The memory (130) may include volatile memory (132) or non-volatile memory (134).

[0054] The program (140) may be stored as software in memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0055] The input module (150) can receive commands or data to be used for a component of the electronic device (101) (e.g., processor (120)) from outside the electronic device (101) (e.g., user). The input module (150) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0056] The sound output module (155) can output a sound signal to the outside of the electronic device (101). The sound output module (155) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.

[0057] The display module (160) can visually provide information to an external (e.g., user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.

[0058] The audio module (170) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150) or output sound through the sound output module (155) or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (101).

[0059] The sensor module (176) can detect the operating state of the electronic device (101) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0060] The interface (177) may support one or more specified protocols that can be used for the electronic device (101) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (102)). According to one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0061] The connection terminal (178) may include a connector through which the electronic device (101) can be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0062] The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that can be perceived by the user through tactile or kinesthetic senses. According to one embodiment, the haptic module (179) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.

[0063] The camera module (180) can capture still images and video. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0064] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).

[0065] The battery (189) can supply power to at least one component of the electronic device (101). According to one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0066] The communication module (190) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may include one or more communication processors that operate independently of the processor (120) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (194) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (104) through a first network (198) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can identify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (196).

[0067] The wireless communication module (192) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (192) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (192) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), external electronic device (e.g., electronic device (104)), or network system (e.g., second network (199)). According to one embodiment, the wireless communication module (192) may support a Peak data rate (e.g., 20 Gbps or more) for eMBB realization, loss coverage (e.g., 164 dB or less) for mMTC realization, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for URLLC realization.

[0068] An antenna module (197) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (198) or a second network (199), may be selected from the plurality of antennas, for example, by a communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (197).

[0069] According to one embodiment, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.

[0070] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.

[0071] According to one embodiment, commands or data may be transmitted or received between an electronic device (101) and an external electronic device (104) through a server (108) connected to a second network (199). Each of the external electronic devices (102, or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations performed on the electronic device (101) may be performed on one or more of the external electronic devices (102, 104, or 108). For example, if the electronic device (101) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (101) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (101) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or neural networks. According to one embodiment, the external electronic device (104) or the server (108) may be included within a second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0072] FIG. 2a is an example diagram showing a user (e.g., a second user (202)) wearing an XR device (e.g., a second electronic device (201)) according to one embodiment of the present disclosure performing an XR (extended reality) program. FIG. 2b is an example diagram showing a first electronic device (e.g., the electronic device (101) of FIG. 1) according to one embodiment of the present disclosure using a camera (e.g., the camera module (180) of FIG. 1) to photograph the second user (202) wearing the XR device (e.g., the second electronic device (201)). FIG. 2c is an example diagram showing that when virtual content is shared by the XR device (201) according to one embodiment of the present disclosure, the shared virtual content is displayed through the display of the first electronic device (101) (e.g., the display module (160) of FIG. 1).

[0073] FIGS. 2a to 2c illustrate, by way of example, an XR device (e.g., a second electronic device (201)) is implemented as glasses-type AR glasses, but this is merely an example and can be replaced with an electronic device that supports XR (extended reality) services or immersive media services.

[0074] Referring to FIG. 2a, a second electronic device (201) according to one embodiment may include an XR device that provides images related to an XR (extended reality) service to a second user (202). For example, XR or XR service may be defined as a service that collectively refers to virtual reality (VR), augmented reality (AR), or mixed reality (MR). The second electronic device (201) may be, but is not limited to, a head-mounted device (HMD), a head-mounted display (HMD), and / or AR glasses worn on the user's body or head. FIG. 2a illustrates, by way of example, that the second electronic device (201) is implemented as glasses-type AR glasses, but this is merely an example.

[0075] The second electronic device (201) may include an OST (optical see-through) type configured to allow external light to reach the eyes of the second user (202) through glass when worn, or a VST (video see-through) type configured to block external light so that light emitted from a display reaches the eyes of the second user (202) when worn, but external light does not reach the eyes of the second user (202).

[0076] The second electronic device (201) may provide a user with images related to an extended reality (XR) service. For example, the second electronic device (201) may provide XR service images (or immersive media) in which at least one virtual content (e.g., an image, video, and / or object) is displayed in a field of view (FoV) region determined to be the field of view (FoV) of the second user (202). The field of view determined to be the field of view of the second user (202) is a region determined to be perceptible to the user through the second electronic device (201), and may be a region that includes all or at least part of the display of the second electronic device (201). The second electronic device (201) may further include at least some of the configurations and / or functions of the electronic device (101) of FIG. 1, and in the case of configurations that overlap with FIG. 1, may be substantially the same configuration.

[0077] For example, the second electronic device (201) may include a plurality of cameras (e.g., a first camera and / or a second camera). For example, the first camera may be referred to as HR (high resolution) or PV (photo video) and may include a high-resolution camera. The first camera may include a color camera equipped with functions for obtaining high-quality images, such as AF (auto focus) and shake correction (OIS (optical image stabilizer)). The first camera may include a GS (global shutter) camera or an RS (rolling shutter) camera. The second electronic device (201) may use the first camera to capture the actual living environment (203). For example, the second camera can perform at least one of 3DoF (3 degrees of freedom), 6DoF head tracking, hand detection and tracking, pose estimation and prediction, gesture recognition, slam function through depth imaging, spatial recognition and / or eye tracking. The second electronic device (201) can use the second camera to acquire information related to the movement of the second user (202) (e.g., head movement, gesture movement, and / or, pupil movement).

[0078] For example, the second camera may be implemented as at least one of a stereo camera for head tracking and spatial recognition, a gesture camera for detecting the user's movement (or hand), an eye tracking camera for tracking the direction of gaze by tracking the movement of the user's left eye and / or right eye, a distance measuring camera (e.g., TOF (time of flight camera) or depth camera) for measuring the distance to an object located in front of the second electronic device (201), a SLAM camera (simultaneous localization and mapping camera) for recognizing information related to the surrounding space (e.g., location and / or direction), and / or an RGB camera for detecting color-related information of an object and distance information to an object, or may be implemented as a camera in which some of these are integrated.

[0079] For example, the second electronic device (201) may include various sensors (e.g., sensor modules) for detecting measurements related to the movement of the second electronic device (201) (e.g., velocity, acceleration, angular velocity, angular acceleration, and / or geographic location). For example, the sensor modules may include, but are not limited to, proximity sensors, light sensors, geomagnetic sensors, gesture sensors, acceleration sensors, and / or gyroscope sensors. According to one embodiment, the second electronic device (201) may detect a first electronic device (e.g., the first electronic device (101) of FIG. 2b) approaching within a set threshold distance based on the sensor modules.

[0080] For example, the second electronic device (201) can store instructions that can be executed by the second electronic device (201) in memory. The second electronic device (201) can execute the instructions stored in memory to implement a software module and can control the components included in the second electronic device (201).

[0081] According to one embodiment, the second electronic device (201) acquires XR service image information related to a space corresponding to the field of view of the second user (202) wearing the second electronic device (201), and can recognize an area (hereinafter, FOV) determined to be the user's field of view (FOV). The second electronic device (201) can control a display unit so that at least a portion of the XR service image is displayed through the recognized FOV. For example, the second user (202) wearing the second electronic device (201) can perceive an external environment (203) (e.g., background image, real environment) seen through the display unit and a virtual object (e.g., virtual content) output through the display unit in a form where they are at least partially mixed. The second user (202) can distinguish and perceive the actual external environment image (203) and the virtual content.

[0082] According to one embodiment, the second electronic device (201) implements a virtual environment interface and can output it through a display unit and process various tasks within the virtual environment interface. Based on the virtual environment interface, the second electronic device (201) can output at least one virtual content and set a sharing right for the virtual content. For example, based on the setting of the sharing right, the second electronic device (201) can determine whether to share the virtual content with an external electronic device (e.g., the first electronic device (101)). For example, if sharing of the first virtual content is allowed, information related to the first virtual content can be provided to the external electronic device, and the first virtual content can be viewed on the external electronic device. As another example, if sharing of the second virtual content is not allowed, limited information related to the second virtual content can be provided to the external electronic device, and only limited information related to the second virtual content can be viewed on the external electronic device.

[0083] According to one embodiment, when a sharing right for specific content is granted to a first electronic device (101), the first electronic device (101) can obtain information related to said specific content, and based on said obtained information, the specific content can be displayed through the display of the first electronic device (101).

[0084] Referring to FIGS. 2b and 2c, the first electronic device (101) can execute a program (e.g., an application) related to shooting by the camera (180) and can display a preview image (230) taken using the camera (180) through a display (e.g., the display module (160) of FIG. 1).

[0085] According to one embodiment, the first electronic device (101) may enter a specific operation mode (e.g., virtual reality mode, XR mode) for outputting information related to virtual content when a preview image (230) is displayed through a display (160). For example, in response to entering the virtual reality mode, the first electronic device (101) may be connected to a second electronic device (201) for communication and may obtain information related to virtual content (210, 220) being output by the second electronic device (201) from the second electronic device (201). For example, the information related to the virtual content (210, 220) may include the virtual content, coordinate information corresponding to the virtual content, and / or sharing permission information corresponding to the virtual content. For example, the coordinate information corresponding to the virtual content may include location information where the virtual content is displayed based on a virtual environment interface. The sharing permission information corresponding to the virtual content may be information determining whether to share the virtual content with an external electronic device.

[0086] According to one embodiment, the first electronic device (101) may obtain information related to virtual content from the second electronic device (201) in response to entry into a virtual reality mode, and may display at least one virtual content (210, 220) based on the information related to the virtual content. The first electronic device (101) may display at least one virtual content (210, 220) in a form that is at least partially overlapping in a real environment (203) that includes a second user (202) wearing the second electronic device (201).

[0087] Referring to FIG. 2b, at least one virtual content (210, 220) may be in a state where no sharing rights are granted. When the first electronic device (101) displays the at least one virtual content (210, 220) through the display (160), it may display only the size and / or shape corresponding to the at least one virtual content (210, 220). The virtual content that is not granted sharing rights may include virtual content in which the actual image of the virtual content is not shared with an external electronic device (e.g., the first electronic device (101)).

[0088] Referring to FIG. 2c, at least one virtual content (211, 221) may be in a state where sharing rights have been granted. When the first electronic device (101) displays the at least one virtual content (211, 221) through the display (160), it may display an actual image of the at least one virtual content (211, 221).

[0089] According to one embodiment, the first electronic device (101) may enter a virtual reality mode when a preview image (230) is displayed through a camera (180), and in response to the entry into the virtual reality mode, may obtain information related to virtual content from the second electronic device (201). Based on the information related to the obtained virtual content, the first electronic device (101) may display at least one virtual content (210, 220) within the preview image (230). For example, if the first electronic device (101) is not granted permission to share the virtual content, the first electronic device (101) may display only the size and / or shape corresponding to the virtual content (210, 220), as shown in FIG. 2B. As another example, if the first electronic device (101) is granted permission to share virtual content, the first electronic device (101) can display a real image corresponding to the virtual content (211, 221), as shown in FIG. 2c.

[0090] According to one embodiment, a first user using a first electronic device (101) can directly check virtual content being output from a second electronic device (201). For example, the first user can check the display location of the virtual content being displayed based on a preview image (230) and move to avoid the virtual content. When working on the virtual content, the second user can prevent the virtual content from being obscured by the first user. As another example, the first user can check the virtual content being displayed based on a preview image (230) and request collaboration on the virtual content from the second electronic device (201) (e.g., the second user (202)). If the second electronic device (201) accepts the request for collaboration, the first user can perform collaboration on the virtual content together with the second user.

[0091] FIG. 3 is a block diagram of a first electronic device according to one embodiment of the present disclosure.

[0092] The first electronic device (101) of FIG. 3 may be at least partially similar to the electronic device (101) of FIG. 1 (e.g., portable electronic device, smartphone) or may further include other embodiments of the electronic device (101). According to one embodiment, the first electronic device (101) may include at least partially similar components to the first electronic device (101) of FIG. 2b and FIG. 2c.

[0093] For example, the first electronic device (101) may support a specific operating mode (e.g., virtual reality mode, XR mode) for outputting information related to virtual content. When entering virtual reality mode, the first electronic device (101) may display virtual content being output from an external electronic device (e.g., a wearable electronic device providing XR services to a user, a head-mounted device (HMD) device, the second electronic device (201) of FIG. 2a) through a display (160) (e.g., the display module (160) of FIG. 1). For example, the first electronic device (101) operating in virtual reality mode may obtain information related to virtual content from an external electronic device (e.g., the second electronic device) and, based on the information related to virtual content, may verify at least one virtual content. When displaying a preview image, the first electronic device (101) may display a real environment image including the external electronic device and at least one virtual content in an integrated manner.

[0094] Referring to FIG. 3, the electronic device (101) may include a processor (120) (e.g., processor (120) of FIG. 1), a memory (130) (e.g., memory (130) of FIG. 1), a display (160) (e.g., display module (160) of FIG. 1), a camera (180) (e.g., camera module (180) of FIG. 1), and / or a communication circuit (190) (e.g., communication module (190) of FIG. 1). The memory (130) of the electronic device (101) may store coordinate information (311) related to the display location of virtual content and / or sharing authority information (312) related to the sharing authority for said virtual content. Although not illustrated, the memory (130) may store an augmented reality application for displaying said virtual content through the display (160) based on a virtual environment interface. According to one embodiment, various information related to a virtual environment interface and virtual content (e.g., virtual object) can be stored in the memory (130).

[0095] According to one embodiment, a processor (120) of an electronic device (101) can execute a program stored in memory (130) (e.g., program (140) of FIG. 1, augmented reality-related application) to control at least one other component (e.g., hardware and / or software component) and perform various data processing or operations. According to one embodiment, the processor (120) may include at least one processor including a processing circuit. The number of processors (120) may be one or more. For example, the processor (120) may include the structure of a multi-core processor such as a dual core, a quad core, and / or a hexa core.

[0096] According to one embodiment, the memory (130) may store instructions (e.g., instructions) that are executed individually or collectively by the processor (120) (e.g., at least one processor). The processor (120) may control the operation of components included in the electronic device (101) by executing the instructions stored in the memory (130). For example, the processor (120) may include a plurality of processors and control a plurality of operations to be performed individually or collectively among the plurality of processors. According to one embodiment, the processor (120) may be operatively, functionally, and / or electrically connected to the memory (130), display (160), camera (180), and / or communication module (190).

[0097] According to one embodiment, the processor (120) can execute an augmented reality-related application stored in memory (130) and can implement an augmented reality space (e.g., a virtual environment interface) based on the augmented reality-related application. For example, the processor (120) can access at least partially a virtual environment interface generated by an external electronic device based on the augmented reality-related application and can display the virtual environment interface centered on the electronic device (101). For example, the virtual environment interface generated by the external electronic device may have first coordinate information determined centered on the external electronic device and may be implemented in accordance with the line of sight of the external electronic device. The processor (120) of the electronic device (101) can obtain first coordinate information according to the location of the external electronic device and can calculate second coordinate information aligned with the line of sight of the electronic device (101) based on the obtained first coordinate information. The processor (120) can store the first coordinate information and the second coordinate information in memory (130) as coordinate-related information (311). The processor (120) can check the second coordinate information aligned with the electronic device (101) based on coordinate-related information (311) (e.g., second coordinate information), and can display a virtual environment interface based on the second coordinate information.

[0098] According to one embodiment, the processor (120) can determine the sharing rights for at least one virtual content included within the virtual environment interface. If the virtual content is generated by an external electronic device, the external electronic device can set the sharing rights corresponding to the virtual content. For example, if a sharing right is granted to the electronic device (101) in relation to the first virtual content, the electronic device (101) can obtain an actual image of the first virtual content from the external electronic device and display the first virtual content through the display (160) of the electronic device (101). In another example, if a sharing right is not granted to the electronic device (101) in relation to the first virtual content, the electronic device (101) can obtain only size information and / or shape information of the first virtual content from the external electronic device and display only the shape of the first virtual content through the display (160). If a sharing right is not granted, the actual image of the first virtual content cannot be displayed.

[0099] According to one embodiment, the processor (120) can determine the sharing rights for at least one virtual content based on a virtual environment interface based on sharing rights information (312) stored in memory (130). When the sharing rights for at least one virtual content are granted, the processor (120) can display a real image corresponding to the at least one virtual content centered on the electronic device (101).

[0100] According to one embodiment, the processor (120) can display an augmented reality space (e.g., a virtual environment interface) through a display (160). For example, when the virtual environment interface is implemented by an external electronic device, the external electronic device can display the virtual environment interface based on first coordinate information. The processor (120) can obtain first coordinate information from the external electronic device and can calculate second coordinate information (e.g., coordinate information corresponding to the virtual environment interface when centered on the electronic device (101)). According to one embodiment, the processor (120) can display a virtual environment interface (e.g., at least one virtual content) through a display (160) based on the second coordinate information.

[0101] According to one embodiment, the camera (180) may include a rear camera whose shooting direction is directed from the rear of the electronic device (101) toward the external environment, and may capture the actual environment viewed by the first user. For example, the processor (120) may use a camera (180) to photograph a wearable electronic device included in the actual environment (e.g., a wearable electronic device providing a virtual environment interface, a head-mounted display (HMD), and a second user wearing the wearable electronic device). Based on the preview image, the processor (120) may display the second user wearing the wearable electronic device and the virtual environment interface implemented by the wearable electronic device (e.g., at least one virtual content). For example, if a sharing permission is granted for the virtual content included in the virtual environment interface, the processor (120) may display a real image corresponding to the virtual content. If a sharing permission is not granted for the virtual content included in the virtual environment interface, the processor (120) may display an outline image (e.g., size, shape) corresponding to the virtual content.

[0102] According to one embodiment, the communication circuit (190) can perform a communication connection with an external electronic device (e.g., a wearable electronic device providing XR services to a user, a head-mounted device (HMD) device, the second electronic device (201) of FIG. 2a). For example, the electronic device (101) (e.g., a portable electronic device, the first electronic device (101) of FIG. 2b) and the external electronic device (e.g., the second electronic device (201) of FIG. 2a) can be connected via the communication module (190) according to various communication methods (e.g., a wired communication channel, a wireless communication channel).

[0103] According to one embodiment, the first electronic device (101) can detect whether the external electronic device (201) is approaching within a set threshold distance through a communication circuit (190). For example, the first electronic device (101) can detect the distance between the first electronic device (101) and the external electronic device (201) based on the strength of the communication signal between the first electronic device (101) and the external electronic device (201). As another example, the first electronic device (101) can determine the distance between the first electronic device (101) and the external electronic device (201) by using a camera (e.g., a distance measuring camera, a depth camera). According to one embodiment, when the distance between the first electronic device (101) and the external electronic device (201) is within a set threshold distance (e.g., threshold), the first electronic device (101) may enter a specific operation mode for outputting virtual content to check virtual content generated by the external electronic device (201).

[0104] According to one embodiment, an electronic device (101) (e.g., a first electronic device (101)) may be connected to an external electronic device (201) (e.g., a wearable electronic device, an HMD device, a second electronic device (201) providing augmented reality services) via a communication circuit (190) in response to a situation in which the electronic device (101) enters a specific operating mode (e.g., a virtual reality mode, an XR mode) for outputting virtual content. In response to the connection to the external electronic device (201), the electronic device (101) may obtain information related to a virtual environment interface implemented by the external electronic device (201) (e.g., information related to at least one virtual content) from the external electronic device (201).

[0105] According to one embodiment, an electronic device (101) can verify the sharing rights for at least one virtual content included in the virtual environment interface when displaying a virtual environment interface implemented by an external electronic device (201), and can display the at least one virtual content in accordance with the verified sharing rights. A processor (120) can display at least one virtual content in a form that is at least partially superimposed based on a real environment image captured using a camera (180). For example, if a sharing right for the virtual content is granted, the processor (120) can display a real image corresponding to the virtual content. For example, if a sharing right for the virtual content is not granted, the processor (120) can display an outline image corresponding to the virtual content. For virtual content for which a sharing right is not granted, only the display location is displayed as an outline image, and a real image showing the characteristics of the virtual content may not be displayed.

[0106] According to one embodiment, a first electronic device (101) and a second electronic device (201) can share virtual content with each other. Virtual content can be displayed on the first electronic device (101) centered on the first electronic device (101) (e.g., based on second coordinate information), and virtual content can be displayed on the second electronic device (201) centered on the second electronic device (201) (e.g., based on first coordinate information). According to one embodiment, the first electronic device (101) and the second electronic device (201) can easily share information related to virtual content and efficiently utilize functions related to virtual content (e.g., collaboration functions). The first electronic device (101) can provide an efficient user experience to a first user, and the second electronic device (201) can provide an efficient user experience to a second user.

[0107] According to one embodiment, the first electronic device (101) may include a display (160), a communication module (190) including a communication circuit, a processor (120) including a processing circuit, and a memory (130) for storing instructions. When the above instructions are executed individually or collectively by the processor (120), the first electronic device (101) detects a second electronic device (201) that outputs virtual content, and in response to the situation in which the second electronic device (201) is detected, obtains the virtual content, first coordinate information corresponding to the virtual content, and a sharing right corresponding to the virtual content from the second electronic device (201) through the communication module (190), calculates second coordinate information corresponding to the virtual content to be displayed through the display (160) based on the obtained first coordinate information, and can display information related to the virtual content through the display (160) based on the second coordinate information and the sharing right.

[0108] According to one embodiment, when the instructions are executed individually or collectively by the processor (120), the first electronic device (101) determines whether a sharing right to the virtual content is granted based on the acquired sharing right, and in response to a situation where a sharing right to the virtual content is not granted, a first image (e.g., a contour image) corresponding to the virtual content can be displayed through the display (160) based on the second coordinate information.

[0109] According to one embodiment, when the instructions are executed individually or collectively by the processor (120), the first electronic device (101) transmits a sharing request signal to the second electronic device (201) to share the virtual content in response to a situation where no sharing rights to the virtual content are granted, and under the control of the second electronic device (201), checks whether sharing rights to the virtual content are granted, and if sharing rights to the virtual content are granted, the first image can be changed to a second image corresponding to the virtual content (e.g., a real image, a virtual content image being output by the second electronic device) through the display (160) based on the second coordinate information.

[0110] According to one embodiment, when the instructions are executed individually or collectively by the processor (120), the first electronic device (101) determines whether a sharing right to the virtual content is granted based on the acquired sharing right, and in response to a situation where a sharing right to the virtual content is granted, a second image corresponding to the virtual content (e.g., a real image, a virtual content image being output from the second electronic device) can be displayed through the display (160) based on the second coordinate information.

[0111] According to one embodiment, when the instructions are executed individually or collectively by the processor (120), the first electronic device (101) can determine, based on the communication module (190), whether the second electronic device (201) is located within a set threshold distance, detect the second electronic device (201) in response to the situation where the second electronic device (201) is located within the set threshold distance, and display relative position information for the detected second electronic device (201) and relative position information for virtual content being output from the second electronic device (201) relative to the first electronic device (101).

[0112] According to one embodiment, the first electronic device (101) may further include a camera (180). When the instructions are executed individually or collectively by the processor (120), the first electronic device (101) may detect the second electronic device (201) based on the camera (180) in response to the execution of a virtual environment-related application (e.g., AR mode) and display virtual content included in a preview screen being captured by the camera (180) through the display (160).

[0113] According to one embodiment, when the instructions are executed individually or collectively by the processor (120), the first electronic device (101) may display the preview screen containing the virtual content when the virtual content is included within the field of view of the camera (180), and when the virtual content is not included within the field of view of the camera (180), acquire the virtual image being output through the second electronic device (201) and display the acquired virtual image through the display (160).

[0114] According to one embodiment, the first electronic device (101) may further include at least two speakers. When the instructions are executed individually or collectively by the processor (120), the first electronic device (101) may acquire audio information related to the virtual content from the second electronic device (201) in response to a situation in which sharing rights to the virtual content are granted, and output the acquired audio information through the at least two speakers based on the second coordinate information.

[0115] According to one embodiment, when the instructions are executed individually or collectively by the processor (120), the first electronic device (101) can check user input for the virtual content while the virtual content is being displayed and transmit editing information based on the user input to the second electronic device (201) within a set time.

[0116] According to one embodiment, when the instructions are executed individually or collectively by the processor (120), the first electronic device (101) checks for user input to a third electronic device (e.g., another external electronic device, TV) capable of outputting the virtual content while the virtual content is being displayed, communicates with the third electronic device through the communication module (190), and can output the virtual content based on the third electronic device.

[0117] According to one embodiment, when the instructions are executed individually or collectively by the processor (120), the first electronic device (101) may generate a notification message denying access to the virtual content based on the sharing rights corresponding to the virtual content, and display the generated notification message through the display (160).

[0118] According to one embodiment, when the instructions are executed individually or collectively by the processor (120), the first electronic device (101) can check whether the first electronic device (101) and the second electronic device (201) are in a grouped state in response to a situation where the second electronic device (201) is detected, check shared authority information corresponding to the second electronic device (201) in response to the grouped state, and display the virtual content through the display (160) based on the checked shared authority information.

[0119] According to one embodiment, when the instructions are executed individually or collectively by the processor (120), the first electronic device (101) determines the display direction for the three-dimensional content based on the first coordinate information and the second coordinate information when the virtual content is three-dimensional content, and can display the three-dimensional content with the determined display direction through the display (160).

[0120] According to one embodiment, a second electronic device (201) wearable on the head by a user may include a housing, a display supported on the housing and outputting visual information, a communication module including a communication circuit, a processor including a processing circuit, and a memory for storing instructions. When the instructions are executed individually or collectively by the processor, the second electronic device (201) may detect a first electronic device (101) approaching within a set threshold distance, and in response to the situation in which the first electronic device (101) is detected, confirm first coordinate information corresponding to virtual content being output through the display and a sharing right corresponding to the virtual content, transmit the confirmed first coordinate information, the virtual content, and the sharing right corresponding to the virtual content to the first electronic device through the communication module, and display information related to the sharing status of the virtual content through the display.

[0121] According to one embodiment, when the instructions are executed individually or collectively by the processor (120), the second electronic device (201) may receive a sharing request signal for the virtual content from the first electronic device, grant the first electronic device a sharing right for the virtual content, and transmit a second image corresponding to the virtual content to the first electronic device.

[0122] FIG. 4 is a flowchart illustrating a method for displaying virtual content according to one embodiment of the present disclosure.

[0123] In the following embodiments, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, and at least two operations may be performed in parallel.

[0124] According to one embodiment, operations 401 through 407 may be understood to be performed by a processor (e.g., processor (120) of FIGS. 1 and 3, processing circuit, at least one processor) of a first electronic device (e.g., electronic device (101) of FIGS. 1 and 3, first electronic device (101) of FIGS. 2b). The first electronic device (101) of FIG. 4 may be at least partially similar to the first electronic device (101) of FIG. 2b and the electronic device (101) of FIG. 3, or may further include other embodiments of the electronic device (101). The first electronic device (101) may include a portable electronic device carried by a first user. The second electronic device (201) of FIG. 4 may be at least partially similar to the second electronic device (201) of FIG. 2a, or may further include other embodiments of the second electronic device (201). For example, the second electronic device (201) may include an XR device, an electronic device in the form of glasses, and / or a wearable electronic device, as illustrated in FIG. 2a. The second electronic device (201) may include a wearable electronic device (e.g., a head-mounted display (HMD) device) that operates while being worn at least partially on a part of the second user's body (e.g., the head). The second electronic device (201) may provide a virtual reality service (e.g., a virtual environment interface) to the second user while being worn on the second user's head. Based on the virtual environment interface, the second electronic device (201) may display real images corresponding to the real environment and virtual content generated virtually together.

[0125] In operation 401, the processor (120) of the first electronic device (101) can identify the second electronic device (201) that outputs virtual content using a camera (e.g., the camera (180) of FIG. 3). For example, the processor (120) can establish a communication connection with the second electronic device (201) in response to a situation where an application related to the display of virtual content is executed, or a situation where a preview image based on the camera (180) is displayed, and can identify the state in which virtual content is being output from the second electronic device (201). For example, the first electronic device (101) and the second electronic device (201) may be located within a set threshold distance and may establish a communication connection with each other upon mutual request.

[0126] According to one embodiment, the method of recognizing the second electronic device (201) in the first electronic device (101) is not limited to using a camera (180) and the second electronic device (201) can be recognized in various ways. For example, the first electronic device (101) can detect whether the second electronic device (201) is located within a set threshold distance based on a communication signal generated by the second electronic device (201). As another example, the first electronic device (101) can detect whether the second electronic device (201) is located within a set threshold distance based on a communication signal generated by the first electronic device (101). According to one embodiment, the first electronic device (101) can display a notification message indicating that the second electronic device (201) is in close proximity in response to the detection of the second electronic device (201).

[0127] In operation 403, the processor (120) of the first electronic device (101) may obtain first coordinate information corresponding to virtual content and a sharing right for virtual content from the second electronic device (201). For example, the processor (120) may request information related to said virtual content from the second electronic device (201) in relation to said virtual content generated by the second electronic device (201), and may obtain said virtual content, said first coordinate information corresponding to said virtual content, and / or information regarding a sharing right for said virtual content from the second electronic device (201). For example, the virtual content may include at least one of an outline image of the virtual content or an actual image of the virtual content. For example, if a sharing right for the virtual content is granted, the first electronic device (101) may obtain the outline image or the actual image. If a sharing right for the virtual content is not granted, the first electronic device (101) may obtain only the outline image. For example, the first coordinate information may be coordinate information indicating the display location of the virtual content centered on the location of the second electronic device (201). The sharing rights information for the virtual content may be information determining whether sharing rights have been granted for each of the virtual content.

[0128] According to one embodiment, the second electronic device (201) can determine at least one image among a contour image or a real image of virtual content based on sharing permission information for virtual content, and can transmit the determined at least one image to the first electronic device (101). For example, if a sharing permission for the first virtual content is granted to the first electronic device (101), the second electronic device (201) can transmit the contour image or the real image of the first virtual content to the first electronic device (101). As another example, if a sharing permission for the second virtual content is not granted to the first electronic device (101), the second electronic device (201) can transmit the contour image of the second virtual content to the first electronic device (101).

[0129] In operation 405, the processor (120) of the first electronic device (101) can calculate second coordinate information for virtual content to be displayed centered on the first electronic device (101). For example, the processor (120) can calculate second coordinate information based on the acquired first coordinate information. The first coordinate information may be information indicating the display location of virtual content centered on the second electronic device (201). The second coordinate information may be information indicating the display location of virtual content centered on the first electronic device (101).

[0130] According to one embodiment, the second electronic device (201) can display virtual content based on first coordinate information. A second user of the second electronic device (201) can check virtual content with a determined display location based on the first coordinate information.

[0131] According to one embodiment, the first electronic device (101) can display virtual content through the display (160) based on second coordinate information. When displaying a preview image captured using a camera (180), the first electronic device (101) can also display virtual content whose display position is determined based on the second coordinate information.

[0132] In operation 407, the processor (120) of the first electronic device (101) may display information related to the virtual content based on the second coordinate information and the sharing rights for the virtual content. For example, the sharing rights for the virtual content may be determined under the control of the second electronic device (201). For example, the second electronic device (201) may grant the first electronic device (101) a sharing right for the first virtual content, in which case the first electronic device (101) may obtain a contour image or an actual image of the first virtual content. For example, the second electronic device (201) may not grant the first electronic device (101) a sharing right for the second virtual content, in which case the first electronic device (101) may obtain only a contour image of the second virtual content.

[0133] According to one embodiment, the processor (120) can determine the display position for virtual content based on second coordinate information when displaying a preview image through a display (160), and can display one image among an outline image or a real image of said virtual content based on a sharing right for said virtual content.

[0134] FIG. 5a is an exemplary diagram showing virtual content to which sharing rights have been granted through a display of a first electronic device according to one embodiment of the present disclosure. FIG. 5b is an exemplary diagram showing an image output through a second electronic device on the first electronic device based on a mirroring function when the camera of the first electronic device according to one embodiment of the present disclosure does not photograph a second user wearing a second electronic device.

[0135] The first electronic device (101) of FIGS. 5a and 5b may be at least partially similar to the electronic device (101) of FIGS. 1 and 3 (e.g., the first electronic device (101) of FIG. 2b), or may further include other embodiments of the electronic device (101). The first electronic device (101) may include a portable electronic device carried by a first user. The second electronic device (201) of FIGS. 5a and 5b may include an XR device, an electronic device in the form of glasses, and / or a wearable electronic device, as illustrated in FIG. 2a. The second electronic device (201) may include a wearable electronic device (e.g., a head-mounted display (HMD) device) that operates while being worn at least partially on a part of the second user's body (e.g., head). The second electronic device (201) can provide a virtual reality service (e.g., a virtual environment interface) to the second user while being worn on the second user's head. Based on the virtual environment interface, the second electronic device (201) can display real images corresponding to the real environment and virtual content generated virtually together.

[0136] The operation in FIGS. 5a and FIGS. 5b can be understood as being performed by a processor of the electronic device (101) (e.g., processor (120) of FIG. 3, processing circuit, at least one processor).

[0137] FIG. 5a is an example diagram showing a second user (202) wearing a second electronic device (201) receiving a virtual reality service and using a first electronic device (101) to view virtual content based on said virtual reality service. Referring to FIG. 5a, the second user (202) is experiencing virtual reality based on the second electronic device (201) and may be performing operations on at least one virtual content (211, 220). The first electronic device (101) may be in a state of displaying a preview image (230) captured using a camera (e.g., camera (180) in FIG. 3) through a display (e.g., display (160) in FIG. 3).

[0138] Referring to FIG. 5a, the processor (120) of the first electronic device (101) can change the shooting mode to a virtual reality mode (e.g., an operation mode for checking virtual content) when a preview image (230) is displayed. For example, the processor (120) can communicate with the second electronic device (201) in response to the situation where the virtual reality mode is changed, and can confirm that virtual content (211, 220) is being output from the second electronic device (201). For example, the first electronic device (101) and the second electronic device (201) can be located within a set threshold distance and can communicate with each other by request. The first electronic device (101) can communicate with the second electronic device (201) through a communication circuit (e.g., the communication circuit (190) of FIG. 3).

[0139] Referring to FIG. 5a, the first electronic device (101) can obtain information related to virtual content (e.g., virtual content information, first coordinate information for virtual content, and / or, sharing rights information for virtual content) from a second electronic device (201) connected via communication, and can add at least one virtual content (211, 220) to a preview image (230) based on the obtained information related to virtual content. The first electronic device (101) can display the preview image (230) containing the at least one virtual content (211, 220) through a display (160). According to one embodiment, the second electronic device (201) can set a sharing right for an external electronic device (e.g., the first electronic device (101)) in relation to at least one virtual content (211, 220). For example, the second electronic device (201) may be in a state where it has granted sharing rights to the first electronic device (101) in relation to the first virtual content (211), and may be in a state where it has not granted sharing rights to the first electronic device (101) in relation to the second virtual content (220). For example, the second electronic device (201) may transmit a contour image and / or a real image corresponding to the first virtual content (211) to which sharing rights have been granted to the first electronic device (101). The second electronic device (201) may transmit a contour image corresponding to the second virtual content (220) to which sharing rights have not been granted to the first electronic device (101).

[0140] According to one embodiment, the first electronic device (101) can display a real image corresponding to the first virtual content (211) to which sharing rights are granted and an outline image corresponding to the second virtual content (220) to which sharing rights are not granted.

[0141] Referring to FIG. 5b, the first electronic device (101) can perform a mirroring function for the second electronic device (201) in response to a situation where the first virtual content (211) is out of the field of view of the camera (180). For example, if a situation is confirmed where the first virtual content (211) is not included in the preview image (230) (e.g., a situation where the first virtual content (211) is not captured by the camera (180)), the first electronic device (101) can perform a mirroring function for the content being displayed on the second electronic device (201). For example, the first electronic device (101) can obtain the virtual environment interface (511) that the user of the second electronic device (201) is viewing from the second electronic device (201) and can display the virtual environment interface (511) through the display (160). The first electronic device (101) can perform a mirroring function for the second electronic device (201). Referring to FIG. 5b, the user of the second electronic device (201) is focusing on the first virtual content (211), and the first electronic device (101) can display a virtual environment interface (511) containing the focused first virtual content (211).

[0142] FIG. 6a is an example diagram indicating whether conversation with a second user of a second electronic device is possible based on audio information obtained from a second electronic device according to an embodiment of the present disclosure. FIG. 6b is an example diagram requesting sharing rights for virtual content based on virtual content being output from a second electronic device according to an embodiment of the present disclosure. FIG. 6c is an example diagram determining a display mode when displaying virtual content according to an embodiment of the present disclosure. FIG. 6d is an example diagram performing collaborative work on virtual content based on virtual content being output from a second electronic device according to an embodiment of the present disclosure.

[0143] The first electronic device (101) of FIGS. 6a through 6d may be at least partially similar to the electronic device (101) of FIGS. 1 and 3 (e.g., the first electronic device (101) of FIG. 2b), or may further include other embodiments of the electronic device (101). The first electronic device (101) may include a portable electronic device carried by a first user. The second electronic device (201) of FIGS. 6a through 6d may include an XR device, an electronic device in the form of glasses, and / or a wearable electronic device, as illustrated in FIG. 2a. The second electronic device (201) may include a wearable electronic device (e.g., a head-mounted display (HMD) device) that operates while being worn at least partially on a part of the second user's body (e.g., head). The second electronic device (201) can provide a virtual reality service (e.g., a virtual environment interface) to the second user while being worn on the second user's head. Based on the virtual environment interface, the second electronic device (201) can display real images corresponding to the real environment and virtual content generated virtually together.

[0144] The operation in FIGS. 6a through 6d can be understood as being performed by a processor of the electronic device (101) (e.g., the processor (120) of FIG. 3, a processing circuit, at least one processor).

[0145] FIG. 6a is an example diagram showing whether the second user (202), wearing the second electronic device (201), is in a state where a virtual reality service is provided, and the second user (202) is in a state where conversation is possible using the first electronic device (101). Referring to FIG. 6a, the second user (202) may be in a state where an audio signal is being output while experiencing virtual reality based on the second electronic device (201). The first electronic device (101) may be in a state where a preview image (230) captured using a camera (e.g., camera (180) in FIG. 3) is displayed through a display (e.g., display (160) in FIG. 3).

[0146] Referring to FIG. 6a, the processor (120) of the first electronic device (101) can obtain audio information (e.g., volume level information of an audio signal) from the second electronic device (201), and based on the obtained audio information, can determine whether the second user (202) is in a state where conversation is possible. The processor (120) can display a notification message (611) related to conversation with the second user (202) through the display (160). Although not illustrated, the notification message (611) may include volume level information of an audio signal that the second user (202) is listening to, or a guidance message attempting to request a conversation with the second user (202). The processor (120) can attempt to request a conversation with the second user (202) in response to input to the confirmation button (612) of the notification message (611). For example, the second electronic device (201) may output a notification message regarding the conversation request or, or, output a signal notification sound.

[0147] FIG. 6b is an example illustration in which a first user of a first electronic device (101) requests sharing rights for virtual content (210, 220) while a second user (202) wearing a second electronic device (201) is receiving a virtual reality service. Referring to FIG. 6b, the first electronic device (101) is in a state of displaying the first virtual content (210) and the second virtual content (220), and in response to user input (613) for the first virtual content (210), it may display a sharing rights message (620) for the first virtual content (210). For example, the sharing rights message (620) may include a first option (621) requesting sharing for the virtual content and a second option (622) requesting collaboration on the virtual content. For example, the processor (120) may transmit a signal to the second electronic device (201) requesting sharing rights for the first virtual content (210) in response to the selection of the first option (621). As another example, the processor (120) may transmit a signal to the second electronic device (201) requesting collaboration on the first virtual content (210) in response to the selection of the second option (622).

[0148] Referring to FIG. 6b, the first electronic device (101) can verify virtual content to which sharing rights have been granted by the second electronic device (201) and can display an actual image of said virtual content. The first electronic device (101) can display an outline image for virtual content to which sharing rights have not been granted and can display an actual image for virtual content to which sharing rights have been granted.

[0149] FIG. 6c is an example diagram illustrating a situation in which a first electronic device (101) determines a display mode for a specific virtual content when a sharing right for a specific virtual content is granted from a second electronic device (201). Referring to FIG. 6c, the first electronic device (101) is in a state of displaying a first virtual content (210) and a second virtual content (220), and may request a sharing right for the first virtual content (210). In response to the granting of a sharing right by the second electronic device (201), the first electronic device (101) may provide a first option (631) for viewing the first virtual content (210) as a current view and a second option (632) for viewing the first virtual content (210) as an output screen image of the second electronic device (201) (e.g., mirroring function, mirroring mode) to the first user.

[0150] FIG. 6d is an example diagram illustrating a first electronic device (101) performing a collaborative operation on the first virtual content (210) when a sharing right to the first virtual content (210) is granted. Referring to FIG. 6d, the first electronic device (101) can respond to a first user input (641) (e.g., drag input) on the first virtual content (210) to determine the direction of movement (643) and the distance of movement according to the first user input (641), and can perform a movement function (642) on the first virtual content (210). For example, the first electronic device (101) and the second electronic device (201) performing the collaborative operation may be at least partially synchronized with each other, and the movement function (642) on the first virtual content (210) may be shared with each other.

[0151] FIG. 7 is an example diagram of outputting an audio signal through an audio output device connected to a first electronic device based on audio information obtained from a second electronic device according to one embodiment of the present disclosure.

[0152] The first electronic device (101) of FIG. 7 may be at least partially similar to the electronic device (101) of FIG. 1 and FIG. 3 (e.g., the first electronic device (101) of FIG. 2b), or may further include other embodiments of the electronic device (101). The first electronic device (101) may include a portable electronic device carried by a first user. The first electronic device (101) may be connected to an audio output device (721, 722) (e.g., earphones, wireless earphones, sound output device) and may output an audio signal through the audio output device (721, 722) based on audio information obtained from the second electronic device (201).

[0153] Referring to FIG. 7, the first electronic device (101) can obtain audio information (712) related to the first virtual content (711) from the second electronic device (201) and can output an audio signal (723) corresponding to the audio information (712) using audio output devices (721, 722). For example, the first electronic device (101) can confirm that the first virtual content (711) is located relatively to the right, centered on the first user. Considering the display position of the first virtual content (711), the first electronic device (101) can output the audio signal (723) mainly through the second audio output device (722) among the first audio output device (721) (e.g., an earphone worn on the left ear) and the second audio output device (722) (e.g., an earphone worn on the right ear). For example, the first electronic device (101) can output an audio signal (723) to the second audio output device (722) as the main, thereby improving convenience in directly recognizing the first virtual content (711). The first user can directly check the state in which the audio signal (723) is being output in relation to the first virtual content (711) being displayed relatively to the right.

[0154] FIG. 8a is an exemplary diagram illustrating a sharing restriction on virtual content being output by a second electronic device according to an embodiment of the present disclosure. FIG. 8b is an exemplary diagram illustrating a warning message displayed by the first electronic device in response to a situation in which the first electronic device approaches the second electronic device within a set threshold distance according to an embodiment of the present disclosure. FIG. 8c is an exemplary diagram illustrating a situation in which the first user of the first electronic device is seen from the perspective of a second user wearing the second electronic device according to an embodiment of the present disclosure. FIG. 8d is a first exemplary diagram illustrating a situation in which the first user of the first electronic device approaches within a set threshold distance from the perspective of a second user wearing the second electronic device according to an embodiment of the present disclosure. FIG. 8e is a second exemplary diagram illustrating a situation in which the first user of the first electronic device approaches within a set threshold distance from the perspective of a second user wearing the second electronic device according to an embodiment of the present disclosure. FIG. 8f is a first exemplary diagram illustrating a situation in which a second electronic device is detected within a threshold distance set by a first electronic device according to an embodiment of the present disclosure, and a request is made to share virtual content being output by the second electronic device. FIG. 8g is a second exemplary diagram illustrating a situation in which a second electronic device is detected within a threshold distance set by a first electronic device according to an embodiment of the present disclosure, and a request is made to share virtual content being output by the second electronic device. FIG. 8h is a third exemplary diagram illustrating a situation in which a second electronic device is detected within a threshold distance set by a first electronic device according to an embodiment of the present disclosure, and a request is made to share virtual content being output by the second electronic device.

[0155] The first electronic device (101) of FIGS. 8a through 8h may be at least partially similar to the electronic device (101) of FIGS. 1 and 3 (e.g., the first electronic device (101) of FIG. 2b), or may further include other embodiments of the electronic device (101). The first electronic device (101) may include a portable electronic device carried by a first user. The second electronic device (201) of FIGS. 8a through 8h may include an XR device, an electronic device in the form of glasses, and / or a wearable electronic device, as illustrated in FIG. 2a. The second electronic device (201) may include a wearable electronic device (e.g., a head-mounted display (HMD) device) that operates while being worn at least partially on a part of the second user's body (e.g., head). The second electronic device (201) can provide a virtual reality service (e.g., a virtual environment interface) to the second user while being worn on the second user's head. Based on the virtual environment interface, the second electronic device (201) can display real images corresponding to the real environment and virtual content generated virtually together.

[0156] The operation in FIGS. 8a through 8h can be understood as being performed by a processor of the electronic device (101) (e.g., the processor (120) of FIG. 3, a processing circuit, at least one processor).

[0157] FIG. 8a is an example illustration showing a sharing restriction on virtual content being output from the second electronic device (201) while the second user (202) wearing the second electronic device (201) is receiving a virtual reality service. Referring to FIG. 8a, the second user (202) is experiencing virtual reality based on the second electronic device (201) and may be in a state where the sharing rights for virtual content (210, 220) are restricted. The first electronic device (101) may be in a state where it displays a preview image (230) captured using a camera (e.g., camera (180) in FIG. 3) through a display (e.g., display (160) in FIG. 3) and displays an outline image of virtual content (210, 220) with restricted sharing rights.

[0158] Referring to FIG. 8a, the processor (120) of the first electronic device (101) can obtain information regarding sharing rights for virtual content (210, 220) from the second electronic device (201), and based on the obtained sharing rights information, can determine whether the virtual content (210, 220) can be shared. The processor (120) can display a notification message (811) related to sharing of the virtual content (210, 220) through a display (160). Although not illustrated, the notification message (811) may include a guidance message requesting the second user (202) and the virtual content (210, 220) to move away from each other. The processor (120) can display a sharing request message (620) requesting the sharing of the first virtual content (210) in response to an input regarding the first virtual content (210). According to one embodiment, the first electronic device (101) can obtain sharing permission information from the second electronic device (201) in relation to virtual content (210, 220) being output from the second electronic device (201), and if the sharing of the virtual content (210, 220) is restricted, it can display a notification message (811) related to sharing.

[0159] Referring to FIG. 8b, after the notification message (811) in FIG. 8a is displayed, if it is confirmed that the distance between the first electronic device (101) and the second electronic device (201) is reduced to less than a set threshold distance, the second electronic device (201) may transmit a signal restricting access to the first electronic device (101). In response to receiving the signal restricting access, the first electronic device (101) may display a notification message (812) warning of proximity to the second electronic device (201), or output a vibration signal (813) (e.g., a haptic signal). According to one embodiment, the second electronic device (201) can detect the first electronic device (101) approaching within a set threshold distance, and can control the first electronic device (101) so that a notification message (812) and / or a vibration signal that restricts approach within the set threshold distance is output through the first electronic device (101).

[0160] Referring to FIGS. 8c through 8e, a second electronic device (201) (e.g., a wearable electronic device, HMD) can detect a first electronic device (101) and a first user (814) approaching within a set first distance while displaying a virtual environment interface (801). For example, the second electronic device (201) can detect a first electronic device (101) approaching within a set threshold distance while displaying at least one virtual content (821, 822) based on the virtual environment interface (801). For example, the second electronic device (201) may transmit information related to at least one virtual content (821, 822) being output (e.g., coordinate information (311) of FIG. 3, and / or sharing rights information (312) of FIG. 3) to the first electronic device (101) in response to confirmation by the first electronic device (101).

[0161] Referring to FIG. 8c, the second electronic device (201) may display the first electronic device (101) or the first user (814) as a background image when displaying at least one virtual content (821, 822) within the virtual environment interface (801). The second electronic device (201) may preferentially display at least one virtual content (821, 822) within the virtual environment interface (801). For example, the second electronic device (201) may preferentially display at least one virtual content (821, 822) even when the first user (814) approaches increasingly closely.

[0162] Referring to FIG. 8d, the second electronic device (201) may display at least one virtual content (821, 822) within a virtual environment interface (801) such that the at least one virtual content (821, 822) overlaps at least partially with the first user (814). For example, the second electronic device (201) may transmit a signal restricting access to the first electronic device (101), as shown in FIG. 8b, to prevent a collision with the first user (814) wearing the first electronic device (101).

[0163] Referring to FIG. 8e, the second electronic device (201) may display a contour image (815) of the first user (814) in response to a situation where the first user (814) approaches within a set threshold distance to prevent collision with the first user (814), and may display a visual highlighting effect (816) (e.g., highlight display) along the outline of the contour image (815).

[0164] According to one embodiment, the first electronic device (101) and the second electronic device (201) can maintain a state of communication connection with each other and can be at least partially synchronized to share information related to virtual content with each other. The first electronic device (101) and the second electronic device (201) can detect a situation where they come close to each other (e.g., a situation where they come close within a set threshold distance) and can share a notification signal so as not to collide with each other.

[0165] Referring to FIGS. 8f through 8h, the first electronic device (101) can detect a second electronic device (201) approaching within a set first distance. For example, the second electronic device (201) may be in a situation where it is outputting at least one virtual content (831, 832) based on a virtual environment interface. The first electronic device (101) can identify the second electronic device (201) located within a set threshold distance and at least one virtual content (831, 832) being output by the second electronic device (201). For example, the first electronic device (101) may request information related to at least one virtual content (831, 832) being output (e.g., coordinate information (311) of FIG. 3, and / or sharing rights information (312) of FIG. 3) from the second electronic device (201) in response to detection by the second electronic device (201), and may receive said information from the second electronic device (201).

[0166] Referring to FIG. 8f, the first electronic device (101) may display a notification message (840) in response to detection by the second electronic device (201). For example, the notification message (840) may include a first message (841) indicating that an AR device (e.g., the second electronic device (201)) is located nearby (e.g., within a set threshold distance) and a second message (842) indicating a sharing right related to at least one virtual content (831, 832). The first electronic device (101) may display a minimap indicating relative location information for at least one virtual content (831, 832) relative to the first user (814). Referring to FIG. 8f, the second virtual content (832) may be displayed on the left and the first virtual content (831) may be displayed on the right, centered on the first user (814). A first user (814) using the first electronic device (101) can determine the location (e.g., coordinate information) of the second electronic device (201) and / or the location (e.g., coordinate information) of at least one virtual content (831, 832) based on a minimap. Referring to FIG. 8f, the first electronic device (101) can display a user interface (e.g., notification message (840), minimap) indicating the location of the first electronic device (101), the second electronic device (201), and / or at least one virtual content (831, 832) in response to detection by the second electronic device (201).

[0167] According to one embodiment, the first electronic device (101) can detect a second electronic device (201) (e.g., an electronic device providing at least one virtual content (831, 832)) that is within a set threshold distance even when the camera function (e.g., virtual reality mode) is not activated, and can obtain information related to at least one virtual content (831, 832) (e.g., sharing permission information) from the second electronic device (201).

[0168] Referring to FIG. 8g, a user of the first electronic device (101) may select the first virtual content (831) from at least one virtual content (831, 832) and request an operation on the first virtual content (831). For example, the first virtual content (831) and the second virtual content (832) may not be granted sharing rights to the first electronic device (101). The first electronic device (101) may display an option selection message (850) in response to user input regarding the first virtual content (831). For example, the option selection message (850) may include a first option (851) requesting sharing of the first virtual content (831) and a second option (852) requesting a collaborative operation on the first virtual content (831). According to one embodiment, the first electronic device (101) can transmit a request signal corresponding to the selected option to the second electronic device (201) in response to user input for an option selection message (850).

[0169] When the first option (851) is selected in FIG. 8g, the first electronic device (101) can transmit a request signal to the second electronic device (201) requesting sharing of the first virtual content (831). For example, if the second electronic device (201) allows sharing of the first virtual content (831), the first electronic device (101) in FIG. 8h may display a notification message (860) indicating that sharing of the virtual content has been allowed.

[0170] Referring to FIG. 8h, the first electronic device (101) may display a notification message (860) in response to permission to share the first virtual content (831). For example, the notification message (860) may include a first message (861) indicating the sharing status of the virtual content and a second message (862) indicating a selectable mode in the sharing status. According to one embodiment, the first electronic device (101) may select one of a camera mode (863) and a mirroring mode (864) in response to a situation where permission to share the first virtual content (831) is allowed. For example, when the camera mode (863) is selected, the first electronic device (101) may display a captured preview image using an activated camera (180), as in FIG. 8a. The preview image may include the second electronic device (201) and / or at least one virtual content (831, 832). As another example, when the mirroring mode (864) is selected, the first electronic device (101) may share the screen being displayed on the second electronic device (201) with respect to the first virtual content (831). The first electronic device (101) may display a screen substantially identical to the screen being output on the second electronic device (201), as shown in FIG. 8c.

[0171] Referring to FIGS. 8f through 8h, the first electronic device (101) can display the second electronic device (201) and at least one virtual content (831, 832) output from the second electronic device (201) through a display (160). According to one embodiment, the first electronic device (101) may omit the display of the first user (814) within the user interface when displaying a user interface, and may display only the relative position to the at least one virtual content (831, 832).

[0172] According to one embodiment, when a second electronic device (201) is detected within a set proximity distance, the first electronic device (101) may display a notification message regarding the detection of the second electronic device (201). The first electronic device (101) may provide the user with information regarding sharing rights for virtual content being output from the second electronic device (201). The first electronic device (101) may request sharing rights for virtual content from the second electronic device (201), and if sharing rights for virtual content are granted, the virtual content may be displayed. The first electronic device (101) may display virtual content by selecting a specific mode.

[0173] FIG. 9a is an exemplary illustration of moving virtual content to a third electronic device under the control of a second user wearing a second electronic device according to an embodiment of the present disclosure. FIG. 9b is an exemplary illustration of virtual content being output through a third electronic device from the perspective of a second user wearing a second electronic device according to an embodiment of the present disclosure. FIG. 9c is an exemplary illustration of moving virtual content to a third electronic device under the control of a first user in a preview image based on a first electronic device according to an embodiment of the present disclosure. FIG. 9d is an exemplary illustration of virtual content being output through a third electronic device in a preview image based on a first electronic device according to an embodiment of the present disclosure.

[0174] The first electronic device (101) of FIGS. 9a through 9d may be at least partially similar to the electronic device (101) of FIGS. 1 and 3 (e.g., the first electronic device (101) of FIG. 2b), or may further include other embodiments of the electronic device (101). The first electronic device (101) may include a portable electronic device carried by a first user. The second electronic device (201) of FIGS. 9a through 9d may include an XR device, an electronic device in the form of glasses, and / or a wearable electronic device, as illustrated in FIG. 2a. The second electronic device (201) may include a wearable electronic device (e.g., a head-mounted display (HMD) device) that operates while being worn at least partially on a part of the body (e.g., the head) of a second user (202). The second electronic device (201) can provide a virtual reality service (e.g., a virtual environment interface) to the second user (202) while being worn on the head of the second user (202). Based on the virtual environment interface, the second electronic device (201) can display real images corresponding to the real environment and virtual content generated virtually together.

[0175] The operation in FIGS. 9a through 9d can be understood as being performed by a processor of the electronic device (101) (e.g., the processor (120) of FIG. 3, a processing circuit, at least one processor).

[0176] FIGS. 9a and 9b are examples illustrating a second user (202) wearing a second electronic device (201) receiving a virtual reality service, selecting one of a first virtual content (921) and a second virtual content (922), and moving the selected virtual content (e.g., the first virtual content (921)) to a third electronic device (930). Referring to FIG. 9a, the second user (202) may be in a state of experiencing virtual reality based on the second electronic device (201) and performing operations on the virtual content (921, 922). For example, the second electronic device (201) may be in a state of being in communication connection with the first electronic device (101) and / or the third electronic device (930) of the first user (911), which is included in the first virtual environment interface (901). For example, the second electronic device (201) can detect the third electronic device (930) included in the first virtual environment interface (901) and can be connected to the communication with the third electronic device (930).

[0177] Referring to FIG. 9a, the second electronic device (201) can transmit information related to the first virtual content (921) to the third electronic device (930) in response to user input (931) for the first virtual content (921) (e.g., drag input by a second user wearing the second electronic device (201), drag input by a second user moving the display position of the first virtual content (921) to the third electronic device (930).

[0178] Referring to FIG. 9b, the third electronic device (930) can obtain information related to the first virtual content (921) from the second electronic device (201) and can display a first image (932) corresponding to the first virtual content (921) through a display. For example, the second electronic device (201) can control the function and operation of the third electronic device (930) at least partially. The second electronic device (201) can control the third electronic device (930) so that the first image (932) is displayed through the display of the third electronic device (930). Referring to FIG. 9b, the second electronic device (201) can display the first image (932) being output through the first electronic device (101) and the third electronic device (930) of the first user (911) based on the second virtual environment interface (902). The second electronic device (201) may also display a notification message (940) that informs of sharing information (e.g., sharing status) in relation to the first virtual content (921) being shared.

[0179] According to one embodiment, the first electronic device (101), the second electronic device (201), and / or the third electronic device (930) may be connected to each other for communication and may be in a state of sharing information with each other.

[0180] Referring to FIG. 9c, the first electronic device (101) may transmit information related to the first virtual content (921) to the third electronic device (930) in response to user input (951) for the first virtual content (921) (e.g., drag input by a first user using the first electronic device (101), drag input by a first user moving the display position of the first virtual content (921) to the third electronic device (930). Referring to FIG. 9c, the first electronic device (101) may be in a state where it has been granted sharing rights for the first virtual content (921) from the second electronic device (201) and may be in a state where it is possible to work on the first virtual content (921).

[0181] Referring to FIG. 9d, the third electronic device (930) can obtain information related to the first virtual content (921) under the control of the first electronic device (101) and can display a first-1 image (952) corresponding to the first virtual content (921) through a display. For example, the first electronic device (101) can control the function and operation of the third electronic device (930) at least partially. The first electronic device (101) can control the third electronic device (930) so that the first-1 image (952) is displayed through the display of the third electronic device (930). Referring to FIG. 9d, the first electronic device (101) can display the first-1 image (952) being output through the second electronic device (201) and the third electronic device (930) of the second user (202).

[0182] FIG. 10a is an exemplary illustration showing 3D-based virtual content being output through a second electronic device in a preview image based on a first electronic device according to an embodiment of the present disclosure. FIG. 10b is an exemplary illustration showing the orientation of 3D-based virtual content being adjusted based on first coordinate information centered on the first electronic device and second coordinate information centered on the second electronic device in a preview image based on a first electronic device according to an embodiment of the present disclosure.

[0183] The first electronic device (101) of FIGS. 10a and 10b may be at least partially similar to the electronic device (101) of FIGS. 1 and 3 (e.g., the first electronic device (101) of FIG. 2b) or may further include other embodiments of the electronic device (101). The second electronic device (201) of FIGS. 10a and 10b may include an XR device, an electronic device in the form of glasses, and / or a wearable electronic device, as shown in FIG. 2a. The second electronic device (201) may include a wearable electronic device (e.g., a head-mounted display (HMD) device) that operates while being worn at least partially on a part of the body (e.g., the head) of the second user (202).

[0184] The operation in FIG. 10a and FIG. 10b can be understood as being performed by a processor of the electronic device (101) (e.g., processor (120) of FIG. 3, processing circuit, at least one processor).

[0185] Referring to FIG. 10a, a second user (202) wearing a second electronic device (201) may be in a state of viewing 3D-based virtual content (1011) based on a virtual environment interface. For example, the 3D-based virtual content (1011) may be in a state where sharing rights have been granted to the first electronic device (101). The first electronic device (101) may display the 3D-based virtual content (1011) being output through the second electronic device (201) on a display (e.g., the display (160) of FIG. 3). Referring to FIG. 10a, the second electronic device (201) may output the 3D-based virtual content (1011) along a first display direction based on the field of view of the second user (202).

[0186] Referring to FIG. 10b, when the sharing rights for 3D-based virtual content (1011) are granted, the first electronic device (101) can share coordinate information with the second electronic device (201). The first electronic device (101) can determine the display direction for the 3D-based virtual content (1011) based on first coordinate information corresponding to the first electronic device (101), second coordinate information corresponding to the second electronic device (201), and / or third coordinate information corresponding to the 3D-based virtual content (1011). In FIG. 10b, the display position and / or display posture of the virtual content (1011) according to the first display direction can be changed to virtual content (1012) according to the second display direction. For example, the first display direction can be determined by considering only the position of the second electronic device (201) (e.g., second coordinate information). The second display direction can be determined by considering the position of the first electronic device (101) (e.g., first coordinate information) and the position of the second electronic device (201) (e.g., second coordinate information) together.

[0187] FIG. 11a is an example diagram of individually setting sharing rights for each user according to one embodiment of the present disclosure. FIG. 11b is an example diagram of individually setting sharing rights for each group according to one embodiment of the present disclosure. FIG. 11c is an example diagram of individually setting sharing rights for a program corresponding to content according to one embodiment of the present disclosure.

[0188] The first electronic device (101) of FIGS. 11a through 11c may be at least partially similar to the electronic device (101) of FIGS. 1 and 3 (e.g., the first electronic device (101) of FIG. 2b), or may further include other embodiments of the electronic device (101). The first electronic device (101) may include a portable electronic device carried by a first user. The second electronic device (201) of FIGS. 11a through 11c may include an XR device, an electronic device in the form of glasses, and / or a wearable electronic device, as illustrated in FIG. 2a. The second electronic device (201) may include a wearable electronic device (e.g., a head-mounted display (HMD) device) that operates while being worn at least partially on a part of the body (e.g., the head) of a second user (202). The second electronic device (201) can provide a virtual reality service (e.g., a virtual environment interface) to the second user (202) while being worn on the head of the second user (202). Based on the virtual environment interface, the second electronic device (201) can display real images corresponding to the real environment and virtual content generated virtually together.

[0189] According to one embodiment, the second electronic device (201) can create at least one virtual content based on a virtual environment interface and can set a sharing right for the virtual content. For example, the setting of the sharing right may be a setting that determines the degree of sharing of the virtual content with respect to an external electronic device (e.g., the first electronic device (101)). For example, the second electronic device (201) may grant a sharing right to the first electronic device (101) in relation to the first virtual content. The first electronic device (101) to which a sharing right for the first virtual content has been granted can view the actual image of the first virtual content and can at least partially control functions and operations regarding the first virtual content.

[0190] Referring to FIG. 11a, the second electronic device (201) may display a setting interface for granting sharing rights to individuals. For example, the first setting screen (1101) shows external users included in the “Family” group (e.g., Kang Gil-dong, Kang Young-hee (1111), Kang Cheol-su (1121)). When user Kang Young-hee (1111) is selected on the first setting screen (1101), the second electronic device (201) may change from the first setting screen (1101) to the first-1 setting screen (1112) and determine detailed settings for user Kang Young-hee (1111). Referring to the first-1 setting screen (1112), user Kang Young-hee (1111) may be granted sharing rights for “Sharing and editing content location information,” “Sharing and editing personal information,” and “Sharing and editing 15-year-old content.” For example, user Kang Young-hee (1111) can check coordinate information related to the display location of virtual content, perform limited operations on said virtual content, and view content for ages 15 and under. When user Kang Cheol-su (1121) is selected in the first setting screen (1101), the second electronic device (201) can change from the first setting screen (1101) to the first-second setting screen (1122) and determine detailed settings for user Kang Cheol-su (1121). Referring to the first-second setting screen (1122), user Kang Cheol-su (1121) may be granted sharing rights for “Share and edit all content.” User Kang Cheol-su (1121) may be granted all sharing rights for virtual content.

[0191] Referring to FIG. 11b, the second electronic device (201) may display a setting interface for granting sharing rights to a group. For example, the second setting screen (1102) displays each group (e.g., coworkers (1131), clubs, close friends (1141), and / or family). For example, if a coworker (1131) is selected on the second setting screen (1102), the second electronic device (201) may switch from the second setting screen (1101) to the second-1 setting screen (1132) and determine detailed settings for the coworker (1131). As another example, when a close friend (1141) is selected in the second setting screen (1102), the second electronic device (201) can change from the first setting screen (1101) to the second-second setting screen (1142) and determine detailed settings for the close friend (1141).

[0192] Referring to FIG. 11c, the second electronic device (201) may display a setting interface for granting sharing rights to applications (e.g., memory (e.g., programs stored in memory (130) of FIG. 3). For example, the third setting screen (1103) displays each application (e.g., Gallery (1151), Game Launcher, Calculator, Weather, and / or My Files). For example, if Gallery (1151) is selected on the third setting screen (1103), the second electronic device (201) may change from the third setting screen (1103) to the third-1 setting screen (1152) and determine detailed settings for Gallery (1151).

[0193] According to one embodiment, an electronic device (101) can verify the sharing rights for at least one virtual content included in the virtual environment interface when displaying a virtual environment interface implemented by an external electronic device (201), and can display the at least one virtual content in accordance with the verified sharing rights. A processor (120) can display at least one virtual content in a form that is at least partially superimposed based on a real environment image captured using a camera (180). For example, if a sharing right for the virtual content is granted, the processor (120) can display a real image corresponding to the virtual content. For example, if a sharing right for the virtual content is not granted, the processor (120) can display an outline image corresponding to the virtual content. For virtual content for which a sharing right is not granted, only the display location is displayed as an outline image, and a real image showing the characteristics of the virtual content may not be displayed.

[0194] According to one embodiment, a first electronic device (101) and a second electronic device (201) can share virtual content with each other. Virtual content can be displayed on the first electronic device (101) centered on the first electronic device (101) (e.g., based on second coordinate information), and virtual content can be displayed on the second electronic device (201) centered on the second electronic device (201) (e.g., based on first coordinate information). According to one embodiment, the first electronic device (101) and the second electronic device (201) can easily share information related to virtual content and efficiently utilize functions related to virtual content (e.g., collaboration functions). The first electronic device (101) can provide an efficient user experience to a first user, and the second electronic device (201) can provide an efficient user experience to a second user.

[0195] A method for displaying virtual content in a first electronic device (101) according to one embodiment may include: detecting a second electronic device that outputs the virtual content; in response to a situation in which the second electronic device is detected, obtaining the virtual content, first coordinate information corresponding to the virtual content, and a sharing right corresponding to the virtual content from the second electronic device; calculating second coordinate information corresponding to the virtual content to be displayed through a display (160) of the first electronic device (101) based on the obtained first coordinate information; and displaying information related to the virtual content through the display (160) based on the second coordinate information and the sharing right.

[0196] An operation of displaying information related to the virtual content according to one embodiment may include an operation of determining whether a sharing right to the virtual content is granted based on the acquired sharing right, and an operation of displaying a first image (e.g., a contour image) corresponding to the virtual content through the display (160) based on the second coordinate information in response to a situation where a sharing right to the virtual content is not granted.

[0197] A method according to one embodiment may further include the operation of transmitting a sharing request signal to the second electronic device (201) for sharing the virtual content, the operation of checking whether a sharing right to the virtual content has been granted under the control of the second electronic device (201), and, if a sharing right to the virtual content has been granted, the operation of displaying a second image corresponding to the virtual content (e.g., a real image, a virtual content image being output from the second electronic device) through the display (160) based on the second coordinate information.

[0198] A method according to one embodiment may further include an operation of determining whether the second electronic device (201) is located within a set threshold distance, an operation of detecting the second electronic device (201) in response to a situation where the second electronic device (201) is located within the set threshold distance, and an operation of displaying relative position information for the detected second electronic device (201) and relative position information for virtual content being output from the second electronic device (201) based on the first electronic device (101).

[0199] According to one embodiment, a non-transient computer-readable storage medium (or computer program product) storing one or more programs for performing a method of displaying virtual content in a first electronic device (101) may be described. According to one embodiment, the one or more programs may include instructions for performing, when executed by a processor (120) of the first electronic device (101), an operation of detecting a second electronic device that outputs the virtual content; an operation of obtaining the virtual content, a first coordinate information corresponding to the virtual content, and a sharing right corresponding to the virtual content from the second electronic device in response to the situation in which the second electronic device is detected; an operation of calculating a second coordinate information corresponding to the virtual content to be displayed through a display (160) of the first electronic device (101) based on the obtained first coordinate information; and an operation of displaying information related to the virtual content through the display (160) based on the second coordinate information and the sharing right.

[0200] The electronic device according to the various embodiments disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this document is not limited to the devices described above.

[0201] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as “coupled” or “connected” to another (e.g., 2nd) component, with or without the terms “functionally” or “communicationly,” it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.

[0202] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0203] Various embodiments of the present document may be implemented as software (e.g., program (140)) comprising one or more instructions stored in a storage medium (e.g., internal memory (136) or external memory (138)) readable by a machine (e.g., electronic device (101)). For example, a processor (e.g., processor (120)) of the machine (e.g., electronic device (101)) may call at least one of the one or more instructions stored in the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.

[0204] According to one embodiment, the method according to the various embodiments disclosed herein may be provided as included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or distributed online (e.g., download or upload) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0205] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In the first electronic device (101), Display (160); A communication module (190) including a communication circuit; A processor (120) including a processing circuit; and Includes memory (130) for storing instructions, When the above instructions are executed individually or collectively by the processor (120), the first electronic device (101) is made to, Detecting a second electronic device (201) that outputs virtual content, and In response to a situation in which the second electronic device (201) is detected, the virtual content, first coordinate information corresponding to the virtual content, and sharing rights corresponding to the virtual content are obtained from the second electronic device (201) through the communication module (190), and Based on the first coordinate information obtained above, second coordinate information corresponding to the virtual content to be displayed through the display (160) is calculated, and A first electronic device that displays information related to the virtual content through the display (160) based on the second coordinate information and the sharing rights.

2. In Paragraph 1, When the above instructions are executed individually or collectively by the processor (120), the first electronic device (101) is made to, Based on the above-mentioned acquired sharing rights, determine whether sharing rights for the above-mentioned virtual content have been granted, and In response to a situation where sharing rights for the virtual content are not granted, a first image corresponding to the virtual content is displayed through the display (160) based on the second coordinate information, and In response to a situation where sharing rights for the virtual content are not granted, a sharing request signal for sharing the virtual content is transmitted to the second electronic device (201), and Under the control of the second electronic device (201), check whether sharing rights to the virtual content have been granted, and A first electronic device that, when a sharing right for the virtual content is granted, changes the first image into a second image corresponding to the virtual content through the display (160) based on the second coordinate information.

3. In Paragraph 1, When the above instructions are executed individually or collectively by the processor (120), the first electronic device (101) is made to, Based on the above-mentioned acquired sharing rights, determine whether sharing rights for the above-mentioned virtual content have been granted, and A first electronic device that, in response to a situation in which a sharing right to the virtual content is granted, displays a second image corresponding to the virtual content through the display (160) based on the second coordinate information.

4. In Paragraph 1, When the above instructions are executed individually or collectively by the processor (120), the first electronic device (101) is made to, Based on the communication module (190), check whether the second electronic device (201) is located within a set threshold distance, and In response to a situation where the second electronic device (201) is located within the set threshold distance, the second electronic device (201) is detected, and A first electronic device that displays relative position information for the detected second electronic device (201) and relative position information for virtual content being output from the second electronic device (201) based on the first electronic device (101).

5. In Paragraph 1, Including a camera (180), When the above instructions are executed individually or collectively by the processor (120), the first electronic device (101) is made to, In response to the execution of a virtual environment-related application, the second electronic device (201) is detected based on the camera (180), and The virtual content is displayed through the display (160) based on the preview screen being captured by the camera (180), and When the virtual content is included within the field of view of the camera (180), the preview screen containing the virtual content is displayed, and A first electronic device that, when the virtual content is not included within the field of view of the camera (180), acquires a virtual image being output through the second electronic device (201) and displays the acquired virtual image through the display (160).

6. In Paragraph 1, Includes at least two speakers; and When the above instructions are executed individually or collectively by the processor (120), the first electronic device (101) is made to, In response to a situation where sharing rights for the virtual content are granted, audio information related to the virtual content is obtained from the second electronic device (201), and A first electronic device that outputs the acquired audio information using the at least two speakers based on the second coordinate information.

7. In Paragraph 1, When the above instructions are executed individually or collectively by the processor (120), the first electronic device (101) is made to, While the above virtual content is being displayed, check user input for the above virtual content, and A first electronic device that transmits editing information based on the above user input to the second electronic device (201) within a set time.

8. In Paragraph 1, When the above instructions are executed individually or collectively by the processor (120), the first electronic device (101) is made to, While the above virtual content is being displayed, user input to a third electronic device capable of outputting the above virtual content is checked, and The third electronic device is connected to the communication module (190) through communication, and A first electronic device that outputs the virtual content based on the third electronic device.

9. In Paragraph 1, When the above instructions are executed individually or collectively by the processor (120), the first electronic device (101) is made to, Based on the sharing authority corresponding to the virtual content, a notification message is generated to deny access to the virtual content, and A first electronic device that displays the generated notification message through the above display (160).

10. In Paragraph 1, When the above instructions are executed individually or collectively by the processor (120), the first electronic device (101) is made to, In response to a situation in which the second electronic device (201) is detected, check whether the first electronic device (101) and the second electronic device (201) are in a grouped state, and In response to the above grouping state, check the shared authority information corresponding to the second electronic device (201), and A first electronic device that displays the virtual content through the display (160) based on the confirmed shared permission information.

11. In Paragraph 1, When the above instructions are executed individually or collectively by the processor (120), the first electronic device (101) is made to, If the above virtual content is 3D-based content, the display direction for the 3D-based content is determined based on the first coordinate information and the second coordinate information, and A first electronic device that displays the three-dimensional based content, in which the display direction is determined, through the display (160).

12. In a second electronic device (201) wearable on the head by a user, Housing; A display supported by the above housing and outputting visual information; A communication module including a communication circuit; A processor including a processing circuit; and Memory for storing instructions; including, When the above instructions are executed individually or collectively by the processor, the second electronic device (201) is made to, Detecting a first electronic device (101) approaching within a set threshold distance, and In response to a situation in which the first electronic device (101) is detected, the first coordinate information corresponding to the virtual content being output through the display and the sharing rights corresponding to the virtual content are checked, and The above-mentioned confirmed first coordinate information, the virtual content, and the sharing authority corresponding to the virtual content are transmitted to the first electronic device through the communication module, and A second electronic device that displays information related to the sharing status of the virtual content through the above display.

13. In Paragraph 12, When the above instructions are executed individually or collectively by the processor, the second electronic device (201) is made to, Receiving a sharing request signal for the virtual content from the first electronic device, and For the first electronic device, granting sharing rights for the virtual content, and A second electronic device that transmits a second image corresponding to the virtual content to the first electronic device.

14. A method for displaying virtual content in a first electronic device (101), An operation to detect a second electronic device (201) that outputs the above virtual content; An operation to obtain the virtual content, the first coordinate information corresponding to the virtual content, and the sharing rights corresponding to the virtual content from the second electronic device (201) in response to a situation in which the second electronic device (201) is detected; An operation of calculating second coordinate information corresponding to the virtual content to be displayed through the display (160) of the first electronic device (101) based on the first coordinate information obtained above; and A method comprising: an operation of displaying information related to the virtual content through the display (160) based on the second coordinate information and the sharing rights.

15. In Paragraph 14, An operation to determine whether a sharing right to the virtual content is granted based on the above-mentioned acquired sharing right; An operation to display a first image corresponding to the virtual content through the display (160) based on the second coordinate information in response to a situation where sharing rights for the virtual content are not granted; The operation of transmitting a sharing request signal to the second electronic device (201) for sharing the above virtual content; An operation to check whether sharing rights to the virtual content have been granted under the control of the second electronic device (201); and A method further comprising: an operation of changing the first image into a second image corresponding to the virtual content through the display (160) based on the second coordinate information when a sharing right for the virtual content is granted.

Images