System for sharing graphics object through hologram device, and operation method thereof

Abstract

An operation method of a system for sharing a graphics object between a plurality of users, according to an embodiment of the present disclosure, may comprise the steps of: identifying terminal devices requested to access a management server for managing an object sharing service; recognizing a target graphics object on the basis of a pointer identified by a head mounted device; transmitting the recognized target graphics object to terminal devices connected using the object sharing service; identifying a hologram device paired with each of the terminal devices; and displaying the target graphics object through the identified hologram device.

Description

System for sharing graphic objects through a holographic device and its operation method

[0001] The technical idea of ​​the present disclosure relates to a system for sharing graphic objects between a plurality of devices, and more particularly, to a graphic object sharing system using a holographic device and an operating method thereof.

[0002] Augmented Reality is a branch of Virtual Reality that is a computer graphics technique that synthesizes virtual objects into the real environment to make them appear as if they were objects in the original environment.

[0003] Unlike conventional virtual reality, which only deals with virtual spaces and objects, augmented reality has the characteristic of synthesizing virtual objects on top of the real world to provide additional information that is difficult to obtain from the real world alone.

[0004] In other words, virtual reality technology generally immerses users in a virtual environment, so they cannot see the actual environment, whereas augmented reality technology allows users to see the actual environment, and the real environment and virtual objects are mixed. In other words, while virtual reality replaces the real world and shows it to the user, augmented reality has the distinction of supplementing the real world by superimposing virtual objects onto the real world and showing it to the user, and has the characteristic of providing users with a better sense of reality. Due to these characteristics, unlike existing virtual reality, which can be applied only to fields such as games, it can be applied to various real environments, and is particularly attracting attention as a next-generation display technology suitable for ubiquitous environments.

[0005] This AR technology can be utilized in tabletop systems. A table is a space placed in the center of a home or office, allowing people to discuss or play games around it. Tabletop systems leverage this concept to provide a collaborative environment for multi-party meetings, entertainment, education, and exhibitions.

[0006] Tabletop systems with horizontal displays often present information or content that is biased toward one side, making it difficult for users in different directions to simultaneously view the same content. To address this issue, research has been conducted to divide the table screen into sections to accommodate the number of users or to configure the table screen in a circular shape that can rotate left and right. The former approach suffers from the disadvantage that the split screen becomes smaller as the number of users increases, while the latter approach forces users to compete for control over the rotation of the circular screen.

[0007] To address these shortcomings of tabletop systems, a need has arisen for a collaborative environment system that provides a personalized interface for each user, allowing them to directly control and operate in a personalized manner, while also enabling users to share and collaborate on transformation of personalized results.

[0008] The purpose of the present invention is to provide a system for sharing graphic objects through multiple terminal devices owned by users in order to solve the above-mentioned problems.

[0009] An operating method of a system for sharing graphic objects among multiple users according to an embodiment of the present disclosure may include: identifying at least one terminal device that has requested connection to a management server managing an object sharing service; recognizing a target graphic object based on a pointer identified by a head mounted device; transmitting the recognized target graphic object to a terminal device connected to the object sharing service; identifying a hologram device paired with the connected terminal device; and displaying the target graphic object with the identified hologram device.

[0010] According to one embodiment, the method may further include: starting the object sharing service by the head mounted device; and connecting a terminal device among at least one terminal device requested for connection, which is authorized to access the service, to the object sharing service.

[0011] According to one embodiment, in the connecting step, access to the service may be granted to a terminal device for which pre-specified identification information has been confirmed or authorized by the head mounted device.

[0012] According to one embodiment, the object sharing service may be a service that provides a virtual conference room.

[0013] In one embodiment, the head mounted device may have editing access to the graphical object implemented in augmented reality or mixed reality.

[0014] According to one embodiment, the step of recognizing the target graphic object can identify the target graphic object by tracking the gaze of a user wearing the head mounted device.

[0015] According to one embodiment, in the step of recognizing the target graphic object, the target graphic object can be identified based on the difference between the coordinates by the identified pointer and the coordinates by the user's gaze.

[0016] According to one embodiment, among the connected terminal devices, additional information may be displayed in addition to the target graphic object on a terminal device that is not paired with the hologram device.

[0017] According to one embodiment, the method may further include a step of generating modeling data based on the target graphic object and a context image surrounding the target graphic object.

[0018] According to one embodiment, the method may further include: generating first rendering data corresponding to the terminal device based on the modeling data; and generating second rendering data corresponding to the paired hologram device based on the modeling data.

[0019] According to one embodiment, the step of generating the second rendering data may include the step of generating the second rendering data by removing the context image from the modeling data.

[0020] According to one embodiment, the target graphic object may be implemented as augmented reality or mixed reality.

[0021] A system for sharing a graphic object among a plurality of users according to another embodiment of the present disclosure comprises: a memory storing computer-executable instructions; and a processor executing the computer-executable instructions, wherein the processor identifies at least one terminal device that has requested connection to a management server managing an object sharing service, recognizes a target graphic object based on a pointer identified by a head-mounted device, transmits the recognized target graphic object to the terminal device connected to the object sharing service, identifies a hologram device paired with the connected terminal device, and causes the identified hologram device to display the target graphic object.

[0022] According to one embodiment, the processor can start the object sharing service at the request of the head mounted device and connect a terminal device that is permitted to access the service among at least one terminal device that has requested the connection to the object sharing service.

[0023] According to one embodiment, the processor may grant access to a service to a terminal device for which pre-specified identification information has been verified or authorized by the head mounted device.

[0024] A system according to an embodiment of the present disclosure can share graphic objects more accurately and quickly by providing a method of rendering graphic objects recognized through a head-mounted device according to the specifications of each terminal device.

[0025] FIG. 1 is a diagram illustrating a system for sharing graphic objects according to an embodiment of the present disclosure.

[0026] Figure 2 is a block diagram illustrating the configuration of a system according to one embodiment.

[0027] Figure 3 is a block diagram illustrating the configuration of a management server according to an embodiment.

[0028] FIG. 4 is a flowchart illustrating a method for displaying a target graphic object according to one embodiment.

[0029] FIGS. 5 and 6 are drawings illustrating a head mount device according to one embodiment.

[0030] FIG. 7 is a diagram illustrating an embodiment of recognizing a graphic object through pointer and gaze tracking according to an embodiment.

[0031] FIG. 8 is a drawing illustrating an embodiment of controlling a graphic object according to one embodiment.

[0032] FIG. 9 is a diagram illustrating an embodiment of displaying a graphic object based on first rendering data in a terminal device according to an embodiment.

[0033] FIG. 10 is a diagram illustrating an embodiment of displaying a graphic object based on second rendering data in a holographic device according to an embodiment.

[0034] FIG. 1 is a diagram illustrating a system for sharing a graphic object (2) according to an embodiment of the present disclosure.

[0035] Referring to FIG. 1, the system of the present disclosure can share a graphic object (2) specified by a head-mounted device (10) with a plurality of connected devices, and can display the graphic object (2) in different ways depending on the types of devices. In the embodiment of the present disclosure, the graphic object (2) is displayed by the head-mounted device (10) and can be any type of graphic object (2) that can be manipulated by a user wearing the head-mounted device (10).

[0036] According to one embodiment, a user equipped with a head-mounted device (10) can edit a displayed graphic object (2), and the system can store the edited graphic object (2) as modeling data in a management server. Editing a graphic object (2) can mean any type of control operation, such as rotating, cutting, combining, or enlarging / reducing the graphic object (2).

[0037] The management server can transmit modeling data to a plurality of connected terminal devices (30), and each terminal device (30) can generate rendering data based on the modeling data. The rendering data can be information on how a graphic object (2) is implemented in a manner corresponding to each terminal device (30). At this time, among each terminal device (30), a terminal device (30) paired with a hologram device can generate rendering data that enables the graphic object (2) to be implemented in the hologram device.

[0038] According to another embodiment, the management server can receive modeling data, generate rendering data directly from the modeling data, and transmit rendering data corresponding to the terminal device (30) by identifying the type of each terminal device (30). At this time, the management server can transmit rendering data corresponding to the hologram device to the terminal device (30) paired with the hologram device.

[0039] Accordingly, the object sharing system of the present disclosure can provide a description of information provided through a graphic object (2) in real time by sharing a graphic object (2) controlled by a head mounted device (10) with a plurality of devices connected to the system.

[0040] Figure 2 is a block diagram illustrating the configuration of a system (1) according to one embodiment.

[0041] Referring to FIG. 2, the system (1) of the present disclosure may include a head mounted device (10), a management server (20), a terminal device (30), and a hologram device (40). At this time, the hologram device (40) may be connected to the terminal device (30) to receive rendering data generated by the management server (20) or the terminal device (30) and display a graphic object.

[0042] The head mounted device (10) may include a communication unit, an interface unit, a display unit, a storage unit, and a control unit.

[0043] The communication unit of the head-mounted device (10) can communicate with an external device or management server (20) via a network, either wired or wirelessly. The communication unit can transmit information and / or data received from the external device or server to the control unit. In addition, the communication unit can transmit information and / or data transmitted from the control unit to the external device or server.

[0044] The head mounted device (10) may connect to an access point connected to the management server (20) using Wi-Fi, Bluetooth, WiMax, cellular communication, satellite communication, Zigbee, etc. to connect to the management server (20). The access point may relay information and / or data between the head mounted device (10) and the management server (20).

[0045] The interface unit may receive information and / or commands from a user. For example, the interface unit may include, but is not limited to, one or a combination of user interfaces such as a keyboard, mouse, buttons, switches, microphones, and touchpads.

[0046] Additionally, the interface unit can acquire pointer and user gaze information via a camera module. For example, the camera module may be positioned to face the device's exterior and interior, with the camera module facing the device's exterior identifying the pointer, and the camera module facing the device's interior identifying the user's gaze information. The pointer may be used to designate a specific location or range.

[0047] The display unit can output graphic objects. The display unit can include one of a transparent display, a translucent display, or a combination thereof, and can further include a light-emitting diode for outputting graphic objects to the display.

[0048] The storage unit can store information about a graphic object to be displayed through the head mounted device (10). The display unit can obtain information about the graphic object from the storage unit and display the graphic object. In addition, the storage unit can store information about a graphic object identified by a user, and can provide the information about the graphic object to a communication unit to transmit the information to a management server (20) and / or a terminal device (30). The storage unit can store a control command or a computer program of the head mounted device (10). The storage unit can be configured to include a non-volatile memory such as a ROM (Read Only Memory), an EPROM (Erasable Programmable ROM), an EEPROM (Electrically Erasable Programmable ROM), a flash memory, a hard disk, a removable disk, a CD-ROM, or any form of a computer-readable recording medium well known in the art to which the present invention pertains.

[0049] The control unit can control the overall functions and operations of the head-mounted device (10). The control unit can cause the display unit to display graphic objects based on user input and perform the overall process for generating modeling data. For example, the control unit can perform operations to specify a target graphic object based on information about the identified pointer and gaze. When the target graphic object is identified, the control unit can designate a range for generating modeling data.

[0050] The control unit may be configured to include a processor such as a CPU (Central Processing Unit), MPU (Micro Processor Unit), MCU (Micro Controller Unit), AP (Application Processor), etc.

[0051] The components of the head-mounted device (10) are merely categorized by function or operation, and may be categorized according to other criteria. Furthermore, since the illustrated components are not essential components, the head-mounted device (10) may not include some components or may include additional components.

[0052] The terminal device (30) can be any type of electronic device capable of communicating with the management server (20) and outputting a graphic object through a display unit. In addition, the terminal device (30) can be an electronic device that can be paired with a hologram device (40) and provide rendering data to the paired hologram device (40). That is, the terminal device (30) can be a device that can display a graphic object by itself when not paired with the hologram device (40), and can be an electronic device that can provide rendering data to the hologram device (40) when paired with the hologram device (40).

[0053] A hologram device (40) can be paired with a terminal device (30) to receive rendering data, and can display a graphic object as a hologram based on the rendering data. For example, the hologram device (40) can be a floating hologram device that can output images on four sides and implement a three-dimensional graphic object by arranging a light guide that guides light on each side.

[0054] A floating hologram device may be a device capable of three-dimensionally implementing a graphic object by utilizing the interference of light output from each side. That is, the floating hologram device may output different images from each side, and may create a three-dimensionally implemented graphic object by combining the images output from each side. In this case, the management server (20) or the terminal device (30) may generate rendering data by distinguishing the different images output from each side.

[0055] According to another embodiment, the holographic device (40) may include a spatial light modulator and display a graphic object through the spatial light modulator. The spatial light modulator may be a device that modulates the amplitude or phase of light on a pixel-by-pixel basis depending on the location where light is incident. For example, a holographic device (40) that displays a three-dimensional graphic object by including a spatial light modulator may be described in published patent application US 2023-0142442.

[0056] At this time, the system (1) can share graphic objects through an object sharing service operated by a management server (20), and can manage access rights so that graphic objects can be provided only to terminal devices (30) connected to the object sharing service. For example, the head mounted device (10) can start the object sharing service by user input, and the management server (20) can connect terminal devices (30) that have requested connection, among which access to the service is permitted, to the object sharing service.

[0057] Figure 3 is a block diagram illustrating the configuration of a management server (20) according to one embodiment.

[0058] Referring to FIG. 3, the management server (20) may include a processor (100), a RAM (200) (Random Access Memory), a storage (300), and a communication unit (400). The management server (20) may be referred to as a user terminal capable of transmitting and receiving data and information with a plurality of devices when communication with the plurality of devices is established. For example, the management server (20) may include a mobile phone, a smart phone, a tablet personal computer (PC), a wearable device, a healthcare device, or an Internet of Things (IoT) device. In addition, the management server (20) may include all types of hardware in which a method implemented in software form is implemented, and may include, for example, a device that performs computational processing, such as a TV, a computer, a set-top box, or a display device.

[0059] The processor (100) can control the overall operation of the management server (20). The processor (100) may include a single processor (100) core (Single Core) or a CPU (Central Processing Unit) including multiple processor (100) cores (Multi-Core). The management server (20) may include one or more processors (100). In addition, the processor (100) may be referred to as an ASIC (Application Specific Integrated Circuit), a chipset, a logic circuit, and a data processing device.

[0060] The processor (100) can process or execute programs, data, or instructions stored in the storage (300). For example, the processor (100) can generate rendering data by executing programs stored in the storage (300). In addition, the processor (100) can also generate data packets so as to communicate with a server according to a predefined protocol.

[0061] RAM (200) can temporarily store programs, data, or instructions. For example, programs and / or data stored in storage (300) can be temporarily stored in RAM (200) according to the control or booting code of the processor (100). For example, RAM (200) includes DRAM (Dynamic RAM), SRAM (Static RAM), SDRAM (Synchronous DRAM), etc.

[0062] Storage (300) is a storage location for storing data, and can store an operating system (OS), various programs, and various data. Storage (300) includes ROM (Read Only Memory), flash memory, PRAM (Phase-change RAM), MRAM (Magnetic RAM), RRAM (Resistive RAM), FRAM (Ferroelectric RAM), etc. In an embodiment, storage (300) can be implemented as a HDD (Hard Disk Drive), SSD (Solid State Drive), etc.

[0063] The communication unit (400) can transmit and / or receive data from the management server (20). For example, the communication unit (400) can transmit and receive data by various communication methods. For example, the communication unit (400) can perform communication by, for example, 3G, LTE, Wi-Fi, Bluetooth, BLE (Bluetooth Low Energy), Zigbee, NFC (Near Field Communication), ultrasonic communication, etc., and can include wired communication, wireless communication, short-range communication, and long-range communication.

[0064] Accordingly, the management server (20) of the present disclosure can perform operations by the above configurations, temporarily store data or commands, or perform data transmission and / or reception with other electronic devices.

[0065] The invention of the present disclosure will be described below with reference to FIGS. 2 and 3.

[0066] FIG. 4 is a flowchart illustrating a method for displaying a target graphic object according to one embodiment.

[0067] Referring to FIG. 4, the system (1) of the present disclosure can identify terminal devices (30) that have requested access to an object sharing service, and share a target graphic object specified by a head mounted device (10) with the terminal device (30) and the hologram device (40). The system (1) can provide different amounts of rendering data to the terminal device (30) depending on whether the terminal device (30) is paired with the hologram device (40).

[0068] In step (S110), the management device managing the object sharing service can identify the terminal devices (30) that have requested connection. At this time, the object sharing service may be a virtual conference room created by being triggered by the head mounted device (10). That is, the head mounted device (10) may be a host of the object sharing service, and a separate virtual conference room may be opened as an object sharing service for each trigger of the head mounted device (10).

[0069] The host of the object sharing service can share link information of the service with terminal devices (30), and the terminal devices (30) can access the link information and request access to the object sharing service. The management server (20) can mediate the creation of link information and access requests, and can transmit access requests received from terminal devices (30) to the head mounted device (10).

[0070] The head mounted device (10) can verify the identification information of the terminal device (30) that has requested access, and if the identification information corresponds to the pre-specified identification information, the terminal device (30) can access the object sharing service. If the identification information does not correspond to the pre-specified identification information, the head mounted device (10) can verify whether to allow the user access, and if access is permitted, the management server (20) can connect the terminal device (30) to the object sharing service.

[0071] A terminal device (30) connected to an object sharing service can display a virtual conference room screen. In this case, if the target graphic object is not identified by the head-mounted device (10), the management server (20) may not share the graphic object and display only a preset virtual conference room screen.

[0072] In step (S120), the head mounted device (10) can display graphic objects, and if a graphic object is specified by a user wearing the head mounted device (10), the graphic object can be recognized as a target graphic object. The head mounted device (10) can identify the target graphic object based on the pointer and the user's gaze tracking.

[0073] The head-mounted device (10) can determine the user's binocular state through a pair of camera modules facing the user when mounted, and can identify a pointer through at least one camera module facing away from the user. A method for identifying one of a plurality of graphic objects through the head-mounted device (10) will be described later with reference to FIGS. 5 to 7.

[0074] In step (S130), the head mounted device (10) can transmit a target graphic object to the terminal device (30). At this time, the head mounted device (10) can transmit only modeling data for the target graphic object to the management server (20), and the management server (20) or the terminal device (30) can implement the graphic object by generating rendering data from the modeling data.

[0075] Modeling data is information for implementing a graphic object in three dimensions, and may be data that is stored by distinguishing object information for each of the x-axis, y-axis, and z-axis. According to one embodiment, the modeling data may be generated based on a target graphic object and a context image around the target graphic object. The target graphic object may be graphic information displayed on a head mounted device (10), and the context image may be image information around a pointer captured by a camera module. That is, the context image may be image data identified around a certain range of the target graphic object.

[0076] Accordingly, the modeling data may be data modeled with information about objects viewed in augmented reality by a user wearing a head-mounted device (10), or may be data combining displayed augmented reality objects or virtual reality objects with actual reality objects. In other words, the modeling data may be data modeled with information about objects viewed in mixed reality (MR) by a user wearing a head-mounted device (10).

[0077] The head mounted device (10) can distinguish and store target graphic objects and context images among modeling data. That is, the head mounted device (10) can distinguish and store images of displayed augmented reality objects and actual reality objects collected by the camera module as modeling data.

[0078] In step (S140), each of the terminal devices (30) connected to the object sharing service can identify whether there is a paired hologram device (40). For example, the hologram device (40) and the terminal device (30) may be connected one-to-one via Bluetooth communication.

[0079] In step (S150), if a paired hologram device (40) exists, the target graphic object can be displayed on the hologram device (40). The terminal device (30) can generate rendering data from modeling data and transmit it to the hologram device (40), and the hologram device (40) can display the received rendering data.

[0080] If the terminal device (30) is not paired with the hologram device (40), the target graphic object can be output through the display unit of the terminal device (30).

[0081] At this time, the terminal device (30) can generate or receive different types of rendering data depending on whether it is connected to the hologram device (40). Since the hologram device (40) requires a large amount of data to implement the same graphic object in three dimensions compared to the case where the graphic object is displayed on the terminal device (30), the amount of data for displaying the target graphic object may need to be reduced. Accordingly, the terminal device (30) can generate a smaller amount of rendering data and provide it to the hologram device (40) compared to the case where the target graphic object is directly implemented on the terminal device (30).

[0082] To this end, the terminal device (30) or the management server (20) can generate first rendering data corresponding to the terminal device (30) based on modeling data, and can generate second rendering data corresponding to the hologram device (40) that is distinct from the first rendering data. The second rendering data may include less content compared to the first rendering data.

[0083] For example, the terminal device (30) or the management server (20) can generate first rendering data including a target graphic object and a context image from modeling data, and can generate second rendering data including only the target graphic object with the context image excluded from the modeling data.

[0084] That is, modeling data can be stored separately as information related to the target graphic object and information about the context image, and the terminal device (30) or management server (20) can extract only information related to the target graphic object to generate second rendering data.

[0085] The system (1) of the present disclosure can provide rendering data to a hologram device (40) or a terminal device (30) through the above series of steps, and can display a target graphic object or context image to a user through the provided rendering data.

[0086] FIG. 5 and FIG. 6 are drawings illustrating a head mount device (10) according to one embodiment.

[0087] Referring to FIG. 5, at least one camera module (11) may be positioned on the front of the head mounted device (10). The camera module (11) positioned on the front may be in the direction of the gaze of a user wearing the head mounted device (10), and may be positioned so as to identify a pointer positioned on the front.

[0088] For example, the pointer may be a stick-shaped object for indicating a graphic object, and the camera module (11) may identify the tip of the pointer. The pointer is not limited thereto and may be a finger, and the camera module (11) may identify the tip of the finger.

[0089] A head mounted device (10) according to an embodiment can calculate three-dimensional coordinates of a pointer. At this time, the three-dimensional coordinate system may be a coordinate system in which the user's gaze direction is one axis (the x-axis in the embodiment of FIG. 5). The head mounted device (10) can measure the distance between the pointer and the head mounted device (10) through a camera module (11) and set the measured distance as a coordinate value. In order to measure the distance between the head mounted device (10) and the pointer, the camera module (11) may be configured to include a sensor capable of measuring depth, such as a ToF (Time of Flight) sensor.

[0090] Referring to FIG. 6, a pair of camera modules (12) can be placed inside a head-mounted device (10). A pair of camera modules (12) placed inside can capture images of both eyes of a user, and can estimate a point at which the user is looking based on the captured directions of both eyes.

[0091] FIG. 7 is a diagram illustrating an embodiment of recognizing a graphic object through pointer and gaze tracking according to an embodiment.

[0092] Referring to FIG. 7, a pair of camera modules (12) can measure and store the curvature of the user's eyes during the user initialization process, and estimate the center coordinates of the eyes based on the curvature. When the user gazes at a graphic object, the camera module (12) can obtain the center coordinates of the pupils, and the head-mounted device (10) can estimate the gaze direction by connecting the center coordinates of the eyes and the center coordinates of the pupils. The head-mounted device (10) can calculate the intersection coordinates of the straight-line vectors derived in the gaze directions of each of the eyes.

[0093] The head mounted device (10) can specify a target graphic object based on the coordinates of the gaze coordinates (14) and the pointer coordinates (13) calculated as the intersection coordinates of straight line vectors when they match within a certain error range. The head mounted device (10) can specify a portion of the display unit where the coordinates on a plane parallel to the front of the head mounted device (the yz plane in the embodiment of FIG. 5) match as a target graphic object. For example, referring to FIGS. 5 and 6, when the x-coordinate value of the front of the head mounted device (10) is 0, the x-coordinate values ​​of the coordinate values ​​of the graphic objects being displayed may also be 0. Therefore, the head mounted device (10) can specify a graphic object corresponding to the y, z-coordinate values ​​of the gaze coordinates (14) and the y, z-coordinate values ​​of the pointer coordinates (13) as a target graphic object.

[0094] The head mounted device (10) can re-estimate the gaze coordinates when the gaze coordinates (14) and the pointer coordinates (13) fall outside a certain error range. The head mounted device (10) can continuously update the gaze coordinates until the target graphic object is specified.

[0095] FIG. 8 is a drawing illustrating an embodiment of controlling a graphic object according to one embodiment.

[0096] Referring to FIG. 8, the head mounted device (10) can specify a target graphic object (2), and the user can edit the target graphic object (2) using a pointer. For example, a user equipped with the head mounted device (10) can point to both ends of the target graphic object (2), and when the head mounted device (10) identifies that both ends of the target graphic object (2) are pointed, the head mounted device (10) can perform a zoom-in / out operation on the target graphic object (2). In addition, when the coordinates of the pointer identified by the head mounted device (10) move along a specific rotation direction, a rotation operation can be performed on the target graphic object (2).

[0097] FIG. 9 is a drawing illustrating an embodiment of displaying a graphic object based on first rendering data in a terminal device (30) according to one embodiment.

[0098] Referring to FIG. 9, when the terminal device (30) receives modeling data or rendering data of a target graphic object through the management server (20), it can determine whether there is a paired hologram device (40). When it is determined that there is no paired hologram device (40) in the terminal device (30), the terminal device (30) can render a surrounding image of the target graphic object from the modeling data including a context image. The surrounding image of the target graphic object is an image implemented through the context image, and can be implemented by including a pointer.

[0099] FIG. 10 is a drawing illustrating an embodiment of displaying a graphic object based on second rendering data in a hologram device (40) according to one embodiment.

[0100] Referring to FIG. 10, when a hologram device (40) paired with a terminal device (30) is identified, the terminal device (30) may not output a target graphic object through a display unit, but may output the target graphic object through the hologram device (40) paired with the terminal device (30). In this case, the rendering image output through the hologram device (40) may be an image that does not include a context image, and only the target graphic object is displayed, thereby reducing the amount of data that must be implemented through the hologram device (40).

[0101] The object sharing system (1) of the present disclosure can provide an efficient object sharing service by accurately specifying a graphic object to be displayed through the above method and transmitting only the necessary portion to an output device in consideration of the amount of data required.

Claims

1. In the operation method of a system that shares graphic objects among multiple users, A step of identifying at least one terminal device that has requested connection to a management server that manages an object sharing service; A step of recognizing a target graphic object based on a pointer identified by a head mounted device; A step of transmitting the recognized target graphic object to a terminal device connected to the object sharing service; A step of identifying a hologram device paired with the connected terminal device; and A step of displaying the target graphic object using the identified holographic device. A method for sharing graphic objects including .

2. In paragraph 1, a step of starting the object sharing service by the head mounted device; and A step of connecting a terminal device that is authorized to access the service among at least one terminal device that has requested the connection to the object sharing service. A method for sharing a graphic object, characterized in that it further includes:

3. In paragraph 2, In the above connecting step, A method for sharing graphic objects, characterized in that access to a service is granted to a terminal device for which pre-specified identification information is verified or authorized by the head mounted device.

4. In paragraph 2, A graphic object sharing method characterized in that the above object sharing service is a service providing a virtual conference room.

5. In paragraph 1, The above head mounted device, A method for sharing a graphic object, characterized in that the user has editing access rights to the target graphic object implemented in augmented reality or mixed reality.

6. In paragraph 1, The step of recognizing the above target graphic object is: A graphic object sharing method characterized in that the target graphic object is identified by tracking the gaze of a user equipped with the head mounted device.

7. In paragraph 6, In the step of recognizing the above target graphic object, A graphic object sharing method characterized in that the target graphic object is identified based on the difference between the coordinates by the identified pointer and the coordinates by the user's gaze.

8. In paragraph 1, A graphic object sharing method characterized in that, among the connected terminal devices, additional information is displayed in addition to the target graphic object on a terminal device that is not paired with the hologram device.

9. In paragraph 1, A step of generating modeling data based on the target graphic object and a context image around the target graphic object. A method for sharing a graphic object, characterized in that it further includes:

10. In paragraph 5, A step of generating first rendering data corresponding to the terminal device based on the modeling data; and A step of generating second rendering data corresponding to the paired hologram device based on the modeling data. A method for sharing a graphic object, characterized in that it further includes:

11. In paragraph 6, The step of generating the above second rendering data is: A step of generating the second rendering data by removing the context image from the modeling data. A method for sharing a graphic object, characterized by including:

12. In paragraph 1, A method for sharing a graphic object, characterized in that the target graphic object is implemented as augmented reality or mixed reality.

13. In a system that shares graphic objects among multiple users, A memory that stores instructions executable by a computer; and A processor that executes instructions executable by the computer Including, The above processor, Identify at least one terminal device that has requested connection to the management server that manages the object sharing service, Recognize a target graphic object based on a pointer identified by a head-mounted device, Transmitting the recognized target graphic object to a terminal device connected to the object sharing service, Identify the hologram device paired with the above connected terminal device, A graphic object sharing system that displays the target graphic object using the above-identified holographic device.

14. In paragraph 13, The above processor, Starting the object sharing service at the request of the head mounted device, A graphic object sharing system characterized in that it connects a terminal device that is authorized to access the service among at least one terminal device that has requested the connection to the object sharing service.

15. In paragraph 14, The above processor, A graphic object sharing system characterized in that access to a service is granted to a terminal device for which pre-specified identification information has been verified or authorized by the head mounted device.

Images