Extended reality synchronization method and system based on user viewport

Abstract

The present invention provides an extended reality synchronization method comprising: receiving location information of a user in an extended reality space from a user terminal; adding the user terminal to a synchronization group of a specific adjacent virtual object on the basis of the location information; receiving object information and state information on the specific virtual object from the user terminal; identifying the synchronization group to which the user terminal is added, on the basis of the object information; and transmitting the state information to another user terminal included in the synchronization group to synchronize the state of the virtual object.

Description

Method and system for synchronizing extended reality based on user viewport

[0001] The present invention relates to a method and system for synchronizing extended reality based on a user viewport.

[0002] Recently, interest in extended reality, which encompasses virtual reality (VR), augmented reality (AR), and mixed reality (MR), has been increasing, and accordingly, contents that provide extended reality spaces with various purposes are being developed.

[0003] In particular, with the advancement of CPU (Central Processing Unit) and GPU (Graphics Processing Unit) performance, the computational load required to render objects placed in augmented reality spaces is also increasing. Consequently, the network load required to synchronize object state changes across multiple user terminals accessing the augmented reality space is also increasing.

[0004] In this regard, state synchronization and remote procedure call (RPC) synchronization methods have been conventionally used. First, the state synchronization method is a method that performs synchronization by transmitting the state of a specific object placed in an extended reality space to another user terminal when the state of the object is changed, and the RPC method is a method that performs synchronization by calling a specific function implemented in the extended reality space from each user terminal, and complex interactions are processed by calling a series of functions.

[0005] The present invention relates to an extended reality synchronization method and system for synchronizing the state of an object recognized in a viewport of a user terminal.

[0006] In order to solve the problem discussed above, the extended reality synchronization method according to the present invention may include the steps of: receiving location information of a user in an extended reality space from a user terminal; adding the user terminal to a synchronization group of a specific virtual object adjacent to the location information among a plurality of synchronization groups pre-created for each virtual object arranged in the extended reality space; receiving object information and status information for the specific virtual object from the user terminal; and confirming the synchronization group to which the user terminal is added based on the object information, and transmitting the status information to another user terminal included in the synchronization group to synchronize the status of the virtual object.

[0007] In addition, the extended reality synchronization system according to the present invention includes a communication unit that receives location information of a user in an extended reality space from a user terminal; and a control unit that adds the user terminal to a synchronization group of a specific virtual object adjacent to the location information among a plurality of synchronization groups previously created for each virtual object arranged in the extended reality space, wherein the communication unit receives object information and status information about the specific virtual object from the user terminal, and the control unit confirms the synchronization group to which the user terminal is added based on the object information, and transmits the status information to other user terminals included in the synchronization group to synchronize the status of the virtual object. Alternatively, the status information may be preferentially transmitted to other user terminals included in the synchronization group rather than to users not included in the synchronization group.

[0008] In addition, a program stored in a computer-readable recording medium according to the present invention is a program stored in a computer-readable recording medium, which is executed by one or more processes in an electronic device, and which includes instructions for performing the steps of: receiving location information of a user in an extended reality space from a user terminal; adding the user terminal to a synchronization group of a specific virtual object adjacent to the location information among a plurality of synchronization groups previously created for each virtual object arranged in the extended reality space; receiving object information and status information for the specific virtual object from the user terminal; and confirming the synchronization group to which the user terminal is added based on the object information, and transmitting the status information to another user terminal included in the synchronization group to synchronize the status of the virtual object.

[0009] According to various embodiments of the present invention, the extended reality synchronization method and system can efficiently synchronize the states of each object placed in the extended reality space by recognizing an object in a viewport of a user terminal estimated based on the user's location and generating a synchronization group for each object placed in the extended reality space.

[0010] In addition, according to various embodiments of the present invention, the extended reality synchronization method and system can reduce network traffic due to synchronization in the extended reality space by preferentially synchronizing a specific user terminal based on a synchronization group set for a specific object during a synchronization process in the extended reality space to which a plurality of user terminals are connected, and can realize a shortening of the end-to-end synchronization delay time and battery saving of the user terminal due to the reduction in network traffic.

[0011] Figures 1 and 2 illustrate an extended reality synchronization system according to the present invention.

[0012] Figure 3 is a flowchart of an extended reality synchronization method according to the present invention.

[0013] Figure 4 is a flowchart of one embodiment of setting up a synchronization group.

[0014] Figure 5 illustrates an embodiment of estimating the viewport area of ​​a user terminal.

[0015] Figures 6 to 8 are examples of setting up a synchronization group.

[0016] Figure 9 is a flowchart of one embodiment of synchronizing the state of a virtual object.

[0017] Figure 10 illustrates an embodiment in which the state of a virtual object changes.

[0018] Figures 11 and 12 illustrate an embodiment of synchronizing the state of a virtual object.

[0019] Hereinafter, embodiments disclosed in this specification will be described in detail with reference to the attached drawings. Regardless of the drawing numbers, identical or similar components will be given the same reference numbers, and redundant descriptions thereof will be omitted. The suffixes "module" and "part" used for components in the following description are assigned or used interchangeably only for the convenience of writing the specification, and do not in themselves have distinct meanings or roles. In addition, when describing the embodiments disclosed in this specification, if it is determined that a specific description of a related known technology may obscure the gist of the embodiments disclosed in this specification, a detailed description thereof will be omitted. In addition, the attached drawings are only intended to facilitate easy understanding of the embodiments disclosed in this specification, and the technical ideas disclosed in this specification are not limited by the attached drawings, and should be understood to include all modifications, equivalents, and substitutes included in the spirit and technical scope of the present invention.

[0020] Terms that include ordinal numbers, such as first, second, etc., may be used to describe various components, but the components are not limited by these terms. These terms are used solely to distinguish one component from another.

[0021] When a component is referred to as being "connected" or "connected" to another component, it should be understood that it may be directly connected or connected to that other component, but that there may be other components intervening. Conversely, when a component is referred to as being "directly connected" or "connected" to another component, it should be understood that there are no other components intervening.

[0022] Singular expressions include plural expressions unless the context clearly indicates otherwise.

[0023] In this application, terms such as “include” or “have” are intended to specify the presence of a feature, number, step, operation, component, part or combination thereof described in the specification, but should be understood not to exclude in advance the possibility of the presence or addition of one or more other features, numbers, steps, operations, components, parts or combinations thereof.

[0024] Figures 1 and 2 illustrate an extended reality synchronization system according to the present invention.

[0025] Referring to FIG. 1, the extended reality synchronization system (100) according to the present invention can synchronize the state of a virtual object (3) placed in an extended reality space to another user terminal (4, 6) based on a viewport (2) in a user terminal (1).

[0026] Here, the extended reality space is a mixed reality (MR) space that applies virtual reality (VR) and augmented reality (AR), and can be a virtual space based on real space.

[0027] However, in the present invention, the extended reality space is simply referred to as a concept that includes all of virtual reality space, augmented reality space, and mixed reality space, and therefore, can be replaced with virtual reality space, augmented reality space, or mixed reality space.

[0028] Accordingly, the user terminal (1) may be a device that provides virtual reality, augmented reality, mixed reality, or extended reality. For example, the user terminal (1) may be a head-mounted display (HMD), but this is merely an example, and other types of devices may also be possible.

[0029] That is, the user terminal (1) may be referred to as a tablet, personal computer, smartphone, wearable device, etc., and can render an extended reality space based on a pre-implemented process.

[0030] At this time, the user terminal (1) can provide the user with an extended reality space through a display equipped on the user terminal (1), or can be connected to a device that is provided to output a virtual reality space, an augmented reality space, a mixed reality space, or an extended reality space through a wireless or wired network, and can provide the user with an extended reality space rendered on the device through the user terminal (1).

[0031] Accordingly, the extended reality synchronization system (100) may be implemented as a server or a computer device to provide a service according to the extended reality synchronization system (100) through a user terminal (1). For example, the extended reality synchronization system (100) may be provided in the form of an application or software, or may be provided on a web page.

[0032] Meanwhile, the virtual object (3) may be placed in an extended reality space and implemented to perform a predetermined interaction according to user input through a user terminal (1), or to perform a predetermined action based on a pre-implemented algorithm for the extended reality space.

[0033] For example, a virtual object (3) may refer to an animal, plant, object, avatar, etc. placed in an extended reality space. Such a virtual object (3) may be placed in an extended reality space by setting arbitrary location information in the extended reality space, and based on a user input (or a pre-implemented algorithm), the previously set location information may be changed or removed from the extended reality space.

[0034] These virtual objects (3) can be stored by matching object information. Accordingly, the object information can include unique information that is determined to be able to distinguish different virtual objects (3), location information where the virtual object is placed in the extended reality space, information related to the characteristics of the virtual object (e.g., whether it is fixed, movable, deformable, and interactive), information related to one or more predefined states of the virtual object (3), and information related to the current state (or changed state) of the virtual object (3).

[0035] Additionally, the virtual object (3) can have state information set to indicate the placement state and operation state of the virtual object (3) in the extended reality space.

[0036] For example, for a virtual object (3) that can be transformed into multiple appearances, information related to each of the multiple appearances can be referenced, for a virtual object (3) that can be moved in an extended reality space, information related to the location of the virtual object (3) can be referenced, and information related to the blinking state (or creation state and extinction state) of the virtual object (3) in the extended reality space can be referenced.

[0037] Accordingly, the virtual object (3) is placed in an initial state predetermined according to state information in the extended reality space, and the state information can be changed to be switched to another state (3a) based on interaction according to user input and at least one of the pre-implemented algorithms.

[0038] Meanwhile, the viewport (2) is a screen provided through an output module (e.g., a display) according to the real-time location of the user terminal in the extended reality space, and may refer to a screen displayed through the display of the user terminal.

[0039] According to an embodiment, the viewport (2) may include, for a user terminal of a video-through type (e.g., a tablet), a real image scene input through a real camera mounted on the user terminal, and a virtual scene (e.g., a virtual object and an avatar) augmented with the real image scene, for a user terminal of a see-through type (e.g., a Hololens, a transparent glasses type), a real scene shown through a see-through display, and a virtual scene (e.g., a virtual object and an avatar) augmented with the real scene, and for a user terminal of an immersive type (e.g., a VR, a Meta quest, etc.), a scene in which a virtual extended reality space unrelated to a camera input is displayed.

[0040] At this time, the location information may include the coordinates and direction of the avatar rendered when the user terminal (1) accesses the extended reality space. That is, the user's location information may mean the coordinates and direction of the avatar rendered when the user accesses the extended reality space through the user terminal (1).

[0041] Therefore, in one embodiment, the extended reality synchronization system (100) receives the user's location information from the user terminal (1), and based on the location information, estimates the viewport area (2) of the user terminal (1) as a real-time screen visually provided to the user through the display of the user terminal at a specific location in the extended reality space.

[0042] In this regard, the extended reality space can be implemented in the form of a global content map. That is, the extended reality space can be implemented so that coordinates (e.g., location information) for each point are determined based on the global content map. Furthermore, the extended reality space implemented as a global content map can include multiple content maps. In such a case, the extended reality space can be implemented so that a space associated with each of the multiple content maps and coordinates for a specific point in each content map are determined.

[0043] Meanwhile, synchronizing the state of the virtual object (3) can be understood as providing a virtual object (3) set to the same state to multiple user terminals connected to the extended reality space by providing information related to the different state (3a) of the virtual object (3) changed by the user terminal (3) to other user terminals (4, 6) connected to the same extended reality space when the virtual object (3) in the extended reality space is changed to a different state (3a) by the user terminal (3).

[0044] To this end, referring to FIG. 2, the extended reality synchronization system (100) according to the present invention may include a communication unit (110), a storage unit (120), and a control unit (130).

[0045] The communication unit (110) can be connected to the user terminal (8) via a wireless or wired network. Accordingly, the communication unit (110) can receive location information from the user terminal (8) and status information related to the virtual object.

[0046] At this time, the communication unit (110) may receive information related to the user terminal (8) (e.g., IP address, Mac address, terminal unique identification number, etc.) in the process of receiving a series of information from the user terminal (8).

[0047] Additionally, the communication unit (110) can transmit status information related to the virtual object to the user terminal (8).

[0048] The storage unit (120) can store information and commands necessary for the operation of the extended reality synchronization system (100) according to the present invention.

[0049] For example, the storage unit (120) may store information related to the extended reality space (e.g., information related to a content map), location information, information related to virtual objects, and status information related to virtual objects.

[0050] Additionally, the storage unit (120) can store information related to a user terminal (8) connected to the extended reality space.

[0051] The control unit (130) can control the overall operation of the extended reality synchronization system (100) according to the present invention.

[0052] For example, the control unit (130) can receive location information of the user in the extended reality space from the user terminal and add the user terminal to a preset synchronization group based on the location information.

[0053] At this time, a synchronization group may be set to correspond to each of multiple virtual objects placed in the extended reality space. That is, a synchronization group may be created for each of multiple virtual objects placed in the extended reality space, and may include one or more user terminals that synchronize status information related to a specific virtual object.

[0054] Accordingly, the control unit (130) can receive status information on a specific virtual object placed in an extended reality space from a user terminal, check a synchronization group to which the user terminal is added based on the status information, and transmit the status information to other user terminals included in the synchronization group to synchronize the status of the virtual object.

[0055] Based on the configuration of the extended reality synchronization system (100) discussed above, the extended reality synchronization method will be described in more detail below.

[0056] FIG. 3 is a flowchart of an extended reality synchronization method according to the present invention. FIG. 4 is a flowchart of one embodiment of setting a synchronization group. FIG. 5 illustrates one embodiment of estimating a viewport area of ​​a user terminal. FIGS. 6 to 8 illustrate one embodiment of setting a synchronization group. FIG. 9 is a flowchart of one embodiment of synchronizing the state of a virtual object. FIG. 10 illustrates one embodiment of changing the state of a virtual object. FIGS. 11 to 12 illustrate one embodiment of synchronizing the state of a virtual object.

[0057] Referring to FIG. 3, the extended reality synchronization system (100) receives location information (e.g., coordinates and direction) of a user in an extended reality space from a user terminal (S100), and can add the user terminal to a synchronization group of a specific virtual object adjacent to the location information among a plurality of synchronization groups created in advance for each virtual object placed in the extended reality space (S200).

[0058] Referring to FIG. 4, specifically, the user terminal (8) can check the user's location information in the extended reality space and transmit the checked location information to the extended reality synchronization system (100).

[0059] At this time, the user terminal (8) can transmit (for example, transmit once) viewing angle information for the upper, lower, left, and right sides according to the type of the user terminal (8) when initially connecting to the extended reality space.

[0060] Accordingly, the extended reality synchronization system (100) receives the user's location information and viewing angle information from the user terminal (8), and based on the location information and viewing angle information, can estimate the viewport area for the extended reality space displayed on the user terminal (8) from the content map.

[0061] Referring to FIG. 5, for example, the extended reality synchronization system (100) can specify a point (11) corresponding to the location information of the user terminal in a predetermined content map (10) for the extended reality space, and estimate a viewport area (13) at the previously specified point (11) based on a direction according to the location information of the user terminal. Through this, the extended reality synchronization system (100) can specify information related to virtual objects and avatars belonging to the viewport area (13).

[0062] Additionally, the extended reality synchronization system (100) can estimate the viewport area of ​​the user terminal by processing previously acquired information based on information related to the viewport area of ​​the user terminal.

[0063] As another example, the extended reality synchronization system (100) can specify a point corresponding to the location information of the user terminal in a predetermined content map for the extended reality space, estimate a viewport area for the extended reality space from the specified point, and specify virtual objects and avatars belonging to the estimated viewport area.

[0064] In this regard, the extended reality synchronization system (100) can receive location information from the user terminal according to a predetermined time cycle and estimate the viewport area based on the received location information.

[0065] Furthermore, referring again to FIG. 4, the extended reality synchronization system (100) can specify object information for an object belonging to the previously estimated viewport area and add a user terminal to a synchronization group corresponding to the specified object information.

[0066] Specifically, the extended reality synchronization system (100) can recognize one or more objects in an estimated viewport area (or scene) based on location information received from a user terminal, and specify object information corresponding to the recognized objects.

[0067] Accordingly, the extended reality synchronization system (100) can check a synchronization group stored in accordance with the object information and add a user terminal to the checked synchronization group.

[0068] At this time, adding a user terminal to the synchronization group may mean adding information related to the user terminal to the synchronization group (e.g., a user ID logged into the user terminal, a unique identification number of the user terminal, etc.).

[0069] Referring to FIG. 6, for example, the extended reality synchronization system (100) can add the first user terminal (31) to the first synchronization group (21) corresponding to the first object (16) when the first object (16) is recognized in the estimated viewport area based on the location information received from the first user terminal (31).

[0070] In addition, the extended reality synchronization system (100) can add the second user terminal (32) to the first synchronization group (21) corresponding to the first object (16) and the third synchronization group (23) corresponding to the third object (18) when the first object (16) and the third object (18) are recognized in the estimated viewport area based on the location information received from the second user terminal (32).

[0071] In addition, the extended reality synchronization system (100) can add the third user terminal (33) to the second synchronization group (22) corresponding to the second object (17) and the third synchronization group (23) corresponding to the third object (18) when the second object (17) and the third object (18) are recognized in the estimated viewport area based on the location information received from the third user terminal (33).

[0072] As another example with reference to FIG. 7, the extended reality synchronization system (100) can add each of the plurality of user terminals (45, 46, 47, 48, 49) to the object-specific synchronization group (20) based on each of the plurality of objects (41, 42, 43, 44) recognized in the estimated viewport area of ​​each of the plurality of user terminals (45, 46, 47, 48, 49).

[0073] That is, the extended reality synchronization system (100) can recognize the first object (41) in the viewport area of ​​the first user terminal (45) and the second user terminal (46), and add the first user terminal (45) and the second user terminal (46) to the synchronization group for the first object (41).

[0074] Additionally, the extended reality synchronization system (100) can recognize a second object (42) in the viewport area of ​​a third user terminal (47) and add the third user terminal (47) to a synchronization group for the second object (42).

[0075] Additionally, the extended reality synchronization system (100) can recognize a third object (43) in the viewport area of ​​the fourth user terminal (48) and the fifth user terminal (49), and add the fourth user terminal (48) and the fifth user terminal (49) to a synchronization group for the third object (43).

[0076] At this time, if the extended reality synchronization system (100) cannot recognize a specific object (e.g., the fourth object (44)) in the viewport area of ​​any user terminal, the synchronization group corresponding to the specific object can be set to an empty group.

[0077] Referring to FIG. 8, as another example, when the extended reality synchronization system (100) recognizes the first object (51) and the third object (53) in the estimated viewport area for the user terminal (55), the system can add the user terminal (55) to the synchronization group corresponding to the first object (51) and the synchronization group corresponding to the third object (53) among the object-specific synchronization groups (20a).

[0078] Furthermore, the extended reality synchronization system (100) can remove a user terminal from the synchronization group if an object corresponding to the synchronization group to which the user terminal has been added is not recognized in the estimated viewport area for the user terminal.

[0079] For example, the extended reality synchronization system (100) may add the user terminal to a synchronization group corresponding to the first object when a first object is recognized in an estimated viewport area for the user terminal at a first time point, and may remove the user terminal from the synchronization group corresponding to the first object when the first object is not recognized in an estimated viewport area for the user terminal at a second time point later than the first time point.

[0080] As another example, the extended reality synchronization system (100) may add the user terminal to a synchronization group corresponding to the first object when a first object is recognized in an estimated viewport area for the user terminal at a first time point, and may remove the user terminal from the synchronization group corresponding to the first object when a second object and a third object are recognized in the estimated viewport area for the user terminal at a second time point later than the first time point, and may add the user terminal to a synchronization group corresponding to the second object and a synchronization group corresponding to the third object.

[0081] As another example, the extended reality synchronization system (100) may add the user terminal to a synchronization group corresponding to the specific object when a specific object is recognized in the estimated viewport area for the user terminal at a first time point, and may start counting for the user terminal added to the synchronization group corresponding to the specific object when the specific object is not recognized in the estimated viewport area for the user terminal at a second time point immediately after the first time point.

[0082] In this case, the extended reality synchronization system (100) continues to count user terminals added to a synchronization group corresponding to a specific object when a specific object is not recognized in the estimated viewport area for the user terminal over time from the second point in time, and at this time, when a specific object is recognized in the estimated viewport area for the user terminal at a specific point in time, the counted value can be initialized.

[0083] Additionally, the extended reality synchronization system (100) can remove a user terminal from a synchronization group corresponding to a specific object when the counted value reaches a predetermined value.

[0084] Referring again to FIG. 3, the extended reality synchronization system (100) receives status information on a specific virtual object placed in an extended reality space from a user terminal (S300), checks a synchronization group to which the user terminal is added based on the status information, and transmits the status information to other user terminals included in the synchronization group to synchronize the status of the virtual object (S400).

[0085] At this time, the extended reality synchronization system (100) may, according to an embodiment, preferentially transmit status information to other user terminals included in the synchronization group among a plurality of user terminals connected to the extended reality space, rather than to other user terminals not included in the synchronization group, thereby synchronizing the status of the virtual object for the plurality of user terminals.

[0086] Referring to FIG. 9, specifically, the first user terminal (8) can perform an interaction on a specific object in an extended reality space based on a user input, change the state information of the specific object according to the interaction result, and transmit the changed state information and object information on the object to the extended reality synchronization system (100).

[0087] Referring to FIG. 10, for example, a user terminal may store object information (65) including first state information (66), and render a tree-shaped object (65a) according to the first state information (66) in an extended reality space (61). That is, the first state information (66) may be determined so that a complete tree-shaped object (65a) is implemented.

[0088] Accordingly, the user terminal may interact with a tree-shaped object (65a) in the extended reality space (61) based on user input, and, based on the interaction result, transform the tree-shaped object (65a) into a tree stump-shaped object (65b) in the extended reality space (62). At this time, the second state information (67) may be determined so that the tree stump-shaped object (65b) is implemented.

[0089] That is, the user terminal can change the first state information (66) to the second state information (67) by performing an interaction on the object information (65) having the first state information (66) based on the user input to the extended reality space (61).

[0090] Next, the user terminal can transmit object information (65) and second state information (67) to the extended reality synchronization system (100) based on the fact that the first state information (66) for the tree-shaped object (65a) has been changed to second state information (67).

[0091] Through this, the extended reality synchronization system (100) can receive object information and status information from the user terminal.

[0092] For another example, a user terminal may move the location of a specific object based on user input in the augmented reality space. In this case, the user terminal may identify the location to which the specific object has moved as status information and transmit object information and previously identified status information for the specific object to the augmented reality synchronization system (100).

[0093] Furthermore, referring again to FIG. 9, the extended reality synchronization system (100) receives object information and status information from a user terminal (8), identifies a synchronization group corresponding to the object information, and transmits the object information and status information to one or more user terminals included in the identified synchronization group, thereby synchronizing one or more user terminals included in the synchronization group.

[0094] Referring to FIG. 11, for example, the extended reality synchronization system (100) can receive object information (70) and status information (71) from a user terminal, and identify a synchronization group (80) corresponding to the object information (70). At this time, the synchronization group (80) can include one or more user terminals (81, 82, 83) in which an object corresponding to the object information (70) is recognized in the viewport area of ​​each of a plurality of user terminals estimated by the extended reality synchronization system (100).

[0095] Accordingly, referring to FIG. 12, when the state information of a specific object changes according to a user input in the extended reality space (81a), the first user terminal (81) can transmit object information and state information for the object to the extended reality synchronization system (100).

[0096] Accordingly, the extended reality synchronization system (100) can receive object information and status information from a first user terminal (81), check a synchronization group (80) corresponding to the object information, and transmit the object information and status information to a second user terminal (82) and a third user terminal (83) included in the synchronization group (80).

[0097] Through this, the second user terminal (82) and the third user terminal (83) can receive object information and status information from the extended reality synchronization system (100), and change the status information of an object corresponding to the previously received object information among objects implemented in the extended reality space to the received status information.

[0098] In this way, the extended reality synchronization system (100) can synchronize the extended reality space implemented in multiple user terminals by transmitting changed status information from the first user terminal (81) to the second user terminal (82) and the third user terminal (83).

[0099] Furthermore, the extended reality synchronization system (100) can sequentially perform synchronization for other user terminals connected to the extended reality space after synchronization for one or more user terminals included in a synchronization group corresponding to a specific object is completed.

[0100] Through the above configurations, the extended reality synchronization system (100) can efficiently synchronize the states of each object placed in the extended reality space by recognizing an object in the viewport area of ​​the user terminal estimated based on the user's location and generating a synchronization group for each object placed in the extended reality space.

[0101] Through the above configurations, the extended reality synchronization system (100) can reduce network traffic due to synchronization in the extended reality space by preferentially synchronizing a specific user terminal based on a synchronization group set for a specific object during a synchronization process in the extended reality space where multiple user terminals are connected, thereby reducing end-to-end synchronization delay time and saving battery of the user terminal due to the reduced network traffic.

[0102] Furthermore, the present invention discussed above can be implemented as a program executed by one or more processes in an electronic device and stored in a computer-readable recording medium.

[0103] Accordingly, the present invention can be implemented as computer-readable code or instructions on a program-recorded medium. That is, the various control methods according to the present invention can be provided in the form of integrated or individual programs.

[0104] Meanwhile, computer-readable media include all types of recording devices that store data that can be read by a computer system. Examples of computer-readable media include hard disk drives (HDDs), solid-state disk drives (SSDs), silicon disk drives (SDDs), ROMs, RAMs, CD-ROMs, magnetic tapes, floppy disks, and optical data storage devices.

[0105] Furthermore, the computer-readable medium may include a storage device and may be a server or cloud storage device accessible via communication. In this case, the computer may download the program according to the present invention from the server or cloud storage device via wired or wireless communication.

[0106] Furthermore, in the present invention, the computer described above is an electronic device equipped with a processor, i.e., a CPU (Central Processing Unit), and there is no particular limitation on its type.

[0107] Meanwhile, the detailed description above should not be construed as limiting in any respect and should be considered illustrative. The scope of the present invention should be determined by a reasonable interpretation of the appended claims, and all modifications within the equivalent scope of the present invention are intended to be included within the scope of the present invention.

Claims

1. A step of receiving user location information in an extended reality space from a user terminal; A step of adding the user terminal to a synchronization group of a specific virtual object adjacent to the location information among a plurality of synchronization groups pre-created for each virtual object placed in the extended reality space; A step of receiving object information and status information about the specific virtual object from the user terminal; and An extended reality synchronization method, comprising the step of confirming the synchronization group to which the user terminal is added based on the object information, and transmitting the status information to other user terminals included in the synchronization group to synchronize the status of the virtual object.

2. In the first paragraph, the step of synchronizing the state of the virtual object is: An extended reality synchronization method, wherein, among a plurality of user terminals connected to the extended reality space, status information is transmitted preferentially to other user terminals included in the synchronization group rather than to other user terminals not included in the synchronization group, thereby synchronizing the status of the virtual object for the plurality of user terminals.

3. In the first paragraph, the step of receiving the user's location information is: An extended reality synchronization method for receiving, when the user terminal is initially connected to an extended reality space, information on the viewing angles for the upper, lower, left, and right sides according to the type of the user terminal, together with the location information.

4. In the third paragraph, the step of adding the user terminal to the synchronization group is: A step of estimating a viewport area displayed on the user terminal based on the above location information and the above viewing angle information; A step of recognizing the specific virtual object included in the estimated viewport area and confirming the object information for the recognized specific virtual object; and An extended reality synchronization method, comprising the step of adding the user terminal to the synchronization group corresponding to the extracted object information.

5. In the fourth paragraph, the step of estimating the viewport area displayed on the user terminal is as follows: A step of specifying a point corresponding to the location information in a predefined content map for the extended reality space; and An extended reality synchronization method, comprising a step of estimating a viewport area corresponding to the viewport area at the specified point based on a direction according to the location information.

6. In the fourth paragraph, the step of estimating the viewport area displayed on the user terminal is as follows: An extended reality synchronization method, which receives location information from the user terminal according to a predetermined time cycle and estimates a viewport area based on the received location information.

7. In the first paragraph, the synchronization group is, An extended reality synchronization method, comprising at least one user terminal, among a plurality of user terminals connected to the extended reality space, in which an object corresponding to the specific object information is recognized in a viewport area of ​​each of the plurality of user terminals.

8. In the first paragraph, the status information is, An extended reality synchronization method, wherein an interaction with a specific object in the extended reality space is performed based on a user input from the user terminal, and the state of the specific virtual object changed according to the result of the interaction is displayed.

9. A communication unit that receives the user's location information in the extended reality space from the user terminal; and A control unit is included for adding the user terminal to a synchronization group of a specific virtual object adjacent to the location information among a plurality of synchronization groups pre-created for each virtual object placed in the extended reality space, The above communication department, Receive object information and status information about the specific virtual object from the user terminal, The above control unit, An extended reality synchronization system that confirms the synchronization group to which the user terminal is added based on the object information and synchronizes the status of the virtual object by transmitting the status information to other user terminals included in the synchronization group.

10. A program that is executed by one or more processes in an electronic device and stored in a computer-readable recording medium, The above program is, A step of receiving user location information in an extended reality space from a user terminal; A step of adding the user terminal to a synchronization group of a specific virtual object adjacent to the location information among a plurality of synchronization groups pre-created for each virtual object placed in the extended reality space; A step of receiving object information and status information about the specific virtual object from the user terminal; and A program stored on a computer-readable recording medium, characterized in that it includes commands for performing a step of checking the synchronization group to which the user terminal is added based on the object information and transmitting the status information to other user terminals included in the synchronization group to synchronize the status of the virtual object.

Images