Extended reality content creation method and system

The extended reality content authoring method and system address compatibility issues by using a common framework and unit content, simplifying the development process and enabling diverse content creation across various devices and environments.

WO2025110372A1PCT designated stage expired Publication Date: 2025-05-30KOREA INST OF SCI & TECH INFORMATION
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/KR2024/005470
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-11-20
Filing Date
2024-04-23
Publication Date
2025-05-30

AI Technical Summary

Technical Problem

Existing extended reality content development faces challenges in ensuring compatibility across various extended reality implementation devices, requiring complex solutions for rendering, network operations, and user interactions.

Method used

A method and system for authoring extended reality content that utilizes a common framework and unit content, allowing for the creation of extended reality content that can be executed in various environments by separating functional elements and target elements.

Benefits of technology

This approach significantly reduces the complexity and time required for developing extended reality content, enabling easy adaptation to different devices and environments, and allowing users without specialized skills to create diverse extended reality content.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure KR2024005470_30052025_PF_FP_ABST
    Figure KR2024005470_30052025_PF_FP_ABST
Patent Text Reader

Abstract

The present invention provides an extended reality (XR) content creation method for: by using studio creation tools, creating unit content comprising an object and a scene in XR content; by using a builder, building a common framework pre-compiled into a program executable on a preset device; and connecting the unit content to the common framework on the basis of the execution of the pre-compiled common framework.
Need to check novelty before this filing date? Find Prior Art

Description

Method and system for authoring extended reality content

[0001] The present invention relates to a method and system for authoring extended reality content.

[0002] Recently, interest in extended reality, which encompasses virtual reality (VR), augmented reality (AR), and mixed reality (MR), has been increasing, and accordingly, contents that provide extended reality spaces with various purposes are being developed.

[0003] In order to provide such extended reality content, solutions are required for various matters related to implementing extended reality content, such as rendering techniques for various extended reality implementation devices, network and server operation techniques, and interaction techniques between users or between users and objects.

[0004] For example, in the case of extended reality content developed with a specific extended reality implementation device in mind, it may not be possible to run it on another extended reality implementation device. To solve this problem, compatibility with each of the various extended reality implementation devices must be considered during the development process of the extended reality content.

[0005] Meanwhile, the present invention was derived as part of the national research and development project 'Development of Untact Realistic OpenXR Platform Technology' (Project Unique Number: 1711177182, Project Number: CRC21011, Ministry Name: Ministry of Science and ICT, Project Management (Specialized) Agency Name: National Research Council of Science and Technology, Research Project Name: National Research Council of Science and Technology Research Operational Expenses Support (Main Project Expenses), Research Project Name: Development of Untact Realistic OpenXR Platform Technology, Contribution Rate: 1 / 1, Project Implementing Agency Name: Korea Institute of Science and Technology Information, Research Period: 2021.12.01 ~ 2027.11.30).

[0006] The present invention relates to an efficient extended reality content creation method and system that enables a user to easily become a content producer.

[0007] In addition, the present invention relates to an extended reality content authoring method and system for authoring extended reality content by connecting a common framework and unit content.

[0008] To solve the challenges discussed above, we build a common framework of common functional elements that can be used in different services, and build an extended reality content pipeline that creates unit content corresponding to each service.

[0009] More specifically, the method for authoring extended reality content according to the present invention may include the steps of authoring unit content composed of objects and scenes in extended reality (XR) content using a studio authoring tool; constructing a common framework that is pre-compiled into a program executable on a preset device using a builder; and connecting the unit content to the common framework based on execution of the pre-compiled common framework to author the extended reality content.

[0010] In addition, a program stored in a computer-readable recording medium according to the present invention is a program stored in a computer-readable recording medium, which is executed by one or more processes in an electronic device, and which may include instructions for performing the steps of: using a studio authoring tool to create unit content composed of objects and scenes in extended reality content; using a builder to build a common framework that is pre-compiled into a program executable in a preset device; and, based on execution of the pre-compiled common framework to create the extended reality content, connecting the unit content to the common framework.

[0011] According to various embodiments of the present invention, a method and system for authoring extended reality content can effectively shorten the development process for implementing extended reality content through a user terminal by constructing common functional elements that can be used in different services as a common framework and authoring unit content corresponding to individual services based on the common framework, thereby facilitating the development of more diverse individual services.

[0012] In addition, according to various embodiments of the present invention, the method and system for authoring extended reality content can author extended reality content that can be executed in various execution environments by authoring functional elements related to various environments in which extended reality content is implemented into a common framework, thereby drastically reducing the difficulty of developing extended reality content.

[0013] In addition, according to various embodiments of the present invention, the method and system for authoring extended reality content authorizes extended reality content by connecting unit content with a common framework, thereby making it easy to link unit content authored in different ways to the same common framework, and thereby easily authoring extended reality content having various styles.

[0014] Figures 1 and 2 illustrate one embodiment of extended reality content according to the present invention.

[0015] Figure 3 illustrates an extended reality content authoring system according to the present invention.

[0016] Figure 4 is a flowchart of an extended reality content creation method according to the present invention.

[0017] Figures 5 to 8 illustrate one embodiment of unit content.

[0018] Figure 9 illustrates one embodiment of functional elements included in the common framework.

[0019] Figures 10 and 11 illustrate one embodiment in which a common framework and unit content are connected.

[0020] Figure 12 illustrates one embodiment of a process in which extended reality content is executed.

[0021] Hereinafter, embodiments disclosed in this specification will be described in detail with reference to the attached drawings. Regardless of the drawing numbers, identical or similar components will be given the same reference numbers, and redundant descriptions thereof will be omitted. The suffixes "module" and "part" used for components in the following description are assigned or used interchangeably only for the convenience of writing the specification, and do not in themselves have distinct meanings or roles. In addition, when describing the embodiments disclosed in this specification, if it is determined that a specific description of a related known technology may obscure the gist of the embodiments disclosed in this specification, a detailed description thereof will be omitted. In addition, the attached drawings are only intended to facilitate easy understanding of the embodiments disclosed in this specification, and the technical ideas disclosed in this specification are not limited by the attached drawings, and should be understood to include all modifications, equivalents, and substitutes included in the spirit and technical scope of the present invention.

[0022] Terms that include ordinal numbers, such as first, second, etc., may be used to describe various components, but the components are not limited by these terms. These terms are used solely to distinguish one component from another.

[0023] When a component is referred to as being "connected" or "connected" to another component, it should be understood that it may be directly connected or connected to that other component, but that there may be other components intervening. Conversely, when a component is referred to as being "directly connected" or "connected" to another component, it should be understood that there are no other components intervening.

[0024] Singular expressions include plural expressions unless the context clearly indicates otherwise.

[0025] In this application, terms such as “include” or “have” are intended to specify the presence of a feature, number, step, operation, component, part or combination thereof described in the specification, but should be understood not to exclude in advance the possibility of the presence or addition of one or more other features, numbers, steps, operations, components, parts or combinations thereof.

[0026] Figures 1 and 2 illustrate one embodiment of extended reality content according to the present invention. Figure 3 illustrates an extended reality content authoring system according to the present invention.

[0027] Referring to FIG. 1, the extended reality content authoring system according to the present invention builds a common framework (Framework) (1) that is pre-compiled into an executable program on a preset device using a builder, and can author unit content consisting of objects and scenes in extended reality (XR) content using a studio authoring tool.

[0028] Here, the extended reality content may include a scene (e.g., a virtual space) based on extended reality, virtual reality (VR), augmented reality (AR), and mixed reality (MR), and one or more objects placed in the scene.

[0029] Accordingly, the extended reality content can be implemented to run through a user terminal to render a scene and one or more objects, and perform predetermined interactions based on user input for the objects.

[0030] For example, if the extended reality content is implemented to perform communication between multiple users, it may be implemented as an object to implement an avatar for a user who has accessed the extended reality content through a user terminal in a scene, and as an example of interaction, it may be implemented to transmit a message to a user terminal of another user based on a user input for the avatar of the other user, or to perform a voice call or video call.

[0031] As another example, if the extended reality content is implemented to assist the user's health status, it may be implemented as an object, implementing a plurality of objects with different shapes in a scene, and as an example of interaction, calculating a score for the user's health status based on a user input for any one of the plurality of objects.

[0032] As another example, if the extended reality content is implemented to perform training for a specific user, it may be implemented as an object, implementing one or more objects necessary for training in a scene, and as an example of interaction, it may be implemented to perform shape transformation, position movement, rotation, etc. of the object according to a predetermined algorithm based on user input for one or more objects.

[0033] As another example, if the extended reality content is implemented to place furniture in a predetermined area, it may be implemented as an object, one or more pieces of furniture to be placed in the predetermined area, and as an example of interaction, it may be implemented to provide information such as dimensions for the predetermined area in the virtual space based on user input for the area, and place the furniture in the predetermined area based on user input for the furniture.

[0034] Such extended reality content may be implemented to be provided through user terminals such as tablets, personal computers, smartphones, and wearable devices, and for example, the extended reality content may be provided in the form of an application or software, or may be provided on a web page.

[0035] At this time, the user terminal may be referred to as a tablet, personal computer, smartphone, wearable device, etc., and may be connected to a device capable of outputting a scene implemented as a virtual reality space, an augmented reality space, a mixed reality space, or an extended reality space, etc., so as to provide a scene according to the extended reality content.

[0036] Additionally, the user terminal may be a device that provides virtual reality, augmented reality, mixed reality, or extended reality. For example, the user terminal may be a head-mounted display (HMD), but this is merely an example, and other types of devices may also be possible.

[0037] Meanwhile, a common framework may be implemented as a framework app, containing common functional elements that can be used across different services. In this case, the functional elements may be elements commonly included across multiple extended reality content within the same service area.

[0038] That is, the functional element is a kind of template for extended reality content, and according to an embodiment, may include information for rendering extended reality content to a user terminal, information for recognizing user input in the extended reality content, information for placing an object in a scene of the extended reality content, and information for executing interaction with an object based on user input.

[0039] Accordingly, a functional element is implemented in the form of a function that executes a specific interaction or performs a specific function, and may include properties for resources such as textures, strings, and animations, and a resource database (Resource DB) in which commonly used resources are stored.

[0040] In addition, the functional elements may contain various information required to implement different extended reality contents.

[0041] For example, the functional element may include an element for rendering extended reality content according to the type (3) of virtual reality environment supported by the user terminal (e.g., virtual reality environment, augmented reality environment, mixed reality environment, and extended reality environment), and an element for processing network and data according to the connection type (4) of the extended reality content.

[0042] At this time, the connection type (4) of the extended reality content may include a 1:1 handshaking type of a speaker-receiver relationship, a broadcasting type of a 1:many relationship, and a multicasting type of a many:many relationship.

[0043] For another example, if the extended reality content is implemented to enable communication between multiple users, the functional element may include a functional element for creating a chat room, a functional element for providing voice calls between users participating in the chat room, and a functional element for providing information related to users participating in the chat room.

[0044] As another example, the functional element may include a functional element for determining a score related to the user's health condition when the extended reality content is implemented to assist the user's health condition, a functional element for recognizing user input through an object implemented in a virtual space, and a functional element for performing shape transformation, position movement, and rotation of an object implemented in a virtual space based on the user input.

[0045] As another example, when the extended reality content is implemented to perform education targeting a specific user, the functional element may include a functional element for providing the user with information related to an object implemented in a virtual space, a functional element for performing shape transformation, position movement, and rotation of the object according to a predetermined algorithm, and a functional element for controlling the speed of state change of the object in the virtual space.

[0046] As another example, the functional element may include a functional element for designating an area in a virtual space, a functional element for placing one or more pieces of furniture in a pre-designated area, a functional element for displaying one or more pieces of furniture that can be placed in a pre-designated area, and a functional element for transforming the shape, position, and phase of the furniture, if the extended reality content is implemented to place furniture in a pre-designated area.

[0047] The above functional elements can be implemented in the form of a common framework (1) executable on a user terminal. That is, the common framework (1) may be a type of extended reality content that only includes functional elements. Through this, a user can implement an extended reality-based scene using the functional elements included in the common framework (1).

[0048] In this regard, the builder may be implemented to build a common framework. That is, the builder can author functional elements that can be used in different services as extended reality content, and perform pre-compilation of the functional elements to build the common framework.

[0049] Meanwhile, an object may be an element implemented so that the user can recognize it based on the functional elements included in the common framework (1).

[0050] That is, an object is an element implemented using a common framework (1) that includes functional elements, and, depending on the embodiment, may include information related to interactions executed in response to user input, information related to the shape and position of an object displayed through a user terminal, and information related to a background image of a virtual space.

[0051] Therefore, the object is implemented in the form of a callback function that calls a functional element included in the common framework (1), and may include a function that defines external resources such as textures, strings, and animations.

[0052] In addition, the object may include various information implemented to enable the user to experience extended reality content through the user terminal.

[0053] For example, if the object is implemented to enable communication between multiple users through extended reality content, the object may include elements for distinguishing chat rooms created by other users, elements for distinguishing multiple users participating in the chat room, and elements related to the location where information related to other users is displayed through the user terminal.

[0054] For another example, if the object is implemented to assist the user's health status with augmented reality content, the object may include elements related to the location where the score calculated in relation to the user's health status is displayed, and elements related to the shape and location of an object implemented in virtual space to recognize user input.

[0055] As another example, if the extended reality content is implemented to perform training for a specific user, the object may include elements related to the initial shape, state, and position of the object implemented in the virtual space, and elements related to the next shape, state, and position of the object upon which interaction is executed based on user input.

[0056] For another example, if the extended reality content is implemented to place furniture in a predetermined area, the object may include an element for displaying a predetermined area in the virtual space, an element for displaying an area within the predetermined area where a specific piece of furniture can be placed, and an element related to the shape of one or more predetermined pieces of furniture.

[0057] The above objects can be implemented in the form of unit content (2) based on a common framework (1). That is, the unit content (2) includes information related to one or more objects for extended reality content, and can be authored to include objects and scenes corresponding to each individual service for different services.

[0058] In this regard, the studio authoring tool may be implemented to author unit content (2) by composing objects and scenes implemented in extended reality content. That is, the studio authoring tool can author unit content by creating objects and scenes in extended reality content based on a common framework.

[0059] Accordingly, the extended reality content authoring system can author extended reality content by loading unit content (2) into a common framework (1), and can easily implement different extended reality contents by loading each unit content (2) containing different objects into the same common framework (1).

[0060] At this time, the extended reality content created by the extended reality content creation system can be named a domain framework consisting of a common framework (1) and unit content (2), and this domain framework can be expanded into a comprehensive framework in which common functional elements that can be commonly applied in a specific service field and different unit contents are installed.

[0061] In an embodiment, when the extended reality content includes UI, Object, Space, Interaction and Device Control, the functional elements and objects may each include at least one of the components included in the extended reality content.

[0062] The components included in these functional elements and objects may vary depending on the service field or service purpose of the extended reality content.

[0063] In another embodiment, the functional elements of the extended reality content may be implemented in the form of functions that perform specific functions, and the objects may be implemented as code in the form of callback functions that call functions according to the functional elements included in the common framework.

[0064] Accordingly, referring to (a) of FIG. 2, the extended reality content authoring system can author extended reality content by loading unit content (2a) implemented based on each common framework (1a) into different common frameworks (1a) implemented for each service field.

[0065] At this time, each common framework (1a) can be implemented based on the operating system (or Infrastructure (5a)) installed on the user terminal.

[0066] In addition, referring to (b) of FIG. 2, the extended reality content authoring system can author different extended reality contents based on a single common framework (1b) by loading different unit contents (2b) implemented based on the same common framework (1b) onto the common framework (1b).

[0067] At this time, the common framework (1b) can be implemented based on the operating system (or Infrastructure (5b)) installed on the user terminal.

[0068] Through the above configurations, the extended reality content authoring system according to the present invention authorizes an object based on a common framework (1) implemented to author extended reality content, and loads unit content (2) including the authored object into the framework (1), thereby authoring extended reality content.

[0069] To this end, the extended reality content authoring system (100) according to the present invention may include a communication unit (110), an input unit (120), a control unit (130), an output unit (140), and a storage unit (150).

[0070] The communication unit (110) can be connected to any external device via a wired or wireless network. Accordingly, the communication unit (110) can receive a common framework from an external device (e.g., a management server, etc.).

[0071] Additionally, the communication unit (110) may transmit the created extended reality content to an external device (e.g., another user terminal) or receive unit content (or object) created in the external device.

[0072] The input unit (120) can recognize user input for the extended reality content authoring system (100). For example, the input unit (120) can recognize user input for creating an object (or functional element).

[0073] The storage unit (130) can store various information and commands required for the operation of the extended reality content authoring system (100) according to the present invention. For example, the storage unit (130) can store common frameworks and unit content. In other words, the storage unit (130) can store functional elements and objects.

[0074] The control unit (140) can control the overall operation of the extended reality content creation system (100) according to the present invention. For example, the control unit (140) can create unit content (or objects) based on a common framework based on user input.

[0075] Additionally, the control unit (140) can create extended reality content by loading unit content (or objects) into a common framework. To this end, the control unit (140) can compile unit content based on the common framework.

[0076] Additionally, the control unit (140) can generate functional elements based on user input and author a common framework.

[0077] The output unit (150) can display extended reality content for the user to confirm. In addition, the output unit (150) can display information generated during the process of creating at least one of the functional elements and objects.

[0078] Based on the configuration of the extended reality content authoring system (100) discussed above, the extended reality content authoring method will be described in more detail below.

[0079] Figure 4 is a flowchart of a method for authoring extended reality content according to the present invention. Figures 5 to 8 illustrate one embodiment of unit content. Figure 9 illustrates one embodiment of functional elements included in a common framework. Figures 10 and 11 illustrate one embodiment of connecting a common framework and unit content. Figure 12 illustrates one embodiment of a process for executing extended reality content.

[0080] First, a new pipeline for authoring extended reality content proposed in the present invention is described with reference to FIG. 4.

[0081] The above pipeline consists of a process of building common functional elements that can be used in different services into a common framework, authoring unit content corresponding to each service, and connecting the common framework and unit content.

[0082] To this end, the extended reality content authoring system (100) according to the present invention can author unit content composed of objects and scenes in extended reality content using a studio authoring tool (S100).

[0083] Specifically, the extended reality content authoring system (100) can load objects into the studio authoring tool based on the execution of the studio authoring tool and place the objects in a scene based on user input.

[0084] For example, the extended reality content authoring system (100) can author a collaborative context interaction by specifying the properties or multimodality of objects related to collaboration based on a common framework built to provide services related to collaboration.

[0085] In this regard, the present invention can be utilized as an extended reality content authoring model centered on the purpose of a collaborative service that enables efficient content authoring by distinguishing collaborative function elements and target elements in extended reality.

[0086] For example, when collaborative participants directly author content used in collaboration, it is not easy to provide an easy authoring environment because authoring extended reality content requires a lot of specialized knowledge and skills.

[0087] However, the authoring model according to the present invention separates functional elements (e.g., common framework) and target elements (e.g., unit content), thereby enabling an authoring environment in which even collaborative participants without professional content authoring skills can easily participate as collaborative content producers in extended reality collaborative services that include complex functional elements.

[0088] Meanwhile, multimodality may define at least one of the input method and output method for extended reality content. That is, multimodality refers to at least one of various input methods and output methods, and according to an embodiment, multimodality may refer to a positional input method using a mouse, touch pad, etc., a voice input method using a microphone, etc., a text input method using a keyboard, etc., a voice output method using a speaker, etc., a tactile output method using a haptic device, etc., and a visual output method using a monitor, TV, etc.

[0089] In addition, the extended reality content authoring system (100) can author collaborative context interactions by specifying properties or multimodality of objects related to various services, such as architecture-related services, education-related services, interior-related services, and entertainment-related services, in addition to collaboration-related services.

[0090] As another example with reference to FIG. 5, the extended reality content authoring system (100) can author unit content that stacks blocks (63) according to example images (62) by placing avatars (61), example images (62), and blocks (63) in a scene (60) created by a studio authoring tool.

[0091] In this case, the extended reality content authoring system (100) can utilize functional elements related to manipulation of an avatar (61) and functional elements related to object properties for example images (62) and blocks (63) based on a common framework.

[0092] In addition, the extended reality content authoring system (100) can author unit content by using a studio authoring tool to specify the location and shape of an avatar (61), specify the location, size, and image file of an example image (62), and specify the shape, location, and interaction method of a block (63).

[0093] As another example with reference to FIG. 6, the extended reality content authoring system (100) can author unit content that provides education on the configuration and function of the learning object (72) by manipulating the information confirmation window (73) by placing an avatar (71), a learning object (72), and an information confirmation window (73) in a scene (70) created by a studio authoring tool.

[0094] In this case, the extended reality content authoring system (100) can utilize functional elements related to manipulation of an avatar (71) and functional elements related to object properties for a learning object (72) and an information confirmation window (73) based on a common framework.

[0095] In addition, the extended reality content authoring system (100) can author unit content by using a studio authoring tool to specify the location and shape of an avatar (71), specify the location, size, and animation motion of a learning object (62), and specify the shape, location, image, string, and interaction method of an information confirmation window (73).

[0096] Referring to FIG. 7, as another example, the extended reality content authoring system (100) can author unit content that changes the image of the answer confirmation window (82) to the same form as the image displayed in the problem confirmation window (81) by manipulating the interaction menu (83) by placing a question confirmation window (81), an answer confirmation window (82), an interaction menu (83), and a score confirmation window (84) in a scene (80) created by a studio authoring tool.

[0097] In this case, the extended reality content authoring system (100) can utilize functional elements related to operations on the interaction menu (83) and functional elements related to object properties for the problem confirmation window (81), the answer confirmation window (82), the interaction menu (83), and the score confirmation window (84) based on a common framework.

[0098] In addition, the extended reality content authoring system (100) can author unit content by using a studio authoring tool to specify the location, shape, and image file of a question confirmation window (81), specify the location, size, image file, and animation action of an answer confirmation window (82), specify the shape, position, string, and interaction method of an interaction menu (83), and specify the location, size, image file, and animation action of a score confirmation window (84).

[0099] Furthermore, the extended reality content authoring system (100) can author story content that configures scene transitions by placing objects in multiple scenes and specifying relationships between the multiple scenes in which the objects are placed.

[0100] Referring to FIG. 8, for example, the extended reality content authoring system (100) can author unit content that places a scene movement menu (91), a furniture object (92), a furniture information window (93), and a mission confirmation window (94) in a plurality of scenes (90) created by a studio authoring tool, thereby placing a predetermined furniture object (92) in each of the plurality of scenes (90) and providing a furniture information window (93) related to the placed furniture object (92).

[0101] In this case, the extended reality content authoring system (100) can utilize functional elements related to transitions to multiple scenes (90) according to a scene movement menu (91), functional elements related to operations on a scene movement menu (91), a furniture object (92), a furniture information window (93), and a mission confirmation window (94), and functional elements related to object properties based on a common framework.

[0102] In addition, the extended reality content authoring system (100) can author unit content by using a studio authoring tool to specify the location, shape, string, and interaction method of a scene movement menu (91), specify the location, shape, texture image, and interaction method of a furniture object (92), specify the location, shape, and string of a furniture information window (93), and specify the location, shape, and interaction method of a mission confirmation window (94).

[0103] Furthermore, the extended reality content authoring system (100) according to the present invention can build a common framework that is pre-compiled into a program executable on a preset device using a builder (S200).

[0104] Specifically, the extended reality content authoring system (100) can author functional elements that can be used in different services based on user input.

[0105] For example, the extended reality content authoring system (100) can author functional elements related to at least one of data linkage, avatar synchronization, and collaboration space synchronization through a builder.

[0106] As another example with reference to FIG. 9, the extended reality content authoring system (100) can author functional elements related to at least one of a host menu (51), an avatar selection menu (52), and an object property (53) through a builder.

[0107] At this time, the extended reality content authoring system (100) may author sub-function elements (or detailed function elements) related to each function element through the builder. That is, the extended reality content authoring system (100) may author a function element related to at least one of member list check, space reference reset, microphone on / off, asset sharing, and exit as a sub-function element for the function element related to the host menu (51), and may author a function element related to at least one of export and host delegation as a sub-function element for the function element related to the avatar selection menu (52).

[0108] In addition, the extended reality content authoring system (100) may author sub-function elements for sub-function elements, such as member search, invitation, export, and host delegation, which are sub-function elements for member list confirmation.

[0109] Furthermore, the extended reality content authoring system (100) can build a common framework as a program executable on a preset device by performing pre-compilation on previously authored functional elements using a builder.

[0110] The extended reality content authoring system (100) according to the present invention can connect unit content to a common framework based on the execution of a pre-compiled common framework to author extended reality content (S300).

[0111] Specifically, the extended reality content authoring system (100) authores unit content using a studio authoring tool, compiles the unit content into code and resource parts through a unit compiler, and connects it to a common framework.

[0112] Referring to FIG. 10, for example, the extended reality content authoring system (100) can implement the code (17) of the unit content (16) as a callback function that can be connected to the functional element (27) of the common framework (26) using a studio authoring tool, and convert the code (17) of the unit content (16) into a dynamic program element (31) (or dynamic functional element) through compilation (30) of the unit content (16).

[0113] At this time, the extended reality content authoring system (100) can convert the resource (18) of the unit content (16) into an object (32) that can be dynamically referenced through the resource database (28) of the common framework (26).

[0114] As another example, referring to FIG. 11, the extended reality content authoring system (100) can build a common framework (21) including functional elements (22) related to extended reality content using a builder (20) (e.g., UIIX Builder).

[0115] In addition, the extended reality content authoring system (100) can load at least one of the scenes and objects (12) authored using various digital content authoring tools (Digital Content Creation Tools) using a studio authoring tool (10) (e.g., UIIX Studio).

[0116] To this end, at least one of the scenes and objects (12) may be authored based on a common framework (22), or may be converted to be compatible with the common framework (22) through a studio authoring tool (10).

[0117] Accordingly, the extended reality content authoring system (100) can author unit content (11) (e.g., XR3C Unit) by placing an object (12) in an arbitrary scene through a studio authoring tool (10).

[0118] Next, the extended reality content authoring system (100) can link (or load) the unit content (11) to the common framework (21) through compilation of the unit content (11). At this time, the extended reality content authoring system (100) can convert at least one of the scene and object (12) to be compatible with the common framework (22).

[0119] Furthermore, the extended reality content authoring system (100) can generate an extended reality application that is loaded on a specific device and executes extended reality content by using a common framework and unit content connected through compilation.

[0120] For example, the extended reality content authoring system (100) can create an extended reality application for each specific service by connecting unit content corresponding to a specific service to a common framework in a builder (or studio authoring tool).

[0121] As another example, the extended reality content authoring system (100) can create a common framework as a common application in a builder (or studio authoring tool), and as unit content corresponding to a specific service is loaded into the common application, an extended reality application can be created to provide the corresponding service.

[0122] Meanwhile, referring to FIG. 12, one embodiment of a process in which extended reality content created to provide services related to collaborative meetings is executed can be confirmed.

[0123] In some embodiments, the extended reality content may be loaded (or executed) based on the operation of the extended reality application, at least one of the functional elements included in the common framework and the objects included in the unit content.

[0124] For example, operations such as launching (App Start), terminating (App End), user logging in (Login), and loading assets (or objects) (Load Assets) of an extended reality application can be executed by functional elements included in a common framework, and operations such as setting a host location (Select Host Location) and anchoring the host's location space and the virtual space of the extended reality content (Anchoring) can be implemented by executing a callback function that calls a specific functional element by an object of the unit content.

[0125] Through the above configurations, the extended reality content authoring system (100) according to the present invention can effectively shorten the development process for implementing extended reality content through a user terminal by constructing common functional elements that can be used in different services as a common framework and authoring unit content corresponding to individual services based on the common framework, and can easily develop more diverse individual services.

[0126] In particular, the extended reality content authoring system (100) according to the present invention can author extended reality content that can be executed in various execution environments by authoring functional elements related to various environments in which extended reality content is implemented using a common framework, thereby drastically reducing the difficulty of developing extended reality content.

[0127] In addition, the extended reality content authoring system (100) according to the present invention authorizes extended reality content by connecting a common framework and unit content, thereby making it easy to link unit content authored in different ways to the same common framework, and thereby making it easy to author extended reality content having various styles.

[0128] As a more specific example, referring to FIG. 13, a pipeline according to one embodiment of an extended reality content authoring system (100) can be confirmed.

[0129] According to this, the extended reality content authoring system (100) can build a common framework based on a builder based on user input by a developer.

[0130] At this time, the builder can be implemented to provide a development environment in which a common framework can be built and the built common framework can be built into a client app. In other words, the builder can be implemented to build a common framework that includes various functional elements, such as a menu UX (User eXperience) / UI (User Interface) component, a multi-platform builder component, and a multi-player networking component.

[0131] Meanwhile, the extended reality content authoring system (100) can build unit content based on a studio authoring tool based on user input by a content author.

[0132] At this time, the studio authoring tool can be implemented to provide an authoring environment that can generate unit content and convert the generated unit content into content files that can be loaded into a client app. In other words, the studio authoring tool can be implemented to generate unit content that includes various target elements such as home screens, scene compositions, objects and assets, properties corresponding to objects and assets, animations, and events.

[0133] In this regard, the extended reality content authoring system (100) may be linked to a platform service that enables sharing of content files converted from various unit contents. Accordingly, the extended reality content authoring system (100) may, based on user input by a content author, add a specific project shared in the platform service as a target element to the unit contents, or upload at least some of the target elements included in the authored unit contents to the platform service and share them with other content authors.

[0134] In addition, the extended reality content authoring system (100) can be implemented so that service users can download various content units and execute them by loading them into a client app by uploading content files converted from unit content to a platform service.

[0135] That is, the extended reality content authoring system (100) can execute content by loading a content file downloaded from a platform service into a client app (or common framework) based on user input by a service user.

[0136] To this end, the extended reality content authoring system (100) accesses the platform service through a client app (or a common framework), selects one of a plurality of content units uploaded to the platform service based on user input, downloads the content unit, and loads it into the client app to execute it.

[0137] Furthermore, the present invention discussed above can be implemented as a program executed by one or more processes in an electronic device and stored in a computer-readable recording medium.

[0138] Accordingly, the present invention can be implemented as computer-readable code or instructions on a program-recorded medium. That is, the various control methods according to the present invention can be provided in the form of integrated or individual programs.

[0139] Meanwhile, computer-readable media include all types of recording devices that store data that can be read by a computer system. Examples of computer-readable media include hard disk drives (HDDs), solid-state disk drives (SSDs), silicon disk drives (SDDs), ROMs, RAMs, CD-ROMs, magnetic tapes, floppy disks, and optical data storage devices.

[0140] Furthermore, the computer-readable medium may include a storage device and may be a server or cloud storage device accessible via communication. In this case, the computer may download the program according to the present invention from the server or cloud storage device via wired or wireless communication.

[0141] Furthermore, in the present invention, the computer described above is an electronic device equipped with a processor, i.e., a CPU (Central Processing Unit), and there is no particular limitation on its type.

[0142] Meanwhile, the above detailed description should not be construed as limiting in any respect and should be considered illustrative. The scope of the present invention should be determined by a reasonable interpretation of the appended claims, and all modifications within the equivalent scope of the present invention are intended to be included within the scope of the present invention.

Claims

1. A step for creating unit content consisting of objects and scenes in extended reality (XR) content using a studio authoring tool; A step of building a common framework that is precompiled into an executable program on a preset device using a builder; and A method for authoring extended reality content, comprising the step of linking the unit content to the common framework based on execution of the precompiled common framework to author the extended reality content.

2. In the first paragraph, the unit content is: A method for authoring extended reality content, characterized in that the content is authored using the above studio authoring tool, compiled into code and resource parts through a unit compiler, and linked to the common framework.

3. In paragraph 2, The above code is implemented as a callback function that can be linked to the common framework, and is converted into a dynamic program element through the compilation. A method for authoring extended reality content, characterized in that the above resource is converted into an object that can be dynamically referenced through a resource database (Resource DB) of the common framework.

4. In the first paragraph, the common framework, A method of authoring extended reality content, characterized by implementing common functional elements that can be used in each different service as a framework app.

5. In the fourth paragraph, the unit content is, An extended reality content authoring method characterized in that, for the different services described above, the objects and scenes corresponding to each individual service are authored to be included.

6. In the first paragraph, the step of authoring the unit content comprises: A step of loading the object into the studio authoring tool based on the execution of the studio authoring tool; A step of placing the above object in the above scene and creating a story content that constitutes the transition of the above scene; and A method for authoring extended reality content, comprising the step of authoring a collaborative context interaction by specifying properties or multimodality of the above objects related to collaboration.

7. In the 6th paragraph, the step of constructing the common framework is: A method for authoring extended reality content, characterized by authoring at least one of data linkage, avatar synchronization, and collaboration space synchronization through the above builder.

8. In paragraph 1, A method for authoring extended reality content, further comprising the step of generating an extended reality application loaded on the device, wherein the extended reality content is executed.

9. In the 8th paragraph, the extended reality application, In the above builder, unit content corresponding to a specific service is linked to the above common framework and created for each specific service, or A method for authoring extended reality content, characterized in that the specific service is provided by generating a public application from the above builder and loading unit content corresponding to the specific service into the public application.

10. A program that is executed by one or more processes in an electronic device and stored in a computer-readable recording medium, The above program is, A step of authoring unit content consisting of objects and scenes in extended reality content using a studio authoring tool; A step of building a common framework that is precompiled into an executable program on a preset device using a builder; and A program stored on a computer-readable recording medium, characterized in that it includes instructions for performing a step of linking the unit content to the common framework based on the execution of the precompiled common framework to author the extended reality content.

Citation Information

Patent Citations

  • Object extraction device, object recognition system and meta-data creating system

    JP2018147019A

  • A method for controlling fractional share trading, and apparatus therefore

    KR102295421B1

  • System for providing cloud based application making service

    KR102352225B1

  • Ultra high strength shotcrete composition and construction method using the same

    KR102626820B1

  • KR20190075177A