Method and device for obtaining virtual object data in augmented reality

Abstract

A method and apparatus for obtaining virtual object data in augmented reality are provided. The method includes: identifying at least one exposed component from three-dimensional image data corresponding to a target device, where the exposed component is exposed to a view outside the target device; identifying the type of the target device from the three-dimensional image data corresponding to the target device; determining at least one main direction of the target device based on the type of the target device; and obtaining virtual object data for presenting an appearance of the target device based on the at least one exposed component and the at least one main direction.

Description

Technical Field

[0001] The present disclosure relates to a technology for obtaining virtual object data in augmented reality. More specifically, the present disclosure relates to a technology for obtaining virtual object data from three-dimensional image data of an object. Background Art

[0002] With the development of digital technology, various electronic devices such as mobile communication terminals, personal digital assistants (PDAs), electronic notebooks, smart phones, tablet personal computers (PCs), or wearable devices have been widely distributed. These electronic devices and other electronic devices can provide various sensory experiences to users. For example, an electronic device can provide augmented reality (AR) that adds virtual information to real objects to a user.

[0003] Augmented reality is a technical field that provides a new paradigm that can be used in human-computer interaction and communication. Augmented reality is a type of virtual reality, and combines the real world seen by a user with a virtual world having additional information in one image. Augmented reality is a concept of supplementing the real world with a virtual world, and uses a virtual environment generated by computer graphics, but can also be based on a real environment.

[0004] In order to provide augmented reality to a user, three-dimensional graphics technology can be used. In order to make a user feel that various objects seem to exist in a virtual world, three-dimensional appearance data for each object and an application capable of visually realizing the three-dimensional appearance data can be used.

[0005] According to related art, in order to visually realize a preset object in a virtual world in augmented reality, a method of directly and manually creating and generating three-dimensional appearance data for each object by a user has been used. This three-dimensional appearance data generation method generates data inefficiently because it causes a user to manually realize the appearance of each object for a long time.

[0006] Therefore, a method for efficiently obtaining three-dimensional appearance data of various objects in augmented reality is needed. Summary of the Invention

[0007] Technical Solution

[0008] An apparatus and method for effectively providing virtual object data in augmented reality are provided.

[0009] Additional aspects will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the presented embodiments of the present disclosure.

[0010] According to one aspect of the present disclosure, a method for obtaining virtual object data in augmented reality is provided. The method includes: identifying at least one component of a target device from three-dimensional image data corresponding to the target device, wherein the at least one component is exposed to a view outside the target device; identifying the type of the target device from the three-dimensional image data corresponding to the target device; identifying a first direction of the target device based on the type of the target device; and obtaining virtual object data for presenting an appearance of the target device based on the at least one component and the first direction.

[0011] The three-dimensional image data may include computer-aided design (CAD) data.

[0012] The step of identifying at least one component of the target device may include: arranging the target device and at least one virtual light source in a virtual space based on the three-dimensional image data; and identifying, as the at least one component, a component among a plurality of components included in the target device that is reached by light emitted from the at least one virtual light source.

[0013] The step of identifying, as the at least one component, a component among a plurality of components included in the target device that is reached by light emitted from the at least one virtual light source may include: rotating the at least one virtual light source around a virtual line passing through the target device as a central axis; and identifying, as the at least one component, a component among the plurality of components included in the target device that is reached by light emitted from the at least one virtual light source while the at least one virtual light source rotates.

[0014] The step of identifying, as the at least one component, a component among a plurality of components included in the target device that is reached by light emitted from the at least one virtual light source may include: moving a movable component among the plurality of components included in the target device; and identifying, as the at least one component, a component among the plurality of components included in the target device that is reached by light emitted from the at least one virtual light source while the movable component moves.

[0015] The method may further include: setting a component weight corresponding to the at least one component, wherein the step of obtaining virtual object data for presenting an appearance of the target device includes: identifying a size of the virtual object data based on at least one of the at least one component or the set component weight.

[0016] The step of identifying a first direction of the target device based on the type of the target device may include: obtaining a database including information about a preset type of the target device and a main direction corresponding to the preset type of the target device; matching the preset type of the target device in the database with the identified type of the target device; and identifying the first direction of the target device based on a result of the matching.

[0017] The method may further include: setting a direction weight corresponding to the first direction, wherein the step of obtaining virtual object data for presenting an appearance of the target device includes: determining a size of the virtual object data based on the direction weight.

[0018] The first direction of the target device may be defined based on a three-dimensional coordinate system set in a virtual space.

[0019] The three-dimensional image data may be obtained from a network including a cloud.

[0020] According to another aspect of the present disclosure, there is provided an electronic device for obtaining virtual object data in augmented reality. The electronic device includes: a memory storing one or more instructions; and a processor configured to execute the one or more instructions to perform operations including: identifying at least one component of a target device from three-dimensional image data corresponding to the target device, wherein the at least one component is exposed to a view outside the target device, identifying a type of the target device from the three-dimensional image data corresponding to the target device, identifying a first direction of the target device based on the identified type of the target device, and obtaining virtual object data for presenting an appearance of the target device based on the at least one component and the first direction.

[0021] The three-dimensional image data may include computer-aided design (CAD) data.

[0022] The processor may further be configured to execute the one or more instructions to perform operations including: arranging the target device and at least one virtual light source in a virtual space based on the three-dimensional image data, and identifying a component among a plurality of components included in the target device that is reached by light emitted from the at least one virtual light source as the at least one component.

[0023] The processor may further be configured to execute the one or more instructions to perform operations including: rotating the at least one virtual light source around a virtual line passing through the target device as a central axis, and identifying a component among the plurality of components included in the target device that is reached by light emitted from the at least one virtual light source while the at least one virtual light source rotates as the at least one component.

[0024] The processor may also be configured to execute one or more instructions to perform the following operations: move another movable component among the plurality of components included in the target device, and identify, as the at least one component, a component that receives light emitted from at least one virtual light source when the other component moves among the plurality of components included in the target device.

[0025] The processor may also be configured to execute one or more instructions to perform the following operations: set a component weight corresponding to the at least one component, and identify the size of the virtual object data based on at least one of the at least one component and the set component weight.

[0026] The processor may also be configured to execute one or more instructions to perform the following operations: obtain a database including information about a preset type of the target device and a main direction corresponding to the preset type of the target device, match the preset type of the target device included in the database with the identified type of the target device, and identify a first direction of the target device based on a result of the matching.

[0027] The processor may also be configured to execute one or more instructions to perform the following operations: set a direction weight corresponding to the first direction, and determine the size of the virtual object data based on the direction weight.

[0028] The first direction of the target device may be defined based on a three-dimensional coordinate system set in a virtual space.

[0029] According to another aspect of the present disclosure, there is provided a computer-readable recording medium having recorded thereon a program for executing, on a computer, a method of acquiring virtual object data in augmented reality, wherein the method includes: identifying at least one component of a target device from three-dimensional image data corresponding to the target device, wherein the at least one component is exposed to a view outside the target device; identifying a type of the target device from the three-dimensional image data corresponding to the target device; identifying a first direction of the target device based on the type of the target device; and acquiring virtual object data for presenting an appearance of the target device based on the at least one component and the first direction. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] The above and other aspects, features, and advantages of certain embodiments of the present disclosure will become more apparent from the following description in conjunction with the accompanying drawings, in which:

[0031] The above and other features and advantages will become more apparent by referring to the accompanying drawings in detail, in which reference numerals denote structural elements.

[0032] Figure 1is a block diagram of an electronic device according to an embodiment of the present disclosure;

[0033] Figure 2 is a diagram showing a method of obtaining virtual object data according to an embodiment of the present disclosure;

[0034] Figure 3 is a diagram showing a method of determining an exposed component according to an embodiment of the present disclosure;

[0035] Figure 4 is a diagram showing a method of determining an exposed component according to an embodiment of the present disclosure;

[0036] Figure 5 is a diagram showing a method of determining an exposed component according to an embodiment of the present disclosure;

[0037] Figure 6 is a diagram showing a method of determining an exposed component according to an embodiment of the present disclosure;

[0038] Figure 7 is a diagram showing a method of setting a direction weight according to an embodiment of the present disclosure;

[0039] Figure 8 is a diagram of a database including information about direction weights according to an embodiment of the present disclosure;

[0040] Figure 9 is a diagram showing a method of calibrating the direction of a target device according to an embodiment of the present disclosure;

[0041] Figure 10 is a diagram showing a method of reducing the weight of image data of an exposed component according to an embodiment of the present disclosure;

[0042] Figure 11 is a flowchart showing a method of obtaining virtual object data according to an embodiment of the present disclosure;

[0043] Figure 12 is a diagram showing a method of implementing a target device based on virtual object data according to an embodiment of the present disclosure; and

[0044] Figure 13 is a block diagram of an electronic device according to an embodiment of the present disclosure. Detailed Description

[0045] Best Mode for Carrying Out the Invention

[0046] According to one aspect of the present disclosure, a method for obtaining virtual object data in augmented reality is provided. The method includes: identifying at least one component of a target device from three-dimensional image data corresponding to the target device, wherein the at least one component is exposed to a view outside the target device; identifying the type of the target device from the three-dimensional image data corresponding to the target device; identifying a first direction of the target device based on the type of the target device; and obtaining virtual object data for presenting the appearance of the target device based on the at least one component and the first direction.

[0047] Embodiments of the present invention

[0048] Hereinafter, one or more embodiments of the present disclosure will be described in detail with reference to the accompanying drawings to the extent that those of ordinary skill in the art can implement the present disclosure. However, the present invention can be implemented in various ways and is not limited to one or more embodiments of the present disclosure described herein. Additionally, for clear description, components irrelevant to the description are omitted in the drawings, and the same reference numerals are used throughout the specification for similar components.

[0049] Throughout the disclosure, the expression "at least one of a, b, or c" means only a, only b, only c, both a and b, both a and c, both b and c, all of a, b, and c, or variations thereof.

[0050] One or more embodiments of the present disclosure may be presented as a functional block structure, various processing stages, and / or various processing operations. Some or all of the functional blocks may be implemented by any number of hardware components and / or software components configured to perform the specified functions.

[0051] For example, the functional blocks of the present disclosure may be implemented by one or more microprocessors or circuit structures for performing preset functions.

[0052] Additionally, for example, the functional blocks of the present disclosure may be implemented in any programming or scripting language. The functional blocks may be implemented with an algorithm to be executed on one or more processors.

[0053] Furthermore, the present disclosure may adopt any number of technologies according to related technologies for electronic configuration, signal processing, and / or data processing, etc.

[0054] Additionally, the connecting lines or connectors shown in the various drawings presented are intended to represent exemplary functional relationships and / or physical or circuit couplings between various elements. It should be noted that in an actual device, there may be connections between elements through many alternative or additional functional relationships, physical connections, or circuit connections.

[0055] In addition, terms such as "unit" and "module" provided herein indicate a unit that performs at least one function or operation, and can be implemented by hardware, software, or a combination of hardware and software. The "unit" and "module" can be stored in an addressable storage medium and can be implemented by a program executable by a processor.

[0056] For ease of description, spatial relative terms (such as "above", "on", "below", "beneath", "under", etc.) may be used herein to describe the relationship of one element or feature shown in the figure to another element or feature or other elements or features. It should be understood that, in addition to the orientation depicted in the drawings, the spatial relative terms are also intended to cover different orientations during the use or operation of the device. For example, when the device in the drawing is flipped, an element described as "below" or "beneath" other elements or features will be positioned "above" the other elements or features. Thus, the term "above" can cover both the upper and lower orientations. The device can be positioned otherwise (rotating the device 90 degrees in other orientations), and the spatial relative descriptive terms used herein can be interpreted accordingly.

[0057] The terms used herein are for the purpose of describing particular embodiments and are not intended to limit the present disclosure. It will be apparent to those skilled in the art that various embodiments based on the technical spirit of the present disclosure are possible in addition to the disclosed embodiments. Furthermore, when necessary, the above-described respective embodiments can be combined. For example, an embodiment of the present disclosure and a part of another embodiment of the present disclosure can be combined to operate the device.

[0058] Figure 1 is a block diagram of an electronic device 100 according to an embodiment of the present disclosure.

[0059] Referring to Figure 1 , the electronic device 100 can obtain virtual object data of the target device from the three-dimensional image data of the target device.

[0060] According to an embodiment of the present disclosure, the target device can be a device from which the electronic device 100 will obtain virtual object data. The target device according to an embodiment of the present disclosure can include an electronic device including household appliances. For example, the target device can include a washing machine, a refrigerator, an air conditioner, a speaker, a smart device, etc. However, the target device of the embodiment of the present disclosure is not limited to an electronic device, but can include various objects. For example, the electronic device 100 can obtain virtual object data of the target object from the three-dimensional image data of the target object. According to an exemplary embodiment, the target object can include various objects such as a wardrobe, a table, a chair, a car, a house, etc.

[0061] Hereinafter, the target device can refer to the target device located in the virtual space presenting the virtual object data.

[0062] The three-dimensional image data may be a large amount of data including geometric data presenting the appearance and structure of the target device. In addition, the three-dimensional image data may include attribute data of the target device. The attribute data may include information such as dimensions, weight, center of gravity, material, and joint information between components of the target device or corresponding parts of the target device.

[0063] The virtual object data may be simplified data including geometric data presenting the appearance of the target device. The electronic device 100 according to an embodiment of the present disclosure may obtain virtual object data for visually implementing the target device in an augmented reality virtual world based on the three-dimensional image data of the target device. That is, the virtual object data of the target device may be used to provide information about the target device to the augmented reality service.

[0064] The electronic device 100 may obtain the three-dimensional image data of the target device from the server 10. Optionally, the electronic device 100 may obtain the three-dimensional image data stored in the memory of the electronic device 100. Optionally, the electronic device 100 may be connected to a network 200 including a cloud to obtain the three-dimensional image data from the network 200.

[0065] The electronic device 100 may obtain data about at least one of the type of the target device, the orientation of the target device, or components in the target device from the three-dimensional image data of the target device in order to obtain the virtual object data. Based on the obtained data, the electronic device 100 may convert the three-dimensional image data of the target device into the virtual object data. According to an embodiment, the orientation of the target device is the main orientation of the target device. The main orientation of the target device may be the front view of the target device.

[0066] The electronic device 100 may identify components included in the target device, for example, to convert the three-dimensional image data of the target device into the virtual object data.

[0067] The three-dimensional image data according to an embodiment of the present disclosure may include data about a plurality of components included in the target device. Specifically, the three-dimensional image data may include component image data presenting the appearance of each component in the target device. For example, when the target device is a refrigerator, the three-dimensional image data may include component image data presenting the appearance of the door, knob, water purifier, motor, etc. included in the refrigerator, respectively.

[0068] The electronic device 100 may identify data of exposed components or exposed parts exposed on the outer portion of the target device based on the component image data included in the three-dimensional image data of the target device. An exposed component may be a component at least a part of which is photographed by a camera located at an arbitrary position outside the target device. That is, an exposed component may be a component at least partially reached by light from a light source at an arbitrary position outside the target device.

[0069] According to an embodiment, the exposed part may be an exposed part of an exposed component photographed by a camera located at any position outside the target device. That is, the exposed part may be a part where light from a light source located at any position outside the target device arrives. Here, the electronic device 100 may identify the exposed component or the exposed part by using three-dimensional image data and a virtual camera or a virtual light source located in a virtual space presenting the three-dimensional image data.

[0070] According to an embodiment, the exposed component or the exposed part exposed on the outer side part of the target device may include a case where, in an open state when there is a second component that is opened / closed in the target device, the first component is exposed to the outside. For example, when the target device is a refrigerator, the inner wall of the refrigerator is exposed when the door of the refrigerator is opened, and thus may be identified as an exposed component. However, whether the door is open or closed, the compressor built in the refrigerator cannot be photographed by an external camera, and thus may not be identified as an exposed component. In addition, being exposed to the outside of the target device may include being exposed through a transparent component when there is a transparent component in the target device.

[0071] The electronic device 100 may obtain exposed component image data regarding the identified exposed component from the three-dimensional image data. The exposed component image data may include geometric data presenting the appearance and structure of the exposed component. The exposed component image data according to an embodiment of the present disclosure may also be obtained by removing data regarding other parts other than the exposed part in the exposed component.

[0072] According to an embodiment, the electronic device 100 may identify the type of the target device in order to obtain virtual object data from the three-dimensional image data of the target device. Here, the type of the target device may be information for identifying the category to which the target device belongs. The type of the device according to an embodiment of the present disclosure may include a product group of the target device, a model name, etc. For example, when the target device is a refrigerator, the type may include "electronic device", "household appliance", "refrigerator", "double-door refrigerator", "RS82M6000", etc. The electronic device 100 may use geometric data, attribute data, metadata, file name, etc. of the target device included in the three-dimensional image data in order to identify the type of the target device.

[0073] The electronic device 100 may determine at least one of the exposed component or the main direction of the target device implemented in the virtual reality based on the identified type of the target device and the components included in the target device. The electronic device 100 may obtain virtual object data from the three-dimensional image data of the target device based on at least one of the determined exposed component or the main direction of the target device.

[0074] In this specification, the main direction may include at least one direction, where the at least one direction is pre-determined from the directions in which the target device is seen in the virtual space expressing the virtual object data of the target device based on at least one of the functional characteristics or design characteristics of the target device. That is to say, the main direction may be the direction that is determined to be frequently exposed or gazed at when the user views the target device in the virtual space including augmented reality. Identifying the main direction of the target device may be identifying the main view of the target device. Examples of the main direction of the target device will be described later with reference to Figure 7 Examples of the main direction of the target device.

[0075] The electronic device 100 may set a direction weight for each direction in which the target device is seen based on the identified main direction. Each direction of viewing the target device according to an embodiment of the present disclosure may be set based on the coordinate system set in the virtual space. For example, when a three-dimensional rectangular coordinate system is set in the virtual space, a plurality of directions of viewing the electronic device may be defined based on the XY plane, YZ plane, and XZ plane of the coordinate system.

[0076] According to an embodiment of the present disclosure described below, it is assumed that six directions of viewing the front surface, rear surface, opposite side surfaces (right side surface and left side surface), upper surface, and lower surface of the electronic device are defined in a three-dimensional rectangular coordinate system. However, those of ordinary skill in the art will understand that the technical characteristics regarding the coordinate system and directions are not limited to the above examples.

[0077] In addition, the electronic device 100 may set a component weight for each exposed component based on at least one of the three-dimensional image data of the target device or the identified type of the target device. The component weight may be pre-determined according to the priority order in which each of the individual components must be visualized in the virtual object data.

[0078] The electronic device 100 according to an embodiment of the present disclosure may set the component weight based on the functional characteristics of the component. For example, components that must be located within a specific distance from a connector (such as a drain or an electrical socket) may have a high priority. Optionally, components that are important tips for product installation or must be spaced apart from a wall or other products by a preset distance (e.g., a heat dissipation device or a control panel) may have a high priority. Additionally, components that are impressively recognized by the customer due to the design (e.g., the door of a washing machine) may have a high priority.

[0079] In addition, the electronic device 100 according to an embodiment of the present disclosure may set a component weight based on the shape complexity of component image data corresponding to an exposed component. For example, when available resources are over-allocated to a component with a simple shape, the electronic device 100 may set the component weight of the component to have a low priority. Optionally, when the component has a complex shape, the electronic device 100 may set the component weight of the component to have a high priority. According to an embodiment of the present disclosure, the shape complexity of the component image data may be calculated based on the variance of the surface normal direction per unit area. However, those of ordinary skill in the art will understand that the method of calculating or obtaining the shape complexity is not limited to the above example.

[0080] The electronic device 100 may identify high-priority components from the three-dimensional image data based on the type of the identified target device, or may identify high-priority components based on a user input. To set the component weight, the electronic device 100 may use geometric data, attribute data, metadata, file names, etc. of the electronic device included in the three-dimensional image data. In addition, the electronic device 100 may correct the component weight of each component based on a user input.

[0081] The electronic device 100 may determine an upper limit of the size of data for presenting the appearance of each exposed component based on at least one of the direction in which the exposed component is exposed, a direction weight, or a component weight. As an example, the size of the data may be the capacity occupied by the data.

[0082] The electronic device 100 may obtain virtual object data for presenting the appearance of the target device by adjusting the size of the data for presenting the appearance of the exposed component in the component image data of each exposed component based on the determined size.

[0083] The electronic device 100 may determine a texture to be applied to the virtual object data of the target device based on the type of the identified target device. The electronic device 100 may apply the texture to the obtained virtual object data. The electronic device 100 according to an embodiment of the present disclosure may correct all or part of the applied texture based on a user input.

[0084] The electronic device 100 may output the generated virtual object data. The electronic device 100 according to an embodiment of the present disclosure may output the virtual object data of the target device to the server 10. Optionally, the electronic device 100 may store the virtual object data of the target device in the memory of the electronic device 100. Optionally, the electronic device 100 may be connected to a network including a cloud and may transmit the virtual object data of the target device to the network.

[0085] Figure 2 is a diagram showing a method of obtaining virtual object data by an electronic device according to an embodiment of the present disclosure.

[0086] Reference Figure 2 , the electronic device can obtain virtual object data by simplifying three-dimensional image data.

[0087] In operation S210, the electronic device can simplify three-dimensional image data based on whether components are exposed.

[0088] The electronic device can obtain lightweight and visually quality-maintained virtual object data by removing internal components that are not visually recognized by a user observing the target device from the three-dimensional image data. According to an embodiment, the lightweight virtual object data can correspond to a relatively smaller amount of data than the original three-dimensional image data.

[0089] For example, the electronic device can store component image data corresponding to exposed components among the component image data included in the three-dimensional image data, and can remove component image data corresponding to other components except the exposed components. Optionally, the electronic device can store only component image data corresponding to components recognized as exposed components in a state where an openable / closable component is closed. Optionally, the electronic device can store only component image data corresponding to components recognized as exposed components in a state where an openable / closable component is open. Optionally, the electronic device can store only data corresponding to exposed portions, and can remove data corresponding to unexposed portions in the component image data corresponding to the exposed components. In an embodiment of the present disclosure, weight reduction of the three-dimensional image data based on exposure can be performed in various ways including combinations of the above examples.

[0090] In operation S220, the electronic device can simplify the three-dimensional image data based on weights and output virtual object data. The electronic device can obtain lightweight and visually quality-maintained virtual object data from the three-dimensional image data by allocating more available data resources to visually important portions based on weights.

[0091] According to an embodiment of the present disclosure, weights that the electronic device can use to simplify three-dimensional image data can include at least one of a direction weight or a component weight.

[0092] As described above, direction weights can be set for multiple directions in which the electronic device is viewed in a virtual space presenting three-dimensional image data of the target device. Component weights can be predetermined according to a priority order in which each of the respective components must be visualized in the virtual object data.

[0093] Compared with components having a relatively low weighted sum of two weights, the electronic device can, for example, allocate more available data resources to components having a relatively high weighted sum of two weights based on the direction weight and the component weight. That is, compared with components having a lower weighted sum of two weights, components having a higher weighted sum of two weights can retain more visual details.

[0094] The electronic device may determine an upper limit of the size of data for presenting the appearance of each component included in the electronic device based on, for example, a direction weight and a component weight. The electronic device may simplify the three-dimensional image data based on the determined upper limit of the data size.

[0095] The electronic device may output the simplified data as virtual object data.

[0096] Hereinafter, an example of determining exposed components of a target device by using a virtual light source will be described with reference to Figure 3 and Figure 4 The virtual light source is a preset light source implemented in a virtual space for presenting three-dimensional image data of the target device, and may be implemented by a preset software (S / W) module.

[0097] Since identifying and / or emphasizing an object in the virtual space by using the virtual light source implemented by the S / W module corresponds to a conventional technique in the field of three-dimensional image technology, a detailed description of a method for implementing the virtual light source will be omitted in the following description with reference to Figure 3 and Figure 4

[0098] Figure 3 is a diagram illustrating a method of determining exposed components according to an embodiment of the present disclosure.

[0099] Specifically, Figure 3 illustrates a state in which a target device 300 and a first virtual light source 31 and a second virtual light source 32 are located in a virtual space for presenting three-dimensional image data of the target device.

[0100] The target device 300 includes, for example, five components, namely, a first component 301, a second component 302, a third component 303, a fourth component 304, and a fifth component 305. In an embodiment of the present disclosure, the first component 301 includes a door 301a.

[0101] According to an embodiment of the present disclosure, since virtual light emitted from the first virtual light source 31 and the second virtual light source 32 reaches the first component 301, the first component 301 may be identified as an exposed component. In addition, virtual light emitted from the first virtual light source 31 and the second virtual light source 32 reaches a portion 302a of the second component 302, and thus, the second component 302 may be identified as an exposed component. In addition, virtual light emitted from the second virtual light source 32 reaches the third component 303 after passing through a transparent portion, and the third component 303 may be identified as an exposed component. On the other hand, virtual light emitted from any external light source including the first virtual light source 31 and the second virtual light source 32 may not reach the fourth component 304 and the fifth component 305, and thus, the fourth component 304 and the fifth component 305 may not be identified as exposed components.

[0102] Figure 4 is a diagram showing a method for determining an exposed component according to an embodiment of the present disclosure.

[0103] Specifically, Figure 4 shows a state in which the target device 400 and the first virtual light source 41, the second virtual light source 42, and the third virtual light source 43 are located in a virtual space presenting three-dimensional image data of the target device 400.

[0104] The target device 400 includes, for example, five components, namely, a first component 401, a second component 402, a third component 403, a fourth component 404, and a fifth component 405. In an embodiment of the present disclosure, the first component 401 includes a door 401a. In Figure 4 , the door 401a can be in an open state.

[0105] According to an embodiment of the present disclosure, since the virtual light emitted from the first virtual light source 41 and the second virtual light source 42 reaches the first component 401, the first component 401 can be recognized as an exposed component. In addition, the virtual light emitted from the first virtual light source 41 and the second virtual light source 42 reaches a part 402a of the second component 402, and thus, the second component 402 can be recognized as an exposed component. In addition, the virtual light emitted from the second virtual light source 42 reaches the third component 403 after passing through the transparent part, and thus, the third component 403 can be recognized as an exposed component. On the other hand, the virtual light emitted from any external light source including the first virtual light source 41 and the second virtual light source 42 may not reach the fifth component 405, and thus, the fifth component 305 may not be recognized as an exposed component.

[0106] Unlike Figure 3 , since the door 401a is open in Figure 4 , the virtual light emitted from the third virtual light source 43 can reach the fourth component 404. Therefore, in Figure 4 , the fourth component 404 can be further recognized as an exposed component.

[0107] Figure 5 is a diagram showing a method for determining an exposed component according to an embodiment of the present disclosure.

[0108] Referring to Figure 5 , the first component 501 and the second component 502 included in the target device are exemplarily shown. The dashed line dividing the surface of the second component 502 in Figure 5 represents the shape of the surface of the second component as a polygon mesh.

[0109] In three-dimensional computer graphics, the shape of a polyhedron can be realized as a polygon mesh obtained by connecting triangles, rectangles, or polygons to each other, and the polygon mesh can be composed of primitives as basic units. Examples of primitives as basic units of the polygon mesh can include surfaces (e.g., triangles or other polygons), vertices (e.g., vertices of triangle or other polygon surfaces), and edges (line segments connecting vertices).

[0110] Light rays emitted from any external light source can reach only a part of the second component 502 by virtue of the first component 501 located in front. The electronic device according to an embodiment of the present disclosure can recognize only the part where the light rays in the second component 502 reach as an exposed part. Here, the unit recognized as the exposed part of the second component 502 can be a primitive unit of geometric data.

[0111] The electronic device according to an embodiment of the present disclosure can obtain lightweight and visually quality-preserved virtual object data by removing data of primitives corresponding to unexposed parts of components included in the target device.

[0112] Figure 6 is a diagram showing a method of determining an exposed component according to an embodiment of the present disclosure.

[0113] Referring to Figure 6 , three-dimensional image data of N virtual light sources and a washing machine as a target device are shown in a virtual space (60).

[0114] In Figure 6 , as an example, the washing machine (i.e., the target device) includes six components, e.g., a door, a front panel, a right panel, a left panel, a top panel, and a motor. Here, the electronic device determines whether virtual light emitted from the N virtual light sources reaches each component, and can determine the component in contact with at least one virtual light ray as an exposed component.

[0115] Figure 6 Table 61 of

[0116] According to an embodiment of the present disclosure, the number N of virtual light sources to be virtually positioned for facilitating determination of an exposed component can be determined based on at least one of the size of the target device, the surface complexity, the required accuracy of the virtual object data, or the design complexity of the target device. In addition, the electronic device can set or change the number N of virtual light sources based on a user input.

[0117] In addition, according to an embodiment of the present disclosure, a plurality of virtual light sources may emit light while rotating a preset angle (e.g., 360 degrees) around a target device. The rotation angle of the plurality of virtual light sources, the interval between the virtual light sources, the distance between the plurality of virtual light sources and the target device, etc. may be determined to have optimal values based on at least one of the size of the target device, the surface complexity, the required accuracy of the virtual object data, or the design complexity of the target device. Additionally, the electronic device may set or change the above values based on a user input.

[0118] According to an embodiment of the present disclosure, when the target device includes an openable / closable or movable component, the electronic device may repeatedly perform the above operation of determining the exposed component while moving the component within a movable range. The number of times the electronic device performs the operation of determining the exposed component may be determined to be an optimal value based on at least one of the size of the target device, the surface complexity, the required accuracy of the virtual object data, or the design complexity of the target device.

[0119] For example, when the target device includes a door, the electronic device may perform the above operation of determining the exposed component when the door of the target device is in an open state and when the door of the target device is in a closed state, or while opening the door or while closing the door. Optionally, when the target device includes a lift with a bracket that moves upward, in the middle, or downward, the electronic device may perform the above operation of determining the exposed component in each state where the bracket of the lift of the target device is in an upper position, a middle position, or a lower position, or while moving the lift.

[0120] According to an embodiment of the present disclosure, when the target device includes a transparent component, the electronic device may perform the above operation of determining the exposed component in a state where the transparent component is removed. The electronic device may perform the operation of determining the exposed component in a state where the transparent component is temporarily removed, so that the virtual light can more effectively reach the inside of the transparent component. According to an embodiment of the present disclosure, when the target device includes a translucent component, when the transparency of the component is equal to or greater than a preset value, the electronic device may perform the above operation of determining the exposed component in a state where the translucent component is removed. Additionally, the electronic device may set or change whether to remove the component with transparency based on a user input.

[0121] In Figure 6 is shown a method of determining an exposed component according to an embodiment of the present disclosure, but those of ordinary skill in the art will understand that the embodiments of the present disclosure may be similarly applied to determining an exposed part.

[0122] Figure 7 is a diagram showing a method of setting a direction weight according to an embodiment of the present disclosure.

[0123] Referring toFigure 7 , showing the situation (70) of setting a three-dimensional rectangular coordinate system in a virtual space.

[0124] According to an embodiment of the present disclosure, a front surface direction D1 and a rear surface direction D2 are defined in the normal direction of the XY plane in the rectangular coordinate system in the virtual space. In addition, a left side direction D3 and a right side direction D4 are defined in the normal direction of the XZ plane of the rectangular coordinate system, and an upper surface direction D5 and a lower surface direction D6 are defined in the normal direction of the YZ plane of the rectangular coordinate system. However, the above definitions of directions are examples, and those of ordinary skill in the art will understand that the coordinate system and multiple directions can be defined in various ways.

[0125] When a user views a target device in a virtual space including augmented reality, based on the type of the target device, there may be a direction (i.e., the main direction) that is frequently exposed or emphasized. For example, when the target device is a refrigerator, the design of the front of the refrigerator may be important for the user to classify the product. On the other hand, the designs of the rear and side portions adjacent to the wall surface or surrounding objects may be less important than the front design. However, when the target device is a washing machine, the designs of the side and front portions of the washing machine may be important in the classification of the product, and thus, a large amount of available resources can be allocated to the components located on the side. That is, the direction emphasized when the user views the target device may vary according to the type of the target device, and the electronic device according to the present disclosure can handle the above problems by using the direction weights determined based on the main direction of the target device.

[0126] According to an embodiment of the present disclosure, the type of the target device may include information for identifying the category to which the target device belongs. The type according to an embodiment of the present disclosure may include the product group, model name, etc. of the target device. The electronic device may use the geometric data, attribute data, metadata, file name, etc. of the target device included in the three-dimensional image data to identify the type of the target device.

[0127] In addition, the electronic device may obtain a database including information about a preset type and the direction weights corresponding to the type. The electronic device may obtain the database from a server. Optionally, the electronic device may obtain the data stored in the memory of the electronic device. Optionally, the electronic device may be connected to a network including the cloud and may obtain the data from the network.

[0128] The electronic device may obtain the direction weights corresponding to the identified target device from the database. The direction weights may be set for each of the multiple directions set based on the coordinate system.

[0129] Figure 8 is a diagram of a database including information about direction weights according to an embodiment of the present disclosure.

[0130] Refer toFigure 8 , the database can be configured in a hierarchical manner.

[0131] The database according to an embodiment of the present disclosure may include data fields corresponding to types and data values corresponding to direction weights. The name of the data field may correspond to the type of the target device, and the data value may correspond to the value of the direction weight corresponding to the type. Optionally, the database may include classifications corresponding to types and instances corresponding to direction weights. The name of the classification may correspond to the type of the target device, and the instance may correspond to the direction weight corresponding to the type.

[0132] The database may include multiple sorts based on data fields or classifications. The type field of each sort may include multiple elements. In Figure 8 , a database having a main classification, intermediate classifications, and sub-classifications is shown as an example. Additionally, Figure 8 it is shown that "washing machine" (i.e., an element of the main classification layer) includes "front load", "top load", and "2-in-1" (i.e., elements of the intermediate classification layer). Further, as an example, "front load" (i.e., an element of the intermediate classification layer) includes model names "WF7500", "WW6800", and "WF5300" (i.e., elements of the sub-classification layer). However, the above examples are provided only for describing the configuration method of the database, and those of ordinary skill in the art will understand that the hierarchical structure and elements in the database are not limited to the above examples.

[0133] The electronic device may match the identified type of the target device with the preset type of the target device in the database. The electronic device may set the type of the target device having the highest coincidence degree among the preset types of the target device in the database as the identified type of the target device.

[0134] Since the identified type of the target device matches the elements of the lower layer, a more accurate direction weight can be obtained. For example, as shown in Figure 8 , when the identified type of the target device matches one of the elements included in the model name (i.e., the sub-classification layer, such as "WW6800"), the electronic device may determine the identified type of the target device as the "WW6800" model. However, it may be inefficient to continuously keep the direction weight corresponding to the segmented product information up-to-date. Therefore, even when the identified type of the target device does not match the elements of the sub-classification layer, the electronic device may search for elements having a matching type, or a preset similarity or greater similarity, with the identified target device by using the hierarchical structure of the database, and set the found element as the identified type of the target device. For example, when the identified type of the target device is "washing machine - front load - WW6900", the electronic device may set the identified type of the target device as "washing machine - front load" (i.e., an element of the intermediate classification layer).

[0135] In Figure 8 as an example, the directional weights for each direction are shown as rational values with a maximum value of 1.0. However, embodiments of the present disclosure are not limited thereto, that is, the directional weights according to embodiments of the present disclosure can be represented and stored in various ways.

[0136] Figure 9 is a diagram showing a method of calibrating the direction of a target device according to an embodiment of the present disclosure.

[0137] During the process of applying the directional weights set corresponding to a defined plurality of directions, it may be necessary to calibrate the target device in an appropriate direction in the virtual space. Referring to Figure 9 , the electronic device can rotate or align the target device so that the target device fits the plurality of directions defined in the virtual space.

[0138] In Figure 9 operation (a) of, an electronic device according to an embodiment of the present disclosure can define a boundary region around the target device. The electronic device can divide the boundary region into n equal blocks based on the center point of the target device arranged in the virtual space, where n is an integer.

[0139] Referring to Figure 9 , the boundary region 90 is defined in the shape of a rectangular parallelepiped and is shown as being divided into eight equal blocks. However, those of ordinary skill in the art will understand that rather, the shape of the defined boundary region and the number n of divisions can vary according to the plurality of directions defined for the application coordinate system and the directional weights in the virtual space. In addition, according to another exemplary embodiment, the boundary region may not be divided into equal blocks.

[0140] In Figure 9 operation (b) of, an electronic device according to an embodiment of the present disclosure searches for components installed on a specific surface of the target device to determine in which of the n boundary regions the found components are located. Based on the determination result, the electronic device can infer a first direction vector, which is a vector for determining the up and down direction of the target device.

[0141] For example, the electronic device can search for components installed only on the first direction surface of the target device and obtain a first direction vector based on the found first direction surface.

[0142] The electronic device can search for components installed only on the lower surface of the target device, for example. The electronic device can search for components installed only on the lower surface of the target device based on, for example, the component name including "wheel".

[0143] For example, the electronic device may present a boundary region including components mounted only on the lower surface of the target device as the lower surface (i.e., the first direction surface 901), and may obtain a lower surface vector perpendicular to the lower surface of the target device as the first direction vector 911. Based on the determination result, the electronic device may derive a second direction vector, which is a vector for determining the front-back direction of the target device.

[0144] In Figure 9 operation (c), the electronic device may, for example, search for components mounted only on the second direction surface of the target device, and obtain a second direction vector based on the found second direction surface.

[0145] The electronic device may search for components mounted only on the front surface of the target device, for example. The electronic device may search for components mounted only on the front surface of the target device based on, for example, the component name including "front".

[0146] For example, the electronic device may present a boundary region including components mounted only on the front surface of the target device as the front surface (i.e., the second direction surface 902), and may obtain a front surface vector perpendicular to the front surface of the target device as the second direction vector 912.

[0147] In Figure 9 operation (d), the electronic device may rotate the target device in a desired direction by using a pre-set three-dimensional coordinate system and the obtained first direction vector 911 and second direction vector 912. For example, the electronic device may rotate (i.e., align) the target device in the forward direction such that, on the three-dimensional coordinate system, the direction indicated by the first direction vector 911 matches a pre-set first direction, and the direction indicated by the second direction vector 912 matches a pre-set second direction.

[0148] Figure 10 is a diagram showing a method for reducing the weight of image data of exposed components according to an embodiment of the present disclosure.

[0149] When performing a lightweight operation by merging primitives of a polygon mesh constituting original component image data, edges of the original component image may be lost or surface distortion may frequently occur. The electronic device according to an embodiment of the present disclosure may solve the above problems caused by the merging of primitives by obtaining new component image data by using a mesh shell.

[0150] As described above, the electronic device according to an embodiment of the present disclosure may determine an upper limit of the size of data for presenting the appearance of each exposed component based on the weight.

[0151] Referring to Figure 10, as an example, the upper limit of the size of the determined data is the upper limit of the number of vertices for presenting the appearance of the exposed component. Hereinafter, this will be described with reference to the accompanying drawings.

[0152] Referring to Figure 10 operation (a), the shape of the original component 1000 located in the virtual space is schematically shown based on the component image data. The original component 1000 located in the virtual space may include a plurality of vertices 1001 and a mesh defined by the plurality of vertices 1001.

[0153] In Figure 10 operation (b), the electronic device may generate a shell 1010 surrounding the original component 1000 according to the target number of vertices determined based on the weight. In an embodiment of the present disclosure, the shell 1010 may include a plurality of vertices 1011 and a mesh defined by the vertices 1011. The number of vertices in the generated shell 1010 may be equal to or less than the target number of vertices. In Figure 10 , as an example, the number of vertices in the shell 1010 is five.

[0154] The target number of vertices is determined to simplify the component image data and corresponds to the upper limit of the size of the data for presenting the appearance of the original component 1000. Therefore, the target number of vertices may be less than the number of vertices in the original component located in the virtual space. That is, the vertices of the original component 1000 and the vertices of the shell 1010 may not correspond one by one. Therefore, the electronic device may select some vertices corresponding to the vertices of the shell from the vertices of the original component.

[0155] In an embodiment of the present disclosure, the electronic device may select some vertices corresponding to the vertices of the shell from the vertices of the original component based on the distance between the vertices of the shell and the vertices of the original component and the surface curvature of the original component. The electronic device may move the vertices of the shell to the positions of the selected vertices of the original component.

[0156] As shown in Figure 10 , the electronic device may select some vertices of the original component having relatively high surface curvature (i.e., vertices with relatively small angles between the edges connected to the vertices) from the vertices 1001 of the original component 1000 to correspond to the five vertices 1011 of the shell 1010.

[0157] In Figure 10In operation (c), when the vertex 1011 of the reticulated shell 1010 moves to the vertex of the selected original component 1000, the shape of the reticulated shell 1010 can be changed to the simplified shape of the original component 1000. Since vertices with relatively high surface curvature are selected from the vertices 1001 of the original component 1000, loss of the main edges constituting the image of the original component or surface distortion during the simplification process of the merged primitive can be prevented.

[0158] In Figure 10 operation (d), the electronic device can replace the component image data of the original component 1000 with the changed reticulated shell 1020 to simplify the component image data presenting the appearance of the original component 1000.

[0159] However, referring to Figure 10 the embodiments of the present disclosure shown are examples of methods for simplifying component image data, and the methods for simplifying component image data are not limited to the above examples.

[0160] Figure 11 is a flowchart showing a method for obtaining virtual object data according to an embodiment of the present disclosure.

[0161] Referring to Figure 11 , in operation S1110, at least one exposed component of the target device can be determined from the three-dimensional image data corresponding to the target device.

[0162] For example, the three-dimensional image data may include component image data presenting the appearance of components in the target device.

[0163] An exposed component of the target device may be a component at least a part of which is photographed by a camera located at an arbitrary position outside the target device. That is to say, an exposed component may be a component at least part of the light from a light source located at an arbitrary position outside the target device reaches. In addition, the exposed part may represent the exposed part of the exposed component photographed by a camera located at an arbitrary position outside the target device. That is to say, the exposed part may be the part where the light from the light source reaches at an arbitrary position outside the target device. A part of the exposed component according to an embodiment of the present disclosure can be identified in units of primitives of geometric data.

[0164] In addition, the exposed components of the target device may include the case where, when another component in the target device is in an open / closed state, the component is exposed to the outside in the open state. For example, when the target device is a refrigerator, the inner wall of the refrigerator is exposed when the door of the refrigerator is opened, and thus can be exposed as an exposed component. However, no matter whether the door is open or closed, the compressor built in the refrigerator cannot be photographed by a camera outside, and thus can be identified as not an exposed component. In addition, being exposed to the outside of the target device may include being exposed through a transparent component when there is a transparent component in the target device.

[0165] In operation S1120, the type of the target device can be identified from the three-dimensional image data corresponding to the target device.

[0166] The type of the target device may be information for identifying the category to which the target device belongs. The type of the target device according to an embodiment of the present disclosure may include the product group, model name, etc. of the target device. The electronic device may use the geometric data, attribute data, metadata, file name, etc. of the target device included in the three-dimensional image data to identify the type of the target device.

[0167] In operation S1130, at least one main direction of the target device can be determined based on the identified type of the target device.

[0168] The at least one main direction of the target device according to an embodiment of the present disclosure can be set based on the coordinate system set in the virtual space.

[0169] For example, in order to determine the at least one main direction of the target device, a database including information about a preset type of the target device and the main direction corresponding to the preset type of the target device can be obtained. The preset type of the target device included in the database can match the identified type of the target device. Based on the matching result, the at least one main direction of the target device can be determined.

[0170] In operation S1140, virtual object data for presenting the appearance of the target device can be generated based on the determined at least one exposed component and the at least one main direction.

[0171] Component weights can be set for the determined at least one exposed component. The component weights can be determined in advance according to the priority order in which each component among the various components must be visualized in the virtual object data. The electronic device according to an embodiment of the present disclosure can set the component weights based on at least one of the functional characteristics of the component or the shape complexity of the component image data corresponding to the exposed component.

[0172] The size of the data for presenting the appearance of the target device can be determined based on the component weights. As an example, the size of the data can represent the capacity occupied by the data. Optionally, the size of the data can represent the number of primitives in the geometric data included in the data.

[0173] In an example, the exposed component image data of the identified exposed component can be obtained from the three-dimensional image data. The exposed component image data may include geometric data presenting the appearance and structure of the exposed component. The exposed component image data according to an embodiment of the present disclosure can also be obtained by removing data about the parts of the exposed component that are not the exposed parts.

[0174] In addition, direction weights can be set for at least one determined main direction. The size of the data for presenting the appearance of the target device can be determined based on the direction weights. As an example, the size of the data can represent the capacity occupied by the data. Optionally, the size of the data can represent the number of primitives in the geometric data included in the data.

[0175] In addition, the texture of the virtual object data to be applied to the target device can be determined based on the identified type of the target device. When the texture is determined, the determined texture can be applied to the virtual object data. Further, all or some of the applied texture can be corrected based on user input.

[0176] According to another embodiment of the present disclosure, a method of obtaining virtual object data in augmented reality includes: identifying the type of a target object from three-dimensional image data corresponding to the target object, identifying the front view of the target object based on the type of the target object, and obtaining virtual object data for presenting the appearance of the target object based on a first weight associated with one or more components of the target object or a second weight associated with one or more directions of the target object, the first weight and the second weight corresponding to the front view. The one or more components can be visible from a view outside the target object.

[0177] The method may further include: obtaining the original shape of the one or more components, the original shape being located in a virtual space including a plurality of vertices, generating a shell around the original shape according to a target number of vertices identified based on the first weight or the second weight, selecting one or more vertices from the plurality of vertices of the original shape to correspond to the target number of vertices, shaping the shell by moving the target vertices to the selected vertices, and replacing the component image data of the original shape with the shaped shell to present the appearance of the target object.

[0178] As described above, the method of obtaining virtual object data according to an embodiment of the present disclosure can obtain virtual object data for presenting the appearance of a target device in augmented reality by simplifying three-dimensional image data. That is, the virtual object data of the target device can be used to provide information about the target device to an augmented reality service.

[0179] Figure 12 is a diagram showing a method of implementing a target device based on virtual object data 1203 according to an embodiment of the present disclosure.

[0180] Referring to Figure 12 , the virtual object data 1203 can be obtained from the three-dimensional image data 1201 according to the method of obtaining virtual object data of the present disclosure. The method of obtaining the virtual object data 1203 by simplifying the three-dimensional image data 1201 has been described above, and thus, the detailed description of the method is omitted.

[0181] For example, the three-dimensional image data 1201 may include computer-aided design (CAD) data. That is, the three-dimensional image data 1201 can be directly used for the development and design of the target device, and may include CAD data as a result of processing, where the user draws and designs the target device by using two-dimensional (2D) graphic tools and / or three-dimensional (3D) graphic tools. The three-dimensional image data 1201 can be, for example, in OBJ data format or STL data format, but is not limited thereto.

[0182] In addition, the virtual object data 1203 may include three-dimensional appearance data used in an application for implementing the target device in augmented reality. The virtual object data 1203 can be used, for example, to implement the appearance of the target device in the application, and can be the result of converting the three-dimensional image data 1201 by a specific S / W module. The specific S / W module may include, for example, instructions for performing the method of simplifying the three-dimensional image data 1201 described above. The virtual object data 1203 can be, for example, in FBX data format or GLB data format, but is not limited thereto.

[0183] Return reference Figure 12 , showing an example (1210) where the virtual object data 1203 is used to visually implement the appearance of the target device in the application.

[0184] An application according to an embodiment of the present disclosure can provide an augmented reality service that allows a user to arrange a target object in space to the user. According to an embodiment, the space can be a preset space. That is, when the user selects the target device to be arranged and the position and orientation of the target device while photographing the preset space through the application, the application can arrange the target device corresponding to the selection in the virtual space. The application displays the photographed space combined with the virtual space of the arranged target device ( Figure 12 views (a)-(c) in), and thus, an experience as if the target device is actually installed in the preset indoor space can be provided to the user.

[0185] As described above, according to the method of generating the virtual object data, the virtual object data of each target device can be obtained by simplifying the processing of the three-dimensional image data used in the drawing and design of the target device, without directly generating the virtual object data corresponding to each target device. Therefore, the time and cost required to provide the augmented reality service can be effectively reduced.

[0186] Figure 13 is a block diagram of an electronic device 1300 according to an embodiment of the present disclosure. Referring to Figure 13 , the electronic device 1300 may include a processor 1310, a transmitter / receiver 1320, a memory 1330, and a display 1340.

[0187] The processor 1310 controls the overall operation of the electronic device 1300. The processor 1310 may be configured to process at least one instruction by performing basic arithmetic operations, logical operations, and input / output operations. Instructions may be provided to the processor 1310 from the memory 1330. That is, the processor 1310 may be configured to execute instructions according to program code stored in a recording device (such as the memory 1330). Optionally, instructions may be provided to the processor 1310 via the transmitter / receiver 1320.

[0188] In an example, the processor 1310 may include a central processing unit (CPU). Although not shown in Figure 13 it, the processor 1310 may operate in link with at least one other processor. Here, the at least one other processor may include a graphics processing unit (GPU). The processor 1310 and the at least one other processor operating in link with each other according to an embodiment of the present disclosure may cooperate to process at least one instruction in such a way as to reduce the amount of computation of the processor 1310 and allocate tasks corresponding to the reduced amount of computation to the at least one other processor.

[0189] The processor 1310 may control the electronic device 1300 to acquire virtual object data of a target device from three-dimensional image data of the target device. In addition, the processor 1310 may control the display 1340 to display the process of acquiring the virtual object data. In an embodiment of the present disclosure, the display 1340 may support touch input. The processor 1310 may control the display 1340 to set or correct numerical values used in the process of acquiring the virtual object data based on a user input.

[0190] In addition, the processor 1310 may receive a user's request for virtual object data of a target device via a network or the display 1340. The processor 1310 may acquire three-dimensional image data of the target device from a server, a network, or a memory based on the received request for the virtual object data. For example, when a request for virtual object data of a washing machine model "WF7500" is received from a user, the processor 1310 may acquire pre-stored three-dimensional image data of the washing machine model "WF7500" from a server, a network, or a memory. The processor may acquire virtual object data of the target device by simplifying the three-dimensional image data and may output the virtual object data.

[0191] The electronic device 1300 according to an embodiment of the present disclosure may include, but is not limited to, a server, a computing device, a smart phone, a tablet personal computer (PC), a PC, a smart TV, a mobile phone, a personal digital assistant (PDA), a laptop computer, a media player, a micro server, a global positioning system (GPS) device, an e-book terminal, a navigation system, a kiosk, an MP3 player, a digital camera, a household appliance, and other mobile or non-mobile computing devices. In addition, the electronic device 1300 may include a wearable device having communication functions and data processing functions, such as a watch, glasses, a headband, a ring, etc. However, the embodiments of the present disclosure are not limited thereto, that is, the electronic device 1300 may include all types of devices for acquiring virtual object data.

[0192] In addition, the electronic device 1300 may communicate with a server and another device (not shown) via a network to acquire or output three-dimensional image data and a database. In this case, the network may include a local area network (LAN), a wide area network (WAN), a value-added network (VAN), a mobile radio communication network, a satellite communication network, and a combination of a local area network (LAN), a wide area network (WAN), a value-added network (VAN), a mobile radio communication network, and a satellite communication network. The network is a data network in a broad sense, in which components of each network actively communicate with each other via the data network, and may include a wired Internet, a wireless Internet, and a mobile wireless communication network. For example, the wireless communication may be Wi-Fi, Bluetooth, Bluetooth Low Energy, Zigbee, Wi-Fi Direct (WFD), Ultra Wide Band (UWB), Infrared Data Association (IrDA), Near Field Communication (NFC), etc., but is not limited thereto.

[0193] One or more embodiments of the present disclosure may be implemented as an S / W program including instructions stored in a computer-readable storage medium.

[0194] For example, a computer may be a device capable of acquiring instructions stored in a storage medium and operating according to the instructions for the embodiments of the present disclosure, and may include a device according to one or more embodiments of the present disclosure or an external server connected to the device.

[0195] The computer-readable storage medium may be provided in the form of a non-transitory storage medium. Here, the term "non-transitory" simply means that the storage medium is a tangible device and does not include signals and currents, but the term does not distinguish between data being stored semi-permanently in the storage medium and data being temporarily stored in the storage medium. For example, the non-transitory storage medium may include a medium for temporary storage (such as registers, caches, buffers, etc.) and a non-transitory readable storage medium (such as a CD, a DVD, a hard disk, a Blu-ray disc, a universal serial bus (USB), an internal memory, a memory card, a ROM, or a RAM).

[0196] In addition, a method according to one or more embodiments of the present disclosure may be provided as a computer program product.

[0197] The computer program product may include an S / W program, a computer-readable storage medium storing the S / W program, or a product traded between a seller and a purchaser.

[0198] For example, the computer program product may include a product in the form of an S / W program (e.g., a downloadable application) electronically released by a device manufacturer or an electronic marketplace (e.g., Google TM PlayStore or App Store). For the electronic release, at least a part of the S / W program may be stored in a storage medium or be temporarily generated. In this case, the storage medium may be a server of the manufacturer or the electronic marketplace, or a storage medium of a relay server.

[0199] According to the present disclosure, virtual object data in augmented reality can be effectively provided.

Claims

1. A method for obtaining virtual object data in augmented reality, the method comprises: identifying at least one component of the target device from three-dimensional image data corresponding to the target device, wherein the at least one component is exposed to a view outside the target device; identifying the type of the target device from the three-dimensional image data corresponding to the target device; identifying a plurality of directions of the target device based on the type of the target device; obtaining at least one of component weights or direction weights based on the type of the target device; and acquiring virtual object data for presenting the appearance of the target device by simplifying the three-dimensional image data based on the at least one component, the plurality of directions, and the at least one of the component weights or the direction weights.

2. The method according to claim 1, wherein, the three-dimensional image data includes computer-aided design (CAD) data.

3. The method according to claim 1, wherein, the step of identifying the at least one component of the target device includes: arranging the target device and at least one virtual light source in a virtual space based on the three-dimensional image data; and identifying, as the at least one component, a component among a plurality of components included in the target device that is reached by light emitted from the at least one virtual light source.

4. The method according to claim 3, wherein, the step of identifying, as the at least one component, a component among a plurality of components included in the target device that is reached by light emitted from the at least one virtual light source includes: rotating the at least one virtual light source around a virtual line passing through the target device as a central axis; and identifying, as the at least one component, a component among the plurality of components included in the target device that is reached by light emitted from the at least one virtual light source while the at least one virtual light source rotates.

5. The method according to claim 3, wherein, the step of identifying, as the at least one component, a component among a plurality of components included in the target device that is reached by light emitted from the at least one virtual light source includes: moving a movable component among the plurality of components included in the target device; and identifying, as the at least one component, a component among the plurality of components included in the target device that is reached by light emitted from the at least one virtual light source while the movable component moves.

6. The method according to claim 3, wherein, the step of acquiring virtual object data for presenting the appearance of the target device includes: identifying the size of the virtual object data based on at least one of the at least one component or the component weight.

7. The method according to claim 1, wherein, the step of identifying a plurality of directions of the target device based on the type of the target device includes: obtaining a database including information about a preset type of the target device and a main direction corresponding to the preset type of the target device; matching the preset type of the target device in the database with the identified type of the target device; and Identify the multiple directions of the target device based on the matching result.

8. The method according to claim 7, wherein, The step of obtaining virtual object data for presenting the appearance of the target device includes: determining the size of the virtual object data based on the direction weight.

9. The method according to claim 1, wherein, The multiple directions of the target device are defined based on a three-dimensional coordinate system set in a virtual space.

10. The method according to claim 1, wherein, The three-dimensional image data is obtained from a network including a cloud.

11. An electronic device for obtaining virtual object data in augmented reality, the electronic device comprises: a memory storing one or more instructions; and a processor configured to execute the one or more instructions to perform the following operations: Identify at least one component of the target device from three-dimensional image data corresponding to the target device, wherein the at least one component is exposed to a view outside the target device, Identify the type of the target device from the three-dimensional image data corresponding to the target device, Identify multiple directions of the target device based on the identified type of the target device, obtain at least one of a component weight or a direction weight based on the type of the target device, and Obtain virtual object data for presenting the appearance of the target device by simplifying the three-dimensional image data based on the at least one component, the multiple directions, and the at least one of the component weight or the direction weight.

12. The electronic device according to claim 11, wherein, The processor is further configured to execute the one or more instructions to perform the following operations: Arrange the target device and at least one virtual light source in a virtual space based on the three-dimensional image data, and Identify, as the at least one component, a component among the multiple components included in the target device that is reached by light emitted from the at least one virtual light source.

13. The electronic device according to claim 12, wherein, The processor is further configured to execute the one or more instructions to perform the following operations: Identify the size of the virtual object data based on at least one of the at least one component and the component weight.

14. The electronic device according to claim 11, wherein, The processor is further configured to execute the one or more instructions to perform the following operations: Obtain a database including information about a preset type of the target device and a main direction corresponding to the preset type of the target device, Match the preset type of the target device included in the database with the identified type of the target device, and Identify the multiple directions of the target device based on the matching result.

15. A computer-readable recording medium having recorded thereon a program for executing a method of obtaining virtual object data in augmented reality on a computer, wherein, The method includes: Identify at least one component of the target device from three-dimensional image data corresponding to the target device, wherein the at least one component is exposed to a view outside the target device; Identify the type of the target device from the three-dimensional image data corresponding to the target device; Identify a plurality of directions of the target device based on the type of the target device; Obtain at least one of a component weight or a direction weight based on the type of the target device; and Acquire virtual object data for presenting the appearance of the target device by simplifying the three-dimensional image data based on the at least one component, the plurality of directions, and the at least one of the component weight or the direction weight.

Images