Image generation apparatus and method

Abstract

An image generation apparatus according to an aspect of the disclosed invention may include: a memory; a display; input device; and at least one processor that receives, through the input device, a user input for selecting at least one 2D image and a 3D space type, stored in the memory, provides a 3D image on the basis of the selected at least one 2D image and one 3D space type, and controls the display to output the provided 3D image.

Description

Image generating device and image generating method

[0001] The disclosed invention relates to an image generating device and an image generating method capable of generating a 3D image.

[0002] When changing the wallpaper of a desktop, laptop, or mobile device to suit a user's preference, a variety of images can be used, including images provided by the manufacturer, images provided by separate content providers, or images obtained by the user.

[0003] A Light Field Display (LFD) is a 3D display that creates three-dimensional images by generating a light field expressed as the vector distribution (intensity, direction) of light in space using a flat display and optical elements. When setting the background for an LFD monitor, a 3D image designed for a 3D environment must be used.

[0004] These 3D images are not easy for users to create themselves, and the 3D images provided by manufacturers are limited, so there is an increasing need for users to convert desired images into 3D images and set them as the background of their LFD monitors.

[0005] One aspect of the disclosed invention provides an image generating device and a 3D image generating method that enable a user to easily obtain a desired 3D image by generating a 3D image based on a 2D image.

[0006] The technical problems to be achieved in this document are not limited to the technical problems mentioned above, and other technical problems not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present invention belongs from the description below.

[0007] An image generating device according to one aspect of the disclosed invention may include: a memory storing at least one 2D image and a 3D space type; an input device receiving a selection of one 2D image and one 3D space type from among the at least one 2D image and one 3D space type stored in the memory from a user; a processor generating a 3D image based on the selected one 2D image and one 3D space type; and a display outputting the generated 3D image.

[0008] An image generation method according to one aspect of the disclosed invention may include the steps of: receiving a user input for selecting a 2D image; receiving a user input for selecting a 3D space type; generating a 3D image based on one 2D image and one 3D space type corresponding to the received user input; identifying distinct layers having different depth levels among a plurality of objects included in the generated 3D image; and outputting the generated 3D image.

[0009] FIG. 1 is a drawing showing a control block diagram of an image generating device according to one embodiment of the present disclosure.

[0010] FIG. 2 is a flowchart illustrating a 3D image generation method according to one embodiment of the present disclosure.

[0011] FIG. 3 is a diagram illustrating examples of 2D image and 3D space types according to one embodiment of the present disclosure.

[0012] FIGS. 4 to 6 are diagrams for explaining a process of generating a 3D image based on a 3D space type according to one embodiment of the present disclosure.

[0013] FIG. 7 is a flowchart illustrating generating a 3D image by distinguishing the hierarchy of an object according to one embodiment of the present disclosure.

[0014] FIG. 8 is a diagram illustrating a process of generating a 3D image by distinguishing the hierarchy of an object according to one embodiment of the present disclosure.

[0015] FIG. 9 is a drawing for explaining how a 3D image generated by distinguishing the hierarchy of an object according to one embodiment of the present disclosure is shown to a user.

[0016] FIG. 10 is a flowchart illustrating blurring an object placed in a high depth level layer according to one embodiment of the present disclosure.

[0017] FIG. 11 is a diagram showing the difference in the degree of blur effect according to the layer of an object according to one embodiment of the present disclosure.

[0018] FIG. 12 is a drawing showing a UI object placed together with a 3D image according to one embodiment of the present disclosure.

[0019] FIG. 13 is a flowchart illustrating a collision interaction according to movement of a UI object according to one embodiment of the present disclosure.

[0020] FIG. 14 is a drawing for explaining collision interaction according to movement of a UI object according to one embodiment of the present disclosure.

[0021] It should be understood that the various embodiments and terms used in this document are not intended to limit the technical features described in this document to specific embodiments, but rather to include various modifications, equivalents, or substitutes of the embodiments.

[0022] In connection with the description of the drawings, similar reference numerals may be used for similar or related components.

[0023] The singular form of a noun corresponding to an item may include one or more of said items, unless the relevant context clearly indicates otherwise.

[0024] In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" may include any one of the items listed together in that phrase, or all possible combinations thereof.

[0025] The term “and / or” includes any combination of a plurality of related described elements or any one of a plurality of related described elements.

[0026] Terms such as "first," "second," or "first" or "second" may be used simply to distinguish one component from another and do not qualify the components in any other respect (e.g., importance or order).

[0027] When a component (e.g., a first component) is referred to as being "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0028] The terms “include” or “have” are intended to specify the presence of a feature, number, step, operation, component, part or combination thereof described in this document, but do not preclude the presence or addition of one or more other features, numbers, steps, operations, components, parts or combinations thereof.

[0029] When a component is said to be “connected,” “coupled,” “supported,” or “in contact with” another component, this includes not only cases where the components are directly connected, coupled, supported, or in contact, but also cases where the components are indirectly connected, coupled, supported, or in contact through a third component.

[0030] When we say that a component is “on” another component, this includes not only cases where the component is in contact with the other component, but also cases where there is another component between the two components.

[0031] FIG. 1 is a drawing showing a control block diagram of an image generating device according to one embodiment of the present disclosure, and FIG. 2 is a flowchart showing a 3D image generating method according to one embodiment of the present disclosure.

[0032] The image generation device (1) may include an input device (20), a control unit (10), and a display (30), and the control unit (10) may include a processor (11) and a memory (12).

[0033] The control unit (10) may include a memory (12) that stores a control program and control data for generating a 3D image and controlling a display to output the same, and at least one processor (11) that generates a control signal according to the control program and control data stored in the memory (12). The memory (12) and the processor (11) may be provided integrally or separately.

[0034] The memory (12) can store at least one 2D image and 3D space type, and can store a program and data for generating a 3D image and controlling a display to output the same.

[0035] The memory (12) may include volatile memory such as Static Random Access Memory (S-RAM) and Dynamic Random Access Memory (D-RAP) for temporarily storing data. In addition, the memory (12) may include nonvolatile memory such as Read Only Memory (ROM), Erasable Programmable Read Only Memory (EPROM), and Electrically Erasable Programmable Read Only Memory (EEPROM) for long-term storage of data.

[0036] The processor (11) may include various logic circuits and operation circuits, process data according to a program provided from memory, and generate a control signal according to the processing result.

[0037] The processor (11) can generate and provide a 3D image based on the selected 2D image and 3D space type (205).

[0038] The processor (11) can input these 2D images into an artificial intelligence model to generate a 3D image. Here, the artificial intelligence model may include generative AI.

[0039] In one embodiment, the artificial intelligence model may be stored in memory (12) and / or an external device (e.g., a server).

[0040] When the artificial intelligence model is stored in the memory (12), the processor (11) can generate a 3D image by inputting a selected 2D image and 3D space type into the artificial intelligence model stored in the memory (12).

[0041] When the artificial intelligence model is stored only in the external device, the processor (11) transmits information about the selected 2D image and 3D space type to the external device through the communication module (40), the external device generates a 3D image by inputting the selected 2D image and 3D space type into the artificial intelligence model, and the external device transmits the generated 3D image to the image generating device (1), and thus, the processor (11) can generate a 3D image as a result.

[0042] That is, the operation of the processor (91) generating a 3D image by inputting the selected 2D image and 3D space type into the artificial intelligence model may include the operation of the processor (11) generating a 3D image by inputting the selected 2D image and 3D space type into the artificial intelligence model stored in the memory (12) and / or the operation of the processor (11) generating a 3D image by transmitting information about the selected 2D image and 3D space type to an external device in which the artificial intelligence model is stored through the communication module (40) and receiving the generated 3D image from the external device.

[0043] The communication module (40) may include at least one of a short-range communication module or a long-range communication module.

[0044] The communication module (40) can transmit data to an external device (e.g., a server, a user device, etc.) or receive data from an external device. For example, the communication module (40) can establish communication with a server and / or a user device and transmit and receive various types of data.

[0045] To this end, the communication module (40) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between external devices, and the performance of communication through the established communication channel. According to one embodiment, the communication module (40) can include a wireless communication module (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with the external device through a first network (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These different types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips).

[0046] The short-range wireless communication module may include, but is not limited to, a Bluetooth communication module, a BLE (Bluetooth Low Energy) communication module, a near field communication module, a WLAN (Wi-Fi) communication module, a Zigbee communication module, an infrared (IrDA, infrared Data Association) communication module, a WFD (Wi-Fi Direct) communication module, an UWB (ultrawideband) communication module, an Ant+ communication module, a microwave (uWave) communication module, etc.

[0047] In the case of such a communication module (40), a first communication module for communicating with a server and a second communication module for communicating with a user device, etc. may be provided separately, or communication may be performed with both the server and the user device, etc. in one communication module (40).

[0048] The input device (20) can receive input from a user, etc., of a selection of a 2D image and a 3D space type among at least 2D images and 3D space types stored in the memory (12) (201, 203). The input device (20) is not limited in its implementation method and can be implemented in various forms for receiving input from the user.

[0049] For example, it may include a tact switch, a push switch, a slide switch, a toggle switch, a micro switch, a touch switch, a touch pad, a touch screen, a jog dial, and / or a microphone.

[0050] Additionally, user input can be received from a separate device, such as a remote control, via the second communication module.

[0051] The input device (20) can also receive input in the form of voice from a user or the like.

[0052] In this case, the input device (20) may be implemented in the form of a microphone or the like to directly receive voice input from a user or the like, but voice input through a microphone provided in an external device such as a remote control may also be received by the communication module (40).

[0053] The display (30) can output a 3D image generated by the processor (11). The display (30) can include various types of displays capable of outputting 3D images, such as a monitor of a desktop or a display screen of a mobile device.

[0054] As another embodiment, the image generating device (1) may not include a display (30), but may be connected to a separate external device to output the generated 3D image to a display (not shown) provided in the external device.

[0055] That is, the image generation device (1) can be connected to an external device such as a separate TV or monitor via wired / wireless connection so that a 3D image generated by the image generation device (1) can be output to the external device.

[0056] In this case, the image generation device (1) may be provided with a separate output port for outputting the video / audio signal of the generated 3D image to an external device. That is, a video signal output port for outputting a video signal and an audio signal output port for outputting an audio signal may be provided separately or together in a single port.

[0057] The image generation device (1) can also transmit these video / audio signals to an external device through wireless communication, etc., via a communication module (40).

[0058] FIG. 3 is a diagram illustrating examples of 2D image and 3D space types according to one embodiment of the present disclosure.

[0059] As described above, users can select 2D image and 3D space types through the input device (20).

[0060] Users can select a 2D image that is already stored in memory, or they can upload a 2D image that they have taken themselves or obtained through other means and select the uploaded 2D image.

[0061] Additionally, the user can select at least one of the 3D space types stored in memory.

[0062] The 3D space type (302) may include, for example, a curved type (304), a cylinder type (306), and a cube type (308). These 3D space types (302) are merely examples and may include various forms of 3D space types.

[0063] The processor (11) can generate a 3D image based on a 2D image (300) and a 3D space type (302) selected by the user.

[0064] The process of generating a 3D image for each type of example is explained below.

[0065] FIGS. 4 to 6 are diagrams for explaining a process of generating a 3D image based on a 3D space type according to one embodiment of the present disclosure.

[0066] Referring to FIG. 4, the processor (11) can generate a 3D image of a curved type based on the selection of a curved type (402) among the 3D space types.

[0067] When the curved type (402) is selected, the processor (11) can place the selected 2D image (404) in a 2D unfolding shape (406) corresponding to the selected 3D space type (402).

[0068] Afterwards, in the 2D development form, an image connected to the 2D image can be generated using an artificial intelligence model (e.g., a generative AI model) for the remaining area (408, 410) other than the area occupied by the 2D image (404).

[0069] That is, when an existing 2D image (404) is arranged in a development form (406) corresponding to a curved type (402), the left / right areas (408, 410) of the existing 2D image may not be filled by the 2D image (404) and may be empty.

[0070] At this time, the remaining empty areas (408, 410) that are not filled by the 2D image (404) can be created as images that are connected to the existing 2D image (404).

[0071] In this regard, the artificial intelligence model can recognize images (visual understanding). The visual understanding of the artificial intelligence model is a technology that recognizes and processes objects, etc. like human vision, and can include object recognition, object tracking, image search, person recognition, scene understanding, spatial understanding, and image enhancement.

[0072] In the case of a 2D image (404) in which trees and mountains appear as shown in FIG. 4, an image can be created in which the trees and mountains appear in the remaining area (408, 410) so that they can be naturally connected with the existing 2D image (404).

[0073] As described above, the processor (11) may input the 2D image (404) into the generative AI model to generate an image for the remaining areas (408, 410), or the processor (11) may directly generate an image for the remaining areas (408, 410) as a generative AI model.

[0074] Referring to FIG. 5, the processor (11) can generate a 3D image of a cylinder type based on the selection of a cylinder type (502) among the 3D space types.

[0075] When a cylindrical type (502) is selected, the processor (11) can place the selected 2D image (504) in a 2D unfolding shape (506) corresponding to the selected 3D space type (502).

[0076] Afterwards, in the 2D development form (506), an image connected to the 2D image (504) can be generated using a generative AI model for the remaining area (508, 510) other than the area occupied by the 2D image (504).

[0077] That is, when an existing 2D image (504) is arranged in a development form (506) corresponding to a cylindrical type (502), the upper / lower (512, 514) and left / right areas (508, 510) of the existing 2D image (504) may not be filled by the 2D image and may be empty.

[0078] At this time, the remaining empty areas (508, 510, 512, 514) that are not filled by the 2D image can be created as images that are connected to the existing 2D image (504).

[0079] In the case of a 2D image (504) in which trees, mountains, roads, and the sky appear as shown in FIG. 5, an image can be created in which the trees, mountains, roads, and the sky appear in the remaining areas (508, 510, 512, 514) so ​​that the image can be naturally connected with the existing 2D image (504).

[0080] Specifically, an image showing a tree and a mountain can be generated in the left / right areas (508, 510) of a 2D image connected to a tree and a mountain, an image showing the sky can be generated in the upper area (514) of a 2D image connected to the sky, and an image showing a road can be generated in the lower area (512) of a 2D image connected to a road.

[0081] As described above, the processor (11) may input a 2D image into the generative AI model to generate an image for the remaining area, or the processor (11) may directly generate an image for the remaining area as the generative AI model.

[0082] Referring to FIG. 6, the processor (11) can generate a 3D image of a cube type based on the selection of a cube type (602) among the 3D space types.

[0083] When a cube type (602) is selected, the processor (11) can place the selected 2D image (604) in a 2D unfolding shape (606) corresponding to the selected 3D space type (602).

[0084] Afterwards, in the 2D unfolded form (606), an image connected to the 2D image (604) can be generated using a generative AI model for the remaining areas (608, 610, 612, 614) other than the area occupied by the 2D image. That is, when an existing 2D image (604) is arranged in an unfolded form (606) corresponding to a cube type (602), the upper / lower (612, 614) and left / right areas (608, 610) of the existing 2D image (604) may not be filled by the 2D image and may be empty.

[0085] At this time, the remaining empty areas (608, 610, 612, 614) that are not filled by the 2D image can be created as images that are connected to the existing 2D image (604).

[0086] In the case of a 2D image (604) in which trees, mountains, roads, and the sky appear as shown in FIG. 6, an image can be created in which the trees, mountains, roads, and the sky appear in the remaining areas (608, 610, 612, 614) so ​​that the image can be naturally connected with the existing 2D image (604).

[0087] Specifically, an image showing a tree and a mountain can be generated in the left / right areas (608, 610) of a 2D image connected to a tree and a mountain, an image showing the sky can be generated in the upper area (614) of a 2D image connected to the sky, and an image showing a road can be generated in the lower area (612) of a 2D image connected to a road.

[0088] As described above, the processor (11) may input a 2D image into the generative AI model to generate an image for the remaining area, or the processor (11) may directly generate an image for the remaining area as the generative AI model.

[0089] FIG. 7 is a flowchart illustrating generating a 3D image by distinguishing the hierarchy of an object according to one embodiment of the present disclosure.

[0090] As described above, the processor (11) can generate a 3D image based on the selection of a 2D image and a 3D space type (701).

[0091] Thereafter, the processor (11) can distinguish the layers between multiple objects included in the generated 3D image (703).

[0092] That is, it is possible to distinguish layers between multiple objects to provide a sense of three-dimensionality to users, etc.

[0093] For example, the plurality of objects may include a first object placed in a first layer and a second object placed in a second layer having a higher depth level than the first layer.

[0094] Here, each layer can have a different depth level on the 3D image.

[0095] That is, from the perspective of looking at a 3D image, a layer that is further back, that is, located backward within the 3D image, has a higher depth level, and from the perspective of looking at a 3D image, a layer that is further forward, that is, located forward within the 3D image, has a lower depth level.

[0096] Here, the rear is defined as the direction away from the user, based on the direction in which the user looks at the monitor, etc. In other words, as shown in Fig. 9, the farther away from the user, etc., is the rear, and the closer to the user, etc., is the front.

[0097] Therefore, in the present disclosure, a layer with a higher depth level can be positioned further back within a 3D image, and a layer with a lower depth level can be positioned further forward within a 3D image.

[0098] The processor can thus control the display so that the plurality of objects are sequentially displayed according to the depth level of each layer in which each of the plurality of objects is placed.

[0099] The processor (11) can generate an image that is connected to an image of an unobscured area of ​​the second object for an area where the first object is placed and the second object is obscured within the area where the second object is placed.

[0100] That is, an object of a lower depth level layer is placed within an object area placed in a higher depth level layer, so that an image can be generated that is connected to an image of an unoccluded area of ​​an object of a higher depth level for an area where an object placed in a higher depth level layer is occluded.

[0101] Details about this are explained with reference to Fig. 8.

[0102] FIG. 8 is a drawing showing a process of generating a 3D image by dividing the hierarchy of an object according to one embodiment of the present disclosure, and FIG. 9 is a drawing for explaining how a 3D image generated by dividing the hierarchy of an object according to one embodiment of the present disclosure is shown to a user.

[0103] In step S01, the processor (11) can distinguish between layers of multiple objects included in the generated 3D image. That is, it can distinguish between objects placed in layers of a relatively low depth level and objects placed in layers of a relatively high depth level.

[0104] Thereafter, as in step S02, the processor (11) can divide the plurality of distinct objects. That is, it can divide them into a human-shaped object (O1) arranged in a layer of the lowest depth level, a beach-shaped object (O2) arranged in a layer of a higher depth level than the layer in which the human-shaped object (O1) is arranged, and a sky-shaped object (O3) arranged in a layer of the highest depth level.

[0105] Thereafter, as in step S03, the processor (11) can generate an image that is connected to an image of an unobscured area for a part of an object of a high depth level layer that is obscured by an object of a low depth level layer in each segmented object.

[0106] Specifically, in the case of a beach-shaped object (O2), an image that is connected to an image of an unoccluded area of ​​the beach-shaped object (O2) can be created and filled in for the area of ​​the beach-shaped object (O2) that is occluded by a human-shaped object (O1) located in a lower depth level layer. Accordingly, the unfilled area of ​​the human-shaped object (O2) in the beach-shaped object (O2) can be filled in so that the entire beach-shaped object (O2) can be displayed.

[0107] In addition, in the case of the sky-shaped object (O3), an image that is connected to an image of an unoccluded area of ​​the sky-shaped object (O3) can be created and filled in for the area of ​​the sky-shaped object (O3) that is covered by the human-shaped object (O1) and the beach-shaped object (O2) located in a lower depth level layer. Accordingly, the unfilled areas of the human-shaped and beach-shaped objects among the sky-shaped objects (O3) can be filled in so that the entire sky-shaped object (O3) can be displayed.

[0108] By arranging these according to the hierarchy, a 3D image that can provide a three-dimensional effect from the user's perspective, as shown in Fig. 9, can be created.

[0109] That is, when a user looks at a monitor, etc., a 3D image can be created that makes it feel as if a human-shaped object (O1) is placed at the front, the beach is placed behind it, and the sky is placed at the back.

[0110] FIG. 10 is a flowchart illustrating blurring an object placed in a high depth level layer according to one embodiment of the present disclosure, and FIG. 11 is a diagram illustrating a difference in the degree of blur effect according to the layer of an object according to one embodiment of the present disclosure.

[0111] An image generating device can generate a 3D image (1001). The image generating device can distinguish objects among multiple objects included in the 3D image (1003). That is, as shown in FIG. 8, objects can be segmented from other objects based on depth levels. The image generating device can blur objects located in a layer (a layer further back from a user's perspective) at a higher depth level relative to other objects in the 3D image (1005).

[0112] To improve the visibility of 3D images, etc., the processor (11) can blur objects placed in a layer with a relatively high depth level.

[0113] That is, in the case of a 3D image composed of a first object placed in the first layer as described above and a second object placed in the second layer having a higher depth level than the first layer, the second object placed relatively further back from the user's perspective, etc., is blurred to make the first object placed in the front more visible, thereby providing an effect of improving visibility and three-dimensionality.

[0114] The processor (11) can control the display (30) to output the second object to which the blur effect is applied.

[0115] If a third object is further included in the third layer having a higher depth level than the second layer, the processor (11) can blur the third object at a higher level than the second object.

[0116] That is, as shown in Fig. 11, the visibility and three-dimensionality can be further improved by applying a higher level of blur effect to an object placed in a layer with a higher depth level.

[0117] Taking Fig. 9 as an example, a human-shaped object (O1) placed in the layer with the lowest depth level may not be blurred, a beach-shaped object (O2) may be blurred at a level of about 25%, and a sky-shaped object (O3) placed in the layer with the highest depth level may be blurred at a higher level of about 50%. The blur effect levels shown here are merely examples and may be set to various levels to enhance visibility and three-dimensionality.

[0118] FIG. 12 is a drawing showing a UI object placed together with a 3D image according to one embodiment of the present disclosure.

[0119] UI objects can be placed within the background of a computer, etc. In this case, the relationship between multiple objects within a 3D image and UI objects is described below.

[0120] As described above, a 3D image composed of a first object placed in a first layer and a second object placed in a second layer having a higher depth level than the first layer may further include a UI object placed in a fourth layer having a higher depth level than the first layer and a lower depth level than the second layer.

[0121] In this case, the processor (11) can control the display (30) to blur a second object located in a layer with a higher depth level than the UI object (U) and output the second object with the blur effect applied.

[0122] That is, the visibility of the UI object (U) can be improved by blurring an object placed relatively further back than the UI object (U).

[0123] When a UI object (U) is further included on the generated 3D image as illustrated in FIG. 12, the processor (11) can place the UI object (U) in an appropriate layer so that it is positioned in front of a specific object (O5) and behind another object (O4).

[0124] The placement of these UI objects (U) can be performed by an artificial intelligence model, etc. to place them in an appropriate position to improve user visibility.

[0125] When a UI object (U) is placed in the middle of a mountain-shaped object (O4) and a mountain-shaped object (O5) including a tree, as shown in Fig. 12, the processor (11) can blur the mountain-shaped object (O5) including a tree, which is placed in a layer with a higher depth level than the UI object (U).

[0126] FIG. 13 is a flowchart illustrating a collision interaction according to movement of a UI object according to one embodiment of the present disclosure, and FIG. 14 is a drawing for explaining a collision interaction according to movement of a UI object according to one embodiment of the present disclosure.

[0127] In a 3D image composed of a first object arranged in a first layer as described above and a second object arranged in a second layer having a higher depth level than the first layer, if a UI object (U) arranged in a fourth layer having a higher depth level than the first layer and a lower depth level than the second layer is further included, the processor (11) may control the display (30) to output a UI object that moves the UI object (U) to a layer having a lower depth level than the first layer based on receiving a user input related to moving the UI object to a layer having a lower depth level than the first layer (1301) (1303). The processor (11) may apply a collision effect to the first object based on the movement of the UI object to another layer (1304).

[0128] Afterwards, when the UI object reaches the first layer, the display can be controlled to output the UI object with the collision effect applied and the first object (1305).

[0129] That is, when a mountain-shaped object (O4) located in a layer of a lower Depth level than a UI object (U) and an object (O5) located in a layer of a higher Depth level than the UI object (U) are included, as shown in FIG. 12, in response to receiving a user input (1301) for moving the UI object to a layer of a lower Depth level than the mountain-shaped object (O4), the processor (11) can move the UI object to a layer of a lower Depth level than the mountain-shaped object (O4) (1302).

[0130] Thereafter, when the UI object (U) reaches the same layer as the layer where the mountain-shaped object (O4) is placed during the movement of the UI object, the processor (11) can control the display (30) to apply a collision effect to the UI object (U) and the mountain-shaped object (O4), and output the UI object (U) and the mountain-shaped object (O4) to which the collision effect is applied.

[0131] As illustrated in Fig. 14, a user input may be received to move a UI object (U) forward relative to an object (O4) located at a lower depth level than the UI object (U). This user input may be a motion such as a movement of the user's hand, or may be an input using a separate device such as a mouse.

[0132] When the processor (11) moves the position of the UI object (U) to a layer with a lower depth level according to this gesture, if each object overlaps with an object (O4) placed in a layer with a lower depth level than the UI object (U) in the same layer, a collision effect can be applied to the UI object (U) and the object (O4) in the process of moving the UI object (U) to a layer with a lower depth level.

[0133] For example, various types of collision effects can be applied, such as processing an object (O4) placed in a layer with a lower depth level than the existing UI object (U) to vibrate, processing it to move forward together with the UI object (U) and then move backward again, or processing the UI object (U) to be partially tilted by the object (O4) and then return to its original shape. By applying these collision effects, the user can feel a sense of liveliness.

[0134] An image generating device according to one embodiment may include: a memory; a display; an input device; and at least one processor for receiving a user input for selecting at least one 2D image and a 3D space type stored in the memory through the input device, generating a 3D image based on the selected at least one 2D image and one 3D space type, and controlling the display to output the generated 3D image.

[0135] According to the present disclosure, a 3D image can be generated based on a 2D image, thereby enabling a user to easily obtain a desired 3D image.

[0136] The at least one processor identifies distinct layers among the plurality of objects included in the generated 3D image, and the distinct layers may have different depth levels.

[0137] The plurality of objects include a first object arranged in a first layer; a second object arranged in a second layer located at a higher depth level than the first layer; and the processor can generate an image that is connected to an image of an unobscured area of ​​the second object for an area in which the first object is arranged and the second object is obscured within an area in which the second object is arranged.

[0138] The processor can control the display to blur the second object and output the second object with the blur effect applied.

[0139] A third object disposed in a third layer at a higher depth level than the second layer; wherein the processor can control the display to output the third object to which a blur effect of a higher level than that of the second object is applied.

[0140] The processor can control the display so that the plurality of objects are sequentially displayed according to the depth level of each layer in which the plurality of objects are arranged.

[0141] The plurality of objects further include a UI object arranged in a fourth layer located at a higher depth level than the first layer and a lower depth level than the second layer; and the processor can control the display to blur the second object arranged in the second layer located at a higher depth level than the fourth layer and output the second object to which the blur effect has been applied.

[0142] The processor may control the display to output the UI object moved to a layer having a depth level lower than the first layer based on the user input when a user input related to moving the UI object to a layer having a depth level lower than the first layer is received.

[0143] The processor can control the display to output the UI object and the first object with the collision effect applied when the UI object reaches the first layer.

[0144] The processor can generate the 3D image by arranging the selected 2D image in a 2D unfolded shape corresponding to the selected 3D space type and structuring the 2D image of the 2D unfolded shape into a 3D shape corresponding to the selected 3D space type.

[0145] According to one embodiment, an image generation method may include: receiving a user input for selecting a 2D image; receiving a user input for selecting a 3D space type; generating a 3D image based on one 2D image and one 3D space type corresponding to the received user input; identifying distinct layers having different depth levels among a plurality of objects included in the generated 3D image; and outputting the generated 3D image.

[0146] The plurality of objects may include a first object arranged in a first layer; a second object arranged in a second layer located at a higher depth level than the first layer; and the step of generating a 3D image may include generating an image connected to an image of an unobscured area of ​​the second object for an area in which the first object is arranged and the second object is obscured within an area in which the second object is arranged.

[0147] The step of outputting the 3D image may include blurring the second object and outputting the second object with the blur effect applied.

[0148] A third object is positioned in a third layer at a higher depth level than the second layer; and the step of outputting the 3D image may include outputting the third object to which a blur effect of a higher level than that of the second object is applied.

[0149] The step of outputting the 3D image may include sequentially displaying the plurality of objects according to the depth level of each layer in which the plurality of objects are arranged.

[0150] The plurality of objects may further include a UI object arranged in a fourth layer located at a higher depth level than the first layer and a lower depth level than the second layer; and the step of outputting the 3D image may include blurring the second object arranged in the second layer located at a higher depth level than the fourth layer, and outputting the second object to which the blur effect has been applied.

[0151] The step of outputting the 3D image may include, when a user input related to moving the UI object to a layer having a lower depth level than the first layer is received, outputting the UI object moved to a layer having a lower depth level than the first layer based on the user input.

[0152] The step of outputting the 3D image may include outputting the UI object with the collision effect applied and the first object when the UI object reaches the first layer.

[0153] Generating the 3D image may include arranging the selected 2D image in a 2D development form corresponding to the selected 3D space type, and structuring the 2D image of the 2D development form into a 3D form corresponding to the selected 3D space type to generate the 3D image.

[0154] According to the disclosed invention, a 3D image can be generated based on a 2D image, thereby enabling a user to easily obtain a desired 3D image.

[0155] Meanwhile, the disclosed embodiments may be implemented in the form of a recording medium storing computer-executable instructions. The instructions may be stored in the form of program code, and when executed by a processor, may generate program modules to perform the operations of the disclosed embodiments. The recording medium may be implemented as a computer-readable recording medium.

[0156] Computer-readable storage media include all types of storage media that store instructions that can be deciphered by a computer. Examples include read-only memory (ROM), random access memory (RAM), magnetic tape, magnetic disks, flash memory, and optical data storage devices.

[0157] The disclosed embodiments have been described with reference to the attached drawings as described above. Those skilled in the art will understand that the present invention can be implemented in forms other than the disclosed embodiments without altering the technical spirit or essential features of the present invention. The disclosed embodiments are illustrative and should not be construed as limiting.

Claims

1. Memory; display; input device; Receiving user input for selection of at least one 2D image and 3D space type stored in the memory through the input device, Providing a 3D image based on at least one selected 2D image and one 3D space type, An image generating device comprising at least one processor for controlling the display to output the provided 3D image.

2. In paragraph 1, At least one processor, Identifying distinct layers among multiple objects included in the provided 3D image, The above distinct layers are, An image generating device with different depth levels.

3. In paragraph 2, The above multiple objects are, The first object placed on the first layer; a second object placed in a second layer having a higher depth level than the first layer; The above processor, An image generating device that provides an image that is connected to an image of an unobscured area of ​​the second object for an area where the first object is placed and the second object is obscured.

4. In paragraph 3, The above processor, An image generating device that blurs the second object and controls the display to output the second object to which the blur effect is applied.

5. In paragraph 4, a third object placed in a third layer having a higher depth level than the second layer; The above processor, An image generating device that controls the display to output the third object to which a higher level of blur effect is applied than the second object.

6. In paragraph 5, The above processor, An image generating device that controls the display so that the plurality of objects are sequentially displayed according to the depth level of each layer in which the plurality of objects are arranged.

7. In paragraph 3, The above multiple objects are, Further comprising a UI object placed in a fourth layer having a depth level higher than the first layer and a depth level lower than the second layer; The above processor, An image generating device that blurs the second object placed in the second layer having a higher depth level than the fourth layer and controls the display to output the second object to which the blur effect is applied.

8. In paragraph 7, The above processor, An image generating device that controls the display to output the UI object moved to a layer of a lower depth level than the first layer based on the user input when a user input related to moving the UI object to a layer of a lower depth level than the first layer is received.

9. In paragraph 8, The above processor, An image generating device that controls the display to output the UI object and the first object to which a collision effect is applied when the UI object reaches the first layer.

10. In paragraph 1, The above processor, An image generating device that places the selected 2D image in a 2D development form corresponding to the selected 3D space type, structures the 2D image of the 2D development form into a 3D form corresponding to the selected 3D space type, and provides the 3D image. Step of receiving user input for selection of 11.2D image; A step of receiving user input for selection of a 3D space type; A step of providing a 3D image based on the selected 2D image and 3D space type; and An image generation method comprising the step of outputting the provided 3D image.

12. In paragraph 11, Further comprising a step of identifying distinct layers having different depth levels among a plurality of objects included in the provided 3D image; The above multiple objects are, The first object placed on the first layer; a second object placed in a second layer having a higher depth level than the first layer; The step of providing the above 3D image is: An image generation method comprising providing an image that is connected to an image of an unobscured area of ​​the second object for an area where the first object is placed and the second object is obscured within the area where the second object is placed.

13. In paragraph 12, The step of outputting the above 3D image is: An image generation method comprising blurring the second object and outputting the second object to which the blur effect is applied.

14. In paragraph 13, a third object placed in a third layer having a higher depth level than the second layer; The step of outputting the above 3D image is: An image generation method comprising outputting a third object to which a higher level of blur effect is applied than that of the second object.

15. In paragraph 14, The step of outputting the above 3D image is: An image generation method comprising sequentially displaying the plurality of objects according to the depth level of each layer in which the plurality of objects are arranged.

Images