Electronic device, and operating method of electronic device
By determining and transforming objects within a frustum using processor-executed instructions, the electronic device addresses rendering inaccuracies in three-dimensional content, ensuring accurate and clear image display.
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2025-07-22
- Publication Date
- 2026-03-05
AI Technical Summary
Existing electronic devices struggle with rendering three-dimensional content accurately, leading to issues such as object culling, clipping, and crosstalk due to objects not being within the frustum or being positioned incorrectly, which affects the intended image quality and user experience.
An electronic device and method that utilize processor-executed instructions to determine the location of objects within a frustum and transform objects outside the frustum to be within it, using bounding box algorithms and spatial guide information to adjust size and position, ensuring all objects are correctly positioned and visible.
The solution ensures that all intended objects are rendered without clipping or crosstalk, providing a clear and accurate three-dimensional image that reflects the creator's intent, enhancing user experience.
Smart Images

Figure KR2025010829_05032026_PF_FP_ABST
Abstract
Description
Electronic devices and methods of operating electronic devices
[0001] The present disclosure relates to an electronic device and a method of operating the electronic device. Specifically, the present disclosure relates to an electronic device and a method of operating the electronic device for obtaining corrected content by converting content including a plurality of objects.
[0002] Advances in electronic technology have led to the development and proliferation of various types of electronic devices. Electronic devices, including display devices that display images, have been rapidly evolving in recent years.
[0003] As electronic devices advance, the types of images they display have diversified. Devices capable of displaying not only 2D (two-dimensional) images but also 3D (three-dimensional) images are being developed.
[0004] In addition, in line with these technological advancements, we are providing a Software Development Kit (SDK) to help creators who create content or videos that can be used on various electronic devices create content or videos more easily.
[0005] One embodiment of the present disclosure provides an electronic device. The electronic device may include a memory storing at least one instruction. The electronic device may include at least one processor including a processing circuit. By having the at least one processor individually or collectively execute at least one instruction stored in the memory, the electronic device may obtain camera information including information about a frustum. By having the at least one processor individually or collectively execute at least one instruction, the electronic device may obtain three-dimensional content including a plurality of objects arranged in a space including the frustum. By having the at least one processor individually or collectively execute at least one instruction, the electronic device may determine, based on the frustum and the three-dimensional content, whether each of the plurality of objects is located within the frustum. By having at least one processor individually or collectively execute at least one instruction, the electronic device can obtain the corrected content by transforming at least one object located outside a frustum among a plurality of objects to be located inside the frustum.
[0006] According to one embodiment of the present disclosure, a method of operating an electronic device may be provided. The method of operating the electronic device may include a step of acquiring camera information including information about a frustum. The method of operating the electronic device may include a step of acquiring three-dimensional content including a plurality of objects arranged in a space including the frustum. The method of operating the electronic device may include a step of determining, based on the frustum and the three-dimensional content, whether each of the plurality of objects is located inside the frustum. The method of operating the electronic device may include a step of acquiring corrected content by transforming at least one object, among the plurality of objects, located outside the frustum so that the at least one object is located inside the frustum.
[0007] As one embodiment of the present disclosure, a computer-readable recording medium having recorded thereon a program for performing at least one of the operating methods of the disclosed electronic device on a computer can be provided.
[0008] The technical problems to be achieved in this document are not limited to the technical problems mentioned above, and other technical problems not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present disclosure belongs from the description below.
[0009] The present disclosure may be understood in conjunction with the following detailed description and accompanying drawings, wherein reference numerals refer to structural elements.
[0010] FIG. 1 is a drawing for explaining the operation of an electronic device according to one embodiment of the present disclosure.
[0011] FIG. 2 is a block diagram illustrating the configuration of an electronic device according to one embodiment of the present disclosure.
[0012] FIG. 3 is a flowchart illustrating the operation of an electronic device according to one embodiment of the present disclosure.
[0013] FIG. 4 is a flowchart illustrating an operation for determining whether each of a plurality of objects is located within a frustum according to one embodiment of the present disclosure.
[0014] FIG. 5 is a flowchart illustrating an operation of transforming or filtering an object to obtain correction content according to one embodiment of the present disclosure.
[0015] FIG. 6A is a flowchart illustrating an operation of obtaining correction content by transforming an object according to one embodiment of the present disclosure.
[0016] FIG. 6b is a diagram for explaining an operation of obtaining correction content by transforming an object according to one embodiment of the present disclosure.
[0017] FIG. 7A is a flowchart illustrating an operation of obtaining correction content by transforming an intermediate object located in a space adjacent to the camera rather than the effective plane according to one embodiment of the present disclosure.
[0018] FIG. 7b is a diagram for explaining an operation of obtaining correction content by transforming an intermediate object located in a space adjacent to the camera rather than the effective plane according to one embodiment of the present disclosure.
[0019] FIG. 8A is a flowchart illustrating an operation of obtaining correction content by transforming a border object so that a plurality of objects are positioned within a valid area according to one embodiment of the present disclosure.
[0020] FIG. 8b is a diagram for explaining an operation of obtaining correction content by transforming a border object so that a plurality of objects are positioned within a valid area according to one embodiment of the present disclosure.
[0021] FIG. 9A is a flowchart illustrating an operation of obtaining corrected content by transforming a text object so that the text object is positioned on the zero-plane according to one embodiment of the present disclosure.
[0022] FIG. 9b is a diagram for explaining an operation of obtaining corrected content by transforming a text object so that the text object is located on the zero-plane according to one embodiment of the present disclosure.
[0023] FIG. 10 is a flowchart illustrating the operation of an electronic device according to one embodiment of the present disclosure.
[0024] FIG. 11 is a drawing illustrating an electronic device including a display for displaying correction content according to one embodiment of the present disclosure.
[0025] The terms used in this disclosure will be briefly explained, and one embodiment of the present disclosure will be specifically described.
[0026] Throughout this disclosure, unless specifically stated otherwise, "or" is inclusive and not exclusive. Thus, unless explicitly stated otherwise or context dictates otherwise, "A or B" may refer to "A, B, or both."
[0027] In this disclosure, the expression “at least one of a, b or c” may refer to “a”, “b”, “c”, “a and b”, “a and c”, “b and c”, “all of a, b and c”, or variations thereof.
[0028] The terms used in this disclosure are selected from widely used, current terms, taking into account the functions of one embodiment of the disclosure. However, these terms may vary depending on the intentions of those skilled in the art, precedents, the emergence of new technologies, etc. Furthermore, in certain cases, terms may be arbitrarily selected by the applicant, and in such cases, their meanings will be described in detail in the description of the relevant embodiments of the disclosure. Therefore, the terms used in this disclosure should not be defined simply as names of terms, but rather based on the meanings of the terms and the overall content of the disclosure.
[0029] Singular expressions may include plural expressions unless the context clearly indicates otherwise. Terms used herein, including technical or scientific terms, have the same meaning as commonly understood by a person of ordinary skill in the art described herein.
[0030] Throughout this disclosure, when a part is said to "include" a component, this does not exclude other components, but rather implies the inclusion of other components, unless otherwise specifically stated. Furthermore, terms such as "part," "module," and the like described herein refer to a unit that processes at least one function or operation, which may be implemented in hardware or software, or a combination of hardware and software.
[0031] The expression “configured to” as used herein can be used interchangeably with, for example, “suitable for,” “having the capacity to,” “designed to,” “adapted to,” “made to,” or “capable of.” The term “configured to” does not necessarily mean something that is “specifically designed to” in terms of hardware. Instead, in some contexts, the expression “a system configured to” can mean that the system is “capable of” doing something together with other devices or components. For example, the phrase “a processor configured (or set) to perform A, B, and C” may mean a dedicated processor (e.g., an embedded processor) for performing those operations, or a generic-purpose processor (e.g., a CPU or application processor) that can perform those operations by executing one or more software programs stored in memory.
[0032] Additionally, when a component is referred to as being “connected” or “connected” to another component in the present disclosure, it should be understood that the component may be directly connected or connected to the other component, but may also be connected or connected via another component in between, unless otherwise specifically stated.
[0033] It should be understood that the blocks and combinations of flowcharts in each flowchart can be executed by one or more computer programs containing computer-executable instructions. The one or more computer programs may be stored entirely in a single memory, or may be stored in separate portions across multiple different memories.
[0034] Any function or operation described in this document may be performed by a single processor or a combination of multiple processors.
[0035] Below, with reference to the attached drawings, embodiments of the present disclosure are described in detail so that those skilled in the art can easily implement the present disclosure. However, one embodiment of the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein. In addition, in the drawings, parts irrelevant to the description are omitted to clearly describe one embodiment of the present disclosure, and similar parts are designated with similar drawing reference numerals throughout the present disclosure.
[0036] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings.
[0037] FIG. 1 is a drawing for explaining the operation of an electronic device according to one embodiment of the present disclosure.
[0038] Referring to FIG. 1, in one embodiment of the present disclosure, an electronic device (100) may acquire content (300) including a plurality of objects arranged in a space including a frustum (200). The electronic device (100) may transform the content (300) so that each of the plurality of objects included in the acquired content (300) is positioned within the frustum (200), thereby acquiring corrected content (400).
[0039] In one embodiment of the present disclosure, the electronic device (100) may be implemented as an electronic device of various shapes, such as a desktop, a set-top box, or a server device. The electronic device (100) may receive content (300) from an external electronic device (e.g., an image generating device) connected through an input / output interface, and provide the acquired corrected content (400) to an external electronic device (e.g., an image display device). In addition, the electronic device (100) may receive content (300) from an external electronic device or an external server through a communication interface, and provide the acquired corrected content (400) to the external electronic device or the external server.
[0040] However, the present disclosure is not limited thereto, and content (300) may be generated through an electronic device (100), and the electronic device (100) may convert the generated content (300) to obtain corrected content (400).
[0041] In one embodiment of the present disclosure, content (300) may be three-dimensional content that includes multiple objects and can provide a three-dimensional effect to a user receiving the content. In one embodiment of the present disclosure, content (300) may be content produced to be used on a video display device. Hereinafter, content (300) may also be referred to as three-dimensional content.
[0042] In one embodiment of the present disclosure, the video display device may be an electronic device including a display that provides a user with different images corresponding to each of a plurality of views, depending on the position of the user viewing the image. In this case, a "view" may correspond to a position where the user can view different sides of an object included in the image provided through the video display device.
[0043] In one embodiment of the present disclosure, the image display device may include a light field display device. The image display device may display a three-dimensional image including depth information and provide the image to a user viewing the image.
[0044] In one embodiment of the present disclosure, the image display device may provide the image generation device with information, such as a Software Development Kit (SDK), that can be used to generate content (300) that can be used in the image display device. The SDK may include spatial guide information regarding a space in which a three-dimensional image including depth information can be displayed through the image display device.
[0045] In addition, the software development kit may include information about the position of the "camera (500)" looking at the content (300), the "view-direction (510)" in which the camera looks at the content (300), and the frustum (200). At this time, the "frustum" may refer to a space rendered by an image providing device. The frustum (200) may refer to a space in which the content (300) is rendered and displayed in the view-direction (510) of the camera based on the camera (500) in the image providing device. An object placed in an area adjacent to the camera (500) in the frustum (200) may be displayed as being located close to a user in the image display device. An object placed in an area far from the camera (500) in the frustum (200) may be displayed as being located far from a user in the image display device.
[0046] In one embodiment of the present disclosure, the image generation device may be an electronic device that generates content (300) to be displayed on the image display device based on a software development kit obtained from the image display device. Specifically, the image generation device may include a desktop, a set-top box, or a server device. The image generation device may provide an application, program, or web page capable of generating content (300) to a user using the image generation device. The user may generate content (300) by providing an input for generating content (300) to the image generation device (100).
[0047] In one embodiment of the present disclosure, a user may set the position of a camera (500), the view direction (510) of the camera (500), or the frustum (200) as desired through the image generation device (100). At this time, the user may set the size, shape, or position of the frustum (200) based on the acquired spatial guide information.
[0048] In one embodiment of the present disclosure, content (300) may be generated to include a plurality of objects. The size, shape, position, etc. of the plurality of objects included in the content (300) may be generated by considering the position of the set camera (500), the “view direction (510)” in which the camera views the content (300), and the frustum (200).
[0049] At this time, among the multiple objects included in the content (300), at least one object that is not located within the frustum (200) may be culled or clipped when rendered by the video display device. Accordingly, content different from the intention of the user who created the content (300) by the video generation device may be implemented on the video display device and provided to the user viewing the video.
[0050] Accordingly, the electronic device (100) of the present disclosure can obtain camera information including information about a frustum (200) from an image generating device. At this time, the camera information may include information about a camera (500) viewing content (300) and a view direction (510) of the camera (500).
[0051] In one embodiment of the present disclosure, the electronic device (100) can determine whether each of a plurality of objects included in the content (300) is located inside a frustum (200), and can obtain corrected content (400) by transforming at least one object so that at least one object located outside the frustum (200) among the plurality of objects is located inside the frustum (200).
[0052] Specifically, the frustum (200) may include a near-plane (210) and a far-plane (220), each perpendicular to the view direction (510). The near-plane may be a plane closer to the camera (500) than the far-plane. The electronic device (100) may acquire corrected content (400) by reducing the size of content (300) and moving the reduced content to be located within the frustum (200).
[0053] In one embodiment of the present disclosure, the electronic device (100) may reduce the size of the content (300) so that a first object (310) located in the space between the near-plane (210) and the camera (500) among a plurality of objects is located in the space between the near-plane (210) and the far-plane (220), and then move the content (300) in the view direction (510). Accordingly, the first reduced object (410), which is the reduced first object (310), may be moved in the view direction (510) and positioned in the space between the near-plane (210) and the far-plane (220).
[0054] In addition, the second object (320) and the third object (330) located in the space between the near-plane (210) and the far-plane (220) among the plurality of objects, and the second reduced object (420) and the third reduced object (430) can also be moved together in the view-direction (510).
[0055] However, the present disclosure is not limited thereto, and the electronic device (100) may filter out objects among a plurality of objects that are far from the frustum (200) and thus difficult to transform to be located inside the frustum (200).
[0056] In addition, among the multiple objects included in the content (300), at least one object located inside the frustum (200) set by considering the spatial guide information in the software development kit provided by the video display device may cause crosstalk in which multiple images corresponding to multiple views overlap due to the nature of the video display device that provides different images to the user in each of the multiple views depending on the position of the user viewing the image. Therefore, a clear image cannot be provided to the user viewing the image.
[0057] In particular, such crosstalk may occur in an object located in the space between the effective plane (230) and the near plane (210), which are preset as planes on which content (300) is optimally displayed in a video display device. In this case, the effective plane may be a plane calculated in advance based on characteristics such as the resolution and size of the display included in the video display device.
[0058] Accordingly, the electronic device (100) of the present disclosure can obtain the correction content (400) by transforming at least one object located in the space between the near-plane (210) and the effective-plane (230) among a plurality of objects so that the at least one object is located in the space between the effective-plane (230) and the near-plane (220) when the near-plane (210) is closer to the camera (500) than the effective-plane (230).
[0059] Specifically, the frustum (200) may include an effective plane (230) perpendicular to the view direction (510). The electronic device (100) may obtain the corrected content (400) by reducing the size of the content (300) and moving the reduced content to be positioned in the space between the effective plane (230) and the original plane (220).
[0060] In addition, even if the content (300) is created so that multiple objects are placed inside the frustum (200), crosstalk may occur in which multiple images corresponding to multiple views overlap in at least one object included in the outline area of the display included in the video display device due to the characteristics of the video display device.
[0061] In one embodiment of the present disclosure, the frustum (200) may include a top-plane, a bottom plane, a left-plane, and a right-plane.
[0062] At this time, the area composed of the upper plane, lower plane, left plane, and right plane may be referred to as the active area. The active area may include an effective area and an outline area surrounding the effective area. The ratio of the effective area and the outline area within the active area may be predetermined depending on the type, resolution, size, etc. of the display included in the video display device.
[0063] The electronic device (100) of the present disclosure can obtain correction content (400) by transforming at least one object located in a border area among a plurality of objects so that at least one object is located within a valid area.
[0064] Specifically, the electronic device (100) can obtain the corrected content (400) by reducing the size of the content (300) and moving the reduced content to be positioned within the effective area.
[0065] In addition, if a text type object is included among the multiple objects included in the content (300), crosstalk may occur in which multiple images corresponding to multiple views overlap with the object due to the nature of the text composed of a combination of thin lines.
[0066] The electronic device (100) of the present disclosure can obtain corrected content (400) by transforming at least one object of a text type among a plurality of objects so that the object is located in a zero-plane including depth information of “0” among a frustum (200).
[0067] Specifically, the electronic device (100) can adjust the size of at least one object and move the adjusted at least one object to be positioned on the zero plane to obtain the correction content (400).
[0068] Accordingly, when the corrected content (400) obtained by the electronic device (100) of the present disclosure is rendered on a video display device, at least one object may not be culled or clipped. Accordingly, an image that sufficiently reflects the intention of the user who created the content (300) can be provided to a user using the video display device.
[0069] Additionally, when the correction content (400) obtained by the electronic device (100) of the present disclosure is rendered on a video display device, crosstalk can be prevented from occurring in at least one object. Accordingly, a clear image can be provided to a user viewing the image.
[0070] However, the present disclosure is not limited thereto. The electronic device (100) may be an electronic device including a display. The electronic device (100) may be implemented as electronic devices of various shapes, such as a television, a mobile device, a smart phone, a laptop computer, a desktop, a tablet PC, a digital signage, a projector, and a wearable device. The operations of the image generation device and the image display device described above may both be performed through the electronic device (100). The electronic device (100) may also display the corrected content (400) obtained by converting the generated content (300) through the display.
[0071] FIG. 2 is a block diagram illustrating the configuration of an electronic device according to one embodiment of the present disclosure.
[0072] Referring to FIGS. 1 and 2, in one embodiment of the present disclosure, an electronic device (100) may include a memory (110), at least one processor (120), an input / output interface (130), and a communication interface (140).
[0073] However, not all of the components illustrated in FIG. 2 are essential components. The electronic device (100) may be implemented with more components than those illustrated in FIG. 2, or with fewer components. In one embodiment of the present disclosure, the electronic device (100) may further include a display. Hereinafter, a case in which the electronic device (100) includes a display will be described later with reference to FIG. 11.
[0074] The memory (110), at least one processor (120), input / output interface (130), and communication interface (140) included in the electronic device (100) may each be electrically connected to each other.
[0075] In one embodiment of the present disclosure, the memory (110) may store instructions, data structures, and program codes that can be read by at least one processor (120). In one embodiment of the present disclosure, there may be more than one memory (110). Operations performed by the electronic device (100) may be implemented by at least one processor (120) executing instructions or codes of a program stored in the memory (110).
[0076] In one embodiment of the present disclosure, the memory (110) may include at least one of a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), a RAM (Random Access Memory), a SRAM (Static Random Access Memory), a ROM (Read-Only Memory), an EEPROM (Electrically Erasable Programmable Read-Only Memory), a PROM (Programmable Read-Only Memory), a Mask ROM, a Flash ROM, etc.), a hard disk drive (HDD), or a solid state drive (SSD).
[0077] In one embodiment of the present disclosure, the memory (110) may not exist separately and may be configured to be included in at least one processor (120).
[0078] In one embodiment of the present disclosure, the memory (110) may store instructions or program codes for performing functions or operations of the electronic device (100). The instructions, algorithms, data structures, program codes, and application programs stored in the memory (110) may be implemented in a programming or scripting language such as, for example, C, C++, Java, Python, or an assembler.
[0079] In one embodiment of the present disclosure, various types of modules that can be used to perform operations of the electronic device (100) may be stored in the memory (110).
[0080] In one embodiment of the present disclosure, a memory (110) may store a position determination module (111) and an object transformation module (114). The position determination module (111) may include a bounding box acquisition module (112) and a volume calculation module (113). The object transformation module (114) may include a size adjustment module (115) and a position movement module (116).
[0081] However, not all of the modules illustrated in FIG. 2 are required. The memory (110) may store more or fewer modules than the modules illustrated in FIG. 2.
[0082] In one embodiment of the present disclosure, a 'module' included in the memory (110) may mean a unit that processes a function or operation performed by at least one processor (120). The 'module' included in the memory (110) may be implemented as software such as instructions, an algorithm, a data structure, or a program code.
[0083] In one embodiment of the present disclosure, the bounding box acquisition module (112) may be configured with commands or program codes related to an operation or function of acquiring a plurality of bounding boxes corresponding to each of a plurality of objects included in the content (300) acquired through the input / output interface (130) or the communication interface (140). However, the present disclosure is not limited thereto, and the bounding box acquisition module (112) may be configured with commands or program codes related to an operation or function of acquiring a plurality of bounding boxes corresponding to each of a plurality of objects included in the content (300) stored in the memory (110).
[0084] In one embodiment of the present disclosure, the bounding box acquisition module (112) may include an Axis-Aligned Bounding Box algorithm that acquires minimum and maximum values in the x-axis, y-axis, and z-axis of each of a plurality of objects, and sets the acquired minimum and maximum values as vertices of diagonal corners constituting the bounding box to acquire a bounding box, or an Oriented Bounding Box algorithm that acquires a bounding box in a coordinate system rotated based on the principal axis of each of the plurality of objects.
[0085] By having at least one processor (120) execute instructions or program codes of a bounding box acquisition module (112), the electronic device (100) can acquire a plurality of bounding boxes corresponding to each of a plurality of objects included in the content (300).
[0086] In one embodiment of the present disclosure, the volume calculation module (113) may be configured with instructions or program codes related to an operation or function of obtaining the volume of each of a plurality of bounding boxes. The volume calculation module (113) may be configured with instructions or program codes related to an operation or function of obtaining, based on a plurality of bounding boxes and a plurality of planes constituting the frustum (200), a volume contained within the frustum (200) of at least one bounding box intersecting the plurality of planes among the plurality of bounding boxes, and a volume contained outside the frustum (200).
[0087] By having at least one processor (120) execute instructions or program codes of a volume calculation module (113), the electronic device (100) can obtain the volume of each of a plurality of bounding boxes. The electronic device (100) can obtain the volume contained within the frustum (200) of at least one bounding box intersecting a plurality of planes among the plurality of bounding boxes, and the volume contained outside the frustum (200).
[0088] In one embodiment of the present disclosure, the location determination module (111) may be configured with commands or program codes related to an operation or function for determining whether each of a plurality of objects included in the content (300) is located inside the frustum (200).
[0089] Specifically, the location determination module (111) may be configured with commands or program codes related to an operation or function for determining whether each of the plurality of objects included in the content (300) is located inside the frustum (200) based on the vertices of the plurality of bounding boxes corresponding to the plurality of objects respectively acquired through the bounding box acquisition module (112) and the plurality of planes constituting the frustum (200).
[0090] By having at least one processor (120) execute commands or program codes of a location determination module (111), the electronic device (100) can determine whether each of a plurality of objects included in the content (300) is located inside the frustum (200).
[0091] In one embodiment of the present disclosure, the size adjustment module (115) may be configured with commands or program codes related to an operation or function of enlarging or reducing the size of content (300). In addition, the size adjustment module (115) may be configured with commands or program codes related to an operation or function of enlarging or reducing the size of at least one object among a plurality of objects included in the content (300). In this case, the content (300) or at least one object included in the content (300) may be enlarged or reduced according to a set adjustment ratio. The adjustment ratio will be described below with reference to FIGS. 6A to 9B .
[0092] By having at least one processor (120) execute instructions or program codes of a size adjustment module (115), the electronic device (100) can enlarge or reduce the size of content (300) or at least one object included in the content (300).
[0093] In one embodiment of the present disclosure, the position movement module (116) may be configured with commands or program codes related to an operation or function of transitioning content (300). In addition, the position movement module (116) may be configured with commands or program codes related to an operation or function of transitioning at least one object among a plurality of objects included in the content (300).
[0094] By having at least one processor (120) execute instructions or program codes of a position movement module (116), the electronic device (100) can change the position of the content (300) or at least one object included in the content (300) within the frustum (200).
[0095] In one embodiment of the present disclosure, the object transformation module (114) may be configured with instructions or program codes relating to an operation or function of transforming the content (300) or at least one object included in the content (300) to obtain corrected content through the size adjustment module (115) and the position movement module (116).
[0096] By having at least one processor (120) execute instructions or program codes of an object transformation module (114), the electronic device (100) can transform content (300) or at least one object included in the content (300) to obtain corrected content.
[0097] In one embodiment of the present disclosure, at least one processor (120) may be configured as one or more processors, which control a series of processes to allow the electronic device (100) to operate according to the embodiments described below.
[0098] In one embodiment of the present disclosure, at least one processor (120) may be configured as at least one of a Central Processing Unit, a microprocessor, a Graphic Processing Unit, an Application Processor (AP), an Application Specific Integrated Circuits (ASICs), a Digital Signal Processor (DSPs), a Digital Signal Processing Device (DSPDs), a Programmable Logic Device (PLDs), a Field Programmable Gate Array (FPGAs), a Communication Processor (CP), a Neural Processing Unit, or an artificial intelligence (AI) processor designed with a hardware structure specialized for learning and processing an artificial intelligence (AI) model, but is not limited thereto.
[0099] In one embodiment of the present disclosure, at least one processor (120) may be configured as processing circuitry such as a System on Chip (SoC) or an Integrated Circuit (IC).
[0100] In one embodiment of the present disclosure, at least one processor (120) can execute various types of modules stored in the memory (110). At least one processor (120) can execute at least one instruction constituting the various types of modules stored in the memory (110). By executing the program or at least one instruction stored in the memory (110), at least one processor (120) can process data according to predefined operating rules. At least one processor (120) can individually or collectively execute at least one instruction in the memory (110).
[0101] In one embodiment of the present disclosure, at least one processor (120) may include multiple processors. In one embodiment of the present disclosure, at least one module among the multiple modules in the memory (110) may be executed by any one of the multiple processors. The remaining modules among the multiple modules stored in the memory (110) may be executed by other processors among the multiple processors.
[0102] In one embodiment of the present disclosure, the input / output interface (130) can obtain content (300) from an external electronic device, etc., under the control of at least one processor (120). In addition, the input / output interface (130) can also provide corrected content (400) to an external electronic device including a display, under the control of at least one processor (120).
[0103] In one embodiment of the present disclosure, the input / output interface (130) may perform input / output operations with an external electronic device using at least one of input / output methods including an HDMI port (High-Definition Multimedia Interface port), a DVI (Digital Visual Interface), a component jack, a PC port, or a USB port (Universal Serial Bus port). However, the present disclosure is not limited to the above-described input / output methods.
[0104] In one embodiment of the present disclosure, the communication interface (140) can perform data communication with an external server or external electronic device under the control of at least one processor (120).
[0105] The communication interface (140) may perform data communication with an external server or an external electronic device using at least one of data communication methods including, for example, wired LAN, wireless LAN, Wi-Fi, Bluetooth, zigbee, WFD (Wi-Fi Direct), infrared communication (IrDA, infrared Data Association), BLE (Bluetooth Low Energy), NFC (Near Field Communication), Wireless Broadband Internet (Wibro), World Interoperability for Microwave Access (WiMAX), Shared Wireless Access Protocol (SWAP), Wireless Gigabit Alliance (WiGig), and RF communication.
[0106] In one embodiment of the present disclosure, the communication interface (140) may obtain content (300) from an external electronic device or an external server under the control of at least one processor (120). In addition, the communication interface (140) may provide corrected content (400) to an external electronic device including a display or an external server under the control of at least one processor (120).
[0107] FIG. 3 is a flowchart illustrating the operation of an electronic device according to one embodiment of the present disclosure.
[0108] Referring to FIGS. 1, 2 and 3, in one embodiment of the present disclosure, a method of operating an electronic device (100) may include a step (S100) of acquiring camera information including information about a frustum (200).
[0109] In step S100, the electronic device (100) can obtain camera information including information about the frustum (200) from an external electronic device through an input / output interface (130). The electronic device (100) can also obtain camera information including information about the frustum (200) from an external electronic device or an external server through a communication interface (140).
[0110] In one embodiment of the present disclosure, a method of operating an electronic device (100) may include a step (S200) of obtaining three-dimensional content (300) including a plurality of objects arranged in a space including a frustum (200).
[0111] In step (S200), the electronic device (100) can obtain content (300) including a plurality of objects arranged in a space including a frustum (200) from an external electronic device through an input / output interface (130). The electronic device (100) can also obtain content (300) from an external electronic device or an external server through a communication interface (140).
[0112] In one embodiment of the present disclosure, the operating method of the electronic device (100) may include a step (S300) of determining whether each of a plurality of objects is located inside the frustum (200) based on the frustum (200) and the three-dimensional content (300).
[0113] In step S300, at least one processor (120) executes commands or program codes of a position determination module (111), so that the electronic device (100) can determine whether each of a plurality of objects is located inside the frustum (200) based on the frustum (200) and the three-dimensional content (300).
[0114] In one embodiment of the present disclosure, the operating method of the electronic device (100) may include a step (S400) of obtaining correction content (400) by transforming at least one object located outside a frustum (200) among a plurality of objects so that the at least one object is located inside the frustum (200).
[0115] In step S400, at least one processor (120) executes commands or program codes of an object transformation module (114), so that the electronic device (100) can obtain the correction content (400) by transforming at least one object located outside the frustum (200) among a plurality of objects to be located inside the frustum (200).
[0116] In one embodiment of the present disclosure, step S400 may be performed when it is determined in step S300 that each of the plurality of objects is not located inside the frustum (200). That is, step S400 may be performed when it is determined in step S300 that at least one object among the plurality of objects is not located inside the frustum (200).
[0117] In one embodiment of the present disclosure, step S400 may not be performed because it is determined in step S300 that all of the plurality of objects are located inside the frustum (200). However, the present disclosure is not limited thereto, and the operating method of the electronic device (100) may, of course, perform at least one of steps S500, S700, or S800 described below even if it is determined in step S300 that all of the plurality of objects are located inside the frustum (200).
[0118] FIG. 4 is a flowchart illustrating an operation for determining whether each of a plurality of objects is located within a frustum according to one embodiment of the present disclosure. Hereinafter, steps identical to those described in FIG. 3 are assigned the same reference numerals, and any redundant descriptions are omitted.
[0119] Referring to FIGS. 2, 3 and 4, in one embodiment of the present disclosure, the step (S300) of determining whether each of the plurality of objects is located inside the frustum (200) may include the step (S310) of obtaining a plurality of bounding boxes corresponding to each of the plurality of objects.
[0120] In step S310, at least one processor (120) executes commands or program codes of a bounding box acquisition module (112), so that the electronic device (100) can acquire a plurality of bounding boxes corresponding to each of a plurality of objects.
[0121] In one embodiment of the present disclosure, the step (S300) of determining whether each of the plurality of objects is located inside the frustum (200) may include a step (S320) of determining whether each of the plurality of objects is located inside the frustum (200) based on a plurality of bounding boxes and a plurality of planes included in the frustum (200).
[0122] In step S320, at least one processor (120) executes the commands or program code of the position determination module (111), so that the electronic device (100) can determine whether each of the plurality of objects is located inside the frustum (200) through the positional relationship between the plurality of bounding boxes and the plurality of planes obtained through the bounding box acquisition module (112).
[0123] In one embodiment of the present disclosure, if it is determined in step S320 that at least one of the plurality of bounding boxes is not located inside the frustum (200), step S400 may be performed. If it is determined in step S320 that all of the plurality of bounding boxes are located inside the frustum (200), step S400 may not be performed.
[0124] FIG. 5 is a flowchart illustrating an operation of transforming or filtering an object to obtain correction content according to one embodiment of the present disclosure. Hereinafter, steps identical to those described in FIG. 4 are assigned the same reference numerals, and redundant descriptions are omitted.
[0125] Referring to FIGS. 2, 4, and 5, in one embodiment of the present disclosure, the step (S320) of determining whether each of a plurality of objects is located inside a frustum (200) may include the step (S321) of obtaining a first volume included inside the frustum (200) and a second volume included outside the frustum (200) among the volumes of bounding boxes of at least one object located outside the frustum (200).
[0126] In one embodiment of the present disclosure, in step S320, at least one object corresponding to at least one bounding box among a plurality of bounding boxes corresponding to each of a plurality of objects, the entire volume of which is not included within the frustum (200), may be determined as an object not located within the frustum (200). That is, at least one bounding box among a plurality of bounding boxes, some of which are located outside the frustum (200), may be determined to be located outside the frustum (200).
[0127] In step S321, by having at least one processor (120) execute instructions or program codes of a volume calculation module (113), the electronic device (100) can obtain a first volume included inside the frustum (200) and a second volume included outside the frustum (200) among the volumes of a bounding box of at least one object located outside the frustum (200).
[0128] In one embodiment of the present disclosure, the operating method of the electronic device (100) may further include a step (S322) of determining whether the ratio of the first volume to the volume of the bounding box is greater than a preset conversion ratio. In this case, step S322 may be included in step (S320) of determining whether each of the plurality of objects is located within the frustum (200).
[0129] In one embodiment of the present disclosure, the preset transformation ratio may be a ratio set to determine whether to transform an object determined to be located outside the frustum (200) so that the object is located inside the frustum (200).
[0130] In one embodiment of the present disclosure, when the conversion ratio is set high, only objects having a large ratio of volume contained within the frustum (200), i.e., objects having a relatively small portion located outside the frustum (200), can be converted to generate correction content (400). Accordingly, the amount of computation required to generate correction content (400) can be reduced. When the conversion ratio is set low, objects having a small ratio of volume contained within the frustum (200), i.e., objects having a relatively large portion located outside the frustum (200), can also be converted to generate correction content (400). Accordingly, the amount of data lost during the conversion process can be reduced.
[0131] In step S322, at least one processor (120) executes commands or program codes of the position determination module (111), so that the electronic device (100) can determine whether the ratio of the first volume among the volumes of the bounding box located outside the frustum (200) is greater than a preset conversion ratio. However, the present disclosure is not limited thereto, and commands or program codes for performing the operation of step S322 are stored in the object conversion module (114), and at least one processor (120) can of course perform step S322 through the object conversion module (114).
[0132] In one embodiment of the present disclosure, the step (S400) of obtaining correction content (400) by transforming at least one object located outside the frustum (200) may include the step (S410) of obtaining correction content (400) by transforming at least one object so that the at least one object is located inside the frustum (200) when the ratio of the first volume among the volumes of the bounding box is greater than a preset transformation ratio.
[0133] In step S410, at least one processor (120) can obtain the correction content (400) by executing the instructions or program code of the object transformation module (114) so that at least one object is transformed so that the at least one object is located inside the frustum (200) according to a ratio of the first volume among the volumes of the bounding box being greater than a preset transformation ratio.
[0134] In one embodiment of the present disclosure, the step (S400) of obtaining correction content (400) by transforming at least one object located outside a frustum (200) may include the step (S420) of obtaining correction content (400) by filtering at least one object from the three-dimensional content (300) according to a ratio of a first volume among the volumes of the bounding box being equal to or smaller than a preset transformation ratio.
[0135] In step S420, at least one processor (120) can obtain correction content (400) by filtering at least one object according to whether the ratio of the first volume among the volumes of the bounding box is equal to or less than a preset conversion ratio by executing instructions or program codes of the object transformation module (114).
[0136] FIG. 6a is a flowchart illustrating an operation of obtaining correction content by transforming an object according to one embodiment of the present disclosure. FIG. 6b is a diagram illustrating an operation of obtaining correction content by transforming an object according to one embodiment of the present disclosure. Hereinafter, the same configurations and steps as those described in FIGS. 1 and 3 are assigned the same reference numerals, and redundant descriptions are omitted.
[0137] Referring to FIGS. 1, 2, 3, 6a and 6b, in one embodiment of the present disclosure, the step (S400) of obtaining corrected content (400) by transforming at least one object may include a step (S411) of obtaining reduced content by reducing the three-dimensional content (300) by a ratio of the distance between the near-plane (210) and the circular-plane (220) to the distance between the camera (500) and the circular-plane (220) in the view-direction (510).
[0138] In one embodiment of the present disclosure, since the near-plane (210) is located between the circular-plane (220) and the camera (500), the distance between the camera (500) and the circular-plane (220) is longer than the distance between the near-plane (210) and the circular-plane (220). Therefore, the ratio of the distance between the near-plane (210) and the circular-plane (220) to the distance between the camera (500) and the circular-plane (220) may be less than 1. In one embodiment of the present disclosure, when the ratio of the distance between the near-plane (210) and the circular-plane (220) to the distance between the camera (500) and the circular-plane (220) is 0.7, in step S411, reduced content (300) can be obtained by reducing the content by 0.7 times.
[0139] In step S411, at least one processor (120) can obtain reduced content by executing instructions or program codes of the resizing module (115), thereby reducing the three-dimensional content (300) by the ratio of the distance between the near-plane (210) and the near-plane (220) to the distance between the near-plane (210) and the near-plane (220) in the view-direction (510).
[0140] However, the present disclosure is not limited thereto. In step S411, the three-dimensional content (300) may be reduced by the ratio of the distance between the near-plane (210) and the circular plane (220) to the distance between the object (610) closest to the camera (500) among the multiple objects included in the content (300) in the view direction (510), thereby obtaining the reduced content.
[0141] Referring to FIGS. 5 and 6B, the content (300) may include a first object (610), a second object (620), a third object (630), and a fourth object (640). The positions of the first to fourth objects (610, 620, 630, 640) in the space including the frustum (200) may be different from each other. In this case, it is obvious that the content (300) may include more objects than the first object (610), the second object (620), the third object (630), and the fourth object (640). In addition, the content (300) may include three or fewer objects.
[0142] In one embodiment of the present disclosure, each of the first to fourth objects (610, 620, 630, 640) can be reduced into a first reduced object, a second reduced object (621), a third reduced object (631), and a fourth reduced object (641).
[0143] However, the present disclosure is not limited thereto. In one embodiment of the present disclosure, the first object (610) may be filtered out of the content (300) in steps S322 and S420, since the ratio of the first volume to the volume of the bounding box of the first object (610) is lower than the conversion ratio. In this case, the object closest to the camera (500) may be the third object (630) rather than the first object (610), so the ratio used to reduce the content (300) may increase. Accordingly, the size of the reduced content may be larger than when the first object (610) is not filtered. Hereinafter, the first object (610) will be described as being filtered.
[0144] In one embodiment of the present disclosure, the step (S400) of obtaining the correction content (400) by transforming at least one object may include the step (S412) of obtaining the correction content (400) by moving the reduced content so that the reduced content is located inside the frustum (200).
[0145] In one embodiment of the present disclosure, the reduced second to fourth reduced objects (621, 631, 641) may be moved in the view-direction (510) to be located inside the frustum (200). At this time, in one embodiment of the present disclosure, the reduced content may be moved so that the position of the object farthest from the camera (500) among the plurality of objects included in the content (300) before being reduced is the same as the position of the reduced object farthest from the camera (500) among the plurality of reduced objects included in the correction content (400). However, the present disclosure is not limited thereto, and it goes without saying that the degree to which the reduced content is moved may be different from this.
[0146] In step S412, at least one processor (120) can obtain the correction content (400) by executing instructions or program codes of the position movement module (116) to move the reduced content in the view-direction (510) so that the reduced content is located inside the frustum (200).
[0147] FIG. 7a is a flowchart illustrating an operation of obtaining correction content by transforming an intermediate object located in a space closer to the camera than the effective plane according to one embodiment of the present disclosure. FIG. 7b is a diagram illustrating an operation of obtaining correction content by transforming an intermediate object located in a space closer to the camera than the effective plane according to one embodiment of the present disclosure. Hereinafter, steps identical to those described in FIG. 3 are given the same reference numerals, and redundant descriptions are omitted.
[0148] Referring to FIGS. 1, 2, 3, 7a and 7b, in one embodiment of the present disclosure, a method of operating an electronic device (100) may include a step (S500) of determining whether a distance from a camera (500) in a view-direction (510) to a near-plane (210) is shorter than a distance from a camera (500) in a view-direction (510) to an effective-plane (230).
[0149] In one embodiment of the present disclosure, the camera information acquired in step S100 may include information about a pre-set effective plane on which three-dimensional content (300) is optimally displayed, as well as information about a frustum (200).
[0150] In one embodiment of the present disclosure, the effective plane may be a plane in which crosstalk between multiple different images corresponding to multiple views displayed through a video display device is minimized. The image displayed on the plane may be the image most clearly presented to a user viewing the image.
[0151] In step S500, by having at least one processor (120) execute instructions or program codes included in the memory (110), the electronic device (100) can determine whether the distance from the camera (500) in the view-direction (510) to the near-plane (210) is shorter than the distance from the camera (500) in the view-direction (510) to the effective-plane (230).
[0152] In one embodiment of the present disclosure, the method of operating the electronic device (100) may include a step (S510) of determining whether each of a plurality of objects is located between the near-plane (210) and the effective-plane (230) when the distance from the camera (500) in the view-direction (510) to the near-plane (210) is shorter than the distance from the camera (500) in the view-direction (510) to the effective-plane (230).
[0153] In step S510, by having at least one processor (120) execute instructions or program codes of a position determination module (111), the electronic device (100) can determine whether each of the plurality of objects is located between the near-plane (210) and the effective-plane (230).
[0154] In one embodiment of the present disclosure, the operating method of the electronic device (100) may include a step (S600) of obtaining correction content (400) by transforming at least one intermediate object located between the near-plane (210) and the effective-plane (230) among a plurality of objects so that the at least one intermediate object is located between the effective-plane (230) and the near-plane (220).
[0155] In step S600, at least one processor (120) executes instructions or program codes of the object transformation module (114), so that the electronic device (100) can obtain correction content (400) by transforming at least one intermediate object located between the near-plane (210) and the effective-plane (230) among a plurality of objects so that the at least one intermediate object is located between the effective-plane (230) and the near-plane (220).
[0156] In one embodiment of the present disclosure, step S600 may include a step (S610) of obtaining reduced content by reducing the three-dimensional content (300) by a ratio of the distance between the effective plane (230) and the circular plane (220) to the distance between the near-plane (210) and the circular plane (220) in the view-direction (510).
[0157] In one embodiment of the present disclosure, since the effective plane (230) is located between the near-plane (210) and the circular-plane (220) based on the determination result in step S500, the distance between the near-plane (210) and the circular-plane (220) is longer than the distance between the effective plane (230) and the circular-plane (220). Accordingly, the ratio of the distance between the effective plane (230) and the circular-plane (220) to the distance between the near-plane (210) and the circular-plane (220) in the view-direction (510) may be less than 1. In one embodiment of the present disclosure, when the ratio of the distance between the effective plane (230) and the circle-plane (220) to the distance between the near-plane (210) and the circle-plane (220) in the view-direction (510) is 0.8, in step S610, reduced content that reduces the content (300) by 0.8 times can be obtained.
[0158] Referring to FIG. 7b, the content (300) may include a first object (621), a second object (631), and a third object (641). The positions of the first to third objects (621, 631, 641) in the space including the frustum (200) may be different from each other. At this time, since step S500 is performed after step S400, the first object (621) may correspond to the second reduced object in FIG. 6b, the second object (631) may correspond to the third reduced object in FIG. 6b, and the third object (641) may correspond to the fourth reduced object in FIG. 6b, respectively. However, the present disclosure is not limited thereto, and step S500 may of course be performed after step S200.
[0159] In one embodiment of the present disclosure, the first object (621) may be filtered out of the content (300) in step S510, since the ratio of the first volume to the volume of the bounding box of the first object (621) is lower than the conversion ratio. In this case, the amount of computation required to perform step S610 may be reduced. Hereinafter, the first object (621) will be described as being filtered. The second object (631) may be reduced to the first reduced object (700), and the third object (641) may be reduced to the second reduced object (710), respectively.
[0160] In step S610, at least one processor (120) executes instructions or program codes of the resizing module (115), so that the electronic device (100) can obtain reduced content by reducing the three-dimensional content (300) by the ratio of the distance between the effective plane (230) and the original plane (220) to the distance between the near-plane (210) and the original plane (220) in the view-direction (510).
[0161] In one embodiment of the present disclosure, step S600 may include a step (S620) of obtaining correction content (400) by moving the reduced content so that the reduced content is located between the effective plane (230) and the original plane (220).
[0162] In one embodiment of the present disclosure, the first reduced object (700) and the second reduced object (710) may be moved in the view-direction (510) to be positioned between the effective plane (230) and the original plane (220). At this time, in one embodiment of the present disclosure, the reduced content may be moved so that the position of the object farthest from the camera (500) among the plurality of objects included in the content (300) before being reduced is the same as the position of the reduced object farthest from the camera (500) among the plurality of reduced objects included in the correction content (400). However, the present disclosure is not limited thereto, and it goes without saying that the degree to which the reduced content is moved may be different from this.
[0163] In step S620, at least one processor (120) executes instructions or program codes of a position movement module (116), so that the electronic device (100) can obtain the correction content (400) by moving the reduced content so that the reduced content is located between the effective plane (230) and the original plane (220).
[0164] In one embodiment of the present disclosure, step S510 may be performed when it is determined in step S500 that the distance from the camera (500) to the near-plane (210) is shorter than the distance from the camera (500) to the effective-plane (230). When it is determined in step S500 that the distance from the camera (500) to the near-plane (210) is equal to or longer than the distance from the camera (500) to the effective-plane (230), operation S510 may not be performed.
[0165] In one embodiment of the present disclosure, step S600 may be performed when it is determined in step S510 that at least one object among the plurality of objects is located between the near-plane (210) and the effective-plane (230). When it is determined in step S510 that not all of the plurality of objects are located between the near-plane (210) and the effective-plane (230), step S600 may not be performed.
[0166] The present disclosure is not limited thereto, and it is obvious that the method of operating the electronic device (100) may perform at least one of steps S700 or S800 to be described later, even if step S510 or step S600 is not performed.
[0167] FIG. 8A is a flowchart illustrating an operation of obtaining correction content by transforming a border object so that a plurality of objects are positioned within an effective area according to an embodiment of the present disclosure. FIG. 8B is a diagram illustrating an operation of obtaining correction content by transforming a border object so that a plurality of objects are positioned within an effective area according to an embodiment of the present disclosure. Hereinafter, steps identical to those described in FIG. 3 are given the same reference numerals, and redundant descriptions are omitted.
[0168] Referring to FIGS. 1, 2, 3, 8a, and 8b, in one embodiment of the present disclosure, the frustum (200) may include a top plane, a bottom plane, a left plane, and a right plane. The frustum (200) may be composed of a near-plane (210), a near-plane (220), a top plane, a bottom plane, a left plane, and a right plane.
[0169] In one embodiment of the present disclosure, the camera information acquired in step S100 may include information about a display area (800) composed of an upper plane, a lower plane, a left plane, and a right plane. The display area (800) illustrated in FIG. 8b may be illustrated as a display area composed of an upper plane, a lower plane, a left plane, and a right plane of a frustum (200) cut in a direction perpendicular to the view direction (510).
[0170] In one embodiment of the present disclosure, the camera information acquired in step S100 may include a valid area (810) and a border area (820) surrounding the valid area (810). The border area (820) may be an area displayed through an outer portion of a display included in an image display device.
[0171] At this time, due to the characteristics of the video display device that displays multiple different images corresponding to multiple views, crosstalk may occur in the images displayed through the outer portion of the display. In contrast, the effective area (810) may be an area displayed through the central portion of the display included in the video display device. Crosstalk may not occur in the images displayed through the central portion of the display.
[0172] The ratio, size, shape, etc. of the effective area (810) and the border area (820) among the display area (800) may be determined in advance according to the type, resolution, size, etc. of the display included in the video display device and may be included in the camera information.
[0173] In one embodiment of the present disclosure, the operating method of the electronic device (100) may include a step (S700) of determining whether each of a plurality of objects is located within a valid area (810). In one embodiment of the present disclosure, step S700 may be performed after step S400. However, the present disclosure is not limited thereto, and step S700 may of course be performed after step S200.
[0174] In step S700, at least one processor (120) executes instructions or program codes of a location determination module (111), so that the electronic device (100) can determine whether each of a plurality of objects is located within a valid area (810). An object determined to be located within a border area (820) among the plurality of objects may be referred to as a border object.
[0175] In one embodiment of the present disclosure, the operating method of the electronic device (100) may include a step (S710) of obtaining correction content (400) by transforming at least one border object located in a border area (820) among a plurality of objects so that the at least one border object located in a valid area (810) is located.
[0176] In step S710, at least one processor (120) executes instructions or program codes of the object transformation module (114), so that the electronic device (100) can obtain the correction content (400) by transforming at least one border object located in the border area (820) among a plurality of objects so that the at least one border object located in the valid area (810) is located.
[0177] In one embodiment of the present disclosure, step S710 may include a step of obtaining reduced content (300) that is reduced in size according to a ratio of the area of the effective area (810) to the area of the display area (800). By having at least one processor (120) execute instructions or program codes of the size adjustment module (115), the electronic device (100) may obtain reduced content (300) that is reduced in size according to a ratio of the area of the effective area (810) to the area of the display area (800).
[0178] In one embodiment of the present disclosure, step S710 may include a step of obtaining the corrected content (400) by moving the reduced content toward the center of the display area (800) so that the reduced content is located within the valid area (810). At this time, the direction in which the reduced content is moved may be a direction perpendicular to the view direction (510). By having at least one processor (120) execute instructions or program codes of the position movement module (116), the electronic device (100) may obtain the corrected content (400) by moving the reduced content toward the center of the display area (800).
[0179] Referring to FIG. 7b, the content (300, see FIG. 1) may include a first object (830), a second object (840), a third object (850), and a fourth object (860). The positions of the first to fourth objects (830, 840, 850, 860) in the display area (800) may be different from each other.
[0180] In one embodiment of the present disclosure, in step S700, at least one object corresponding to at least one bounding box, among the plurality of bounding boxes corresponding to each of the plurality of objects, whose entire volume of the bounding box is not included in the valid area (810), may be determined as an object located in the border area (820).
[0181] In one embodiment of the present disclosure, step S700 may include obtaining a third volume included in the effective area (810) and a fourth volume included in the border area (820) among the volumes of the bounding boxes of at least one border object located in the border area (820).
[0182] In one embodiment of the present disclosure, step S700 may further include a step of determining whether the ratio of the third volume to the volume of the bounding box is greater than a preset effective ratio. In one embodiment of the present disclosure, the preset effective ratio may be a ratio set for determining whether to transform a border object determined to be located in the border area (820) so that the border object is located in the effective area (810).
[0183] In one embodiment of the present disclosure, when the effective ratio is set high, only border objects having a large ratio of volume included in the effective area (810), i.e., a relatively small portion located in the border area (820), can be converted to generate correction content (400). Accordingly, the amount of computation required to generate correction content (400) can be reduced. When the effective ratio is set low, objects having a small ratio of volume included in the effective area (810), i.e., a relatively large portion located in the border area (820), can also be converted to generate correction content (400). Accordingly, the amount of data lost during the conversion process can be reduced.
[0184] In one embodiment of the present disclosure, the first object (830) may be filtered out of the content (300) in step S700 because the ratio of the third volume among the volumes of the bounding box of the first object (830) is lower than the effective ratio. In this case, the amount of computation required to perform step S710 may be reduced. Hereinafter, the first object (830) will be described as being filtered. The second object (840) may be reduced to a first reduced object (841), the third object (850) may be reduced to a second reduced object (851), and the fourth object (860) may be reduced to a third reduced object (861).
[0185] In one embodiment of the present disclosure, the first reduced object (841), the second reduced object (851), and the third reduced object (861) can be moved toward the center of the display area (800) so that the reduced content (400) is positioned within the valid area (810).
[0186] In one embodiment of the present disclosure, step S710 may be performed when it is determined in step S700 that at least one object among the plurality of objects is not located within the valid area (810). When it is determined in step S700 that all of the plurality of objects are located within the valid area (810), operation S710 may not be performed.
[0187] The present disclosure is not limited thereto, and it goes without saying that the method of operating the electronic device (100) may perform step S800, which will be described later, even if step S710 is not performed.
[0188] FIG. 9A is a flowchart illustrating an operation of obtaining corrected content by transforming a text object so that the text object is positioned on the zero plane according to one embodiment of the present disclosure. FIG. 9B is a diagram illustrating an operation of obtaining corrected content by transforming a text object so that the text object is positioned on the zero plane according to one embodiment of the present disclosure. Hereinafter, steps identical to those described in FIG. 3 are assigned the same reference numerals, and redundant descriptions are omitted.
[0189] Referring to FIGS. 1, 2, 3, 9a and 9b, in one embodiment of the present disclosure, the operating method of the electronic device (100) may include a step (S800) of determining whether a text type object is included among a plurality of objects.
[0190] In one embodiment of the present disclosure, "text" may include letters such as alphabets or Korean characters, numbers, special symbols, etc. In one embodiment of the present disclosure, the text type indicates that an object is classified as a type that includes text, and an object that includes text may be classified as "Text," "Canvas," "2D UI," "Flat UI," etc., depending on the program, application, model, etc. used to create the content (300), and is not limited to any one of them. In one embodiment of the present disclosure, the content (300) may include information about the type of each of a plurality of objects included in the content.
[0191] In step S800, by having at least one processor (120) execute instructions or program codes included in the memory (110), the electronic device (100) can determine whether a text type object is included among a plurality of objects.
[0192] In one embodiment of the present disclosure, the operating method of the electronic device (100) may include a step (S810) of determining whether depth information of an object of a text type is “0”.
[0193] In one embodiment of the present disclosure, a plurality of objects included in the content (300) may be three-dimensional and may each include depth information. Depending on the position of each of the plurality of objects in the frustum (200), the plurality of objects may have different depth values. In this case, the depth information of an object located at the zero plane (240) in the frustum (200) may be "0". In this case, an object with depth information of "0" may be displayed as being located on the same plane as the display of the image display device. In one embodiment of the present disclosure, the content (300) may include depth information of each of the plurality of objects included in the content.
[0194] In step S810, by having at least one processor (120) execute instructions or program codes included in the memory (110), the electronic device (100) can determine whether the depth information of an object of a text type is “0”.
[0195] In one embodiment of the present disclosure, the operating method of the electronic device (100) may include a step (S900) of obtaining corrected content (400) by converting at least one text object, determined to be a text type among a plurality of objects, so that the at least one text object is located on the zero plane (240).
[0196] In step S900, at least one processor (120) executes commands or program codes of an object conversion module (114), so that the electronic device (100) can obtain corrected content (400) by converting at least one text object determined to be a text type among a plurality of objects so that the at least one text object is located on the zero plane (240).
[0197] In one embodiment of the present disclosure, step S900 may include a step (S910) of resizing the three-dimensional content (300) by a ratio of a distance from the camera (500) in the view-direction (510) to the zero-plane (240) to the distance from the camera (500) in the view-direction (510) to at least one text object, thereby obtaining the adjusted content.
[0198] In one embodiment of the present disclosure, since the text object is located at a location other than the zero-plane according to the judgment result in step S810, the distance from the camera (500) in the view-direction (510) to at least one text object and the distance from the camera (500) to the zero-plane (240) may be different from each other.
[0199] In one embodiment of the present disclosure, when a text object is located in an area closer to the camera (500) than the zero plane, the text object may be presented to a user of the video display device as if it is coming forward from the display of the video display device. In this case, a ratio of the distance from the camera (500) to the zero plane (240) to the distance from the camera (500) to at least one text object may be greater than 1. In step S910, the three-dimensional content (300) may be adjusted in size to be larger by the calculated ratio, thereby obtaining the adjusted content.
[0200] In one embodiment of the present disclosure, when a text object is located in an area further from the camera (500) than the zero plane, the text object may be presented to a user of the video display device as if it were retracted from the display of the video display device. In this case, a ratio of the distance from the camera (500) to the zero plane (240) to the distance from the camera (500) to at least one text object may be less than 1. In step S910, the three-dimensional content (300) may be adjusted in size to be reduced by the calculated ratio, thereby obtaining the adjusted content.
[0201] However, the present disclosure is not limited thereto, and in step S910, the adjusted content may be obtained by adjusting the size of only the text object.
[0202] Referring to FIG. 9B, content (300) may include a first text object (900) and a second text object (910). The positions of the first text object (900) and the second text object (910) in the space including the frustum (200) may be different. The first text object (900), "Hello," may be located in an area closer to the camera (500) than the zero-plane (240). The second text object (910), "Good," may be located in an area farther from the camera (500) than the zero-plane (240).
[0203] In one embodiment of the present disclosure, in step S910, a first text object (900) may be adjusted to increase in size to a first adjusted text object (901). A second text object (910) may be adjusted to decrease in size to a second adjusted text object (911).
[0204] In step S910, at least one processor (120) executes instructions or program codes of a size adjustment module (115), so that the electronic device (100) can acquire adjusted content by adjusting the size of the three-dimensional content (300) by a ratio of the distance from the camera (500) in the view-direction (510) to at least one text object, to the distance from the camera (500) in the view-direction (510) to the zero-plane (240). At this time, the adjusted content may include an adjusted text object.
[0205] In one embodiment of the present disclosure, step S900 may include a step (S920) of moving the adjustment content so that at least one text object is positioned on the zero-plane (240) to obtain the correction content (400).
[0206] In one embodiment of the present disclosure, a first adjustment text object (901) can be moved in the view-direction to be positioned on the zero-plane (240). A second adjustment text object (910) can be moved in the opposite direction of the view-direction to be positioned on the zero-plane (240).
[0207] In step S920, at least one processor (120) executes instructions or program codes of a position movement module (116), so that the electronic device (100) can move the adjustment content so that at least one text object is positioned on the zero plane (240), thereby obtaining the correction content (400).
[0208] In one embodiment of the present disclosure, step S810 may be performed when at least one object among the plurality of objects in step S800 is determined to be a text type object. If all of the plurality of objects in step S800 are determined to be text type objects, operation S810 may not be performed.
[0209] In one embodiment of the present disclosure, step S900 may be performed when it is determined in step S810 that the depth information of at least one text type object is not "0". When it is determined in step S810 that the depth information of at least one text type object is "0", step S900 may not be performed.
[0210] FIG. 10 is a flowchart illustrating the operation of an electronic device according to one embodiment of the present disclosure. Hereinafter, steps identical to those described in FIGS. 3 to 9b are assigned the same reference numerals, and redundant descriptions are omitted.
[0211] Referring to FIGS. 1, 2, and 10, in one embodiment of the present disclosure, in step S300, the electronic device (100) can determine whether each of the plurality of objects included in the content (300) is located inside the frustum (200). In this case, step S300 may be performed after step S200.
[0212] When it is determined in step S300 that at least one object among the plurality of objects is not located inside the frustum (200), the electronic device (100) can perform step S400.
[0213] In step S400, the electronic device (100) can obtain the correction content (400) by transforming at least one object located outside the frustum (200) so that at least one object is located inside the frustum (200).
[0214] When it is determined in step S300 that all of the plurality of objects are located inside the frustum (200), the electronic device (100) can perform step S500.
[0215] In step S500, the electronic device (100) can determine whether the distance from the camera (500) in the view-direction (510) to the near-plane (210) is shorter than the distance from the camera (500) in the view-direction (510) to the effective-plane (230).
[0216] When it is determined in step S500 that the distance from the camera (500) to the near-plane (210) is shorter than the distance from the camera (500) to the effective-plane (230), the electronic device (100) may perform step S510. In step S510, the electronic device (100) may determine whether each of the plurality of objects is located between the near-plane (210) and the effective-plane (230). In this case, when step S400 is performed, the plurality of objects determined in step S510 may refer to objects included in the correction content (400).
[0217] In step S510, when it is determined that at least one object among the plurality of objects is located between the near-plane (210) and the effective-plane (230), the electronic device (100) may perform step S600. In step S600, the electronic device (100) may transform at least one intermediate object among the plurality of objects located between the near-plane (210) and the effective-plane (230) so that the intermediate object is located between the effective-plane (230) and the near-plane (220), thereby obtaining correction content (400), and perform step S510 again.
[0218] Since it is determined in step S510 that none of the plurality of objects are located between the near-plane (210) and the effective-plane (230), the electronic device (100) may perform step S500 again without performing step S600. In addition, since it is determined in step S500 that the distance from the camera (500) to the near-plane (210) is equal to or longer than the distance from the camera (500) to the effective-plane (230), the electronic device (100) may perform step S700.
[0219] In step S700, the electronic device (100) can determine whether each of the plurality of objects is located within the valid area (810). If it is determined in step S700 that at least one object among the plurality of objects is not located within the valid area (810), the electronic device (100) can perform step S710.
[0220] In step S710, the electronic device (100) may obtain correction content (400) by transforming at least one border object located in the border area (820) among a plurality of objects so that at least one border object located in the valid area (810) is located, and then perform step S700 again.
[0221] When it is determined in step S700 that all of the multiple objects are located within the valid area (810), the electronic device (100) can perform step S800.
[0222] In step S800, the electronic device (100) can determine whether a text type object is included among the plurality of objects. If at least one object among the plurality of objects is determined to be a text type object in step S800, the electronic device (100) can perform step S810.
[0223] In step S810, the electronic device (100) can determine whether the depth information of the text type object is "0". If it is determined in step S810 that the depth information of the text type object is not "0", the electronic device (100) can perform step S900.
[0224] In step S900, the electronic device (100) may obtain corrected content (400) by converting at least one text object determined to be a text type among a plurality of objects so that the text object is located on the zero plane (240), and then perform step S810 again.
[0225] As the depth information of the text type object is determined to be “0” in step S810, the electronic device (100) can perform step S800 again.
[0226] When it is determined in step S800 that no text type object is included among the plurality of objects, the electronic device (100) may terminate the operation and obtain the finally generated correction content (400).
[0227] FIG. 11 is a drawing illustrating an electronic device including a display for displaying correction content according to one embodiment of the present disclosure.
[0228] In one embodiment of the present disclosure, FIG. 11 illustrates an electronic device (1100) including a display (1110). The electronic device (1100) illustrated in FIG. 11 can obtain corrected content (400) by converting content (300) through the operations described in FIGS. 1 to 10, and display the obtained corrected content (400) through the display (1110) to provide it to a user (1140).
[0229] In one embodiment of the present disclosure, the display (1110) may include any one of a liquid crystal display, a plasma display, an organic light emitting diode display, and an inorganic light emitting diode display. However, the present disclosure is not limited thereto, and the display (110) may include other types of displays capable of displaying the correction content (400).
[0230] In one embodiment of the present disclosure, the electronic device (1100) includes an optical layer and a plurality of lenses having a convex shape that refract and output an image displayed on the display (1110) to display three-dimensional correction content (400), and may further include a lenticular lens that refracts the provided light in different directions.
[0231] In one embodiment of the present disclosure, the corrected content (400) displayed through the electronic device (1100) may be provided to the user (1140) as a three-dimensional image. The corrected content (400) may be corrected to be positioned within the frustum (200, see FIG. 1 ) so as not to be culled or clipped during the rendering process through the electronic device (1100). Accordingly, the electronic device (1100) may provide the user (1140) with a lossless image.
[0232] In one embodiment of the present disclosure, the correction content (400) includes a plurality of objects (1120) positioned between the effective plane (230, see FIG. 6b) and the original plane (220), so that the electronic device (1100) can provide an image without crosstalk to the user (1140).
[0233] In one embodiment of the present disclosure, the correction content (400) includes a plurality of objects positioned within an effective area (810, see FIG. 8B), so that the electronic device (1100) can provide an image to a user (1140) without crosstalk occurring in the periphery of the display (1110).
[0234] In one embodiment of the present disclosure, the correction content (400) includes a text object (1130) placed on a zero-plane (240), so that the electronic device (1100) can provide a user (1140) with an image in which crosstalk does not occur in the text.
[0235] To solve the above-described technical problem, in one embodiment of the present disclosure, an electronic device is provided. The electronic device may include a memory storing at least one instruction. The electronic device may include at least one processor including a processing circuit. By having at least one processor individually or collectively execute at least one instruction stored in the memory, the electronic device may obtain camera information including information about a frustum. By having at least one processor individually or collectively execute at least one instruction, the electronic device may obtain three-dimensional content including a plurality of objects arranged in a space including the frustum. By having at least one processor individually or collectively execute at least one instruction, the electronic device may determine, based on the frustum and the three-dimensional content, whether each of the plurality of objects is located within the frustum. By having at least one processor individually or collectively execute at least one instruction, the electronic device can obtain the corrected content by transforming at least one object located outside a frustum among a plurality of objects to be located inside the frustum.
[0236] In one embodiment of the present disclosure, a frustum may include a plurality of planes. The electronic device may obtain a plurality of bounding boxes corresponding to each of the plurality of objects. Based on the plurality of bounding boxes and the plurality of planes, the electronic device may determine whether each of the plurality of objects is contained within the frustum.
[0237] In one embodiment of the present disclosure, an electronic device may obtain a first volume included inside the frustum and a second volume included outside the frustum among the volumes of a bounding box of at least one object located outside the frustum. By having at least one processor execute at least one command, the electronic device may obtain correction content by transforming at least one object so that the at least one object is located inside the frustum, when a ratio of the first volume among the volumes of the bounding box is greater than a preset transformation ratio.
[0238] In one embodiment of the present disclosure, the electronic device can obtain corrected content by filtering at least one object from the three-dimensional content according to a ratio of a first volume among the volumes of the bounding box being equal to or less than a preset conversion ratio.
[0239] In one embodiment of the present disclosure, camera information may include information about a camera viewing 3D content and a view direction in which the camera views the 3D content. The frustum may include a near plane and a far plane, each perpendicular to the view direction. The electronic device may acquire the reduced content by reducing the 3D content by a ratio of the distance between the near plane and the far plane to the distance between the camera and the far plane in the view direction. The electronic device may acquire the corrected content by moving the reduced content so that the reduced content is located within the frustum by having at least one processor execute at least one command.
[0240] In one embodiment of the present disclosure, the camera information may include information about a camera viewing 3D content, a view direction in which the camera views the 3D content, and an effective plane preset as a plane in which the 3D content is optimally displayed. The frustum may include a near plane and a far plane, each perpendicular to the view direction. The electronic device may determine whether each of the plurality of objects is located between the near plane and the effective plane, based on a distance from the camera in the view direction to the near plane being shorter than a distance from the camera in the view direction to the effective plane. By having at least one processor execute at least one command, the electronic device may obtain corrected content by transforming at least one intermediate object among the plurality of objects located between the near plane and the effective plane so that the at least one intermediate object is located between the effective plane and the far plane.
[0241] In one embodiment of the present disclosure, an electronic device can acquire reduced content by reducing three-dimensional content by a ratio of the distance between the effective plane and the original plane to the distance between the near plane and the original plane in the view direction. By having at least one processor execute at least one command, the electronic device can acquire corrected content by moving the reduced content so that the reduced content is positioned between the effective plane and the original plane.
[0242] In one embodiment of the present disclosure, a frustum may include a top plane, a bottom plane, a left plane, and a right plane. Camera information may include information about an active area, which is composed of the top plane, the bottom plane, the left plane, and the right plane, and includes an effective area and an outline area surrounding the effective area. The electronic device may determine whether each of a plurality of objects is located within the effective area. By having at least one processor execute at least one command, the electronic device may transform at least one object among the plurality of objects located in the outline area so that the at least one object is located within the effective area, thereby obtaining corrected content.
[0243] In one embodiment of the present disclosure, a plurality of objects included in three-dimensional content may include different depth information depending on the respective positions of the plurality of objects within a frustum. The frustum may include a zero-plane having depth information of "0." By having at least one processor execute at least one command, an electronic device may determine whether a text-type object is included among the plurality of objects. The electronic device may obtain corrected content by transforming at least one text object determined to be a text type among the plurality of objects so that the at least one text object is located in the zero-plane.
[0244] In one embodiment of the present disclosure, the frustum may include a near plane and a far plane, each perpendicular to the view direction. The electronic device may acquire the adjusted content by resizing the three-dimensional content by a ratio of the distance from the camera in the view direction to the zero plane to the distance from the camera in the view direction to at least one text object. The electronic device may acquire the corrected content by moving the adjusted content so that the at least one text object is located on the zero plane by having at least one processor execute at least one command.
[0245] In order to solve the above-described technical problem, one embodiment of the present disclosure provides a method of operating an electronic device. The method of operating an electronic device may include a step of acquiring camera information including information about a frustum. The method of operating an electronic device may include a step of acquiring three-dimensional content including a plurality of objects arranged in a space including the frustum. The method of operating an electronic device may include a step of determining, based on the frustum and the three-dimensional content, whether each of the plurality of objects is located inside the frustum. The method of operating an electronic device may include a step of acquiring corrected content by transforming at least one object, among the plurality of objects, located outside the frustum so that the at least one object is located inside the frustum.
[0246] In one embodiment of the present disclosure, a frustum may include a plurality of planes. The step of determining whether each of the plurality of objects is located within the frustum may include the step of obtaining a plurality of bounding boxes corresponding to each of the plurality of objects. The step of determining whether each of the plurality of objects is located within the frustum may include the step of determining whether each of the plurality of objects is located within the frustum based on the plurality of bounding boxes and the plurality of planes.
[0247] In one embodiment of the present disclosure, the step of determining whether each of a plurality of objects is located inside a frustum may include a step of obtaining a first volume included inside the frustum and a second volume included outside the frustum among volumes of bounding boxes of at least one object located outside the frustum. The step of obtaining correction content by transforming the at least one object may include a step of obtaining correction content by transforming the at least one object so that the at least one object is located inside the frustum when a ratio of the first volume among the volumes of the bounding boxes is greater than a preset transformation ratio. The step of obtaining correction content by transforming the at least one object may include a step of filtering the at least one object from the three-dimensional content to obtain correction content when a ratio of the first volume among the volumes of the bounding boxes is equal to or less than a preset transformation ratio.
[0248] In one embodiment of the present disclosure, the camera information may include information about a camera viewing three-dimensional content and a view-direction in which the camera views the three-dimensional content. The frustum may include a near-plane and a far-plane, each perpendicular to the view-direction. The step of transforming at least one object to obtain corrected content may include the step of obtaining the reduced content by reducing the three-dimensional content by a ratio of the distance between the near-plane and the far-plane to the distance between the camera and the far-plane in the view-direction. The step of transforming at least one object to obtain the corrected content may include the step of moving the reduced content so that the reduced content is located within the frustum to obtain the corrected content.
[0249] In one embodiment of the present disclosure, camera information may include information about a camera viewing 3D content, a view direction in which the camera views the 3D content, and an effective plane preset as a plane in which the 3D content is optimally displayed. The frustum may include a near plane and a far plane, each perpendicular to the view direction. An operating method of an electronic device may include a step of determining whether each of a plurality of objects is located between the near plane and the effective plane, based on a distance from the camera in the view direction to the near plane being shorter than a distance from the camera in the view direction to the effective plane. The operating method of the electronic device may include a step of obtaining corrected content by transforming at least one intermediate object among the plurality of objects located between the near plane and the effective plane so that the at least one intermediate object is located between the effective plane and the far plane.
[0250] In one embodiment of the present disclosure, the step of obtaining the corrected content by transforming at least one intermediate object may include the step of obtaining the reduced content by reducing the three-dimensional content by a ratio of the distance between the effective plane and the original plane to the distance between the near plane and the original plane in the view direction. The step of obtaining the corrected content by transforming at least one intermediate object may include the step of obtaining the corrected content by moving the reduced content so that the reduced content is positioned between the effective plane and the original plane.
[0251] In one embodiment of the present disclosure, a frustum may include a top plane, a bottom plane, a left plane, and a right plane. Camera information may include information about an active area, which is composed of the top plane, the bottom plane, the left plane, and the right plane, and includes an effective area and an outline area surrounding the effective area. An operating method of an electronic device may include a step of determining whether each of a plurality of objects is located within an effective area. The operating method of the electronic device may include a step of obtaining corrected content by transforming at least one border object located in the outline area among the plurality of objects so that the at least one border object located in the outline area is located within the effective area.
[0252] In one embodiment of the present disclosure, a plurality of objects included in three-dimensional content may include different depth information depending on the respective positions of the plurality of objects within a frustum. The frustum may include a zero-plane having depth information of "0". An operating method of an electronic device may include a step of determining whether an object of a text type is included among the plurality of objects. The operating method of the electronic device may include a step of obtaining corrected content by transforming at least one text object determined to be of a text type among the plurality of objects so that the at least one text object is located in the zero-plane.
[0253] In one embodiment of the present disclosure, the frustum may include a near plane and a far plane, each perpendicular to the view direction. The step of obtaining the correction content by transforming at least one text object may include the step of obtaining the correction content by resizing the three-dimensional content by a ratio of a distance from the camera in the view direction to the zero plane to a distance from the camera in the view direction to the at least one text object. The step of obtaining the correction content by transforming at least one text object may include the step of obtaining the correction content by moving the correction content so that the at least one text object is located on the zero plane.
[0254] In order to solve the above-described technical problem, a computer-readable recording medium having recorded thereon a program for performing at least one operating method among one embodiment of an operating method of an electronic device disclosed in the present disclosure on a computer can be provided.
[0255] The program executed by the electronic device described in this disclosure may be implemented as hardware components, software components, and / or a combination of hardware components and software components. The program may be executed by any system capable of executing computer-readable instructions.
[0256] Software may include a computer program, code, instructions, or a combination of one or more of these, which may configure a processing device to do a desired thing or may independently or collectively command a processing device to do a desired thing.
[0257] Software may be implemented as a computer program containing instructions stored on a computer-readable storage medium. Examples of computer-readable storage media include magnetic storage media (e.g., read-only memory (ROM), random-access memory (RAM), floppy disks, hard disks, etc.) and optical readable media (e.g., CD-ROMs, DVDs (Digital Versatile Discs)). The computer-readable storage media may be distributed across network-connected computer systems, so that computer-readable code may be stored and executed in a distributed manner. The storage media may be readable by a computer, stored in a memory, and executed by a processor.
[0258] Computer-readable storage media may be provided in the form of non-transitory storage media. Here, the term "non-transitory storage media" simply means a tangible device that does not contain signals (e.g., electromagnetic waves). This term does not distinguish between cases where data is permanently stored in the storage media and cases where data is temporarily stored. For example, a "non-transitory storage medium" may include a buffer in which data is temporarily stored.
[0259] Additionally, programs according to the embodiments disclosed herein may be provided as part of a computer program product. The computer program product may be traded as a commodity between sellers and buyers.
[0260] A computer program product may include a software program and a computer-readable storage medium storing the software program. For example, a computer program product may include a product in the form of a software program (e.g., a downloadable application) distributed electronically by an electronic device manufacturer or through an electronic marketplace (e.g., the Samsung Galaxy Store). For electronic distribution, at least a portion of the software program may be stored on a storage medium or temporarily created. In this case, the storage medium may be a server of the electronic device manufacturer, a server of the electronic marketplace, or a storage medium of an intermediary server that temporarily stores the software program.
[0261] Although the embodiments described above have been described with limited examples and drawings, those skilled in the art will appreciate that various modifications and variations can be made based on the above description. For example, appropriate results can still be achieved even if the described techniques are performed in a different order than described, and / or components such as the described computer system or modules are combined or combined in a different manner than described, or are replaced or substituted with other components or equivalents.
Claims
1. A memory (110) storing at least one instruction; and At least one processor (160) comprising a processing circuit, The electronic device (100) executes the at least one processor (120) individually or collectively the at least one instruction stored in the memory (110), Obtain camera information including information about the frustum (200), Obtaining three-dimensional content (300) including a plurality of objects arranged in a space including the above frustum (200), Based on the frustum (200) and the three-dimensional content (300), it is determined whether each of the plurality of objects is located inside the frustum (200), An electronic device (100) that obtains correction content (400) by transforming at least one object located outside the frustum (200) among the plurality of objects so that the at least one object is located inside the frustum (200).
2. In paragraph 1, The above frustum (200) includes a plurality of planes, The above electronic device (100) is, Obtain a plurality of bounding boxes corresponding to each of the above plurality of objects, An electronic device (100) that determines whether each of the plurality of objects is contained within the frustum (200) based on the plurality of bounding boxes and the plurality of planes.
3. In paragraph 2, The above electronic device (100) is, Obtaining a first volume included inside the frustum (200) and a second volume included outside the frustum (200) among the volumes of the bounding box of the at least one object located outside the frustum (200), An electronic device (100) that obtains correction content (400) by transforming the at least one object so that the at least one object is located inside the frustum (200) when the ratio of the first volume to the volume of the bounding box is greater than a preset transformation ratio.
4. In paragraph 3, The above electronic device (100) is, An electronic device (100) that obtains the correction content (400) by filtering at least one object from the three-dimensional content (300) according to a ratio of the first volume to the volume of the bounding box being equal to or smaller than a preset conversion ratio.
5. In any one of paragraphs 1 to 4, The above camera information includes information about a camera viewing the three-dimensional content and a view-direction from which the camera views the three-dimensional content, The above frustum (200) includes a near-plane and a far-plane, each perpendicular to the view direction, The above electronic device (100) is, The three-dimensional content (300) is reduced by the ratio of the distance between the near-plane and the circle-plane to the distance between the circle-plane from the camera in the view direction, thereby obtaining reduced content. An electronic device (100) that obtains the correction content (400) by moving the reduced content so that the reduced content is located within the frustum (200).
6. In any one of paragraphs 1 to 5, The above camera information includes information about a camera looking at the three-dimensional content (300), a view-direction in which the camera looks at the three-dimensional content (300), and an effective-plane preset as a plane in which the three-dimensional content (300) is optimally displayed. The above frustum (200) includes a near-plane and a far-plane, each perpendicular to the view direction, The above electronic device (100) is, Determine whether each of the plurality of objects is located between the near-plane and the effective-plane, as the distance from the camera in the view-direction to the near-plane is shorter than the distance from the camera in the view-direction to the effective-plane, An electronic device (100) that obtains the correction content (400) by transforming at least one intermediate object located between the near-plane and the effective-plane among the plurality of objects so that the at least one intermediate object is located between the effective-plane and the original-plane.
7. In paragraph 6, The above electronic device (100) is, The three-dimensional content (300) is reduced by the ratio of the distance between the effective plane and the circle plane to the distance between the near plane and the circle plane in the view direction, thereby obtaining reduced content. An electronic device (100) that obtains the correction content (400) by moving the reduced content so that the reduced content is located between the effective plane and the original plane.
8. In any one of paragraphs 1 to 7, The above frustum (200) includes a top-plane, a bottom-plane, a left-plane, and a right-plane, The above camera information includes information about an active area, which is composed of the upper plane, the lower plane, the left plane, and the right plane, and includes an effective area and an outline area surrounding the effective area. The above electronic device (100) is, Determine whether each of the above multiple objects is located within the valid area, An electronic device (100) that obtains the correction content (400) by transforming at least one object located in the border area among the plurality of objects so that the at least one object is located within the valid area.
9. In any one of paragraphs 1 to 8, The plurality of objects included in the three-dimensional content (300) include different depth information depending on the position of each of the plurality of objects within the frustum (200). The above frustum (200) includes a zero-plane having depth information of “0”, The above electronic device (100) is, Determine whether an object of the text type is included among the above multiple objects, An electronic device (100) that obtains the corrected content (400) by transforming at least one text object determined to be the text type among the plurality of objects so that the at least one text object is located on the zero plane.
10. In paragraph 9, The above frustum (200) includes a near-plane and a far-plane, each perpendicular to the view direction, The above electronic device (100) is, The three-dimensional content (300) is adjusted in size by the ratio of the distance from the camera in the view direction to the zero plane to the distance from the camera in the view direction to the at least one text object, thereby obtaining the adjusted content. An electronic device (100) that obtains the correction content (400) by moving the adjustment content so that at least one text object is positioned on the zero plane.
11. In the operating method of an electronic device (100), Step (S100) of acquiring camera information including information about a frustum; A step (S200) of obtaining three-dimensional content including a plurality of objects arranged in a space including the above frustum; A step (S300) of determining whether each of the plurality of objects is located inside the frustum based on the frustum and the three-dimensional content; and An operating method of an electronic device (100), comprising a step (S400) of obtaining correction content by transforming at least one object located outside the frustum among the plurality of objects so that the at least one object is located inside the frustum.
12. In paragraph 11, The frustum comprises a plurality of planes, The step (S300) of determining whether each of the above plurality of objects is located inside the frustum is, A step of obtaining a plurality of bounding boxes corresponding to each of the plurality of objects; and An operating method of an electronic device (100), comprising a step of determining whether each of the plurality of objects is located inside the frustum based on the plurality of bounding boxes and the plurality of planes.
13. In paragraph 12, The step (S300) of determining whether each of the above plurality of objects is located inside the frustum is, A step of obtaining a first volume included inside the frustum and a second volume included outside the frustum among the volumes of the bounding boxes of the at least one object located outside the frustum, The step (S400) of obtaining the correction content by converting at least one object is as follows: A step of obtaining the correction content by transforming the at least one object so that the at least one object is located within the frustum, according to a ratio of the first volume to the volume of the bounding box being greater than a preset transformation ratio; and An operating method of an electronic device (100), comprising a step of obtaining the correction content by filtering the at least one object from the three-dimensional content according to a ratio of the first volume among the volumes of the bounding box being equal to or smaller than a preset conversion ratio.
14. In any one of paragraphs 11 to 13, The above camera information includes information about a camera viewing the three-dimensional content and a view-direction from which the camera views the three-dimensional content, The frustum includes a near-plane and a far-plane, each perpendicular to the view-direction, The step (S400) of obtaining the correction content by transforming at least one object is as follows: A step of obtaining reduced content by reducing the three-dimensional content by the ratio of the distance between the near-plane and the circle-plane to the distance between the circle-plane from the camera in the view direction; and An operating method of an electronic device (100), comprising a step of obtaining the correction content by moving the reduced content so that the reduced content is located within the frustum.
15. A computer-readable recording medium having recorded thereon a program for performing the method of operation described in any one of Articles 11 to 14 on a computer.
Citation Information
Patent Citations
Apparatus and method for rendering object in 3D graphic terminal
KR101690034B1
Image stitching system
KR101903285B1
Roller for conveyer
KR102651613B1
Method and apparatus for point cloud contents access and delivery in 360 video environment
KR102656191B1
A heating device for reel-to-reel continuous deposition
KR102753821B1