Mathod for determining of browsing path, mathod for determining of browsing point and computer program

Abstract

A browsing path determination method according to an embodiment may include the step of setting a plurality of browsing path candidates based on touch information, the step of calculating a polygon mesh area for each of the plurality of browsing path candidates, and the step of selecting the browsing path candidate among the plurality of browsing path candidates that has the smallest calculated polygon mesh area. The embodiment has the effect of providing high-quality volumetric data to the user by selecting a browsing path and viewpoint with a small polygon mesh area.

Description

Technology Field

[0001] The embodiments relate to a method for determining a browsing path and a method for determining a browsing time. Background Technology

[0002] Generally, as one of the methods for implementing 3D computer graphics, there is the Volumetric Video Capture method, which generates capturing data from images of objects acquired by a camera. In this case, shooting is performed in as much of the entire area as possible so that there are no shaded areas.

[0003] However, there is a problem where capturing fail areas occur due to the movement of objects or the fluttering of clothes, and the quality of the Voltometric data deteriorates as the number of such capturing fail areas increases. The problem to be solved

[0004] To solve the aforementioned problem, the embodiment aims to provide a browsing path determination method, a browsing time determination method, and a computer program for providing high-quality volumometric data to a user. means of solving the problem

[0005] A browsing path determination method according to an embodiment may include the step of setting a plurality of browsing path candidates based on touch information, the step of calculating a polygon mesh area for each of the plurality of browsing path candidates, and the step of selecting the browsing path candidate among the plurality of browsing path candidates that has the smallest calculated polygon mesh area.

[0006] The step of setting the plurality of browsing path candidates above can set the plurality of browsing path candidates according to the touch drag direction.

[0007] In the step of setting the plurality of browsing path candidates, if the touch drag direction is a constant direction and the touch drag distance is greater than or equal to a predetermined distance, the step of setting the plurality of browsing path candidates can be performed.

[0008] Additionally, the embodiment is a computer-readable recording medium storing a computer program, wherein the computer program may include instructions for a processor to perform the steps of setting a plurality of browsing path candidates based on touch information, calculating a polygon mesh area for each of the plurality of browsing path candidates, and selecting the browsing path candidate among the plurality of browsing path candidates that has the smallest calculated polygon mesh area.

[0009] Additionally, the embodiment is a computer-readable recording medium storing a computer program, wherein the computer program may include instructions for the processor to perform the steps of setting a plurality of browsing path candidates based on touch information when executed by a processor, calculating a polygon mesh area for each of the plurality of browsing path candidates, and selecting the browsing path candidate among the plurality of browsing path candidates that has the smallest calculated polygon mesh area.

[0010] Additionally, the embodiment is a computer program stored on a computer-readable recording medium, said computer program may include instructions for a processor to perform the steps of setting a plurality of browsing path candidates based on touch information, calculating a polygon mesh area for each of the plurality of browsing path candidates, and selecting the browsing path candidate among the plurality of browsing path candidates that has the smallest calculated polygon mesh area.

[0011] Additionally, the browsing time determination method according to the embodiment may include the step of setting a plurality of browsing time candidates based on touch information, the step of calculating a polygon mesh area for each of the plurality of browsing time candidates, and the step of selecting the browsing time candidate with the smallest polygon mesh area among the plurality of browsing time candidates.

[0012] In the step of setting the above-mentioned plurality of browsing point candidates, the plurality of browsing point candidates can be set based on the point where the touch is released.

[0013] The above plurality of browsing point candidates may be points having a predetermined distance from the point where the touch is released.

[0014] Additionally, the embodiment is a computer-readable recording medium storing a computer program, wherein the computer program may include instructions for the processor to perform the steps of setting a plurality of browsing point candidates based on touch information when executed by a processor, calculating a polygon mesh area for each of the plurality of browsing point candidates, and selecting the browsing point candidate having the smallest polygon mesh area among the plurality of browsing point candidates.

[0015] Additionally, the embodiment is a computer-readable recording medium storing a computer program, wherein the computer program may include instructions for the processor to perform the steps of setting a plurality of browsing point candidates based on touch information when executed by a processor, calculating a polygon mesh area for each of the plurality of browsing point candidates, and selecting the browsing point candidate having the smallest polygon mesh area among the plurality of browsing point candidates.

[0016] Additionally, the embodiment is a computer program stored on a computer-readable recording medium, said computer program may include instructions for a processor to perform the steps of setting a plurality of browsing point candidates based on touch information, calculating a polygon mesh area for each of the plurality of browsing point candidates, and selecting the browsing point candidate with the smallest polygon mesh area among the plurality of browsing point candidates. Effects of the invention

[0017] The embodiment has the effect of providing high-quality volumetric data to the user by selecting a browsing path and viewpoint with a small polygon mesh area. Brief explanation of the drawing

[0018] FIG. 1 is a flowchart illustrating a browsing path determination method according to a first embodiment. FIGS. 2 and FIGS. 3 are drawings for explaining a browsing path determination method according to a first embodiment. FIG. 4 is a block diagram showing a browsing path determination device according to a first embodiment. FIG. 5 is a flowchart illustrating a method for determining the browsing time according to a second embodiment. FIGS. 6 and FIGS. 7 are drawings for explaining a method for determining a browsing time according to a second embodiment. FIG. 8 is a block diagram showing a browsing time determination device according to a second embodiment. Specific details for implementing the invention

[0019] The advantages and features of the present invention and the methods for achieving them will become clear by referring to the embodiments described below in detail together with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below but can be implemented in various forms. These embodiments are provided merely to ensure that the disclosure of the present invention is complete and to fully inform those skilled in the art of the scope of the invention, and the scope of the present invention is defined only by the claims.

[0020] In describing the embodiments of the present invention, specific descriptions of known functions or configurations will be omitted unless actually necessary for describing the embodiments of the present invention. Furthermore, the terms described below are defined in consideration of the functions in the embodiments of the present invention, and these may vary depending on the intentions or practices of the user or operator. Therefore, such definitions should be based on the content throughout this specification.

[0021] In this specification, singular expressions include plural expressions unless the context clearly indicates otherwise. In this application, terms such as 'comprising' or 'composing' are intended to specify the existence of the features, numbers, steps, actions, components, parts, or combinations thereof described in the specification, and should be understood as not precluding the existence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof.

[0022] Furthermore, in the embodiments of the present invention, when it is stated that a part is connected to another part, this includes not only a direct connection but also an indirect connection through another medium. Additionally, the meaning that a part includes a certain component implies that, unless specifically stated otherwise, it does not exclude other components but may include additional components.

[0023] Hereinafter, embodiments will be described in detail with reference to the drawings.

[0024] FIG. 1 is a flowchart showing a browsing path determination method according to a first embodiment, FIG. 2 and FIG. 3 are drawings for explaining a browsing path determination method according to a first embodiment, and FIG. 4 is a block diagram showing a browsing path determination device according to a first embodiment.

[0025] Capture data for an object may be prepared for determining a browsing path according to the first embodiment. The capture data may be captured by a 3D capture device. The 3D capture device may be positioned around the object to capture the object. For example, the 3D capture device may be structured to capture the object while rotating around it. Alternatively, the 3D capture device may be structured to have multiple units positioned around the object to capture the object simultaneously.

[0026] As described above, the capturing data of an object captured by the 3D capture device is transmitted to a server, and the server can generate 3D capturing data of the object. The 3D capturing data may be mesh data, but is not limited thereto.

[0027] In 3D capturing data, capturing failure areas may occur due to the movement of objects or the fluttering of clothing. A polygon mesh can be generated randomly from these capturing failure areas through automatic or manual post-processing. A polygon is a triangular shape composed of three vertices, and these polygons can be combined to form a polygon mesh capable of representing complex objects.

[0028] In the above description, the polygon mesh is described as being generated using vertices created through post-processing based on captured data (Flag 1), but it is not limited thereto. For example, the polygon mesh may be generated using vertices created by a capturing system (Flag 0), or it may be generated using vertices created by a user performing detailed correction work directly using a computer graphics tool after capturing (Flag 2).

[0029] The 3D capturing data generated as described above is transmitted to a terminal, and the user can view the video while changing the viewpoint of the video on the terminal. The embodiment can provide the video to the user by providing a browsing path determination method for changing the viewpoint of the video based on the user's input signal.

[0030] The browsing path determination method according to the first embodiment may include the step (S110) of setting a browsing path candidate.

[0031] The step (S110) of setting browsing path candidates may set multiple browsing path candidates based on touch information. The touch information may include user touch drag information. User touch drag information may include user touch input information, touch drag direction information, and touch drag distance information, but is not limited thereto. The touch information may include mouse touch information. The touch information may include touch input information using a mouse, touch drag direction information, and touch drag distance information.

[0032] The step of setting a browsing path candidate (S110) can be performed when the touch drag direction maintains a constant direction for a predetermined period of time and the touch drag distance maintains a distance greater than or equal to a predetermined distance. On the other hand, if the touch drag direction changes, the browsing path candidate can be set by recalculating the touch drag direction and distance from the point in time when the touch drag direction changed.

[0033] As illustrated in FIG. 2, a browsing path candidate may include a plurality of browsing path candidates. The plurality of browsing path candidates may be determined according to the drag direction (P). The plurality of browsing path candidates may include a first path candidate (P1), a second path candidate (P2), and a third path candidate (P3), but are not limited thereto. The plurality of browsing path candidates may be directions that are the same as the drag direction or have an angle less than a threshold value.

[0034] For example, the first path candidate (P1) may be the same direction as the touch drag direction (P). The second path candidate (P2) may be a direction having an angle less than a threshold in the positive direction relative to the touch drag direction (P). The third path candidate (P3) may be a direction having an angle less than a threshold in the negative direction relative to the touch drag direction (P). Here, the threshold may be determined by taking into account a point in time that is not too far removed from the point in time selected by the user.

[0035] Returning to FIG. 1, the browsing path determination method according to the first embodiment may perform the step (S120) of calculating the polygon mesh area for each browsing path candidate.

[0036] Once multiple browsing path candidates are determined, the polygon mesh area for each of the multiple browsing path candidates can be calculated. In the capturing data for an object, capturing failure areas may occur due to the object's movement or the fluttering of clothing. Polygon meshes can be generated arbitrarily for these capturing failure areas through automatic or manual post-processing. A polygon is a triangular shape composed of three vertices, and these polygons can be combined to form a mesh capable of representing complex objects. In this case, a single vertex corresponds to a point that makes up the point cloud data, and a collection of these points can be represented as a point cloud.

[0037] Therefore, by calculating the area of ​​the polygon mesh, it becomes possible to calculate the polygon mesh area for the mesh data of each browsing path candidate.

[0038] The browsing path determination method according to the first embodiment can perform the step (S130) of selecting the browsing path candidate with the smallest polygon mesh area.

[0039] Once the polygon mesh area of ​​each browsing path candidate is calculated, the final browsing path can be determined by selecting the browsing path candidate with the smallest polygon mesh area.

[0040] As illustrated in FIG. 3, once the final browsing path is determined, volumetric data corresponding to the final browsing path can be provided to the user device.

[0041] The browsing path determination method according to the first embodiment has the effect of providing high-quality volumetric data to the user by using a browsing path with a small polygon mesh area.

[0042] As illustrated in FIG. 4, a browsing path determination device (100) for performing a browsing path determination method may include a collection unit (110), a setting unit (120), a calculation unit (130), and a determination unit (140).

[0043] The browsing path determination device (100) can perform a browsing path determination method using three-dimensional capturing data.

[0044] 3D capturing data can be generated using captured data of an object. Captured data of an object can be captured by a 3D capture device. For example, the 3D capture device may be structured to capture the object while rotating around it. Alternatively, the 3D capture device may be structured to have multiple units placed around the object to capture the object simultaneously.

[0045] Capture data for an object is transmitted to a server, and the server can generate 3D capturing data using the capture data for the object. The 3D capturing data may be mesh data. The 3D capturing data may include a polygon mesh area formed in a capturing fail area.

[0046] The browsing path determination device (100) can receive three-dimensional capturing data including a polygon mesh area from a server and perform a browsing path determination method.

[0047] The collection unit (110) may include touch information. The touch information may include user touch information. The touch information may include user touch drag information. User touch drag information may include user touch input information, touch drag direction information, and touch drag distance information. The touch information may include mouse touch information. The touch information may include touch input information using a mouse, touch drag direction information, and touch drag distance information.

[0048] The setting unit (120) can set multiple browsing path candidates using touch information.

[0049] Multiple browsing path candidates may be determined based on the touch drag direction. The multiple browsing path candidates may include, but are not limited to, a first path candidate, a second path candidate, and a third path candidate. The multiple browsing path candidates may be directions that are the same as the user's drag direction or have an angle less than a threshold value.

[0050] For example, the first path candidate may be the same direction as the touch drag direction. The second path candidate may be a direction having an angle less than a threshold in the positive direction relative to the user's touch drag direction. The third path candidate may be a direction having an angle less than a threshold in the negative direction relative to the touch drag direction.

[0051] The calculation unit (130) can calculate the polygon mesh area for each of the multiple browsing path candidates. Here, the polygon mesh area may include the area of ​​the polygon mesh generated using vertices generated by post-processing based on the captured data.

[0052] The determination unit (140) can determine the final browsing path by selecting the browsing path candidate with the smallest polygon mesh area among a plurality of browsing path candidates. As described above, once the final browsing path is determined, volumetric data corresponding to the final browsing path can be provided to the user device.

[0054] FIG. 5 is a flowchart showing a method for determining a browsing time according to a second embodiment, FIG. 6 and FIG. 7 are drawings for explaining a method for determining a browsing time according to a second embodiment, and FIG. 8 is a block diagram showing a device for determining a browsing time according to a second embodiment.

[0055] Capture data for an object may be prepared for determining a browsing point according to the second embodiment. The capture data may be captured by a 3D capture device. The 3D capture device may be positioned around the object to capture the object. For example, the 3D capture device may be structured to capture the object while rotating around it. Alternatively, the 3D capture device may be structured to have multiple units positioned around the object to capture the object simultaneously.

[0056] As described above, the capturing data of an object captured by the 3D capture device is transmitted to a server, and the server can generate 3D capturing data of the object. The 3D capturing data may be mesh data, but is not limited thereto.

[0057] In 3D capturing data, capturing failure areas may occur due to the movement of objects or the fluttering of clothing. A polygon mesh can be generated randomly from these capturing failure areas through automatic or manual post-processing. A polygon is a triangular shape composed of three vertices, and these polygons can be combined to form a polygon mesh capable of representing complex objects.

[0058] In the above description, the polygon mesh is described as being generated using vertices created through post-processing based on captured data (Flag 1), but it is not limited thereto. For example, the polygon mesh may be generated using vertices created by a capturing system (Flag 0), or it may be generated using vertices created by a user performing detailed correction work directly using a computer graphics tool after capturing (Flag 2).

[0059] The 3D capturing data generated as described above is transmitted to a terminal, and the user can view the video while changing the viewpoint of the video on the terminal. The second embodiment can provide the video to the user by providing a browsing viewpoint determination method for changing the viewpoint of the video based on the user's input signal.

[0060] Referring to FIG. 5, the browsing time determination method according to the second embodiment may include the step (S210) of setting a plurality of browsing time candidates based on touch information.

[0061] Touch information may include touch information and release information using a user's finger. Touch information may include touch information and release information using a mouse.

[0062] The step of setting browsing time candidates (S210) can set multiple browsing time candidates based on the release time when information regarding the release of the user's touch input is input and the user's touch operation is fast.

[0063] As illustrated in FIGS. 6 and 7, the step (S210) of setting browsing time candidates can determine the time when a touch input is released as a first time candidate (P21). Once the first time candidate (P21) is determined, additional time candidates can be set in the surrounding area of ​​the first time candidate (P21). For example, a point located at a predetermined distance upward from the first time candidate (P21) can be determined as a second time candidate (P22). A point located at a predetermined distance downward from the first time candidate (P21) can be determined as a third time candidate (P23). A point located at a predetermined distance to the left from the first time candidate (P21) can be determined as a fourth time candidate (P24). A point located at a predetermined distance to the right from the first time candidate (P21) can be determined as a fifth time candidate (P25), but is not limited thereto. Here, the time candidates may have volumometric data similar to the time when the touch input is released.

[0064] Returning to FIG. 5, the browsing time determination method according to the second embodiment may include the step (S220) of calculating the polygon mesh area for each of the plurality of browsing time candidates.

[0065] When multiple browsing viewpoint candidates are determined, for example, the polygon mesh area for each of the first to fifth viewpoint candidates can be calculated. In the capturing data for an object, capturing fail regions may occur due to the object's movement or the fluttering of clothing. A polygon mesh can be generated arbitrarily for the capturing fail regions through automatic or manual post-processing. A polygon is a triangular shape composed of three vertices, and these polygons can be combined to form a mesh capable of representing complex objects. In this case, one vertex corresponds to a point that makes up the point cloud data, and a set of these points can be represented as a point cloud.

[0066] Therefore, by calculating the area of ​​the polygon mesh, it becomes possible to calculate the polygon mesh area for the mesh data of each browsing point candidate.

[0067] The method for determining a browsing time point according to an embodiment may include the step (S230) of selecting the browsing time point candidate with the smallest polygon mesh area among a plurality of browsing time point candidates.

[0068] Once the polygon mesh area of ​​each browsing point candidate is calculated, the final browsing point candidate with the smallest polygon mesh area can be selected to determine the final browsing point.

[0069] Once the final browsing time is determined, volumetric data corresponding to the final browsing time can be provided to the user's device.

[0070] The browsing time determination method according to the second embodiment has the effect of providing high-quality volumetric data to the user by using a browsing time with a small polygon mesh area.

[0071] As illustrated in FIG. 8, a browsing time determination device (200) for performing a browsing time determination method may include a collection unit (210), a setting unit (220), a calculation unit (230), and a determination unit (240).

[0072] The browsing time determination device (200) can perform a browsing time determination method using three-dimensional capturing data.

[0073] 3D capturing data can be generated using captured data of an object. Captured data of an object can be captured by a 3D capture device. For example, the 3D capture device may be structured to capture the object while rotating around it. Alternatively, the 3D capture device may be structured to have multiple units placed around the object to capture the object simultaneously.

[0074] Capture data for an object is transmitted to a server, and the server can generate 3D capturing data using the capture data for the object. The 3D capturing data may be mesh data. The 3D capturing data may include a polygon mesh area formed in a capturing fail area.

[0075] The browsing time determination device (200) can receive three-dimensional capturing data including a polygon mesh area from a server and perform a browsing time determination method.

[0076] The collection unit (210) may include touch information. The touch information may include user touch information. The touch information may include touch information and release information using the user's finger. The touch information may include touch information and release information using a mouse.

[0077] The setting unit (220) can set multiple browsing point candidates using touch information.

[0078] The point at which a touch input is released can be determined as the first time point candidate. Once the first time point candidate is determined, additional time point candidates can be set in the surrounding area of ​​the first time point candidate. For example, a point located at a predetermined distance upward from the first time point candidate can be determined as the second time point candidate. A point located at a predetermined distance downward from the first time point candidate can be determined as the third time point candidate. A point located at a predetermined distance to the left from the first time point candidate can be determined as the fourth time point candidate. A point located at a predetermined distance to the right from the first time point candidate can be determined as the fifth time point candidate, but is not limited thereto.

[0079] The calculation unit (230) can calculate the polygon mesh area for each of the multiple browsing point candidates. Here, the polygon mesh area may include the area of ​​the polygon mesh generated using vertices generated by post-processing based on the captured data.

[0080] The determining unit (240) can determine the final browsing time by selecting the candidate with the smallest polygon mesh area among a plurality of browsing time candidates. As described above, once the final browsing time is determined, volumetric data corresponding to the final browsing time can be provided to the user device.

[0081] The browsing point determination method according to the embodiment has the effect of providing high-quality volumetric data to the user by using a browsing point with a small polygon mesh area.

[0083] Combinations of each block of the block diagram attached to the example and each step of the flowchart may be performed by computer program instructions. Since these computer program instructions may be loaded into the processor of a general-purpose computer, a specialized computer, or other programmable data processing equipment, the instructions executed through the processor of the computer or other programmable data processing equipment create means for performing the functions described in each block of the block diagram or each step of the flowchart. Since these computer program instructions may also be stored in computer-available or computer-readable memory that can be directed toward the computer or other programmable data processing equipment to implement the function in a specific way, the instructions stored in computer-available or computer-readable memory may also produce a manufactured item containing instruction means for performing the function described in each block of the block diagram or each step of the flowchart. Since computer program instructions can be loaded onto a computer or other programmable data processing equipment, instructions that execute a computer or other programmable data processing equipment by performing a series of operation steps on the computer or other programmable data processing equipment to create a process executed by the computer can also provide steps for executing the functions described in each block of the block diagram and each step of the flowchart.

[0084] Additionally, each block or each step may represent a module, segment, or part of code containing one or more executable instructions for executing a specified logical function(s). Also, it should be noted that in some alternative embodiments, the functions mentioned in the blocks or steps may occur out of order. For example, two blocks or steps described in succession may actually be performed substantially simultaneously, or the blocks or steps may sometimes be performed in reverse order according to the corresponding function.

[0085] The foregoing description is merely an illustrative explanation of the technical concept of the present invention, and those skilled in the art to which the present invention pertains will be able to make various modifications and variations within the scope of the essential characteristics of the present invention. Accordingly, the embodiments disclosed in the present invention are intended to explain, not limit, the technical concept of the present invention, and the scope of the technical concept of the present invention is not limited by these embodiments. The scope of protection of the present invention shall be interpreted by the claims below, and all technical concepts within an equivalent scope shall be interpreted as being included within the scope of rights of the present invention. Explanation of the symbols

[0086] 110: Collection Department 120: Settings section 130: Output section 140: Decision part

Claims

Claim 1 A browsing path determination method comprising: a step of setting a plurality of browsing path candidates based on touch information; a step of calculating a polygon mesh area for each of the plurality of browsing path candidates; and a step of selecting the browsing path candidate among the plurality of browsing path candidates that has the smallest calculated polygon mesh area. Claim 2 In claim 1, the step of setting the plurality of browsing path candidates is a browsing path determination method that sets the plurality of browsing path candidates according to the touch drag direction. Claim 3 A method for determining a browsing path according to paragraph 2, wherein, in the step of setting the plurality of browsing path candidates, the touch drag direction is a constant direction and the touch drag distance is greater than or equal to a predetermined distance, the step of setting the plurality of browsing path candidates is performed. Claim 4 A computer program stored on a computer-readable recording medium, wherein the computer program includes instructions for causing the processor to perform a method according to any one of claims 1 to 3 when executed by a processor. Claim 5 A method for determining a browsing point, comprising: a step of setting a plurality of browsing point candidates based on touch information; a step of calculating a polygon mesh area for each of the plurality of browsing point candidates; and a step of selecting the browsing point candidate with the smallest polygon mesh area among the plurality of browsing point candidates. Claim 6 A method for determining a browsing time, wherein, in the step of setting the plurality of browsing time candidates, the plurality of browsing time candidates are set based on the point where the touch is released. Claim 7 A method for determining a browsing time point according to claim 6, wherein the plurality of browsing time point candidates are points having a predetermined distance from the point where the touch is released. Claim 8 A computer program stored on a computer-readable recording medium, wherein the computer program comprises instructions for causing the processor to perform a method according to any one of claims 5 to 7 when executed by a processor.

Images