Method for estimating volume and density of object and system and apparatus for performing the same

The two-degree-of-freedom scanner system with a rotatable camera and turntable addresses the accessibility and accuracy issues of conventional 3D scanners by providing comprehensive scanning and precise volume estimation.

KR1020260163791APending Publication Date: 2026-11-17TECH UNIV OF KOREA IND ACADEMIC COOP FOUNDATION
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
KR1020250059987
Authority / Receiving Office
KR · KR
Patent Type
Applications
Current Assignee / Owner
Filing Date
2025-05-08
Publication Date
2026-11-17

AI Technical Summary

Technical Problem

Conventional 3D scanners are expensive and complex, limiting their accessibility to general users and leading to incomplete scanning and reduced accuracy due to fixed camera viewpoints, which results in degraded scan data quality and measurement inaccuracy.

Method used

A two-degree-of-freedom scanner system with a rotatable camera and turntable, combined with an RGB-D camera and advanced data processing algorithms, enables comprehensive scanning from multiple angles and precise volume estimation.

Benefits of technology

The system provides accurate and accessible 3D scanning technology for general users by overcoming blind spots and enhancing data quality, enabling precise volume and density estimation of objects.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure PAT00035_ABST
    Figure PAT00035_ABST
Patent Text Reader

Abstract

A method for estimating the volume and / or density of an object and a system and apparatus for performing the same are disclosed. An object estimation system for estimating the volume of an object includes a scanner device for photographing an object and acquiring scan data, and a volume estimation device for estimating the volume of an object based on the scan data. The scanner device includes a camera for photographing an object and acquiring scan data including 3D points regarding the shape of the object, a first position adjustment module for adjusting the position of the camera, a turntable on which the object is placed, and a second position adjustment module for rotating the turntable. The volume estimation device includes a processor that controls the first position adjustment module so that the camera has a defined scanning position and controls the second position adjustment module so that the turntable on which the object is placed rotates. Scan data of an object photographed from a camera at different points in time is acquired by the rotation of the turntable, and the processor can estimate the volume of the object based on the scan data of the object photographed at different points in time.
Need to check novelty before this filing date? Find Prior Art

Description

Technology Field

[0001] The present invention relates to a technology for estimating the volume and / or density of an object and is the result of support for the following research and development project.

[0002] - Research Project ID: GRRC TUKorea2020-B03

[0003] - Research Project Name: Gyeonggi Regional Cooperation Research Center (GRRC) / GRRC Application Project

[0004] - Organizing Institution: Korea University of Engineering

[0005] - Research Management Agency: Gyeonggi Provincial Government

[0006] - Research Period: July 1, 2024 – June 30, 2025 Background Technology

[0008] Recently, there has been an increasing demand for 3D scanners for object shape restoration and volume measurement in the manufacturing and quality inspection fields. By providing precise volumetric data of objects, 3D scanning technology can be utilized critically in various areas such as robot control, object classification, and collision avoidance. In particular, precise volumetric measurement is attracting attention as an essential element for the implementation of automation and intelligent systems. However, as existing 3D scanners often rely on expensive equipment or complex robotic systems, making them inaccessible to general users, there is a growing demand for low-cost yet highly reliable 3D scanning technology.

[0010] A volume estimation system according to one embodiment includes a scanner device that captures an object and acquires scan data, and a volume estimation device that estimates the volume of an object based on the scan data. The scanner device includes a camera that captures an object and acquires scan data including 3D points regarding the shape of the object, a first position adjustment module for adjusting the position of the camera, a turntable on which the object is placed, and a second position adjustment module for rotating the turntable. The volume estimation device includes a processor that controls the first position adjustment module so that the camera has a defined scanning position and controls the second position adjustment module so that the turntable on which the object is placed rotates. Scan data capturing an object at different points in time is acquired from the camera by the rotation of the turntable, and the processor can estimate the volume of the object based on the scan data capturing the object at different points in time.

[0011] The camera can acquire scan data including 3D points of the shape of the top surface of an object by scanning the object at a first scanning position corresponding to the top of the object in a first scanning step, and acquire scan data including 3D points of the shape of the side surface of an object by moving to a second scanning position by the control of a first position adjustment module and scanning the object at the second scanning position in a second scanning step.

[0012] The camera above acquires scan data including 3D points of the shape of the side of an object by moving to a third scanning position under the control of a second position adjustment module in a third scanning step and scanning an object at the third scanning position, and the third scanning position may represent a positional relationship between the camera and the object that is different from the second scanning position by rotating the object under the control of the second position adjustment module.

[0013] The above processor performs alignment of scan data for an object acquired at each scanning position of the camera and can estimate the volume of the object based on the aligned scan data.

[0014] The processor can perform post-processing on the matched scan data, including 3D point removal and noise removal corresponding to the floor surface where the object is located, and estimate the volume of the object based on the post-processed scan data.

[0015] The above processor can perform 3D modeling of an object based on post-processed scan data.

[0016] The above turntable includes a mass sensor that measures the mass of an object, and the processor can estimate the density of an object based on the measured mass of the object and the estimated volume of the object.

[0017] The above camera may include an RGB-D camera that collects color information and depth information about an object being photographed.

[0018] A scanner device according to one embodiment includes a camera that captures an object and acquires scan data including 3D points regarding the shape of the object, a first position adjustment module for adjusting the position of the camera, a turntable on which the object is placed, and a second position adjustment module for rotating the turntable, and scan data capturing an object at different viewpoints from the camera can be acquired by controlling the first position adjustment module and the second position adjustment module.

[0019] A volume estimation method according to one embodiment may include: controlling a first position adjustment module for adjusting the position of a camera so that the camera has a defined scanning position; controlling a second position adjustment module for rotating a turntable on which an object is placed; acquiring scan data including 3D points regarding the shape of an object at different points in time using a camera that photographs an object; and estimating the volume of an object based on scan data of an object photographed at different points in time.

[0020] The operation of acquiring the above scan data may include, in a first scanning step, an operation of acquiring scan data including 3D points of the shape of the top surface of an object by scanning the object at a first scanning position corresponding to the top of the object, and in a second scanning step, an operation of acquiring scan data including 3D points of the shape of the side surface of an object by moving to a second scanning position by the control of a first position adjustment module and scanning the object at the second scanning position.

[0021] The operation of acquiring the above scan data may include, in the third scanning step, moving to a third scanning position by the control of the second position adjustment module and scanning the object at the third scanning position to acquire scan data including 3D points of the shape of the side of the object.

[0022] The operation of estimating the volume of the object may include performing alignment of scan data for the object acquired at each scanning position of the camera, and estimating the volume of the object based on the aligned scan data.

[0023] The operation of estimating the volume of the object may include performing post-processing on the matched scan data, including removing 3D points and noise corresponding to the floor surface where the object is located, and estimating the volume of the object based on the post-processed scan data.

[0024] The above volume estimation method may further include an operation of performing 3D modeling of an object based on post-processed scan data.

[0025] The above volume estimation method may further include the operation of measuring the mass of an object using a mass sensor and the operation of estimating the density of an object based on the measured mass of the object and the estimated volume of the object. Brief explanation of the drawing

[0027] FIG. 1 is a diagram illustrating an overview of a volume estimation system according to one embodiment. FIGS. 2a and 2b are drawings for illustrating a scanner device and a volume estimation device according to one embodiment. FIG. 3 is a diagram illustrating the process performed by a volume estimation system according to one embodiment to remove a 3D point corresponding to a bottom surface. FIG. 4 is a diagram illustrating a user interface provided by a volume estimation device according to one embodiment. FIG. 5 is a flowchart illustrating the operations of a volume estimation method according to one embodiment. FIG. 6 is a flowchart illustrating additional operations of a volume estimation method according to one embodiment. Specific details for implementing the invention

[0028] Specific structural or functional descriptions of the embodiments are disclosed for illustrative purposes only and may be modified and implemented in various forms. Accordingly, actual implementations are not limited to the specific embodiments disclosed, and the scope of this specification includes modifications, equivalents, or substitutions included in the technical concept described by the embodiments.

[0029] Terms such as "first" or "second" may be used to describe various components, but these terms should be interpreted solely for the purpose of distinguishing one component from another. For example, the first component may be named the second component, and similarly, the second component may be named the first component.

[0030] When it is stated that a component is "connected" to another component, it should be understood that it may be directly connected to or coupled with that other component, or that there may be other components in between.

[0031] The singular expression includes the plural expression unless the context clearly indicates otherwise. In this specification, terms such as "comprising" or "having" are intended to specify the existence of the described features, numbers, steps, actions, components, parts, or combinations thereof, and should be understood as not precluding the existence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof.

[0032] Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as generally understood by those skilled in the art. Terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant technology, and should not be interpreted in an ideal or overly formal sense unless explicitly defined in this specification.

[0033] Hereinafter, embodiments will be described in detail with reference to the attached drawings. In the description with reference to the attached drawings, identical components are given the same reference numeral regardless of the drawing number, and redundant descriptions thereof will be omitted.

[0035] FIG. 1 is a diagram illustrating an overview of a volume estimation system according to one embodiment.

[0036] Referring to FIG. 1, a volume estimation system (100) may include a scanner device (110) and a volume estimation device (120). The scanner device (110) may be a device that obtains scan data by photographing an object whose volume is to be estimated. The volume estimation device (120) may be a device that estimates the volume of an object based on the scan data obtained by the scanner device (110). The scanner device (110) may obtain scan data containing 3D points regarding the shape of an object by photographing the object from multiple angles using a camera. The volume estimation device (120) may adjust the relative position (or direction) between the camera and the object so that the scanner device (110) can photograph the object from multiple angles. The volume estimation device (120) may estimate the volume of an object by aligning the scan data obtained from multiple angles by the scanner device (110) and performing various post-processing on the aligned scan data.

[0037] Conventional 3D scanning technology has focused primarily on high-resolution shape reconstruction and consists of expensive, precision equipment, making it difficult for general users or small-scale research environments to utilize. Among conventional 3D scanning technologies, the turntable method, which rotates objects based on single-axis rotation, has the advantage of a simple structure; however, it has limitations in that the camera's viewpoint is fixed, preventing the complete scanning of the object's upper surface or complex shapes. Blind spots caused by the fixed camera viewpoint can lead to a degradation in the quality of collected 3D scan data and a decrease in the accuracy of estimated volume data. In the field of object volume measurement using 3D scanning, where precision is required, the degradation of scan data quality and the reduction in measurement accuracy can act as a practical limitation that lowers the usability of the device.

[0038] In the present disclosure, the volume estimation system (100) may provide a two-degree-of-freedom scanner device (110) that secures additional degrees of freedom by configuring both the object and the camera to be rotatable, unlike conventional methods. The scanner device (110) can acquire the shape of the top surface as well as the side of the object more precisely and completely, and by efficiently collecting scan data in all directions, it can effectively resolve the blind spot problem that occurred in single-degree-of-freedom scanner devices. The volume estimation system (100) can provide a practical and economical volume estimation technology by combining an inexpensive RGB-D (red-green-blue and depth camera) camera with an improved data processing algorithm, thereby increasing the accessibility of 3D scanning technology to general users and significantly enhancing its potential for use in various research and industrial fields. Below, the volume estimation system (100) including the scanner device (110) estimates the volume and / or density of an object in more detail.

[0040] FIGS. 2a and 2b are drawings for illustrating a scanner device and a volume estimation device according to one embodiment.

[0041] Referring to FIG. 2a, a scanner device (110) and a volume estimation device (120) according to one embodiment may constitute the volume estimation system (100) of FIG. 1. The scanner device (110) may include a camera (220) that captures an object (210) and acquires scan data including 3D points regarding the shape of the object (210), a first position adjustment module (230) for adjusting the position of the camera (220), a turntable (240) on which the object (210) is placed, and a second position adjustment module (250) for rotating the turntable (240). The scanner device (110) may further include a first support (260) forming a connection structure between a first position adjustment module (230) and a camera (220), a second support (262) forming a connection structure between the first support (260) and the first position adjustment module (230), a third support (264) fixing the first position adjustment module (230) to a floor surface, and a fourth support (266) forming a connection structure between the third support (264) and the second position adjustment module (250). The first support (260) to the fourth support (266) may be configured so that the first position adjustment module (230) and the second position adjustment module (250) can smoothly determine the relative position between the camera (220) and the object (210). Since the first support (260) to the fourth support (2660) are configured to smoothly control the movement of the first position adjustment module (230) and the second position adjustment module (250), the structure and / or shape of the support are not limited thereto.

[0042] The object (210) may be positioned on a turntable (240), and although it is depicted as a cylindrical object (210) in FIG. 2a, the shape of the object (210) is not limited thereto. The camera (220) may acquire scan data containing 3D points regarding the shape of the object (210) from multiple angles. The scan data may be represented as 3D points having three-dimensional positional coordinate values ​​for the object (210). For example, the scan data may be represented as mesh data including a set of 3D points and a triangular face or a square face created by connecting the 3D points. The camera (220) may include an RGB-D camera (220) that collects color information and depth information for the object (210) being photographed, but is not limited thereto. The RGB-D camera (220) may acquire color information for each pixel in the image and, at the same time, acquire distance (or depth) information from the camera (220) to each pixel using an infrared sensor. The acquired distance information can be combined with the color information of the corresponding pixel, and the three-dimensional position coordinates of each pixel can be converted into 3D points in real space through a coordinate transformation process using the intrinsic parameters of the camera (220). The 3D points can be combined to form a 3D point cloud, which can be used to precisely represent the shape and structure of the object (210) in a virtual space.

[0043] The first position adjustment module (230) may include a servo motor for rotating the camera (220). The first position adjustment module (230) may rotate the camera (220) 180 degrees to the left and right relative to the object (210). The turntable (240) may rotate the object (210) placed on the turntable (240), for example, 360 degrees. As the turntable (240) rotates, scan data capturing the object (210) at different points in time can be obtained from the camera (220). In one embodiment, the turntable (240) may include a mass sensor for measuring the mass of the object (210). The measured mass of the object (210) can be used to estimate the density of the object (210) together with the estimated volume of the object (210). The second position adjustment module (250) may include a step motor that rotates the turntable (240). The second position adjustment module (250) can rotate the turntable (240) on which the object (210) is placed 360 degrees.

[0044] The volume estimation device (120) is a device capable of providing volume data of an object (210) and can generate volume data of the object (210) based on scan data acquired through a camera (220). The volume estimation device (120) may include a computer device and / or other electronic devices including a processor that processes data. The processor may control components (e.g., hardware or software components) of the scanner device (110) and the volume estimation device (120) and may perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor may store instructions or data received from the components in memory within the volume estimation device (120), process the instructions or data stored in memory, and store result data in memory. The processor may include a main processor (e.g., a central processing unit or an application processor) or an auxiliary processor (e.g., a graphics processing unit, a neural network processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with it.

[0045] The processor can independently control the first position adjustment module (230) and the second position adjustment module (250) so that the scanner device (110) can perform 3D scanning by changing the relative position between the object (210) and the camera (220) in multiple directions. The processor can control the first position adjustment module (230) so that the camera (220) has a defined scanning position, and control the second position adjustment module (250) so that the turntable (240) on which the object (210) is placed rotates. The processor can estimate the volume of the object (210) based on scan data taken of the object (210) at different points in time.

[0046] The processor can register scan data for an object (210) acquired at each scanning position of the camera (220) and estimate the volume of the object (210) based on the registered scan data. The volume estimation device (120) may use an iterative closest point (ICP) algorithm to register scan data acquired from multiple angles. The ICP algorithm may perform a process of searching for an optimal rotation matrix and translation vector that minimizes the error function between different point clouds. For example, if there are different 3D point clouds P and Q, the ICP algorithm may use a rotation matrix that fixes one point cloud Q and moves the other point cloud P to overlap the two point clouds. and movement vectors By searching, different point clouds P and Q can be matched. In the ICP algorithm, the error function can be expressed as Equation 1 below.

[0048]

[0050] In mathematical formula 1 Silver point count, is the i-th point of point cloud P, is the i-th point of point cloud Q, is a rotation matrix that rotates the point cloud P, represents the translation vector that translates the point cloud P. The error function is and Rotation matrix that minimizes the sum of squares of the distances between and movement vectors This represents the process of searching for rotation matrices and translation vectors. The ICP algorithm can utilize singular value decomposition (SVD) to search for rotation matrices and translation vectors, and the processes of Equations 2 to 5 below can be performed to search for rotation matrices and translation vectors using singular value decomposition.

[0052]

[0054] The center between point clouds P and Q can be calculated through Equation 2. In Equation 2 is the center of point cloud P, represents the center of the point cloud Q.

[0056]

[0058] A centered point cloud can be expressed as in Equation 3. To simplify the alignment calculation, the center of the point cloud may be shifted. In Equation 3 , represents the i-th point of point clouds P and Q, respectively, shifted relative to the center.

[0060]

[0062] Through Equation 4, the covariance matrix between point clouds P and Q can be defined.

[0064]

[0066] The covariance matrix through mathematical equation 5 Singular value decomposition is performed on is obtained, and through this, the optimal rotation matrix is ​​obtained. and movement vectors ...can be obtained. The processor can successfully perform alignment of scan data for objects (210) obtained at each scanning location by repeating the process of reducing errors between point clouds through the above mathematical formulas 1 to 5.

[0067] The processor performs post-processing on the aligned scan data, including removing 3D points corresponding to the floor surface where the object (210) is located and removing noise, and can estimate the volume of the object (210) based on the post-processed scan data. The processor can extract 3D points corresponding to the floor surface where the object (210) is located from the aligned scan data. The processor can remove 3D points corresponding to the floor surface, which is not the object (210) whose volume is to be estimated, during the volume estimation process by using the RANSAC (random sample consensus) algorithm, which is one of the algorithms for detecting planes. The RANSAC algorithm is an algorithm that reliably estimates a model in data with a lot of noise or outliers, and considers the floor surface as a plane and can detect points corresponding to the plane in the aligned scan data. The process for detecting the floor surface can be performed through the following mathematical formulas 6 and 7.

[0069]

[0071] A plane in three-dimensional space can be defined through Equation 6. In Equation 6, x, y, and z represent the coordinates of a point in three-dimensional space, and a, b, c, and d represent constants that determine the position of the plane.

[0073]

[0075] An arbitrary point through mathematical formula 7 The distance perpendicularly from the plane can be calculated. The process of estimating the floor surface using the RANSAC algorithm may be a process of assuming an arbitrary plane and determining how well an arbitrary point fits the arbitrary plane, and considering the plane with the most fitting points as the floor surface. The processor can obtain a 3D point corresponding to an intact object (210) by removing the 3D point corresponding to the discovered floor surface from the matched scan data.

[0076] The processor can estimate the volume of the object (210) using mesh data from scan data in which 3D points corresponding to the object (210) are acquired. The mesh data consists of a plurality of triangles, and each triangle can be defined by three vertices. The processor can estimate the volume of the object (210) by summing all the volumes of the tetrahedrons between the triangles and the origin or reference point. The process of estimating the volume of the object (210) can be expressed as shown in Equation 8 below.

[0078]

[0080] In mathematical formula 8 The total number of tetrahedrons, , , represents the three vertex vectors of the i-th triangle. The processor can estimate the volume of the object (210) by summing all the volumes of the tetrahedron through Equation 8.

[0081] In one embodiment, the processor may perform 3D modeling of the object (210) based on post-processed scan data. The processor may convert the post-processed scan data into a 3D model in the format of STL (standard tessellation language) or STEP (standard for the exchange of product model data) and store it or transmit it to an external system. The conversion of the object (210) into a 3D model may mean that it is easy to link to subsequent 3D printing or CAD work regarding the object (210).

[0082] In one embodiment, the processor can estimate the density of the object (210) based on the mass of the measured object (210) and the estimated volume of the object (210). The processor can calculate the density of the object (210) by dividing the mass of the object (210) measured from the mass sensor by the estimated volume of the object (210). The volume estimation system can simultaneously estimate the volume and density of the object (210) without performing any separate process for estimating the density of the object (210).

[0083] Referring to FIG. 2b, the volume estimation device (120) can control the first position adjustment module (230) and the second position adjustment module (250) of the scanner device (110) to cause the camera (220) to photograph an object (210) at different scanning positions in stages. The first position adjustment module (230) can rotate the camera (220) 180 degrees relative to the object (210), and the second position adjustment module (250) can rotate the object (210) placed on the turntable (240) 360 degrees. The first position adjustment module (230) and the second position adjustment module (250) can change the relative position between the camera (220) and the object (210) at each scanning stage under the control of the processor.

[0084] In one embodiment, the scanning step may include a first scanning step, a second scanning step, and a third scanning step. In the first scanning step, the camera (220) can acquire scan data including 3D points of the shape of the top surface of the object (210) by scanning the object (210) at a first scanning position corresponding to the top of the object (210). The processor can control the first position adjustment module (230) so that the camera (220) scans the top surface of the object (210) first, thereby positioning the camera (220) at the top of the object (210). In the second scanning step, the camera (220) can acquire scan data including 3D points of the shape of the side surface of the object (210) by moving to a second scanning position under the control of the first position adjustment module (230) and scanning the object (210) at the second scanning position. For example, the second scanning position may include a positional relationship between the camera (220) and the object (210) at a position where the camera (220) is tilted 45 degrees relative to the existing angle. In the third scanning step, the camera (220) may move to the third scanning position under the control of the second position adjustment module (250) and obtain scan data including 3D points of the shape of the side of the object (210) by scanning the object (210) at the third scanning position. The third scanning position may represent a positional relationship between the camera (220) and the object (210) that is different from the second scanning position, by rotating the object (210) under the control of the second position adjustment module (250). For example, the third scanning position may include the positional relationship between objects (210) created by the turntable (240) rotating by 10 degrees by the second position adjustment module (250) while the first position adjustment module (230) is fixed so that the position of the camera (220) does not change. In the third scanning step, the processor can determine whether the collection of scan data is completed at each time step while the turntable (240) rotates.For example, after confirming that the turntable (240) has been rotated 10 degrees and that scan data has been acquired from the camera (220), the processor may rotate the turntable (240) again 10 degrees. Afterward, the processor may align scan data including 3D points of the shape of the top surface of the object (210) acquired in the first scanning step, scan data including 3D points of the shape of the side surface of the object (210) acquired in the second scanning step, and scan data including 3D points of the shape of the side surface of the object (210) acquired in the third scanning step, and may estimate the volume of the object (210) based on the aligned scan data.

[0086] FIG. 3 is a diagram illustrating the process performed by a volume estimation system according to one embodiment to remove a 3D point corresponding to a bottom surface.

[0087] Referring to FIG. 3, a volume estimation system (e.g., volume estimation system (100) of FIG. 1) can capture an object (310) from multiple angles using a camera (e.g., camera (220) of FIG. 2a) and acquire scan data including 3D points regarding the shape of the object (310). The scan data acquired from multiple angles can be converted into aligned scan data (320) through a process of aligning the 3D points. However, the aligned scan data (320) may include 3D points corresponding to the bottom surface that may affect the estimation of the volume of the object (310). The volume estimation system may remove 3D points corresponding to the bottom surface during the process of acquiring 3D points corresponding to the object (310). This may be an action to remove elements that may affect the estimation of the volume of the object (310) and to accurately estimate the volume of the object (310). Accordingly, the volume estimation system can obtain scan data (330) from which the bottom surface has been removed, and can obtain object scan data (340) from which 3D points corresponding to the bottom surface have been removed from the alignment scan data (320). The volume estimation system can use the object scan data (340) to estimate the volume of the object (310) or to generate a 3D model of the object (310).

[0089] FIG. 4 is a diagram illustrating a user interface provided by a volume estimation device according to one embodiment.

[0090] Referring to FIG. 4, a volume estimation device (e.g., volume estimation device (120) of FIG. 1) included in a volume estimation system (e.g., volume estimation system (100) of FIG. 1) may provide a user interface for user settings. The user interface may provide one or more graphic user interfaces (GUI) (410) that can be selected through user selection and a user interface (420) regarding real-time captured images of a camera. Through the graphic user interface (410) displayed on the volume estimation device, the user can control various settings such as the rotation angles of the first position adjustment module and the second position adjustment module, the scan interval, and parameters of the alignment algorithm. The user can pre-set various settings for the overall operation of the volume estimation system, and the volume estimation system can minimize user intervention during the volume estimation process by pre-setting the overall operation.

[0092] FIG. 5 is a flowchart illustrating the operations of a volume estimation method according to one embodiment. In one embodiment, at least one of the operations of FIG. 5 may be performed simultaneously or in parallel with other operations, and the order of the operations may be changed. Additionally, at least one of the operations may be omitted, and other operations may be performed additionally. The operations of the volume estimation method may be performed by a volume estimation system of the present disclosure (e.g., the volume estimation system (100) of FIG. 1).

[0093] In operation (510), the volume estimation system may control a first position adjustment module for adjusting the position of the camera so that the camera has a defined scanning position. The first position adjustment module may include a servo motor for rotating the camera, and the volume estimation system may control the rotation angle of the servo motor so that the camera has a defined scanning position (or scanning direction).

[0094] In operation (520), the volume estimation system can control a second position adjustment module that rotates a turntable on which an object is placed. The second position adjustment module may include a stepper motor that rotates the turntable, and the volume estimation system can control the rotation angle of the stepper motor so that the object can be positioned at a scanning position defined with respect to the camera. The volume estimation system can vary the relative position between the object and the camera by controlling the servo motor and the stepper motor independently.

[0095] In operation (530), the volume estimation system can acquire scan data including 3D points regarding the shape of the object at different points in time using a camera that captures the object. Each scan data corresponding to the relative position between the object and the camera, which is formed in various ways by controlling the first position adjustment module and the second position adjustment module, can be acquired.

[0096] In one embodiment, the volume estimation system can acquire scan data including 3D points of the shape of the top surface of an object by scanning the object at a first scanning position corresponding to the top of the object in a first scanning step. In a second scanning step, the volume estimation system can acquire scan data including 3D points of the shape of the side surface of an object by moving to a second scanning position under the control of a first position adjustment module and scanning the object at the second scanning position. In a third scanning step, the volume estimation system can acquire scan data including 3D points of the shape of the side surface of an object by moving to a third scanning position under the control of a second position adjustment module and scanning the object at the third scanning position. The third scanning position may represent a positional relationship between the camera and the object that is different from the second scanning position by rotating the object under the control of the second position adjustment module.

[0097] In operation (540), the volume estimation system can estimate the volume of an object based on scan data in which the object is captured at different points in time. The volume estimation system can perform alignment of scan data for an object acquired at each scanning position of the camera and estimate the volume of the object based on the aligned scan data. The volume estimation system can use an ICP algorithm to align scan data acquired from multiple angles. The volume estimation system can perform post-processing on the aligned scan data, including removing 3D points corresponding to the floor surface where the object is located and removing noise, and estimate the volume of the object based on the post-processed scan data. The volume estimation system can extract 3D points corresponding to the floor surface where the object is located from the aligned scan data. The volume estimation system can remove 3D points corresponding to the floor surface that is not the object whose volume is to be estimated by using the RANSAC algorithm, which is one of the plane detection algorithms. 3D point removal may be a process to remove factors that may affect the volume estimation of the object and to estimate the accurate volume of the object. The volume estimation system can estimate the volume of an object by summing up the volumes of the tetrahedrons within the mesh data composed of multiple triangular faces based on scan data in which 3D points corresponding to the object are acquired.

[0099] FIG. 6 is a flowchart illustrating additional operations of a volume estimation method according to one embodiment. In one embodiment, at least one of the operations of FIG. 6 may be performed simultaneously or in parallel with other operations, and the order of the operations may be changed. For example, operation (610) may be performed preferentially or in parallel with operation (540). Additionally, at least one of the operations may be omitted, and other operations may be performed additionally. Additional operations of the volume estimation method may be performed by the volume estimation system of the present disclosure (e.g., the volume estimation system (100) of FIG. 1).

[0100] In operation (610), the volume estimation system can perform 3D modeling of an object based on post-processed scan data. The volume estimation system can convert the post-processed scan data into a 3D model in STL or STEP format and store it or transmit it to an external system. The volume estimation system can convert the post-processed scan data into a 3D model and subsequently perform 3D printing or CAD work on the object.

[0101] In operation (620), the volume estimation system can measure the mass of an object using a mass sensor. In operation (630), the volume estimation system can estimate the density of an object based on the measured mass of the object and the estimated volume of the object. The volume estimation system can estimate the density of an object based on the measured mass of the object and the estimated volume of the object. The volume estimation system can calculate the density of an object by dividing the mass of the object measured by the mass sensor by the estimated volume of the object. The volume estimation system can simultaneously estimate the volume and density of an object without performing any separate process for estimating the density of an object.

[0103] The embodiments described above may be implemented as hardware components, software components, and / or combinations of hardware and software components. For example, the devices, methods, and components described in the embodiments may be implemented using a general-purpose computer or a special-purpose computer, such as, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. The processing unit may execute an operating system (OS) and software applications executed on said operating system. Additionally, the processing unit may access, store, manipulate, process, and generate data in response to the execution of the software. For ease of understanding, the processing unit may be described as being used as a single unit, but those skilled in the art will understand that the processing unit may include multiple processing elements and / or multiple types of processing elements. For example, the processing unit may include multiple processors or one processor and one controller. In addition, other processing configurations, such as parallel processors, are also possible.

[0104] Software may include computer programs, code, instructions, or a combination of one or more of these, and may configure a processing unit to operate as desired or instruct the processing unit independently or collectively. Software and / or data may be stored on any type of machine, component, physical device, virtual equipment, computer storage medium, or device so as to be interpreted by the processing unit or to provide instructions or data to the processing unit. Software may be distributed over networked computer systems and stored or executed in a distributed manner. Software and data may be stored on computer-readable recording media.

[0105] The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer-readable medium. The computer-readable medium may store program instructions, data files, data structures, etc., either individually or in combination, and the program instructions recorded on the medium may be those specifically designed and configured for the embodiment or those known and available to those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes; optical recording media such as CD-ROMs and DVDs; magneto-optical media such as floptical disks; and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, and flash memory. Examples of program instructions include machine code, such as that generated by a compiler, as well as high-level language code that can be executed by a computer using an interpreter, etc.

[0106] Although the embodiments have been described above with reference to the limited drawings, those skilled in the art can apply various technical modifications and variations based thereon. For example, suitable results may be achieved even if the described techniques are performed in a different order than described, and / or if the components of the described system, structure, device, circuit, etc. are combined or assembled in a form different from described, or replaced or substituted by other components or equivalents.

[0107] Therefore, other implementations, other embodiments, and equivalents to the claims also fall within the scope of the claims set forth below.

Claims

Claim 1 A volume estimation system for estimating the volume of an object comprises: a scanner device for photographing the object and acquiring scan data; and a volume estimation device for estimating the volume of the object based on the scan data, wherein the scanner device comprises: a camera for photographing the object and acquiring the scan data including 3D points regarding the shape of the object; a first position adjustment module for adjusting the position of the camera; a turntable on which the object is placed; and a second position adjustment module for rotating the turntable, wherein the volume estimation device comprises a processor for controlling the first position adjustment module so that the camera has a defined scanning position and for controlling the second position adjustment module so that the turntable on which the object is placed rotates, wherein scan data of the object photographed from the camera at different points in time is acquired by the rotation of the turntable, and the processor estimates the volume of the object based on the scan data of the object photographed at different points in time. Claim 2 A volume estimation system according to claim 1, wherein the camera acquires scan data including 3D points of the shape of the top surface of the object by scanning the object at a first scanning position corresponding to the top of the object in a first scanning step, and acquires scan data including 3D points of the shape of the side surface of the object by moving to a second scanning position under the control of the first position adjustment module and scanning the object at the second scanning position in a second scanning step. Claim 3 A volume estimation system according to paragraph 2, wherein the camera acquires scan data including 3D points of the shape of the side of the object by moving to a third scanning position under the control of the second position adjustment module in a third scanning step and scanning the object at the third scanning position, and the third scanning position represents a positional relationship between the camera and the object that is different from the second scanning position by rotating the object under the control of the second position adjustment module. Claim 4 A volume estimation system according to paragraph 2, wherein the processor performs registration of scan data for the object acquired at each scanning position of the camera and estimates the volume of the object based on the registered scan data. Claim 5 A volume estimation system according to claim 4, wherein the processor performs post-processing including 3D point removal and noise removal corresponding to the floor surface where the object is located on the matched scan data, and estimates the volume of the object based on the post-processed scan data. Claim 6 In paragraph 5, the processor is a volume estimation system that performs 3D modeling of the object based on the post-processed scan data. Claim 7 A volume estimation system according to claim 1, wherein the turntable includes a mass sensor for measuring the mass of the object, and the processor estimates the density of the object based on the measured mass of the object and the estimated volume of the object. Claim 8 A volume estimation system according to claim 1, wherein the camera comprises an RGB-D camera (red-green-blue and depth camera) that collects color information and depth information for the object being photographed. Claim 9 A scanner device for capturing an object and acquiring scan data, comprising: a camera for capturing the object and acquiring the scan data including 3D points regarding the shape of the object; a first position adjustment module for adjusting the position of the camera; a turntable on which the object is placed; and a second position adjustment module for rotating the turntable, wherein scan data capturing the object at different viewpoints from the camera is acquired by controlling the first position adjustment module and the second position adjustment module. Claim 10 A scanner device according to claim 9, wherein the camera acquires scan data including 3D points of the shape of the top surface of the object by scanning the object at a first scanning position corresponding to the top of the object in a first scanning step, and acquires scan data including 3D points of the shape of the side surface of the object by moving to a second scanning position by the control of the first position adjustment module and scanning the object at the second scanning position in a second scanning step. Claim 11 A scanner device according to claim 10, wherein the camera acquires scan data including 3D points of the shape of the side of the object by moving to a third scanning position under the control of the second position adjustment module in a third scanning step and scanning the object at the third scanning position, and the third scanning position represents a positional relationship between the camera and the object that is different from the second scanning position by rotating the object under the control of the second position adjustment module. Claim 12 A volume estimation method for estimating the volume of an object, comprising: controlling a first position adjustment module for adjusting the position of a camera so that the camera has a defined scanning position; controlling a second position adjustment module for rotating a turntable on which the object is placed; acquiring scan data including 3D points regarding the shape of the object at different points in time using the camera that photographs the object; and estimating the volume of the object based on the scan data photographed of the object at different points in time. Claim 13 A volume estimation method according to claim 12, wherein the operation of acquiring the scan data comprises: an operation of acquiring scan data including 3D points of the shape of the top surface of the object by scanning the object at a first scanning position corresponding to the top of the object in a first scanning step; and an operation of acquiring scan data including 3D points of the shape of the side surface of the object by moving to a second scanning position by control of the first position adjustment module and scanning the object at the second scanning position in a second scanning step. Claim 14 A volume estimation method according to claim 13, wherein the operation of acquiring the scan data includes, in a third scanning step, moving to a third scanning position by the control of the second position adjustment module and scanning the object at the third scanning position to acquire scan data including 3D points of the shape of the side of the object, and wherein the third scanning position is such that the object is rotated by the control of the second position adjustment module to represent a positional relationship between the camera and the object that is different from the second scanning position. Claim 15 A volume estimation method according to claim 13, wherein the operation of estimating the volume of the object comprises performing alignment of scan data for the object obtained at each scanning position of the camera and estimating the volume of the object based on the aligned scan data. Claim 16 A volume estimation method according to claim 15, wherein the operation of estimating the volume of the object comprises performing post-processing including 3D point removal and noise removal corresponding to the floor surface where the object is located on the matched scan data, and estimating the volume of the object based on the post-processed scan data. Claim 17 A volume estimation method according to claim 16, further comprising the operation of performing 3D modeling of the object based on the post-processed scan data. Claim 18 In claim 12, the above-mentioned turntable comprises a mass sensor for measuring the mass of the object, a method for estimating volume. Claim 19 A volume estimation method according to claim 18, further comprising: an operation of measuring the mass of the object using the mass sensor; and an operation of estimating the density of the object based on the measured mass of the object and the estimated volume of the object. Claim 20 A volume estimation method according to claim 12, wherein the camera comprises an RGB-D camera that collects color information and depth information for the object being photographed.