Three-dimensional object generating system

Abstract

To provide a three-dimensional object generating system that applies tactile sensations different according to each part to a three-dimensional object and provides visual impression such as color or transparency on a surface of an actual object to a surface of the three-dimensional object.SOLUTION: A three-dimensional object generating system comprises: a three-dimensional scanner that scans an object and acquires three-dimensional data; a computer device that specifies one or two or more regions from the three-dimensional data; a tactile sensation measurement device that acquires tactile sensations of the object corresponding to the one or two or more regions; a three-dimensional printer that generates a three-dimensional object based on the three-dimensional data and applies tactile sensations of the one or two or more regions to the three-dimensional object; a surface data scanner that scans surface data of the object and acquires the surface data; and a two-dimensional printer that produces a two-dimensional object based on the surface data. The computer device associates the three-dimensional data with the surface data.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to a three-dimensional object generation system, a method thereof, and a computer program. [Background technology]

[0002] With the rise of three-dimensional printers, it has become relatively easy to generate three-dimensional objects. It is also common to generate three-dimensional objects based on real objects. Under these circumstances, attempts have been made to apply tactile sensations based on real objects to three-dimensional objects.

[0003] Patent document 1 discloses a technology that reduces the time required to generate three-dimensional objects with complex structures by using two or more different light beams on a polymer precursor, which is the material used to generate the three-dimensional objects (paragraphs

[0011] ,

[0017] ,

[0019] ).

[0004] The conventional technology disclosed in Patent Document 1 was aimed at efficiently generating three-dimensional objects with complex structures, but was not aimed at generating three-dimensional objects having different tactile sensations for each part. In the conventional technology disclosed in Patent Document 1, it was possible to apply the tactile sensation of a part of an actual object to the entire three-dimensional object, but it was difficult to apply different tactile sensations for each part of an actual object to each part of a three-dimensional object.

[0005] The prior art disclosed in Patent Document 2 is a method for forming a gel, which includes a step of irradiating light to a plurality of regions of a gel solution to form a polymer, and the plurality of regions includes a first region to which light is irradiated with a first total energy and a second region to which light is irradiated with a second total energy lower than the first total energy. Furthermore, by irradiating the first region with light and then irradiating the second region with light, it becomes possible to apply different tactile sensations to different portions of an actual object (paragraph

[0006] ,

[0007] ). However, achieving a visual representation on the surface of an object has been difficult. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] Special Publication No. 2022-550054 [Patent Document 2] Patent application No. 2022-033365 Summary of the Invention [Problem to be solved by the invention]

[0007] Even if it were possible to apply different tactile sensations to different parts of a three-dimensional object, it was difficult to provide the surface of the three-dimensional object with the visual expression, such as color or transparency, of the surface of an actual object. [Brief description of the drawings]

[0008] [Figure 1] 1 illustrates a three-dimensional object generation system according to an embodiment of the present invention. [Diagram 2] 1 illustrates a computer device according to an embodiment of the present invention. [Diagram 3] 1 shows a process flow for generating a three-dimensional face object according to a first embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] [System Configuration] FIG. 1 shows a three-dimensional object generation system 100 according to an embodiment of the present invention. The three-dimensional object generation system 100 includes a three-dimensional scanner 110, a tactile feel measuring device 115, a surface data scanner 120, a computer device 125, a three-dimensional printer 130, a printer 135, a synthesis device 140, and a compressor 145. As shown in FIG. 1, the three-dimensional scanner 110, the tactile feel measuring device 115, the surface data scanner 120, the three-dimensional printer 130, the printer 135, and the synthesis device 140 are connected to each other via the computer device 125. These devices can communicate with each other. The connection between the computer device 125 and other devices is realized by one or both of a wired connection and a wireless connection. The compressor may be connected by a wire or wirelessly so as to be able to communicate with other devices.

[0010] The three-dimensional scanner 110 can acquire three-dimensional data of an object, i.e., acquire depth data (data in the depth direction) in addition to two-dimensional data (data in the vertical and horizontal directions). For example, the three-dimensional scanner 110 can acquire front surface data of an object, and at least one of right side data, left side data, top side data, and bottom side data of the object. Furthermore, the three-dimensional scanner 110 may be capable of acquiring rear surface data of an object. The three-dimensional scanner 110 may or may not be a device dedicated to scanning. For example, the three-dimensional scanner 110 can be a mobile terminal device such as a smartphone or a digital camera on which application software capable of acquiring three-dimensional data is installed.

[0011] The tactile measurement device 115 acquires tactile data near the surface of an object or inside the surface. Tactile sensations include softness, hardness, stickiness, and the like. In the following, unless otherwise specified, hardness will be described as an example of tactile sensation. When hardness is measured, the tactile measurement device 115 may include a hardness measurement device. The tactile measurement device 115 may acquire, for example, Young's modulus, storage modulus, loss modulus, and the like of the surface or near the surface of an object. One or both of the computer device 125 and the tactile measurement device 115 may associate and store the range of the object with the tactile data corresponding to the range. One or both of the computer device 125 and the tactile measurement device 115 may cooperate with the surface data scanner 120 or the three-dimensional scanner 110 to associate and store the range identified by the surface data scanner 120 or the three-dimensional scanner 110 with the tactile data corresponding to the range. In other embodiments, areas of an object (eg, nose, mouth, etc.) may be manually specified by a user to be associated with tactile data.

[0012] The surface data scanner 120 acquires surface data of the object. The surface data scanner 120 may be a camera capable of acquiring still and / or video images. The surface data scanner 120 may acquire two-dimensional data and color of the surface of the object. If the three-dimensional scanner 110 is capable of acquiring color and other information of the surface of the object, the three-dimensional scanner 110 may be used as the surface data scanner 120. The surface data scanner 120 may acquire texture data such as transparency, gloss, wetness, temperature, and touch of the object surface.

[0013] The three-dimensional printer 130 can print out a three-dimensional object based on three-dimensional data. The three-dimensional printer 130 generates a three-dimensional object by a method such as a stereolithography method, a powder method, a fused deposition modeling method, a sheet lamination method, an inkjet method, or the like. The three-dimensional printer 130 may be realized by any method as long as it can generate an object in three dimensions and can express the tactile sensation near the surface or inside the surface of the object. For example, if the three-dimensional printer 130 can generate a three-dimensional gel object, the printed object can express the hardness of the actual object due to the characteristics of the gel.

[0014] In another embodiment, the three-dimensional printer 130 can generate a three-dimensional object by applying the material of the three-dimensional object to the base object. The base object can be harder than the three-dimensional object, such as plastic, metal, or wood, or it can be softer than the three-dimensional object, such as an elastic body. For example, a three-dimensional gel object is generated by adding gel to the base object. This allows the tactile feel of the resulting three-dimensional gel object to be changed according to the tactile feel of the base object. For example, if the base object is hard, a three-dimensional gel object including the base object feels harder than a three-dimensional gel object generated only with gel. This generates a three-dimensional gel object with a harder interior. In this embodiment, when generating an animal's hand with a three-dimensional gel object, the bones of the hand are generated with the base object, and the flesh, muscles, etc. of the hand are generated with the gel object. In another embodiment, the base object does not have to have the shape of the actual bones of the hand. For example, the base object can have an approximate shape of the bones of the hand, or the shape of only the bones of characteristic parts such as the fingertips. The purpose of using the base object is not to reproduce the shape of the base object itself, but to reproduce the tactile sensation in the gel object, so the base object may have any shape as long as the tactile sensation is reproduced. In another embodiment, the three-dimensional printer 130 may generate a three-dimensional object having a hollow portion in a part thereof. After the three-dimensional object is generated, the base object may be incorporated into the hollow portion of the three-dimensional object. For example, the base object is inserted into the hollow portion of the three-dimensional object.

[0015] The printer 135 can print out at least two-dimensional data. The printer 135 preferably performs color printing. The two-dimensional object generated by the printer 135 covers a part or all of the three-dimensional object generated by the three-dimensional printer, so that the two-dimensional object is added to at least one surface of the three-dimensional object. For example, if the two-dimensional object contains color information, adding the two-dimensional object to the three-dimensional object results in a three-dimensional object with the same color as the actual object.

[0016] The printer 135 may be, for example, an Ultra Violet (UV) printer, which can reduce printing time and allows printing on film, synthetic media, and the like.

[0017] The target to be printed, which is a two-dimensional object, can be a bag-shaped material including at least a first side and a second side. In this case, the printer 135 can print on one or both of the first side and the second side of the bag-shaped material. By placing a three-dimensional object in the printed bag and closing the opening of the bag, the bag can cover the entire three-dimensional object. When both are printed, the front and back surfaces of the three-dimensional object corresponding to the first and second sides are expressed in detail by printing. When the three-dimensional object contains a substance harmful to the human body, the bag can prevent the user from coming into contact with the harmful substance. For example, when the three-dimensional object is a gel object and the material is dimethylacrylamide (DMAAm) gel, the gel in the middle of hardening can provide softness to the gel object, but it is known to be harmful to the human body. By confining the gel in the bag, the user is prevented from coming into contact with the harmful substance, and therefore a three-dimensional gel object that is safe for the human body can be provided. Also, since the bag confines the gel, the gel in the middle of hardening, i.e., a relatively soft gel, can be provided as the final product. In another example, when the three-dimensional object is a gel object or an object made of other materials that are weak against air, water, etc., it is known that when the three-dimensional object is exposed to air for a long time, or when it is exposed to moisture or contains moisture, the three-dimensional object can undergo deformation due to drying, swelling, etc., or deterioration or collapse due to hydrolysis, oxidation, etc. The bag prevents the three-dimensional object from coming into contact with air and moisture, and therefore can prevent the deformation, deterioration, and collapse of the three-dimensional object.

[0018] The synthesis device 140 can synthesize a two-dimensional object into a three-dimensional object by enclosing the three-dimensional object in a bag-shaped two-dimensional object, etc. The synthesis device 140 realizes synthesis by a means for placing the two-dimensional object on the three-dimensional object, a means for pasting the two-dimensional object onto the three-dimensional object, a means for covering the three-dimensional object with the two-dimensional object, etc.

[0019] The compressor 145 can remove some or all of the air trapped in the bladder surrounding the three-dimensional object, which can bring the two-dimensional object and the three-dimensional object into closer contact and improve the tactile feel of the three-dimensional object to which the two-dimensional object is attached.

[0020] As shown in FIG. 2, the computer device 125 includes at least a processor 205, a memory 210, a storage 215, an input / output device 220, and a communication device 225. In the computer device 125, the processor 205 loads a computer program stored in the storage 215 into the memory 210 and executes the program. The input / output device 220 includes a keyboard, a mouse, a display device, and the like. A user can input information to the computer using the keyboard and check the information output on the display device. The computer device 125 can communicate with at least one of the three-dimensional scanner 110, the tactile measurement device 115, the surface data scanner 120, the three-dimensional printer 130, the printer 135, and the synthesis device 140 via the communication device 225, and can transmit and receive data thereto. The computer device 125 may be physically realized by one computer. The computer device 125 may be realized by multiple computers. In this case, the multiple computers operate by cooperating with each other.

[0021] [Example 1: Three-dimensional face object] In this embodiment, a human face is generated as a three-dimensional object. FIG. 3 shows a process flow of the first embodiment for generating a three-dimensional object of a face. The three-dimensional scanner 110 scans a human face, which is an actual object, and acquires three-dimensional data (step 302). The three-dimensional scanner 110 can transmit the three-dimensional data to the computer device 125. The computer device 125 can receive the three-dimensional data from the three-dimensional scanner 110. After acquiring the three-dimensional data, one or both of the three-dimensional scanner 110 and the computer device 125 may check whether the three-dimensional data includes at least one of the eyes, nose, and lips. In response to confirming that at least one of the eyes, nose, and lips is not included, one or both of the three-dimensional scanner 110 and the computer device 125 can determine that the three-dimensional data of the face has not been acquired. For example, one or both of the three-dimensional scanner 110 and the computer device 125 identifies a plane that is continuous in the depth direction of the three-dimensional data (direction from the front to the back of the face) as a cross section, and acquires the length of the cross section in the depth direction. One or both of the 3D scanner 110 and the computer device 125 can identify the part with the shortest depth length as the part of the eyes, the part with the longest depth length as the part of the nose, and the part with a depth length shorter than the depth length identified as the nose and longer than the other depth lengths as the part of the lips, thereby enabling more accurate 3D data to be obtained, which contributes to improving the accuracy of the final 3D object.

[0022] The touch measurement device 115 acquires the touch near the surface of the face or inside the surface as numerical data (step 304). The touch measurement device 115 can transmit one or both of the numerical data of the touch and information related to the touch (such as the area of ​​the face and other information related to the touch) to the computer device 125. The computer device 125 can receive one or both of the numerical data of the touch and information related to the touch from the touch measurement device 115. For example, a hardness measurement device that is part of the touch measurement device 115 acquires the hardness and softness of the face as numerical data. For example, Young's modulus may be used as the numerical data. In one embodiment, the average Young's modulus of an infant's cheek is about 80 kPa. One or both of the touch measurement device 115 and the computer device 125 associate the area of ​​the acquired touch on the face with the numerical data of the touch and store it. For example, one or both of the tactile gauge 115 and the computing device 125 may store an approximate Young's modulus of 80 kPa associated with the cheek, approximately 150 kPa associated with the forehead, and approximately 50 kPa associated with the nose.

[0023] The surface data scanner 120 scans a human face, which is a real object, and obtains surface data (or two-dimensional data) corresponding to the front of the face (step 306). The surface data scanner 120 can transmit the surface data to the computer device 125. The computer device 125 can receive the surface data from the surface data scanner 120. One or both of the surface data scanner 120 and the computer device 125 can analyze the surface data and identify the area of ​​the face. In response to determining that a part or all of the area of ​​the face has not been identified, one or both of the surface data scanner 120 and the computer device 125 can determine that the surface data has not been obtained. For example, the part with the largest surface area may be specified as the face, the center of the part specified as the face as the nose, the part above the range specified as the nose as the forehead, and when at least one of white, blue, red, and black is specified around the upper part of the range specified as the nose, the specified area may be specified as the eyes, and when red or a color different from the color of the range specified as the nose is specified around the lower part of the range specified as the nose, the specified area may be specified as the lips.As another example, the part with the largest surface area may be specified as the face, the center of the part specified as the face as the nose, the up / down, left / right, and depth directions of the face may be specified from the shape of the nose, and a part with a large difference in height and a spherical shape compared to the nose may be specified as the eyes, and further, a region with a unique edge or surface shape with an elliptical pleat or elliptical hole shape may be specified around the lower part of the range specified as the nose, and the specified area may be specified as the lips.

[0024] One or both of the surface data scanner 120 and the computer device 125 can store the face area identified from the surface data in association with the surface data. This allows one or both of the surface data scanner 120 and the computer device 125 to identify a certain face area in the surface data. For example, the nose, forehead, eyes, lips, etc. in the surface data may be set as feature points.

[0025] The computer device 125 identifies a face from the three-dimensional data acquired in step 302, and deletes the range other than the face (step 308). For example, the three-dimensional data is meshed in two dimensions, and the range in which the color of the meshed data is skin color (e.g., white, brown, yellow, etc.) is determined as a face. If the color of the meshed data is determined to be a color other than skin color (e.g., corresponding to the color of clothes or background), and the amount of mesh chunks corresponding to the determined color exceeds a predetermined threshold, the mesh range corresponding to this chunk is determined as other than a face. Furthermore, the computer device 125 may delete a part of the range identified as a face as unnecessary data. For example, if it is not desired to identify the ears or neck as a face, the data corresponding to the ears or neck is deleted as unnecessary data. For example, in the mesh identified as a face, the length in the depth direction from the front of the face to the rear front of the face is identified, and if the identified length is less than a predetermined threshold, the mesh whose length is less than the predetermined threshold is deleted as unnecessary data. For example, since the depth of the face is longer than the depth of the ears and neck, the area of ​​the ears and neck, which has a shorter depth, is identified as unnecessary data.

[0026] The removal of unnecessary data may result in the face represented by the three-dimensional data having corners, for example, the removed portion not having a smooth curve, in which case the computing device 125, in response to detecting the presence of corners, converts the data to remove the corners.

[0027] The computer device 125 may convert the three-dimensional data so that the three-dimensional printer 130 can generate a three-dimensional object from the three-dimensional data more efficiently. For example, the three-dimensional data is converted so that the overall length of the three-dimensional data in the depth direction from the front of the face to the rear of the face is increased or decreased. This reduces the volume of the entire three-dimensional object, and the three-dimensional printer 130 can generate the three-dimensional object more efficiently. For example, if the rear of the face is not necessary, the front of the face and a predetermined depth range may be left, and the other ranges may be deleted. Furthermore, the computer device 125 may convert the three-dimensional data so that the front of the face faces directly upward. For example, when generating a three-dimensional object of a face, a three-dimensional object of a surface approximately from the nose in front to the ears on the side, the nose is placed at the highest position in the three-dimensional object, so that the three-dimensional printer 130 can generate the object more efficiently. When a three-dimensional object is generated so that the volume decreases from the base part of the three-dimensional object to the apex part, the stacking and arrangement of materials of the three-dimensional object can be efficiently realized.

[0028] The computer device 125 determines whether the three-dimensional data corresponding to the face is within the size of a three-dimensional object that can be generated by the three-dimensional printer 130 (step 310). For example, if the size of a three-dimensional object that can be generated by the three-dimensional printer 130 is 110 mm x 110 mm, it is determined whether the three-dimensional data or a three-dimensional object generated therefrom is about 90% of that size (e.g., 95 mm x 100 mm) (step 310). If the three-dimensional data or a three-dimensional object generated therefrom does not fit within the size, the computer device 125 adjusts the three-dimensional data so that the three-dimensional data is reduced or enlarged, or the three-dimensional object generated therefrom is reduced or enlarged (step 312). Steps 310 and 312 may be repeated until the predetermined size is reached.

[0029] The computer device 125 identifies one or more predetermined areas of the face from the three-dimensional data (step 314). For example, the areas of the forehead and nose are identified. The computer device 125 extracts large depressions from the three-dimensional data, identifies the area corresponding to the largest depression (the part with the shortest depth length from the front of the face to the rear of the face) as the eyes, and identifies the area above the eyes as the forehead. The computer device 125 also identifies the area in the three-dimensional data with the longest depth length from the front of the face to the rear of the face as the nose.

[0030] The computer device 125 transmits the three-dimensional data and the numerical data of the touch acquired in step 304 to the three-dimensional printer 130, and the three-dimensional printer 130 generates a three-dimensional object based on the three-dimensional data and the numerical data of the touch (step 316). The three-dimensional object is generated by a method such as a stereolithography method, a powder method, a fused deposition modeling method, a sheet lamination method, or an inkjet method. In this embodiment, a three-dimensional gel object is generated using a gel material to reproduce the hardness and softness of a face part. For example, a container is filled with a gel material that hardens with ultraviolet light, and the container is exposed to ultraviolet light, whereby the gel material hardens and a three-dimensional gel object is generated. The softness of the three-dimensional gel object is adjusted and determined by the distribution of the gel material and water in the mixed solution containing the gel material and water, and the type of crosslinker and gel material. The hardness of the three-dimensional gel object is adjusted and determined by at least one of increasing the amount of light (e.g., ultraviolet light) applied to a predetermined area of ​​the mixed solution (in other words, increasing the density of the light application) and extending the time for which the light is applied. Furthermore, after the three-dimensional gel object is created, moisture can be added to the three-dimensional gel object to add softness.

[0031] In the case of an example using a gel material, in order to generate a three-dimensional gel object having the softest hardness among one or more hardnesses in the numerical data of the touch acquired in step 304, the three-dimensional printer 130 or the computer device 125 determines the distribution of gel and water based on the softest hardness in the numerical data of the touch. At least one of the three-dimensional printer 130, the computer device 125, and other devices (e.g., a mixer for mixing the gel material and water connected to the three-dimensional printer 130 and / or the computer device 125) mixes the gel and water based on the determined distribution and creates a mixed solution in a container. The three-dimensional printer 130 or the computer device 125 determines the density of the ultraviolet light and the time for applying the ultraviolet light to achieve the softest hardness in the created mixed solution. The three-dimensional printer 130 irradiates the ultraviolet light over the entire range corresponding to the object in the mixed solution based on the determined density of the ultraviolet light and the time for applying the ultraviolet light. In this way, a three-dimensional gel object is generated.

[0032] The three-dimensional printer 130 adjusts the tactile feel of the three-dimensional object (step 318) based on the three-dimensional data and the tactile numerical data obtained in step 304. Although the process of step 316 may be the final process in generating the three-dimensional object, the process of step 318 may be incorporated to improve the tactile feel of the three-dimensional object.

[0033] In the case of the example using a gel material, a part of the three-dimensional gel object is further irradiated with ultraviolet light to provide different hardness / softness for each predetermined area of ​​the three-dimensional gel object. For example, the three-dimensional printer 130 or the computer device 125 determines the density of the ultraviolet light and the time for applying the ultraviolet light based on the second softest hardness among the one or more hardnesses in the numerical data of the touch acquired in step 304. Each of the two or more hardness values ​​may be associated with each area of ​​the actual object (nose, mouth, forehead, cheeks, etc.). The three-dimensional printer 130 can further irradiate ultraviolet light to a predetermined area of ​​the three-dimensional gel object according to whether the area associated with the touch and the area in the three-dimensional gel object match based on the determined density of the ultraviolet light and the time for applying the ultraviolet light. This generates a three-dimensional gel object with different hardness / softness for each area. For example, if the three-dimensional gel object is the front of the face, a three-dimensional gel object is generated in which the area of ​​the nose is harder than the area of ​​the cheeks.

[0034] The three-dimensional printer 130 or the computer device 125 may perform a further step to further improve the tactile sensation. In the further step, for example, the three-dimensional printer 130 or the computer device 125 may identify a third softest hardness from the numerical data of the tactile sensation, and the three-dimensional printer 130 may irradiate a predetermined area of ​​the three-dimensional gel object with ultraviolet light based on the third hardness. In this way, when the three-dimensional gel object is the front of a face, a three-dimensional gel object is generated in which the forehead area is harder than the nose area.

[0035] Regarding the example using a gel material, the mixed solution in the container is irradiated with ultraviolet rays in step 316, but the three-dimensional gel object may be removed from the container containing the mixed solution and the removed three-dimensional gel object may be irradiated with ultraviolet rays in step 318. By further irradiating the removed three-dimensional gel object with ultraviolet rays in step 318, it is possible to prevent the mixed solution in the container (i.e., the mixed solution not used in the three-dimensional gel object generated in step 316) from adhering to the three-dimensional gel object generated in step 316, and to prevent the three-dimensional gel object as the final result from being unnecessarily deformed or expanded.

[0036] In step 318, a predetermined texture is added to each predetermined area of ​​the three-dimensional object based on the three-dimensional data and the numerical data of the texture. The three-dimensional printer 130 or the computer device 125 associates the predetermined area in the three-dimensional data identified in step 314 (e.g., forehead, nose) with the area in the face and the area in the numerical data of the texture associated and stored in step 304, and identifies the numerical data of the texture to be applied to the predetermined area in the three-dimensional data. For example, the three-dimensional printer 130 or the computer device 125 can identify that hardness / softness with Young's modulus of approximately 80 kPa, 150 kPa, and 50 kPa should be applied to the cheek, forehead, and nose in the three-dimensional data, respectively.

[0037] Step 318 allows for the generation of haptic enhanced three-dimensional objects.

[0038] The printer 135 and / or the computing device 125 reduce or enlarge the surface data (step 320). The computing device 125 may send the surface data to the printer 135. The printer 135 and / or the computing device 125 reduce or enlarge the surface data obtained in step 306 so that the size of the surface data matches the size of the three-dimensional data or the three-dimensional object. For example, in the three-dimensional data and the surface data, feature points such as a nose have been identified in steps 314 and 306, respectively. The printer 135 and / or the computing device 125 may enlarge or reduce the size of the surface data so that the feature points (nose, mouth, etc.) of the three-dimensional data and the surface data match.

[0039] The printer 135 generates a two-dimensional object based on the surface data (step 322). The two-dimensional object can be a print medium such as paper, a plastic film, etc. The print medium can be one or more sheets, a bag, etc.

[0040] The two-dimensional object is applied to the three-dimensional object (step 324). The computing device 125 associates the three-dimensional data and the surface data such that the positions of the feature points of the data match. The compositor 140 applies the two-dimensional object to the three-dimensional object based on the associated three-dimensional data and surface data. In another embodiment, the compositor 140 may receive the three-dimensional data and the surface data from the computing device 125 and apply the two-dimensional object to the three-dimensional object such that the positions of the feature points of the three-dimensional data and the surface data match. The compositor 140 may apply the two-dimensional object to the three-dimensional object more accurately by using two or more feature points. In another embodiment, the compositor 140 may select one or more feature points from the two or more feature points to more accurately apply the two-dimensional object to the three-dimensional object. A human, rather than a compositor, may apply the two-dimensional object to the three-dimensional object based on the three-dimensional data and surface data associated by the compositor or the computing device 125. This may provide finer control when applying the two-dimensional object to the three-dimensional object.

[0041] In this embodiment, the surface data is printed or applied to a two-dimensional object, not to a three-dimensional object. In printing or applying surface data to a three-dimensional object, it is relatively difficult to achieve high definition and high efficiency of the surface data, since it is necessary to control three data in the horizontal, vertical, and depth directions. In particular, when the surface of the three-dimensional object is uneven, it is more difficult to achieve high definition and high efficiency of the surface data by using the printing or application of surface data to the three-dimensional object. On the other hand, since the printing or application of surface data to a two-dimensional object does not require control of data in at least the depth direction, it is easier to achieve high definition and high efficiency than the printing or application to a three-dimensional object.

[0042] In this embodiment, the three-dimensional object can be a three-dimensional gel object. When dimethylacrylamide (DMAAm) gel or the like is used as the material of the gel object, it is known that the non-gelled portion of DMAAm can be harmful to the human body. Therefore, by covering the three-dimensional object with a two-dimensional object that is a bag, it is possible to avoid the risk of exposing the non-gelled portion of DMAAm to substances that can be harmful to the human body. In addition, by closing the gel before it is completely hardened with a bag, it is possible to provide a softness that cannot be expressed by the gel after hardening. Furthermore, since the gel is not exposed to air or water by the bag, hardening of the gel can be prevented.

[0043] When the two-dimensional object is a bag-shaped print medium, the two-dimensional object covers the three-dimensional object, causing air to enter between the two-dimensional object and the three-dimensional object. The compressor 140 can remove the air from between the two-dimensional object and the three-dimensional object by sucking in the air. If air enters between the two-dimensional object and the three-dimensional object, a gap occurs between the two-dimensional object and the three-dimensional object, which adversely affects the tactile sensation. By removing the air, the tactile sensation can be improved.

[0044] [Variations] In the above embodiment, a face is used as the target of the object, but the object can include various things other than a face. For example, the object can include food. If the food is a fish, the fish's eyes can be the feature points. If the food is a fruit, the stem, i.e., the calyx, can be the feature point. The object can include a part or the whole of a person or an animal. The object can further include various things such as cloth products such as clothes and towels, vehicle tires, and petroleum products such as sponges. One or more of the gel object generating system 100, the three-dimensional scanner 110, the surface data scanner 120, and the computer device 125 can identify the type of the object and identify one or more feature points according to each type of the object.

[0045] According to each embodiment of the present invention, by generating an object that cannot be touched as an actual object as a three-dimensional object, it is possible to provide a tactile sensation through the three-dimensional object to a person who has not been able to provide a tactile sensation until now. For example, the tactile sensation of an actual object that is dangerous to the human body, such as an animal such as a poisonous jellyfish or snake, an animal or plant with thorns, or a carnivorous animal, can be reproduced through the three-dimensional object. In another embodiment, a part or all of an animal or human body can be reproduced as a three-dimensional object. Such a three-dimensional object can be used for remote palpation, training in medical procedures, and the like. In another embodiment, an object that is too small for a person to touch, such as a small living thing or a microorganism, can be enlarged and reproduced as a three-dimensional object. In addition, each embodiment of the present invention may be used as a means of providing a tactile sensation in a three-dimensional virtual space such as a metaverse.

[0046] The process described with reference to Fig. 3 above may be realized as a method by one or more hardware components of the gel object generation system 100, the three-dimensional scanner 110, the tactile feel measuring device 115, the surface data scanner 120, the computer device 125, the three-dimensional printer 130, the printer 135, the synthesis device 140, and the compressor 145. In addition, this method may be realized as a computer program for one or more hardware components, and the computer program may be executed by one or more hardware components of the gel object generation system 100, the three-dimensional scanner 110, the tactile feel measuring device 115, the surface data scanner 120, the computer device 125, the three-dimensional printer 130, the printer 135, the synthesis device 140, and the compressor 145. When computer programs stored in at least some of the gel object generation system 100, the 3D scanner 110, the tactile measurement device 115, the surface data scanner 120, the computing device 125, the 3D printer 130, the printer 135, the synthesis device 140, the compressor 145, and other devices are executed, the computer programs cause those devices to perform some or all of the processes in the above embodiments.

[0047] In each of the above-described embodiments, the 3D scanner 110, the tactile sensor 115, the surface data scanner 120, the computer device 125, the 3D printer 130, the printer 135, the synthesizer 140, and the compressor 145 may be realized by respective hardware, or some or all of them may be realized as an integrated hardware device.

[0048] [others] It will be understood that in the above embodiments, some or all of the elements described as being implemented in hardware may be implemented in software, and some or all of the elements described as being implemented in software may be implemented in hardware.

[0049] In the processes or processing sequences described above, the processes or processing sequences can be freely changed as long as no inconsistencies in the processes or processing sequences arise, such as the use of data in a certain process that is not yet available to that process.

[0050] Regarding each of the embodiments described above, a part or all of each embodiment may be combined to be realized as a single embodiment.

[0051] The above-described embodiments are merely examples for explaining the present invention, and the present invention is not limited to these embodiments. The present invention can be embodied in various forms without departing from the gist of the present invention. [Explanation of symbols]

[0052] 100: Three-dimensional object generation system 110: 3D scanner 115:Tactile measuring device 120: Surface data scanner 125: Computer equipment 130: 3D printer 135: Printer 140:Synthesizer 145: Compressor

Claims

1. A three-dimensional object generation system, comprising: a 3D scanner for scanning an object and acquiring 3D data; A computer device that identifies one or more ranges from the three-dimensional data; a tactile sensation measuring device for acquiring a tactile sensation of an object corresponding to the one or more ranges; a three-dimensional printer that generates a three-dimensional object based on the three-dimensional data and applies the tactile sensations of the one or more areas to areas in the three-dimensional object that correspond to the one or more areas; a surface data scanner for scanning the surface data of the object and acquiring the surface data; a two-dimensional printer that generates a two-dimensional object based on the surface data; The computer device associates the three-dimensional data and the surface data.

2. The three-dimensional object generating system according to claim 1 , The tactile sensation includes hardness, The tactile sensation measuring device comprises: a hardness measuring device for measuring hardness of one or more ranges in the object corresponding to the one or more ranges; A three-dimensional object generation system, wherein the computer device associates the measured one or more ranges of hardness with one or more ranges in the three-dimensional data, and the three-dimensional printer applies the one or more ranges of hardness to ranges in the three-dimensional object corresponding to the one or more ranges based on the association.

3. 3. The three-dimensional object generating system according to claim 1, The computer device determines an extent of a three-dimensional object to be generated, and identifies data of the determined extent from the three-dimensional data.

4. 3. The three-dimensional object generating system according to claim 1, The computer device determines an extent of the three-dimensional object to be generated, and scales or reduces data of the determined extent from the three-dimensional data.

5. 3. The three-dimensional object generating system according to claim 1, The system further comprises: A three-dimensional object generating system comprising a synthesis device for synthesizing the two-dimensional object into the three-dimensional object based on the associated three-dimensional data and the surface data.

6. 1. A method comprising: scanning an object with a three-dimensional scanner to obtain three-dimensional data; Identifying, by a computer device, one or more ranges from the three-dimensional data; acquiring a tactile sensation of an object corresponding to the one or more ranges by a tactile sensation measuring device; generating a three-dimensional object based on the three-dimensional data by a three-dimensional printer, and applying the tactile sensations of the one or more areas to areas in the three-dimensional object corresponding to the one or more areas; scanning a surface of the object with a surface data scanner to obtain the surface data; generating, by a two-dimensional printer, a two-dimensional object based on the surface data; and correlating, by the computing device, the three-dimensional data and the surface data.

7. 1. A computing device comprising: receiving three-dimensional data from a three-dimensional scanner configured to scan an object and acquire three-dimensional data; and identifying one or more ranges from the three-dimensional data; receiving the one or more tactile sensations from a tactile sensation measuring device that acquires a tactile sensation of an object corresponding to the one or more ranges; receiving surface data from a surface data scanner that scans the surface data of the object and acquires the surface data; sending the three-dimensional data to a three-dimensional printer that generates a three-dimensional object based on the three-dimensional data and applies the tactile sensations of the one or more areas to areas in the three-dimensional object that correspond to the one or more areas; sending the surface data to a two-dimensional printer that generates a two-dimensional object based on the surface data; A computing device configured to associate the three-dimensional data and the surface data.

8. 1. A computer device implemented method, comprising: receiving three-dimensional data from a three-dimensional scanner configured to scan an object and acquire three-dimensional data; and identifying one or more regions from the three-dimensional data; receiving the one or more tactile sensations from a tactile measurement device that obtains a tactile sensation of an object corresponding to the one or more ranges; receiving surface data from a surface data scanner that scans a surface data of the object and acquires the surface data; sending the three-dimensional data to a three-dimensional printer that generates a three-dimensional object based on the three-dimensional data and applies the haptic sensations of the one or more areas to areas in the three-dimensional object that correspond to the one or more areas; sending the surface data to a two-dimensional printer that generates a two-dimensional object based on the surface data; and correlating the three-dimensional data and the surface data.

9. A computer program comprising: scanning an object with a three-dimensional scanner to obtain three-dimensional data; Identifying, by a computer device, one or more ranges from the three-dimensional data; acquiring a tactile sensation of an object corresponding to the one or more ranges by a tactile sensation measuring device; generating a three-dimensional object based on the three-dimensional data by a three-dimensional printer, and applying the tactile sensations of the one or more areas to areas in the three-dimensional object corresponding to the one or more areas; scanning a surface of the object with a surface data scanner to obtain the surface data; generating, by a two-dimensional printer, a two-dimensional object based on the surface data; and associating the three-dimensional data and the surface data by the computer device.

10. A computer program comprising: receiving three-dimensional data from a three-dimensional scanner configured to scan an object and acquire three-dimensional data; and identifying one or more regions from the three-dimensional data; receiving the one or more tactile sensations from a tactile measurement device that obtains a tactile sensation of an object corresponding to the one or more ranges; receiving surface data from a surface data scanner that scans a surface data of the object and acquires the surface data; sending the three-dimensional data to a three-dimensional printer that generates a three-dimensional object based on the three-dimensional data and applies the haptic sensations of the one or more areas to areas in the three-dimensional object that correspond to the one or more areas; sending the surface data to a two-dimensional printer that generates a two-dimensional object based on the surface data; and associating the three-dimensional data and the surface data.

Images