Function-Providing Device, Function-Providing Method, and Function-Providing Program

The function-imparting device and method automate the creation of digital objects with implemented functions by imparting programs to digital objects, addressing the challenge of manual function implementation and reducing costs.

JP7683708B2Active Publication Date: 2025-05-27NIPPON TELEGRAPH & TELEPHONE CORP

Patent Information

Application Number
JP2023545000
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-09-06
Publication Date
2025-05-27
Estimated Expiration
2041-09-06

AI Technical Summary

Technical Problem

Existing technologies face challenges in automatically creating digital objects that implement functions, as they primarily assign function labels without digitizing the functions themselves.

Method used

A function-imparting device and method that acquire a digital object and function data, then obtain and impart a program from a storage device to digitally reproduce the function, enabling automatic creation of digital objects with implemented functions.

Benefits of technology

This approach allows for the automatic creation of digital objects with implemented functions, reducing the cost and complexity of manual implementation and enabling more efficient digital twin simulations.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007683708000001
    Figure 0007683708000001
  • Figure 0007683708000002
    Figure 0007683708000002
  • Figure 0007683708000003
    Figure 0007683708000003
Patent Text Reader

Abstract

This function adding device includes an acquisition unit and an addition unit. The acquisition unit acquires a digital object generated by digitizing a physical object, and data that indicates the function of the digital object. The addition unit acquires, from a prescribed storage device, a program for digitally reproducing the function of the digital object and adds the acquired program to the digital object.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to a function imparting device, a function imparting method, and a function imparting program.

Background Art

[0002] The progress of ICT (Information and Communications Technology) has enabled "digital twins." Digital twins can connect the real world and the cyber space and have attracted attention in recent years.

[0003] A digital twin is a digital object that accurately represents a real-world object in the cyber space. Examples of real-world objects include production machines in factories, aircraft engines, and automobiles. A digital twin maps the shape, state, or function of such an object onto the cyber space.

[0004] A digital twin enables simulations in the cyber space. For example, the simulations include current situation analysis, future prediction, and possibility evaluation of the object.

[0005] Technologies related to ICT are easily utilized in the cyber space. Therefore, the application of digital twins to ICT can feedback benefits such as intelligently controlling real-world objects to the real-world objects.

[0006] In the future, as the digital twin conversion of various real-world objects progresses, it is considered that digital twins will lead to an increase in the demand for simulations in the cyber space. For example, there may be an increase in the demand for solutions such as interacting heterogeneous and diverse digital twins across industrial boundaries, cooperation between industries by combining heterogeneous and diverse digital twins, and large-scale simulations.

[0007] The interaction between digital twins is calculated by digitizing the functions inherent in a physical twin (i.e., a real object). The functions of a physical twin are, for example, the "cutting" function of a knife, the "writing" function of a pen, and the like.

[0008] To estimate the functions of a physical twin, a machine learning model such as a neural network is used. The machine learning model uses the image, point cloud, and 3D mesh of the physical twin as inputs. The machine learning model estimates the functions of the physical twin from this input. The estimated functions are assigned to the corresponding digital twin as labels in natural language.

Prior Art Documents

Non-Patent Documents

[0009]

Non-Patent Document 1

Non-Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0010] However, in the above prior art, it may be difficult to automatically create a digital object that implements a function.

[0011] For example, in the above prior art, only the labels of the functions are assigned to the digital twin. That is, the functions themselves are not digitized.

[0012] Therefore, the present disclosure proposes a function - imparting device, a function - imparting method, and a function - imparting program that can automatically create a digital object implementing a function.

Means for Solving the Problems

[0013] In one aspect of the present disclosure, the function - imparting device includes an acquisition unit that acquires a digital object generated by digitizing a physical object and data indicating the function of the digital object, and an imparting unit that acquires a program for digitally reproducing the function of the digital object from a predetermined storage device and imparts the acquired program to the digital object.

Advantages of the Invention

[0014] The function - imparting device according to one or more embodiments of the present disclosure can automatically create a digital object implementing a function.

Brief Description of the Drawings

[0015]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

DETAILED DESCRIPTION OF THE INVENTION

[0016] A plurality of embodiments will be described in detail below with reference to the drawings. Note that the present invention is not limited to these plurality of embodiments. The plurality of features of the various embodiments can be combined in various ways on the condition that these plurality of features do not conflict with each other. The same elements are denoted by the same reference numerals, and redundant descriptions are omitted.

[0017] 〔1. Introduction〕 In digital twin technology, a digital twin can be generated together with a function label indicating the function of the digital twin. A developer can identify the use of the digital twin by the function label. For example, the function label is determined by a machine learning model such as a neural network.

[0018] FIG. 1 shows Generation 10 which is an example of the generation of a digital twin whose function is estimated. In Generation 10, first, a real object is digitized to generate a digital twin. Then, the function of the digital twin is estimated, and a function label is assigned to the digital twin. The function label is a natural language label. In the example of FIG. 1, the digital twin is a saw digital twin, and the function label indicates the function of cutting.

[0019] However, in Generation 10, the function label is only assigned to a specific part of the digital twin. That is, the function itself of the digital twin is not reproduced digitally.

[0020] Figure 2 shows a function implementation 20 which is an example of function implementation in a digital twin. As shown in Figure 2, the saw digital twin implementing the cutting function can cut the digital twin of a tree. In function implementation 20, a developer creates a digital twin implementing a function according to the label assigned to the digital twin.

[0021] However, each time an object is digital-twinned, it is costly to manually create a digital twin implementing a function. A developer can create a digital twin implementing a function each time a digital twin is created. In the actual environment, an unspecified number of objects are digital-twinned. Therefore, manual function implementation increases the creation cost of digital twins.

[0022] To solve the above problems, the function implementation system according to one or more embodiments of the present disclosure performs one or more function implementations described below.

[0023] [2. Environment for Function Implementation] First, referring to Figure 3, the environment for function implementation according to the present disclosure will be described.

[0024] Figure 3 is a block diagram of an environment 1 which is an example of an environment for function implementation in a digital object. As shown in Figure 3, environment 1 includes a function implementation system 100, a network 200, and a user device 300.

[0025] The function implementation system 100 is a system that performs one or more function implementations. The function implementation system 100 is an example of a function conferring device. One or more function implementations include a process of conferring a function on a digital object. An example of a digital object is a digital twin. The overview of the function implementation according to the present disclosure will be described in the next section.

[0026] The function implementation system 100 includes one or more data processing devices such as one or more servers. An example of the configuration of the function implementation system 100 will be described in Section 4.

[0027] The network 200 is a network such as a LAN (Local Area Network), a WAN (Wide Area Network), or the Internet. The network 200 connects the function implementation system 100 and the user device 300.

[0028] The user device 300 is a data processing device such as a client device. The user of the user device 300 is, for example, a person who wants to create a digital twin with implemented functions. The user sends an image of a real object to the function implementation system 100. Then, the user receives a digital twin corresponding to the real object from the function implementation system 100. In this digital twin, the functions of the object are also reproduced.

[0029] 〔3. Outline of Function Implementation〕 Next, with reference to FIG. 4, an outline of function implementation according to the present disclosure will be described. Note that this outline is not intended to limit the present invention or the plurality of embodiments described in the following sections.

[0030] FIG. 4 shows an outline 30 of function implementation according to the present disclosure. The outline 30 includes five steps. The function implementation system 100 automatically generates a digital twin in which the functions inherent in the physical twin are reproduced, without human intervention.

[0031] In step S1, the function implementation system 100 digitizes the saw 31 and generates a saw digital twin 32.

[0032] In step S2, the function implementation system 100 estimates the function of the saw digital twin 32 and assigns a label indicating the estimated function to the saw digital twin 32. As a result, the function implementation system 100 generates a saw digital twin 33 with a function label 34. The function label 34 indicates the function of cutting.

[0033] In step S3, the function implementation system 100 sends the function label 34 to the function database 35 as a query.

[0034] The function database 35 manages the function programs once created by developers. The function program is a program for digitally reproducing functions. In the function database 35, the function label is the key and the function program is the value.

[0035] In step S4, the function implementation system 100 obtains the function program 36 corresponding to the function label 34 from the function database 35. The function program 36 is a cutting script.

[0036] In step S5, the function implementation system 100 assigns the function program 36 to the saw digital twin 33. As a result, the function implementation system 100 generates a saw digital twin 37 that implements the cutting function.

[0037] As described above, the function implementation system 100 uses the label obtained by estimating the function of the digital twin as a query for obtaining the function program. Then, the function implementation system 100 assigns the obtained function program to the digital twin. The function program is stored in the function database. The function implementation system 100 can reuse the function programs created in the past. Therefore, the function implementation system 100 can reduce the implementation cost of creating a digital twin in which functions are digitized up to the functions.

[0038] 〔4. Details of the Function Implementation System〕 Next, with reference to FIGS. 5, 6, and 7, the details of the function implementation system 100 will be described.

[0039] FIG. 5 is a block diagram of a function implementation system 100, which is an example of the configuration of the function implementation system according to the present disclosure. As shown in FIG. 5, the function implementation system 100 includes a communication unit 110, a control unit 120, and a storage unit 130. The function implementation system 100 may include an input unit (for example, a keyboard, a mouse) that receives an input from an administrator of the function implementation system 100. Further, the function implementation system 100 may include an output unit (for example, a liquid crystal display, an organic EL (Electro Luminescence) display) that displays information to the administrator of the function implementation system 100.

[0040] 〔4-1. Communication Unit 110〕 The communication unit 110 is implemented by, for example, a NIC (Network Interface Card). The communication unit 110 is connected to the network 200 by wire or wirelessly. The communication unit 110 can transmit and receive information to and from the user device 300 via the network 200.

[0041] 〔4-2. Control Unit 120〕 The control unit 120 is a controller. The control unit 120 is implemented by one or more processors (for example, a CPU (Central Processing Unit), an MPU (Micro Processing Unit)) that use a RAM (Random Access Memory) as a working area and execute various programs stored in the storage device of the function implementation system 100. Further, the control unit 120 may be implemented by an integrated circuit such as an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), a GPGPU (General Purpose Graphic Processing Unit), etc.

[0042] As shown in FIG. 5, the control unit 120 includes a function management unit 121, a function storage unit 122, an image reception unit 123, a 3D mesh generation unit 124, a function estimation unit 125, a material estimation unit 126, a function imparting unit 127, a DT management unit 128, and a function deficiency confirmation unit 129. One or more processors of the function implementation system 100 can implement each control unit by executing instructions stored in one or more memories of the function implementation system 100. The data processing performed by each control unit is an example, and each control unit (for example, the function imparting unit 127) may perform the data processing described in relation to another control unit (for example, the function estimation unit 125).

[0043] [4-3. Storage Unit 130] The storage unit 130 is implemented by, for example, a semiconductor memory element such as a RAM or a flash memory, or a storage device such as a hard disk or an optical disk. As shown in FIG. 5, the storage unit 130 includes a function database 131.

[0044] [4-4. Functions of Each Control Unit] In this subsection, with reference to FIGS. 6 and 7, the functions of each of the above control units will be described. Also, the function of the function database 131 will be described in relation to the function management unit 121.

[0045] FIG. 6 shows a flow 40 which is an example of the data flow in the function implementation system according to the present disclosure. As shown in FIG. 6, data for creating a digital twin with functions is exchanged between the function management unit 121, the function storage unit 122, the image reception unit 123, the 3D mesh generation unit 124, the function estimation unit 125, the material estimation unit 126, the function imparting unit 127, the DT management unit 128, and the function deficiency confirmation unit 129.

[0046] [4-4-1. Function Management Unit 121] The function management unit 121 manages various programs in which functions are implemented. These various programs are, for example, programs for digitally reproducing the functions of a digital twin. These various programs are created by digitizing the functions of a physical twin.

[0047] The function management unit 121 is implemented as a database management system. For example, the function management unit 121 can search and rewrite a database according to a query. In the examples of FIGS. 5 and 6, this database is the function database 131.

[0048] The input to the function management unit 121 (i.e., the query) is a natural language label representing the function and material of an object. The output of the function management unit 121 is a program in which the function is implemented.

[0049] The function management unit 121 uses labels representing functions and materials as keys. Also, the function management unit 121 uses a program as a value. Therefore, the function management unit 121 manages programs in which functions are implemented in a KVS (Key-Value Store). When a query arrives, the function management unit 121 searches for and returns a program having a key that matches the query.

[0050] In this specification, a program in which a function is implemented is called a function program. Examples of function programs include a script for reproducing the antenna FB (Feedback) and a script for automatically setting the friction coefficient.

[0051] 〔4-4-2. Function storage unit 122〕 The function storage unit 122 stores various function programs in the function database 131. The function storage unit 122 is an example of a storage unit. As described above, the function program is a program in which a function is implemented.

[0052] The function storage unit 122 receives function programs from a developer. Also, the function storage unit 122 receives a label indicating the function reproduced by the function program from the developer. In this specification, the label indicating a function is called a function label.

[0053] The function storage unit 122 associates a corresponding function label with the function program. Then, the function storage unit 122 stores the function program associated with the function label in the function database 131.

[0054] When a developer newly develops a function program that does not exist in the function database 131, the developer sends the new program to the function storage unit 122. The function storage unit 122 adds the new program to the function database 131. The function storage unit 122 may accept access from a general user. In this way, the function storage unit 122 may widely collect function programs.

[0055] 〔4-4-3. Image reception unit 123〕 The image reception unit 123 receives an image of a real object from the user device 300. The image reception unit 123 can store the image in the storage unit 130.

[0056] The image of the real object is, for example, a photograph. The image reception unit 123 can receive a plurality of images for generating a three-dimensional model of the object.

[0057] 〔4-4-4. 3D mesh generation unit 124〕 The 3D mesh generation unit 124 generates a digital object by digitizing the shape of the object depicted in the image. For example, the 3D mesh generation unit 124 generates a 3D mesh from a point cloud obtained by measuring the surface of the object with a three-dimensional laser scanner. Alternatively, the 3D mesh generation unit 124 may create a 3D mesh from a plurality of photographs received by the image reception unit 123 without using a three-dimensional laser scanner. The 3D mesh generation unit 124 is an example of a generation unit. The 3D mesh generation unit 124 can acquire a plurality of images, point clouds, and 3D meshes generated in the past from the storage unit 130. Also, the 3D mesh generation unit 124 can store the generated digital object in the storage unit 130.

[0058] The 3D mesh generation unit 124 generates a 3D mesh model of a real object based on an image or a point cloud. The generated 3D mesh model is an example of a digital twin.

[0059] [4-4-5. Function estimation unit 125] Based on the image of the real object received by the image receiving unit 123 and the shape of the digital object (e.g., digital twin) generated by the 3D mesh generation unit 124, the function estimation unit 125 estimates the function of the object depicted in the original image. The function estimation unit 125 is an example of an estimation unit. The function estimation unit 125 can obtain an image depicting the object or a digital object from the storage unit 130. Further, the function estimation unit 125 can store data indicating the estimated function in the storage unit 130 as a function label.

[0060] The input of the function estimation unit 125 is data such as an image, a point cloud, and a 3D mesh. The function estimation unit 125 can also use tag information attached to such data as an input. For example, the tag information indicates the name of the photographed object.

[0061] The output of the function estimation unit 125 is function part information and a natural language label representing the function. The function part information indicates the part having the function. As an example, the function part information of a saw digital twin can indicate the range corresponding to the blade. The function estimation unit 125 can estimate the function in units of parts.

[0062] The function estimation unit 125 can estimate the function of an object using a machine learning model. An instance of the training data is a range representing a function within data such as an image, a point cloud, and a 3D mesh. The label of the training data is a natural language label of the function corresponding to this range. The function estimation unit 125 can perform learning of the machine learning model based on the training data. The function estimation unit 125 can output the estimated function by inputting data such as an image, a point cloud, and a 3D mesh into the learned model.

[0063] The material estimation unit 126 acquires an image depicting an object from the storage unit 130. Then, the material estimation unit 126 estimates the material of the object based on the acquired image. The material estimation unit 126 can store a material label indicating the estimated material in the storage unit 130.

[0064] The function assignment unit 127 acquires a digital object and a function label of this digital object from the storage unit 130. This is an example of the acquisition unit of the function assignment unit 127. In addition, the function assignment unit 127 can acquire the function part information of this digital object and the material label of this digital object from the storage unit 130.

[0065] The function assignment unit 127 acquires a function program corresponding to the function indicated by the function label from the function database 131. As described above, the function program is a program in which the function is implemented (for example, a program that digitally reproduces the function of cutting an object of a saw). Then, the function assignment unit 127 assigns the acquired function program to the digital object. The function assignment unit 127 is an example of the assignment unit. The function assignment unit 127 can store the digital object to which the function program is assigned in the storage unit 130 as a digital object in which the function is implemented.

[0066] FIG. 7 shows a function assignment 50 which is an example of function assignment according to the present disclosure. In the function assignment 50, the inputs of the function assignment unit 127 are function part information, a function label (that is, a natural language label representing the function), and a digital twin (for example, a 3D mesh). The output of the function assignment unit 127 is a digital twin with a function.

[0067] In the example of FIG. 7, first, the function assignment unit 127 acquires the digital twin 51 together with the function part information and the function label. The digital twin 51 is a saw digital twin. The function part information indicates a range corresponding to the blade. The function label indicates the function of cutting.

[0068] ​​ Next, the function imparting unit 127 sends a function label to the function management unit 121. This function label is sent as a query. The function management unit 121 searches the function database 131 for a function program associated with the key corresponding to the query. In the example of FIG. 7, the cutting script is searched for. The function management unit 121 sends the cutting script to the function imparting unit 127. In this way, the function imparting unit 127 can obtain a function program corresponding to the function of the digital object from the function database 131.

[0069] Next, the function imparting unit 127 imparts the function program to the digital object based on the function part information. In the example of FIG. 7, the cutting script is imparted to the blade part of the saw digital twin.

[0070] 〔4-4-8. DT Management Unit 128〕 Returning to FIG. 6, the DT management unit 128 manages digital objects. For example, the DT management unit 128 manages various digital twins (Digital Twin: DT). The various digital twins include normal digital twins that do not implement the functions of the physical twin.

[0071] The DT management unit 128 can obtain a digital twin with implemented functions from the storage unit 130. Then, the DT management unit 128 can provide the obtained digital twin to the user device 300.

[0072] The DT management unit 128 can receive various digital twins from the developer. The DT management unit 128 can store the received various digital twins in the storage unit 130.

[0073] 〔4-4-9. Function Deficiency Confirmation Unit 129〕 When the function of a digital object is an active function that affects other physical objects, the function deficiency confirmation unit 129 acquires, from the storage unit 130, other digital objects generated by digitizing these other physical objects. The other digital objects are included in various digital twins managed by the DT management unit 128. Then, the function deficiency confirmation unit 129 identifies the function of the other digital object as a passive function that is affected by the digital object.

[0074] The function of a digital object may require the target digital object. In this case, the function of the target digital object is identified as a function lacking in the digital object.

[0075] As an example, the input to the function deficiency confirmation unit 129 is a function label (for example, a natural language label representing the function) indicating the function of the digital object. On the other hand, the output of the function deficiency confirmation unit 129 is function deficiency information such as the digital twin lacking the function, the function label indicating the function lacking in the digital twin, and the function part information corresponding to the function label.

[0076] For example, when a newly added function to a digital twin affects other objects, the function deficiency confirmation unit 129 analyzes the space where the physical twin corresponding to this digital twin exists. As an example, the function deficiency confirmation unit 129 acquires, from the storage unit 130, an image depicting the physical twin. Then, the function deficiency confirmation unit 129 determines whether other objects are included in the acquired image.

[0077] When other objects are included in the acquired image, the function deficiency confirmation unit 129 identifies the other objects as objects affected by the physical twin. Then, the function deficiency confirmation unit 129 acquires, from the storage unit 130, other digital twins corresponding to the identified other objects.

[0078] The functions of other obtained digital twins are specified as functions affected by the digital twin. The function deficiency confirmation unit 129 sends the above function deficiency information to the function provision unit 127 according to the digital twin, other digital twins, and the function labels of these digital twins. The function provision unit 127 can provide a function program corresponding to a passive function to other digital twins.

[0079] For example, assume that a paper cup is digital-twinned and a knife with the function of "cutting" is digital-twinned. In this example, the function deficiency confirmation unit 129 sends the paper cup digital twin and the function label indicating "being cut" to the function provision unit 127. The function provision unit 127 can assign the function label indicating "being cut" to the paper cup digital twin.

[0080] [5. Utilization of Function Implementation] In this section, the utilization of function implementation according to the present disclosure will be described.

[0081] The function implementation system 100 can assign various function scripts to the digital twin. For example, the function implementation system 100 can automatically generate a digital twin of a knife that can "cut" other objects in a virtual space from an image depicting a knife.

[0082] The function implementation system 100 can assign a script for reproducing tactile feedback (FB) to the digital twin. For example, the function implementation system 100 automatically generates a digital twin of an egg from an image of the egg, where the strength of the force returned to the tactile glove changes before and after the egg cracks. The function implementation system 100 can obtain a function program from the function database 131, where the key is the material attribute and the value is the tactile feedback. By assigning such a function program to the egg digital twin, the function implementation system 100 can automatically assign the function of tactile feedback (FB) to the egg digital twin.

[0083] The function implementation system 100 can automatically set the friction coefficient. For example, the administrator of the function implementation system 100 measures the friction coefficient for each material in advance. The measured friction coefficient is stored in the function database 131. The function implementation system 100 can automatically set the friction coefficient for the digital twin (e.g., 3D mesh) based on the material label.

[0084] 〔6. Flowchart of Function Implementation〕 Next, with reference to FIG. 8, a flowchart of an example of function implementation according to the present disclosure will be described. The example of function implementation includes a process for creating a digital object that implements a function. The process for creating a digital object that implements a function is performed, for example, by the function implementation system 100 of FIG. 3.

[0085] FIG. 8 is a flowchart showing a process P100 which is an example of a process for creating a digital object that implements a function.

[0086] As shown in FIG. 8, first, the function storage unit 122 of the function implementation system 100 receives various function programs from the developer (step S101).

[0087] Next, the function storage unit 122 stores the various function programs in the function database 131 of the function implementation system 100 (step S102).

[0088] Next, the image reception unit 123 of the function implementation system 100 receives an image of an object from the user (step S103).

[0089] Next, the 3D mesh generation unit 124 of the function implementation system 100 generates a digital twin of the object from the received image (step S104).

[0090] Next, the function estimation unit 125 of the function implementation system 100 estimates the function of the generated digital twin based on the shape of the generated digital twin (step S105).

[0091] Next, the function provision unit 127 of the function implementation system 100 acquires a function program corresponding to the estimated function from the function database 131 (step S106).

[0092] Next, the function provision unit 127 assigns the acquired function program to the generated digital twin (step S107).

[0093] 〔7. Effect〕 As described above, the function implementation system 100 can automate the implementation for digitally reproducing the functions of an object. As a result, the function implementation system 100 can reduce the creation cost of a digital twin with functions. Furthermore, the function implementation system 100 can automatically assign to the digital twin functions that cannot be reproduced by applying the attribute information of the digital twin to an off-the-shelf physical computing engine.

[0094] 〔8. Others〕 Some of the processes described as being automatically performed may be performed manually. Alternatively, all or part of the processes described as being performed manually may be automatically performed by known methods. Furthermore, the procedure of the processes, specific names, and information including various data and parameters shown in this specification and the drawings can be arbitrarily changed unless otherwise specified. For example, the various information shown in each figure is not limited to the shown information.

[0095] The components of the illustrated systems and devices conceptually show the functions of the systems and devices. The components are not necessarily physically configured as shown in the drawings. In other words, the specific forms of the distributed or integrated systems and devices are not limited to the forms of the systems and devices shown in the drawings. All or part of the systems and devices can be functionally or physically distributed or integrated according to various loads and usage situations.

[0096] 〔9. Hardware Configuration〕 FIG. 9 is a diagram showing a computer 1000 which is an example of the hardware configuration of a computer. The systems and methods described in this specification are implemented, for example, by the computer 1000 shown in FIG. 9.

[0097] FIG. 9 shows an example of a computer in which a function implementation system 100 is implemented by executing a program. The computer 1000 has, for example, a memory 1010 and a CPU 1020. The computer 1000 also has a hard disk drive interface 1030, a disk drive interface 1040, a serial port interface 1050, a video adapter 1060, and a network interface 1070. These components are connected by a bus 1080.

[0098] The memory 1010 includes a ROM (Read Only Memory) 1011 and a RAM 1012. The ROM 1011 stores a boot program such as a BIOS (Basic Input Output System). The hard disk drive interface 1030 is connected to a hard disk drive 1090. The disk drive interface 1040 is connected to a disk drive 1100. A removable storage medium such as a magnetic disk or an optical disk is inserted into the disk drive 1100. The serial port interface 1050 is connected to, for example, a mouse 1110 and a keyboard 1120. The video adapter 1060 is connected to, for example, a display 1130.

[0099] The hard disk drive 1090 stores, for example, an OS 1091, application programs 1092, program modules 1093, and program data 1094. That is, the programs defining the respective processes of the function implementation system 100 are implemented as program modules 1093 in which executable code by the computer 1000 is described. The program modules 1093 are stored, for example, in the hard disk drive 1090. For example, program modules 1093 for executing processes similar to the function configurations in the function implementation system 100 are stored in the hard disk drive 1090. Note that the hard disk drive 1090 may be replaced with an SSD (Solid State Drive).

[0100] The hard disk drive 1090 can store a function - imparting program for function implementation. Also, the function - imparting program can be created as a program product. When the program product is executed, it executes one or more methods as described above.

[0101] Also, the setting data used in the processes of the above - described embodiments is stored as program data 1094, for example, in the memory 1010 or the hard disk drive 1090. Then, the CPU 1020 reads out the program modules 1093 and program data 1094 stored in the memory 1010 or the hard disk drive 1090 to the RAM 1012 and executes them as needed.

[0102] Note that program module 1093 and program data 1094 are not limited to being stored in hard disk drive 1090. For example, they may be stored in a removable storage medium and read by CPU 1020 via disk drive 1100 or the like. Alternatively, program module 1093 and program data 1094 may be stored in another computer connected via a network (LAN, WAN, etc.). Then, program module 1093 and program data 1094 may be read by CPU 1020 from another computer via network interface 1070.

[0103] [[10. Summary of Embodiment]] As described above, the function implementation system 100 according to the present disclosure includes a function imparting unit 127. In at least one embodiment, the function imparting unit 127 acquires a digital object generated by digitizing a physical object and data indicating the function of the digital object. Then, the function imparting unit 127 acquires a program for digitally reproducing the function of the digital object from the function database 131 and imparts the acquired program to the digital object.

[0104] As described above, the function implementation system 100 according to the present disclosure includes a function storage unit 122. In at least one embodiment, the function storage unit 122 receives one or more programs for digitally reproducing the function of an object and stores the one or more programs in the function database 131. In some embodiments, the function imparting unit 127 acquires a program for digitally reproducing the function of the digital object from among the one or more programs stored in the function database 131.

[0105] In some embodiments, the function storage unit 122 associates one or more programs that digitally reproduce the functions of an object with one or more labels each indicating one or more functions reproduced by the one or more programs, and stores the one or more programs associated with the one or more labels in the function database 131. In some embodiments, the function assignment unit 127 identifies a label corresponding to the function of the digital object from among the one or more labels stored in the function database 131, and assigns the program associated with the identified label to the digital object.

[0106] As described above, the function implementation system 100 according to the present disclosure includes a 3D mesh generation unit 124. In at least one embodiment, the 3D mesh generation unit 124 generates a digital object corresponding to the object depicted in the image by digitizing the shape of the object depicted in the image. In some embodiments, the function assignment unit 127 acquires the digital object generated by the 3D mesh generation unit 124 as a digital object generated by digitizing a physical object.

[0107] As described above, the function implementation system 100 according to the present disclosure includes a function estimation unit 125. In at least one embodiment, the function estimation unit 125 estimates the function of the object depicted in the image based on the shape of the digital object generated by the 3D mesh generation unit 124. In some embodiments, the function assignment unit 127 acquires data indicating the function estimated by the function estimation unit 125 as data indicating the function of the digital object.

[0108] As described above, the function implementation system 100 according to the present disclosure includes a function deficiency confirmation unit 129. In at least one embodiment, when the function of the digital object is a function that affects other physical objects, another digital object generated by digitizing the other physical objects is acquired, and the function of the other digital object is specified as a function affected by the digital object.

[0109] Although various embodiments have been described in detail herein with reference to the drawings, these embodiments are examples and are not intended to limit the present invention to these embodiments. The features described herein can be implemented in various ways, including various modifications and improvements based on the knowledge of those skilled in the art.

[0110] In addition, the above-mentioned "parts (module, -er suffix, -or suffix)" can be read as units, means, circuits, etc. For example, the communication part (communication module), the control part (control module), and the storage part (storage module) can be read as a communication unit, a control unit, and a storage unit, respectively.

Description of Reference Numerals

[0111] 1 Environment 100 Function Implementation System 110 Communication Part 120 Control Part 121 Function Management Part 122 Function Storage Part 123 Image Reception Part 124 3D Mesh Generation Part 125 Function Estimation Part 126 Material Estimation Part 127 Function Assignment Part 128 DT Management Part 129 Function Deficiency Confirmation Part 130 Storage Part 131 Function Database 200 Network 300 User Device

Claims

1. A method and device for providing a digital representation of a function of an object, comprising: a receiving unit configured to receive one or more programs that digitally reproduce a function of an object, the one or more programs having been previously created and applied to one or more digital objects that have been generated by digitizing one or more physical objects; an associating unit that associates the one or more programs with one or more labels that respectively indicate one or more functions reproduced by the one or more programs; a storage unit configured to store the one or more programs associated with the one or more labels in a predetermined storage device; an acquisition unit that acquires a new digital object generated by digitizing a new physical object and data indicative of a function of the new digital object; an identification unit that identifies a label corresponding to a function of the new digital object from among the one or more labels stored in the predetermined storage device; an assigning unit that assigns a program associated with the identified label to the new digital object; A function imparting device comprising:

2. A generating unit is further provided for generating a digital object corresponding to an object depicted in an image by digitizing a shape of the object depicted in the image, The acquisition unit acquires the digital object generated by the generation unit as the new digital object generated by digitizing a new physical object. The function imparting device according to claim 1 .

3. An estimation unit that estimates a function of the object depicted in the image based on a shape of the new digital object generated by the generation unit, The acquisition unit acquires data indicating a function estimated by the estimation unit as data indicating a function of the new digital object. The function imparting device according to claim 2 .

4. an identification unit that, when a function of the new digital object is a function that affects another physical object, acquires another digital object generated by digitizing the other physical object, and identifies the function of the other digital object as a function that is affected by the new digital object; The function imparting device according to any one of claims 1 to 3, further comprising:

5. 1. A computer-implemented method for providing functionality, comprising: a receiving unit for receiving one or more programs for digitally reproducing a function of an object, the one or more programs having been previously created and applied to one or more digital objects generated by digitizing one or more physical objects; an associating step of associating said one or more programs with one or more labels, each of said labels indicating one or more functions reproduced by said one or more programs; a storing step of storing the one or more programs associated with the one or more labels in a predetermined storage device; acquiring a new digital object generated by digitizing a new physical object and data indicative of a function of said new digital object; an identification unit that identifies a label corresponding to a function of the new digital object from among the one or more labels stored in the predetermined storage device; an assigning step of assigning a program associated with the identified label to the new digital object; A method for imparting functionality comprising the steps of:

6. A function-imparting program for causing a computer to function as the function-imparting device according to any one of claims 1 to 4.

Citation Information

Patent Citations

  • Three-dimensional body model generating method based upon haptic vision, and haptic vision system

    JP2007026061A

  • Digital twin operation device, digital twin operation method, program and data structure

    WO2020246032A1

  • Control system and control method

    WO2020246473A1

Cited By

  • Information processing system, information processing method, and information processing program

    JP7845737B1