Digital twin computing device, digital twin computing method and program product

Abstract

The present invention includes: a storage unit, which stores a first digital twin in a storage unit, wherein the first digital twin includes one or more models and one or more second data, wherein the one or more models respectively define one or more functions that an individual has at any time, and the one or more second data include first data as a constituent element that is input into the model to realize the function of the individual; a first operation unit, which creates one or more second digital twins by performing a predetermined first operation on the one or more first digital twins stored in the storage unit as an operation object; and an execution unit, which executes an operation for configuring the second digital twin in a sandbox with a predetermined timeline set, and realizing the function of the individual represented by the second digital twin according to the timeline in the sandbox.

Description

Technical Field

[0001] The present invention relates to a digital twin computing device, a digital twin computing method, a program and a data structure. Background Art

[0002] Traditionally, a technology called digital twin is known. Digital twin is mainly used in the manufacturing field, and is digital information obtained by reproducing real objects (such as mechanical parts) in digital space. Since the use of digital twin can grasp the phenomena occurring on real objects in real time, it is actually applied to, for example, improving the quality of products. It should be noted that Patent Document 1 describes a technology for determining the behavior of a moving object.

[0003] <Prior Art Literature>

[0004] <Patent Documents>

[0005] Patent Document 1: (Japanese) Patent Publication No. 2017-211913 Summary of the invention

[0006] <Problems to be Solved by the Invention>

[0007] However, traditional digital twins are digital information obtained by reproducing real objects in digital space, and are not aimed at reproducing real creatures (including humans) in digital space. In addition, traditional digital twins are reproductions of real objects, and do not consider expanding the digital twins of objects or creatures that do not exist in reality, such as by performing operations such as fusing digital twins or exchanging some components between digital twins.

[0008] By expanding the scope of digital twins to include objects or organisms that do not exist in reality and using these digital twins for simulation, it will be possible to support new value creation and solve various problems.

[0009] In view of the above problems, an embodiment of the present invention aims to expand the scope of objects of digital twins.

[0010] <Methods used to solve the problem>

[0011] In order to achieve the above-mentioned purpose, the digital twin computing device in an embodiment of the present invention includes: a storage unit, which stores a first digital twin in a storage unit, wherein the first digital twin includes one or more models and one or more second data, wherein the one or more models respectively define one or more functions that an individual has at any time, and the one or more second data include first data as a constituent element that is input into the model to realize the function of the individual; a first computing unit, which creates one or more second digital twins by performing a predetermined first operation with the one or more first digital twins stored in the storage unit as the operation object; and an execution unit, which configures the second digital twin in a sandbox with a predetermined timeline set, and executes an operation for realizing the function of the individual represented by the second digital twin in the sandbox according to the timeline.

[0012] <Effects of the Invention>

[0013] Able to expand the scope of objects of digital twins. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] Figure 1 1 is a diagram showing an example of the overall configuration of a digital twin computing device in an embodiment of the present invention.

[0015] Figure 2 This is a diagram for explaining an example of sandbox execution.

[0016] Figure 3A This is a diagram used to illustrate an example of digital twin operation (exchange).

[0017] Figure 3B This is a diagram used to illustrate an example of digital twin operation (replication).

[0018] Figure 3C This is a diagram used to illustrate an example of digital twin computing (fusion).

[0019] Figure 4 is a flowchart showing an example of the execution process of the sandbox.

[0020] Figure 5 A diagram for explaining an application example for communication.

[0021] Figure 6 1 is a diagram showing an example of the hardware configuration of a digital twin computing device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0022] In the following, an embodiment of the present invention is described. In an embodiment of the present invention, a digital twin computing device 10 is described, which can create a digital twin of an object or organism that does not exist in reality by expanding the object range of the digital twin to include not only physical objects but also living things (including humans) and performing predetermined operations on these digital twins (this operation is referred to as "digital twin operation").

[0023] It should be noted that, hereinafter, the digital twin created by the digital twin operation is referred to as a “virtual digital twin” or “virtual DT”. On the other hand, the digital twin that is the operation object of the digital twin operation is simply referred to as a “digital twin” or “DT”.

[0024] Here, although the digital twin as the operation object of the digital twin operation is conceived as a digital twin of an object or organism that exists in reality, it is not necessarily limited to this, and may also include digital twins of objects or organisms that do not exist in reality (for example, digital twins of fictional products, digital twins of fictional characters, digital twins of deceased persons, etc.). In addition, objects may include not only tangible objects (for example, machines, vehicles, buildings, structures, materials or natural objects, etc.), but also intangible objects (for example, electricity, light or heat, etc.). In addition, organisms may include animals (including humans), fungi, plants, archaea, bacteria, viruses, etc. It should be noted that in the following text, objects and organisms are also collectively referred to as "individuals".

[0025] The digital twin computing device 10 in the embodiment of the present invention can realize various simulations or services by configuring the virtual DT in a virtual time and space called a sandbox and performing execution operations of the sandbox (i.e., operations to advance or rewind time).

[0026] <Definition of Terms>

[0027] Hereinafter, definitions and the like of terms used in the embodiments of the present invention will be described.

[0028] ·Digital twin or DT: It is digital information obtained by reproducing an individual (object or organism), and is implemented by one or more models and one or more data that contains data that can be input into these models. An ID (digital twin ID) is assigned to the digital twin to identify the digital twin. In addition, the digital twin is associated with information that indicates whether it represents an object or a organism as an attribute. It should be noted that, hereinafter, the model used to implement the digital twin will also be referred to as a "DT model", and the data that contains data that can be input into the DT model will be referred to as "DT data".

[0029] DT model: Digital information that defines a specific function of the digital twin at any time (in other words, the action or state change of the digital twin, etc.). The DT model takes the DT data corresponding to the DT model as input and outputs the result of the processing used to implement the specific function. The DT model is assigned an ID (model ID) for identifying the DT model within the digital twin (therefore, the DT model is uniquely identified by a group of the digital twin ID and the model ID). As these DT models, for example, predefined functions, rule-based models, estimation models created using methods such as machine learning, etc. can be used.

[0030] DT data: data used to implement specific functions of the digital twin at any time. These DT data are collected, for example, by sensing individuals using sensors. DT data is associated with the model ID of the DT model that uses the DT data as input. It should be noted that DT data can be associated with multiple model IDs (that is, a certain DT data can be the input of multiple DT models). In addition, DT data may include data that is not input into the DT model (for example, digital twin ID, etc.).

[0031] Virtual digital twin or virtual DT: Digital information created by performing digital twin operations on a digital twin and configured in a sandbox. Like a digital twin, a virtual digital twin is implemented by one or more DT models and one or more DT data that contains data that can be input into these DT models. In addition, a virtual digital twin is associated with a sandbox in which the virtual DT is configured, and an ID (virtual digital twin ID) is assigned to the virtual digital twin for identifying the virtual DT in the sandbox.

[0032] Digital twin operations: operations used to create virtual digital twins from digital twins. Digital twin operations can be roughly divided into three types, namely "set operations", "copy operations" and "fusion operations". For example, in copy operations, one or more virtual digital twins are created by copying the digital twin as is. There may be operations to further create virtual digital twins from virtual digital twins. Details on these operations will be described later.

[0033] Sandbox: A virtual space-time in which a virtual DT is configured. The virtual DT configured in the sandbox is executed by performing execution operations in the sandbox (i.e., DT data is input into the DT model of the virtual DT according to changes in time, and the DT model is used to implement a specific function). An ID (sandbox ID) is assigned to the sandbox to identify the sandbox.

[0034] Sandbox execution operation: used to execute sandbox operations. By executing sandbox execution operations, the time in the sandbox changes, and the virtual DT is executed according to the change.

[0035] <Overall composition>

[0036] Next, refer to Figure 1 The overall configuration of the digital twin computing device 10 in the embodiment of the present invention will be described. Figure 1 1 is a diagram showing an example of the overall configuration of the digital twin computing device 10 in the embodiment of the present invention.

[0037] like Figure 1 As shown, the digital twin computing device 10 in the embodiment of the present invention includes an interaction unit 101, a digital twin management unit 102, a computing unit 103, and a storage unit 104.

[0038] The interaction unit 101 collects data from the device 20, and outputs data representing the execution result of the sandbox (or the results of various processes during the execution of the sandbox) as feedback information to the device 20. At this time, the interaction unit 101 may perform a conversion process for converting the data collected from the device 20 into a predetermined data format, or converting the data into a data format corresponding to the device 20 before outputting the data to the device 20. That is, the interaction unit 101 may convert the data collected from the device 20 into a data format that can be input by the DT model of the digital twin, or convert the data into a data format that can be input by the device 20 before outputting the data to the device 20.

[0039] Here, the device 20 as the object of data collection by the interaction unit 101 is various devices for obtaining various information from objects, organisms or environments in the real world. Specifically, for example, various sensors for sensing individuals or environments, smartphones used by people, digital cameras for photographing the surroundings of objects or organisms, wearable devices worn by people and other organisms, in-vehicle devices when the object is a vehicle, and control devices for controlling other devices (including BMI (Brain-Machine Interface) that uses brain waves of people and others to control other devices, etc.) can be cited. Examples of information obtained from the devices 20 include physical information of a person (characteristics of physical appearance or shape, such as height and weight, involuntary states such as heart rate, blood pressure, brain waves, body temperature, and sweat volume), psychological information (emotions, thoughts, and psychological states, etc.), motion information (voluntary movements, actions, or words and deeds, such as body posture, gestures, and walking speed), individual information (social attributes such as age, gender, nationality, and occupation, relationships with others such as family relationships or co-workers, and memory, etc.), and environmental information of a person's surrounding environment (temperature, humidity, weather, or meteorology, etc. of the surrounding environment). On the other hand, The information obtained by the object varies depending on the type of the object. For example, when the object is a vehicle, it can include physical information (shape, weight, etc. including characteristics of the appearance or shape, internal states such as engine speed or temperature, etc.), psychological information (personified object = agent's emotions, etc.), motion information (speed, position information, etc., movement, action or behavior that can be observed from outside the individual), individual information (manufacturer, vehicle type, country of manufacture, owner, passengers, social attributes, etc.), environmental information of the vehicle's surrounding environment (number of vehicles located in the surrounding area, temperature, humidity, weather or meteorology, etc.), etc.

[0040] On the other hand, the device 20 to which the data is output by the interaction unit 101 is a variety of devices for controlling individuals or environments in the real world, or providing some information to individuals. Specifically, for example, there can be cited control devices for controlling various machines (vehicles, manufacturing equipment, robots, etc.), displays for providing images to people, speakers for providing sounds to people, VR devices for providing VR (Virtual Reality) environments to people, control devices for controlling other devices (including BMI, etc.), etc. The data output to these devices 20 is data for representing the execution results of the sandbox (or the results of various processes during the execution of the sandbox), for example, there can be cited control information based on the simulation results in the sandbox, prediction information based on the simulation results in the sandbox, audio information spoken by the virtual DT in the sandbox, etc.

[0041] It should be noted that the data collected by the interaction unit 101 (or the data obtained by converting the data format of the data) is stored in the storage unit 104 as DT data. At this time, the interaction unit 101 stores the DT data in the storage unit 104 in association with the digital twin ID of the digital twin as the storage destination of the DT data. An identifier may be further assigned to the DT data, and the DT data may be stored in the storage unit 104 in association with a group of the digital twin ID of the digital twin and the DT data ID of the DT data. It should be noted that the DT data ID is an ID for identifying the DT data.

[0042] In addition, data representing the execution result of the sandbox (or the results of various processes during the execution of the sandbox) is stored in the storage unit 104 by the operation unit 103 described later. Therefore, the interaction unit 101 reads the data representing the execution result of the sandbox (or the results of various processes during the execution of the sandbox) from the storage unit 104, and outputs the data to the corresponding device 20 (for example, sends it via a communication network).

[0043] The digital twin management unit 102 manages the digital twins stored in the storage unit 104. Here, various individual digital twins are stored in the storage unit 104. As described above, the digital twin is realized by one or more DT models and one or more DT data.

[0044] For example, a person's digital twin is realized by a personality model that defines the person's personality, a thought or behavior model that defines the person's thoughts or actions, and a capability model that defines the person's capabilities, as well as DT data for each of these DT models. In this way, a person's digital twin is realized by a DT model that defines the person's personality, thoughts, actions, or capabilities, etc., and DT data (e.g., physical information, psychological information, motion information, individual information, environmental information, etc.) that is input into these DT models. It should be noted that, in addition to this, a person's digital twin can also include various DT models.

[0045] In addition, the above-mentioned personality model, thought or action model, or ability model can be implemented through a DT model of a lower-level concept. For example, the personality model can be implemented by a personality model that defines a person's personality, and a value model that defines a person's values. Similarly, for example, a thought or action model can be implemented by an emotion model that defines a person's emotions, and an action tendency model that defines a person's action tendency. Similarly, for example, the ability model can be defined by a knowledge model that defines a person's knowledge, a language model that defines a person's language ability, and a perception model that defines a person's perception. It should be noted that these DT models can be further implemented through DT models of lower-level concepts. That is, the DT model used to implement digital twins can be a hierarchical structure.

[0046] It should be noted that the digital twins of all people do not need to be realized through the same DT model. For example, the digital twin of a certain person can be realized through a personality model, a thought or action model, and a capability model, while the digital twin of another person can be realized through a personality model and a thought or action model.

[0047] In addition, the digital twin includes time as a parameter. Therefore, one digital twin can realize the function at any time with time as a parameter. Here, as described above, the data collected by the interaction unit 101 (or the data obtained by converting the data format of the data) is stored in the storage unit 104 as DT data. Thus, the digital twin stored in the storage unit 104 is updated as the state of the real individual corresponding to the digital twin changes. For example, the heart rate measured by a real person is stored in the storage unit 104 as DT data in association with the digital twin ID of the digital twin of the person. Thus, the digital twin is updated to a digital twin that reflects the heart rate of the real person.

[0048] It should be noted that the storage unit 104 also stores various information about the digital twin for each digital twin. For example, there can be cited information for identifying the real individual corresponding to the digital twin (for example, user ID or object ID, etc.), the relationship with another digital twin (for example, there is a relationship between a finished product and a part between the digital twin and another digital twin, there is a relationship between a host and a parasite between the digital twin and another digital twin, etc.), the data format of the DT data input to the DT model for implementing the digital twin or the data format of the data output by the DT model, etc. Such information can be defined in any format, but for example, ontology can be used.

[0049] The operation unit 103 creates virtual DTs by performing digital twin operations in response to requests from the service providing system 30, or configures the virtual DTs in the sandbox and performs execution operations of the sandbox. The service providing system 30 is a server or server group that provides services using data for representing the execution results of the sandbox or data for representing the results of various processes during the sandbox execution.

[0050] Here, various simulations can be performed by configuring a virtual DT in a sandbox and executing the sandbox. Figure 2 As shown in FIG. 1 , traffic simulation can be performed by creating virtual DTs such as vehicles, people, or roads and configuring them in a sandbox. Figure 2 As shown in FIG, a virtual DT of a building or a person can be created and configured in a sandbox to perform an urban space simulation. Figure 2As shown, group decision simulation can be performed by creating a virtual DT of a person and configuring it in a sandbox and making the desired decision between people. It should be noted that these are just one example, and various simulations can be performed by configuring a virtual DT in a sandbox and executing the sandbox.

[0051] Therefore, various services using the results of the simulation or information on its execution process can be considered as services provided by the service providing system 30. For example, MaaS (Mobility as a Service), autonomous driving services, logistics services, smart city provision services, Android communication services, etc. can be cited.

[0052] The storage unit 104 stores the digital twin as described above. In addition, the digital twin is associated with a moment, and at least a digital twin representing the current moment is stored in the storage unit 104. However, in addition to representing the current moment, a digital twin representing a past moment may also be stored in the storage unit 104. That is, the storage unit 104 may store, for example, a history from the creation of the digital twin to the current digital twin. At this time, the DT model or DT data of the digital twin may be different or the same depending on the moment. For example, in a person's past digital twin and current digital twin, the capability model and the DT data input by the capability model may be different.

[0053] In addition, data indicating the execution result of the sandbox or data indicating the results of various processes during the execution of the sandbox are stored in the storage unit 104. In addition, various data required for executing the sandbox and the like are stored in the storage unit 104.

[0054] It should be noted that, although the history of the digital twin is stored in the storage unit 104, when the attribute of the digital twin is "object", it is sometimes not necessary to associate it with the time. For example, when the digital twin remains unchanged or can be regarded as unchanged even if the time changes (for example, the digital twin of a building, a mountain, or a planet), it is not necessary to associate it with the time. However, even in this case, it is sometimes necessary to store it in the storage unit 104 in association with the time, depending on the content of the simulation in the sandbox. For example, this includes the case where a simulation is performed in the sandbox using a timeline from hundreds or tens of thousands of years to the present.

[0055] It should be noted that Figure 1 The structure of the digital twin computing device 10 shown is an example, and other structures are also possible. For example, the digital twin computing device 10 can be composed of a first device having an interaction unit 101, a second device having a digital twin management unit 102 and a storage unit 104, and a third device having a computing unit 103.

[0056] <Digital Twin Computing>

[0057] As mentioned above, digital twin operations are operations used to create virtual DTs from digital twins. Digital twin operations can be roughly divided into three types, namely "setting operations", "copy operations" and "fusion operations". "Setting operations" are operations that create virtual DTs by setting the DT model or DT data of the digital twin at any time (or operations that set the DT model or DT data of the digital twin at any time as a virtual DT that has already been created). "Copy operations" are operations that copy the DT model and DT data of the digital twin at any time to create a virtual DT. "Fusion operations" are operations that create virtual DTs that combine the DT model and DT data of the digital twin at any time.

[0058] In addition, "setting operation" can be divided into three types, namely "setting", "exchange" and "anonymization". "Setting" is the most basic operation among the "setting operations", and is an operation that sets the DT model or DT data of the digital twin at any time as a virtual DT as it is (or an operation that sets the DT model or DT data of the digital twin at any time as a virtual DT that has been created as it is). "Exchange" is an operation that creates a virtual DT by exchanging DT models or DT data between multiple digital twins. "Anonymization" is a special case of "setting", and is an operation that anonymizes the DT data related to individual information in the DT data copied in the virtual data according to a given anonymization condition. It should be noted that as a method of implementing anonymization, for example, DT data related to information that can identify an individual or individual information can be processed or deleted, and the virtual DT can also be made unable to access DT data related to information that can identify an individual or individual information. Furthermore, this can be achieved by performing processing such as adding noise to DT data or replacing DT data based on the virtual DT or an index such as usefulness or anonymity required for simulation using the virtual DT, or by combining these processing.

[0059] It should be noted that when creating a virtual DT through digital twin operations, the virtual DT can be created by copying the DT model or DT data of the digital twin, or the virtual DT can be granted access rights to the DT model or DT data of the digital twin of the operation object.

[0060] Here, refer to Figure 3A "Exchange", one of the "setting operations" of digital twin operations, is explained. Figure 3A This is a diagram used to illustrate an example of digital twin operation (exchange).

[0061] like Figure 3AAs shown in the figure, the digital twins of the operation objects are set to "digital twin A" and "digital twin B". Assume that digital twin A is composed of DT model A 1 DT Model A 2 , DT dataa 11 , DT dataa 12 , DT dataa 21 , and DT data a 22 In addition, it is assumed that the digital twin B is composed of DT model B 1 DT Model B 2 DT data b 11 DT data b 12 DT data b 21 , and DT data b 22 accomplish.

[0062] At this time, in the "Exchange" operation, which is one of the "Setting Operations" of the Digital Twin Operation, a virtual DT is created by exchanging DT models and DT data between Digital Twin A and Digital Twin B. For example, a virtual DT is created by DT model A. 1 DT Model B 2 , DT dataa 11 , DT dataa 12 DT data b 21 and DT data b 22 The virtual digital twin A realized by DT model B 1 DT Model A 2 DT data b 11 DT data b 12 , DT dataa 21 and DT data 22 Realized virtual digital twin B.

[0063] This makes it possible to create a virtual DT in which some functions are exchanged between multiple digital twins. Therefore, for example, it is possible to create a virtual DT in which the capability models are exchanged between multiple people, and use these virtual DTs for simulation.

[0064] It should be noted that the DT model and DT data used to implement the virtual DT are specified as the operation conditions of the "exchange" operation. That is, which DT model and DT data are exchanged between digital twin A and digital twin B to create the virtual DT is specified as the operation condition of the "exchange" operation. Figure 3A In the illustrated example, although the case where the virtual DT is implemented by the DT model and the DT data is illustrated, as described above, an access authority for the DT model or the DT data may be granted to the virtual DT.

[0065] Next, refer to Figure 3B Explain the "copy operation" of digital twin operation. Figure 3B This is a diagram used to illustrate an example of digital twin operation (replication).

[0066] like Figure 3B As shown in the figure, the digital twin of the operation object is set to "digital twin A", and it is assumed that the digital twin A is composed of DT model A 1 DT Model A 2 , DT dataa 11 , DT dataa 12 , DT dataa 21 , and DT data a 22 accomplish.

[0067] At this time, in the "copy operation" of the digital twin operation, one or more virtual DTs are created by copying the DT model and DT data of the digital twin A as is. Figure 3B In the example shown, a case where three virtual DTs are created is shown.

[0068] Thus, it is possible to create one or more virtual DTs by copying one digital twin. Therefore, for example, it is possible to create multiple virtual DTs from a digital twin of a certain person and to simulate a discussion between these virtual DTs (i.e., a discussion between the same person).

[0069] It should be noted that the number of virtual DTs to be created is specified as the operation condition of the "copy operation". Figure 3B In the illustrated example, although the case where the virtual DT is implemented by the DT model and the DT data is illustrated, as described above, an access authority for the DT model or the DT data may be granted to the virtual DT.

[0070] Next, refer to Figure 3C Explain the "fusion operation" of digital twin operation. Figure 3C This is a diagram used to illustrate an example of digital twin computing (fusion).

[0071] like Figure 3C As shown in the figure, the digital twins of the operation objects are set to "digital twin A" and "digital twin B". Assume that digital twin A is composed of DT model A 1 DT Model A 2 , DT dataa 11 , DT dataa 12 , DT dataa 21 , and DT data a 22 In addition, it is assumed that the digital twin B is composed of DT model B 1 DT Model B 2 DT data b 11 DT data b 12 DT data b21 , and DT data b 22 accomplish.

[0072] At this time, in the "fusion operation" of digital twin operation, the DT model and DT data of digital twin A are fused with the DT model and DT data of digital twin B to create a virtual DT. That is, for example, a virtual DT is created by DT model A. 1 DT Model A 2 DT Model B 1 DT Model B 2 , DT dataa 11 , DT dataa 12 , DT dataa 21 , DT dataa 22 DT data b 11 DT data b 12 DT data b 21 , and DT data b 22 Realized virtual digital twin C.

[0073] This makes it possible to create a virtual DT that integrates the functions of multiple digital twins. Therefore, for example, it is possible to create a virtual DT of a virtual person that integrates the capabilities of multiple people, and perform simulations using the virtual DT.

[0074] It should be noted that in Figure 3C In the example shown, although the case of fusing two digital twins is described, any number of digital twins as operation objects can be specified as the operation condition of "fusion operation". In addition, as the operation condition of "fusion operation", the DT model or DT data of the digital twin used to fuse the virtual DT can be individually specified. Figure 3C In the illustrated example, although the case where the virtual DT is implemented by the DT model and the DT data is illustrated, as described above, an access authority for the DT model or the DT data may be granted to the virtual DT.

[0075] In addition, in the "fusion operation" of digital twin operation, instead of just processing the DT model or DT data as it is, the original digital twin DT model or DT data can be used to create a new DT model or new DT data and use it as the DT model or DT data of the virtual DT. Specifically, in addition to Figure 3C In addition to the above processing shown in FIG. 1 , a new DT model C1 can be created from the DT data of digital twin A and the DT data of digital twin B. That is, DT data a can be used to 11 , DT dataa 12 , DT dataa 21 , DT dataa 22 DT data b11 DT data b 12 DT data b 21 , and DT data b 22 , to create DT model C1, DT model C2, and create from DT data a 11 and DT data b 11 The DT data c selected from 11 , or from DT data a 22 and DT data b 22 The DT data c selected from 22 etc. DT data, and create a virtual digital twin C realized by these DT models or DT data.

[0076] Although, as described above, the digital twin operation is an operation for creating a virtual DT from a digital twin, a second digital twin operation for creating a virtual DT from a virtual DT may be further defined. In other words, the second "setting operation" may be an operation for creating another virtual DT that sets the DT model or DT data of a virtual DT at any time (or an operation that sets the DT model or DT data of a virtual DT at any time to an already created virtual DT), the second "copy operation" may be an operation for copying the DT model and DT data of a virtual DT at any time to create another virtual DT, and the second "fusion operation" may be an operation for creating another virtual DT that combines the DT model or DT data of virtual DTs at any time. The digital twin operations regarding the second "setting", the second "exchange" and the second "anonymization" are also similarly performed based on the virtual DT that replaces the digital twin.

[0077] In addition, in the second digital twin operation, a “delete” operation may be defined as an operation for deleting the virtual DT.

[0078] <Sandbox execution process>

[0079] Next, refer to Figure 4 , a process in which a virtual DT is created and arranged in a sandbox and then the sandbox is executed (sandbox execution process) is described. Figure 4 is a flowchart showing one example of the execution process of the sandbox.

[0080] Step S101: First, the operation unit 103 receives a sandbox execution request from the service providing system 30. The sandbox execution request specifies various conditions related to the sandbox execution. These conditions, for example, indicate what kind of virtual DT is configured in the sandbox and from what time to what time to perform the execution operation.

[0081] It should be noted that a predetermined template is prepared as a sandbox, and an ID representing the template can be specified in the above-mentioned execution request. The template may include, for example, a template representing a sandbox of modern Japan, a template representing a sandbox of Japan at a certain time point in the past (e.g., 1900), a template of a sandbox of Japan predicted at a certain time point in the future (e.g., 2300), and a template of a sandbox in which a fictitious time and space are set. Thus, for example, since a virtual DT can be configured in a sandbox prepared as a template to execute the sandbox, the information specified in the execution request of the sandbox can be simplified.

[0082] Step S102: Next, the operation unit 103 generates virtual DTs from the digital twins through digital twin operations based on the conditions specified in the sandbox execution request, and then configures these virtual DTs in the sandbox and sets the environment of the sandbox. The environment of the sandbox includes, for example, the start time and end time when the sandbox is executed, the speed of time (such as the speed and direction of travel of time), etc. It should be noted that the speed of time is the speed at which time advances in the sandbox, and can be faster or slower than the real world.

[0083] In addition, various sandbox environments may be set according to the purpose to be simulated in the sandbox, such as repeatedly executing a certain time period until a certain condition is met, or stopping the passage of time in the sandbox until DT data satisfying a certain condition is collected from the device 20.

[0084] Here, when creating a virtual DT, a virtual DT implemented by a portion of the DT model and DT data of the digital twin (i.e., a simple virtual DT that uses only a portion of the functions of the digital twin) can be created. In this way, for example, a virtual DT that only has the functions required for simulation can be created. In this way, the amount of calculation or data capacity required to execute the sandbox can be reduced. It should be noted that in the case where the DT model is a hierarchical structure, when a DT model of a lower-level concept or a DT model of a higher-level concept is needed to implement the DT model required for the simulation, a temporary DT model (for example, a DT model used as a stub or a mock) can be defined as the DT model of these lower-level concepts or the DT model of the higher-level concept.

[0085] Step S103: Next, the operation unit 103 executes the sandbox. That is, the operation unit 103 performs the sandbox execution operation to change the time of the sandbox, and changes the behavior or state of the virtual DT according to the change of the time. It should be noted that by inputting the DT data into the DT model of the virtual DT, the behavior or state of the virtual DT is expressed as the output of the DT model.

[0086] Here, as DT data input to the DT model of the virtual DT, data collected in real time from the device 20 by the interaction unit 101 (or data obtained by converting the data format of the data) may be used, or DT data collected from the device 20 in the past may be used, or DT data created arbitrarily may be used, for example, DT data for representing various conditions for the virtual DT specified by the service providing system 30 at the time of the execution request of the sandbox or fictitious information obtained by setting an operation, etc. Alternatively, for example, data collected in real time as a part of the DT data may be used, and DT data collected from the device 20 in the past may be used as another part of the DT data, etc.

[0087] It should be noted that, as an example, the following timeline and DT data are used for typical execution purposes of the following sandbox.

[0088] When the purpose of executing the sandbox is future prediction: the future time axis is set in the sandbox, and the sandbox execution operation is performed from a certain time in the future to an arbitrary time. At this time, DT data representing future fictional information is input to each virtual DT configured in the sandbox.

[0089] When the execution purpose of the sandbox is past verification: a past timeline is set in the sandbox, and the sandbox execution operation is performed from a certain time in the past to an arbitrary time. At this time, the data collected from the device 20 in the past is input as DT data to each virtual DT configured in the sandbox.

[0090] When the purpose of sandbox execution is current situation analysis: a time axis including the current time point is set in the sandbox, and the sandbox execution operation is performed from a certain time in the past or from the present to an arbitrary time. At this time, data collected from the device 20 in the past or data collected in real time is input as DT data to each virtual DT configured in the sandbox.

[0091] When the purpose of sandbox execution is to discuss a certain topic: set an arbitrary timeline in the sandbox, and start the sandbox execution operation from an arbitrary time. At this time, input arbitrary data as DT data into each virtual DT configured in the sandbox, and perform the sandbox execution operation until the conclusion of the discussion converges or reaches a balanced state.

[0092] When the purpose of sandbox execution is to communicate with the virtual DT: an arbitrary timeline is set in the sandbox, and the sandbox execution operation is started from an arbitrary time. At this time, the data collected in real time from the device 20 is input as DT data to the virtual DT configured in the sandbox, and the data representing the processing result of the virtual DT (for example, the answer to the speech when the DT data is the data representing the speech, etc.) is repeatedly sent to the user of the device 20 as feedback information.

[0093] Step S104: Next, the calculation unit 103 stores data indicating the execution result of the sandbox in the storage unit 104. That is, the calculation unit 103 stores data indicating the result after the execution of the sandbox in the storage unit 104 in association with the sandbox ID of the sandbox.

[0094] Here, the operation unit 103 also stores data representing the results of each process during the execution of the sandbox in association with the sandbox ID in the storage unit 104. The data representing the results of each process during the execution of the sandbox are, for example, data representing the behavior or state of the virtual DT at each moment in the sandbox. These data representing the behavior or state of the virtual DT are also stored in the storage unit 104 together with the sandbox ID and the virtual digital twin ID. It should be noted that the data representing the results of each process during the execution of the sandbox is further associated with the time when the process is performed (the moment in the sandbox).

[0095] In this way, data indicating the processing results at each time in the sandbox and the final execution result in the sandbox are stored in the storage unit 104. In other words, the storage unit 104 stores snapshots at each time from the start time to the end time of the sandbox.

[0096] Step S105: Finally, the interaction unit 101 sends the data (data indicating the execution result of the sandbox, data indicating the result of each process during the execution of the sandbox, or both) stored in the storage unit 104 as feedback information to the corresponding device 20. Here, the corresponding device 20 is, for example, a device 20 that is a destination of the service provided by the service providing system 30 that sent the sandbox execution request in the above-mentioned step S101.

[0097] Here, when the interaction unit 101 sends feedback information to the corresponding device 20, it can mediate the feedback information based on the policy information stored in the storage unit 104. The policy information is control information for preventing the device 20 that receives the feedback information from being adversely affected or the user of the device 20 from being adversely affected. The situation where the device 20 is adversely affected may include, for example, the situation where the device 20 fails due to exceeding the allowable limit of the device 20. The situation where the user of the device 20 is adversely affected may include, for example, the situation where the health of the user of the device 20 is damaged.

[0098] In the case of sending feedback information contrary to the policy information to the device 20, the interaction unit 101 may, for example, change, deform or limit the feedback information according to the policy information, or may not send the feedback information to the device 20, or may warn the device 20 before sending the feedback information. It should be noted that changing, deforming or limiting the feedback information according to the policy may, for example, include multiplying the value contained in the feedback information by an appropriate weight (for example, a weight greater than 0 and less than 1), or limiting the value contained in the feedback information to an upper limit value or a lower limit value, or performing exclusive control between the values ​​contained in the feedback information.

[0099] It should be noted that, although in the above step S105, the feedback information is sent to the corresponding device 20, it is not limited to this, and the interaction unit 101 can send the feedback information to the service providing system 30. At this time, the interaction unit 101 can send the feedback information to the service providing system 30 that is the source of the execution request of the sandbox in the above step S101, or to another service providing system 30 different from the service providing system. As a case of sending feedback information to another service providing system 30, for example, it can include a case where a first service provided by the service providing system 30 and a second service provided by another service providing system 30 cooperate with each other to provide a series of services.

[0100] As described above, the digital twin computing device 10 in the embodiment of the present invention is capable of creating a virtual DT by performing digital twin computing on the digital twin of an individual (person or object), and using the virtual DT to perform various simulations in the sandbox. At this time, the virtual DT may be a copy of the digital twin as it is, or a virtual DT obtained by fusing multiple digital twins or exchanging some of their constituent elements. In addition to creating a virtual DT by copying, fusing or exchanging the current digital twin, a virtual DT may also be created by copying, fusing or exchanging past digital twins. In addition, when performing a simulation, data collected in real time may be used, or data collected in the past may be used, or data representing fictitious information may be used.

[0101] Therefore, the digital twin computing device 10 in the embodiment of the present invention can perform various simulations in a sandbox configured with a virtual DT, thereby supporting new value creation or problem solving of various issues.

[0102] It should be noted that in order to create the template of the above-mentioned sandbox, the digital twin stored in the storage unit 104 can be searched by using individual information such as time and space or spatial range, social relationship, and the attributes of the digital twin, and the ID used to represent the template is assigned to the virtual DT obtained by specifying all or a properly selected part of the search results to set the template creation function as a template. As a query for specifying a template for a sandbox, not only roads or buildings in space can be specified, but also the relationship with buildings in space, or the relationship with space based on location information or action history, and the digital twin of a living thing or object obtained as a search result can be specified as a virtual DT. In addition, the internal structure of the human body or an object can be used as a query, and a virtual DT can be set from a part of the hierarchy of the DT model or a part of the DT data of the digital twin obtained as a search result, and environmental conditions such as weather or meteorological conditions can be used as a query to set the virtual DT from the digital twin obtained as a search result.

[0103] The template of the sandbox can have the function of changing or setting any time, space or environmental conditions that serve as the conditions of the virtual DT or time and space of the sandbox, and can further set or change these arbitrary time, space or environmental conditions when a certain time has passed after the simulation starts or the state of the virtual DT meets predetermined conditions.

[0104] In addition, the template creation function can have the following digital twin operation functions: when creating a sandbox or sandbox template, apply a digital twin operation for the digital twin, or apply a second digital twin operation for an existing sandbox or sandbox template. In addition, the template creation function can be used as a sandbox creation function by assigning an ID for representing the sandbox instead of assigning an ID for representing the template.

[0105] In this way, by creating a sandbox or a sandbox template, it is possible to reduce the setup work for performing various simulations.

[0106] <Application Examples>

[0107] Hereinafter, an application example of the digital twin computing device 10 in the embodiment of the present invention will be described.

[0108] 《Application Example 1》

[0109] First, refer to Figure 5An application example for communication using virtual DT is described. Figure 5 A diagram for explaining an application example for communication.

[0110] (1) Embodiments of the present invention can be applied to communication with one's past or future self. That is, for example, a virtual DT is created from one's digital twin at any time in the past or future through digital twin computing, and the virtual DT is configured in a sandbox. Then, the sandbox is executed while data representing the content of one's speech, etc., is input into the virtual DT as DT data in real time. Thus, a conversation with one's past or future self can be achieved, and it is believed that it can become an opportunity to understand oneself or make new discoveries about oneself and promote learning or growth. It should be noted that at this time, by creating a virtual DT from another person's digital twin rather than one's own digital twin, communication with another person in the past or future can be achieved.

[0111] (2) Embodiments of the present invention can be applied to communication with people who do not actually exist. That is, for example, a virtual DT is created from the digital twin of a deceased person or a fictional character through digital twin computing, and the virtual DT is configured in a sandbox. Then, data representing the content of one's own speech, etc. is input into the virtual DT as DT data in real time while the sandbox is executed. In this way, it is possible to have a conversation with a deceased person or a fictional character, or to make full use of the experience of the deceased person or the fictional character, or to gain new inspiration, or to meet communication needs, etc.

[0112] It should be noted that at this time, communication can be carried out between the virtual DT corresponding to one's own digital twin and the virtual DT corresponding to the digital twin of a deceased person or a fictional character, and information representing the communication result (or information representing the communication process) can be sent as feedback information to the device 20 used by the real person.

[0113] (3) Embodiments of the present invention can be applied to communication between people via virtual DTs. That is, for example, virtual DTs are created from a certain person's digital twin and another person's digital twin respectively through digital twin operations, and these virtual DTs are configured in a sandbox. Then, while certain DT data (for example, past DT data, DT data representing fictional information, or DT data based on data collected in real time, etc.) is input into the virtual DT, the sandbox is executed, and data representing the execution result (or data representing the results of various processes during execution) is sent as feedback information to a device 20 used by a real person. Since communication between virtual DTs in the sandbox can be faster than communication between real people, communication results can be obtained immediately. Therefore, for example, it is possible to discuss a certain topic in advance between virtual DTs, or to exchange knowledge between virtual DTs, and it is possible to support the transmission of meaning between real people, or to support mutual understanding, etc.

[0114] (4) Embodiments of the present invention can be applied to communication within a group. That is, for example, virtual DTs are created from the digital twins of each person belonging to a certain group through digital twin operations, and these virtual DTs are configured in a sandbox. Then, while certain DT data (for example, past DT data, DT data representing fictional information, or DT data based on data collected in real time, etc.) is input into the virtual DT, the sandbox is executed, and data representing the execution result (or data representing the results of various processing during execution) is sent as feedback information to the device 20 used by the people belonging to the group. As a result, for example, it is possible to discuss a certain topic in advance between virtual DTs, or to exchange knowledge between virtual DTs, or to form a consensus within the group, or to optimize the group, and it is possible to support the transmission of meaning within a real group, or to support mutual understanding, etc.

[0115] (5) Embodiments of the present invention can be applied to communication between groups. That is, for example, virtual DTs are created from digital twins of people belonging to a certain group and digital twins of people belonging to another group through digital twin operations, and these virtual DTs are configured in a sandbox. Then, while certain DT data (for example, past DT data, DT data representing fictional information, or DT data based on data collected in real time, etc.) is input into the virtual DT, the sandbox is executed, and data representing the execution result (or data representing the results of various processing during execution) is sent as feedback information to the device 20 used by the people belonging to the group. As a result, for example, it is possible to discuss a certain topic in advance between virtual DTs, or to exchange knowledge between virtual DTs, or to form a consensus between groups, or to optimize between groups, and it is possible to support the transmission of meaning between real groups, or to support mutual understanding, etc.

[0116] 《Application Example 2》

[0117] Embodiments of the present invention can be applied to simulation experiences or virtual experiments, etc. For example, a virtual DT in which a language model of a digital twin of a person who can speak a foreign language is set for a digital twin of a person who can only speak his native language can be created by utilizing "setting operations", thereby creating a virtual DT that can also speak the foreign language. Therefore, by executing the sandbox, it is possible to simulate the experience of yourself who can also speak a foreign language. In addition, for example, a virtual DT in which a DT model for realizing the optical zoom function of a camera is set for a digital twin of a person by utilizing "setting operations", thereby creating a virtual DT that can experience the optical zoom function as one's own vision. Therefore, by executing the sandbox, it is possible to simulate the experience of using the optical zoom function as one's own vision.

[0118] 《Application Example 3》

[0119] Embodiments of the present invention can be applied to simulate the advanced skills of people or incorporate them into the control of robots. For example, a virtual DT can be created by using "setting operation" to set the DT model of the digital twin of a professional athlete or professional chef for one's own digital twin or the digital twin of a robot, thereby creating a virtual DT that has acquired the skills of a professional athlete or the skills of a professional chef. Therefore, for example, it is possible to perform exercises for improving one's own skills based on the skill difference between professionals, or it is possible to control a robot that has acquired skills equivalent to professional skills.

[0120] <Hardware Configuration>

[0121] Finally, refer to Figure 6 The hardware configuration of the digital twin computing device 10 in the embodiment of the present invention will be described. Figure 6 1 is a diagram showing an example of the hardware configuration of the digital twin computing device 10 according to an embodiment of the present invention.

[0122] like Figure 6 As shown, the digital twin computing device 10 in the embodiment of the present invention has an input device 501, a display device 502, an external I / F (interface) 503, a RAM (Random Access Memory) 504, a ROM (Read Only Memory) 505, a processor 506, a communication I / F 507, and an auxiliary storage device 508. These hardware are connected via bus B in a manner that allows communication.

[0123] The input device 501 is, for example, a keyboard, a mouse, or a touch panel, etc. The display device 502 is, for example, a display, etc. It should be noted that the digital twin computing device 10 may not have at least one of the input device 501 and the display device 502 .

[0124] The external I / F 503 is an interface with an external device. The external device includes, for example, a recording medium 503a such as a CD, a DVD, an SD memory card, or a USB memory card. The digital twin computing device 10 can read or write the recording medium 503a via the external I / F 503. It should be noted that, in the recording medium 503a, for example, one or more programs for implementing the various functional units (interaction unit 101, digital twin management unit 102, and computing unit 103, etc.) of the digital twin computing device 10 may be recorded.

[0125] RAM504 is a volatile semiconductor memory. ROM505 is a non-volatile semiconductor memory. The processor 506 is, for example, various computing devices such as a CPU (Central Processing Unit) and a GPU (Graphics Processing Unit). The various functional units of the digital twin computing device 10 are implemented, for example, by causing the processor 506 to execute one or more programs stored in an auxiliary storage device 508. It should be noted that the processor 506 can be, for example, an FPGA (Field-Programmable Gate Array) or the like.

[0126] The communication I / F 507 is an interface for connecting the digital twin computing device 10 to a communication network. One or more programs for realizing each functional unit of the digital twin computing device 10 can be acquired (downloaded) from a predetermined server device or the like via the communication I / F 507 .

[0127] The auxiliary storage device 508 is, for example, a storage device such as a HDD (Hard Disk Drive) or an SSD (Solid State Drive). The auxiliary storage device 508 includes, for example, an OS (Operating System), an application program that implements various functions on the OS, or one or more programs for implementing various functional units of the digital twin computing device 10.

[0128] The storage unit 104 included in the digital twin computing device 10 may be implemented by using the auxiliary storage device 508. However, the storage unit 104 may be implemented by using, for example, a storage device connected to the digital twin computing device 10 via a communication network.

[0129] The digital twin computing device 10 in the embodiment of the present invention has Figure 6 The hardware structure shown in FIG. 1 can realize the above-mentioned various processing. Figure 6 In the embodiment of the present invention, the digital twin computing device 10 is implemented by one device (computer), but it is not limited to this. The digital twin computing device 10 in the embodiment of the present invention can be implemented by multiple devices (computers). In addition, in one device (computer), multiple processors 506 or multiple memories (RAM504, ROM505, or auxiliary storage device 508, etc.) can be included.

[0130] The present invention is not limited to the above-mentioned embodiments specifically disclosed, and various modifications, changes, combinations, etc. may be made without departing from the description of the claims.

[0131] Explanation of symbols

[0132] 10Digital twin computing device;

[0133] 20 devices;

[0134] 30 Service provision system;

[0135] 101 Interaction Department;

[0136] 102 Digital Twin Management Department;

[0137] 103 operation unit;

[0138] 104 storage unit.

Claims

1. A digital twin computing device, comprising: A storage unit stores a first digital twin in a storage unit, wherein the first digital twin includes one or more models and one or more second data, wherein the one or more models respectively define one or more functions that an individual has at any time, and the one or more second data includes first data that is input into the model to realize the function of the individual as a constituent element; A first operation unit receives an execution request of a sandbox from a service providing system, the sandbox representing a virtual space-time, the execution request including one or more conditions regarding the execution of the sandbox, the one or more conditions including a start time and an end time of the execution of the sandbox, and a speed and a direction of travel of the time, and creates one or more second digital twins based on the one or more conditions by performing a predetermined first operation in a manner of using one or more first digital twins stored in the storage unit as operation objects; an execution unit, executing a calculation for configuring the second digital twin in the sandbox having a predetermined timeline set therein, and realizing a function of an individual represented by the second digital twin in the sandbox according to the timeline; as well as an interaction unit, which sends the execution result of the sandbox to a device that is a destination of the service provided by the service providing system, The storage unit further stores the execution result of the sandbox.

2. The digital twin computing device according to claim 1, wherein: The predetermined first operation includes: Setting operations to create a second digital twin, where the second digital twin is formed by setting one or more models and / or one or more data included in the first digital twin at any time; A replication operation to create one or more second digital twins, wherein the one or more second digital twins are formed by replicating one or more models and one or more data contained in the first digital twin at any time; and A fusion operation is performed to create a second digital twin, which is formed by combining one or more models and one or more data respectively contained in multiple first digital twins at any time.

3. The digital twin computing device according to claim 2, wherein: The setting operation includes: An exchange operation is performed to create a second digital twin, wherein the second digital twin is formed by exchanging a portion of the model and a portion of the data between the plurality of first digital twins; and An anonymization operation is performed to create a second digital twin, where the second digital twin is formed by anonymizing predetermined data among the data contained in the first digital twin according to an anonymization condition.

4. The digital twin computing device according to any one of claims 1 to 3, further comprising: The second operation unit creates one or more new second digital twins by performing a predetermined second operation with one or more of the second digital twins as operation objects.

5. The digital twin computing device according to any one of claims 1 to 3, further comprising: a collecting unit that collects data representing information about an individual corresponding to the first digital twin; In which, the execution unit executes operations for realizing the functions of the individual represented by the second digital twin within the sandbox by inputting data stored in the storage unit, pre-created data representing arbitrary information, or data collected by the collection unit into the model contained in the second digital twin according to the timeline.

6. A digital twin computing method, wherein a computer performs the following steps: A storing step of storing a first digital twin in a storage unit, wherein the first digital twin includes one or more models and second data, wherein the one or more models respectively define one or more functions that an individual has at any time, and the second data includes first data as a constituent element that is input into the model to realize the function of the individual; A first operation step, receiving an execution request of a sandbox from a service providing system, wherein the sandbox represents a virtual space-time, and the execution request includes one or more conditions regarding the execution of the sandbox, wherein the one or more conditions include a start time and an end time of the execution of the sandbox, and a speed and a direction of travel of the time, and performing a predetermined first operation in a manner of using one or more first digital twins stored in the storage unit as operation objects, thereby creating one or more second digital twins based on the one or more conditions; An execution step is performed to configure the second digital twin in the sandbox having a predetermined timeline set therein, and to implement a calculation of a function of an individual represented by the second digital twin in the sandbox according to the timeline; A step of causing the storage unit to store the execution result of the sandbox; as well as A step of transmitting the execution result of the sandbox to a device that is a providing destination of the service provided by the service providing system.

7. A program product, comprising a program for causing a computer to function as each unit in a digital twin computing device according to any one of claims 1 to 5.

Images